← Insights

Draft for review

Clean data is an operations problem

Bad data usually starts with how the work is done, not with the database.

When a report is wrong, the usual response is a data project. Someone is asked to clean the records, merge the duplicates and build a better dashboard. For a while the numbers look right. Then, slowly, they drift again, and a few months later the same meeting starts with the same argument about whose report is correct.

The cleanup was real. It just treated the symptom. The data was never the root problem. The work that produces the data was.

Data is a record of work

Every row in a system is the trace of something a person did: an order entered, a location typed in, a status changed, a field left blank because there was no time. If the work is done in different ways by different people, the data records those differences faithfully. If a step encourages shortcuts, the data fills with shortcuts.

Seen this way, messy data is not a mystery. It is an honest picture of a process that allows many versions of the same thing. The same customer entered three ways. The same address spelled differently by each team. A free-text field doing the job a proper choice list should do.

Why cleanup alone does not last

A one-time cleanup fixes the records that exist today. It does nothing about the records that will be created tomorrow by the same process. Unless something changes at the point where data is entered, the system starts collecting the same problems the moment the cleanup ends.

There is also a quieter cost. Every report built on unreliable data comes with a layer of manual correction, usually done by one or two people who know where the problems hide. That knowledge rarely gets written down, so the organization depends on it without realizing.

Fixing it where it starts

Lasting fixes start with the work, not the warehouse. Trace a number that people argue about back to the moment it is created. Watch how that step is actually done. Ask what makes the wrong entry easy and the right entry hard.

The answers are usually practical: a shared list instead of free text, one place where a customer or location is defined, a check at entry instead of a correction later, clear ownership of each important field. None of these are large projects on their own. Together they change what the system records.

This is also where AI helps in a lasting way. Rather than cleaning data after the fact, it can check and match entries as they are made, suggest the existing record instead of creating a new one, and flag what a person needs to confirm.

What you get

When the process produces consistent data, the reporting gets simpler, the manual corrections fade, and the meeting can start with the decision instead of the argument. The database did not change much. The work did.

More insights · How we approach data and analytics