Cleaning big data, what happens to the dirt

When I began this blog site, I came up with the phrase hypothesis-discovery to describe my experiences working with unruly data.   Our project gained a reputation for discovering things that others missed and I attribute that to how we handled the data. One of things we did differently was to postpone the data cleaning…