Table of contents for Live from DAMA 2008
- Live from DAMA – Yin and Yang of Process and Data
- Live from DAMA – What do they mean, BUSINESS Metadata?
- Live from DAMA – Business rules, decision management and smarter systems
- Live from DAMA – A Reference Architecture for Integrating an Active Data Warehouse into the Real-Time Enterprise
- Live from DAMA – Re-Thinking Search in a Web 2.0 World
- Live from DAMA – Deploying Semantic Web Solutions: I’ve Built an Ontology, Now What?
- Live from DAMA – The Business Drivers Behind Creating an Enterprise Data Architecture in the Gaming Industry
- Live from DAMA – Metadata enabled Business/IT Integration
- Live from DAMA – IBM Metadata Strategy – An Information Management Perspective
- Live from DAMA – Impact of Service Oriented Architecture on Data Modeling: A Case Study
- Live from DAMA – Case Study: Implementing a Securities Master Using Flexible Data Models at Lord Abbett
- Live from DAMA – Naked Without My Data
Pip Coburn gave the closing keynote on Naked Without My Data. Pip made the point that lots of people actually don’t want to get quality data – they want to hear what they expect. People are not acting like quality of data matters. They want the data that supports their point of view or conforms in some way, not data that is “right”. Great technology (or data) is helpless in overcoming rotten culture. Why collect all this data if people don’t really want it.
- Society is an infant with respect to data and that this will persist for a long time
- The vast majority of the data ecosystem does not support wiser decision making or better outcomes
- Real-time, results-now mindset has overcome the thoughtful approach
- Data is used for personal missions in conflict with corporate ones – personal survival comes first
- We tend to feel naked without data, making all these things worse
- Opportunities to stand out using data are stunning
When Pip looks at investments he is looking for those where the recognition of a crisis is growing while the pain of adopting a solution is falling. Looking for big societal changes that will affect products and services and for companies that will have an unfair competitive advantage given this change.
One of the societal shifts he sees is “Naked without data” in that people cannot act without data to support it. He gave some background of how data is misused including an example of a 30,000 word report written to “prove” that Roger Clemens did not take HGH that was immediately taken apart by some statistics professors – the word “prove” having set them off. Most people, however, are not protected from this kind of thing because they lack the statistical and analytic tools to assess the data and its usage. They ignore Warren Buffet and idolize data.
If the information age is only 60 years old, as seems likely, this is not a long time for a society to adjust. The Internet hits and now everyone “knows” there is so much data that you won’t be listened to unless you have some. No matter how expert someone is or how much their judgment is valued, they still get asked for data. But no-one checks the data. Add to this data mining and potential for problems is huge – data mining is a two-edged sword because it can be used well or poorly. Surveys and the obsession with survey data is another symptom but most surveys are useless because of the way questions are designed and samples selected. Some surveys are really valuable, most are not. For example, a survey asking CIOs about spending included a question about spending on WTP (Winnie the Pooh) – 40% of CIOs said they planned to increase spend on it!
He showed a simple flow chart moving from problem to data to information/knowledge by adding context to insight/wisdom using experience and ultimately to decisions (my emphasis) and results. He does see huge opportunities for using data to compete and to drive new businesses – everything from Google (mass market, low quality data) to Ansys (small market, high quality data). Not just companies, even individuals like the GM of the Oakland A’s. This can be competing by quality, data mining, presentation, accessibility and more. He focused in on some things that were good ways to compete:
- Competing with better data (most common, perhaps 90%)
But the margins on data are very low relative to those on wisdom. Exclusivity and service quality, for instance, can be competitive advantages but it is tough to compete with just data. He tends to invest in companies that are moving to information or wisdom or event decisions.
- Competing by shortening the time it takes to move through the various steps.
- Simplifying the way the end user interacts with the data.
- Avoiding “one world” views – broader perspectives work better.
- Do not suffer fools gladly – bad data gets shot down.
- Iterative culture – keep learning, fail fast so can learn some more. Data must enable this.
He had some suggestions:
- In data more is less – lots of data must be kept, does not mean it is useful or can/should be the basis for a decision. Figure out the real information needed to increase wisdom and thus make better decisions.
- Technology can only transform a culture if the culture is ready to change.
- Need to hide the details because most people actually don’t care about technology – they want to run their business.
- More complex solutions fail more often and simpler, easier to understand ideas work better
Warren Buffet, for instance, won’t invest in companies he cannot easily understand.
He recommended Good to Great, a book I also liked. That’s me done with DAMA, back home and back to the usual blogging tomorrow.