A Methodology for Establishing Information Quality Baselines for Complex, Distributed Systems
We introduce a methodology for improving information quality for complex, distributed event based systems and apply this methodology to an electronic payments system. The methodology consists of five integrated activities: 1) Exploratory data analysis to identify key features of the data. 2) Developing analytical models that detect statistically significant changes from baselines for data fields and attributes derived from data fields. 3) Monitoring baselines and sending alerts when operational data or data derived from operational data deviates from baselines. 4) Root cause analysis to determine why a statistically significant change has occurred and its impact. These models focus on the reasons for change. 5) Developing formal business and technical reference models so that information quality problems are less likely to occur in the future.