Open Access Open Access  Restricted Access Subscription or Fee Access

Automatic Progressive View Maintenance in Datamining and Warehousing

S. Sowndarya, C. Akila

Abstract


A data warehouse organizes and stores consolidated data derived from distributed, autonomous data sources for OLAP (Online Analytical Processing) and data mining analyses. View maintenance involves the process of propagating the changes to the data warehouse. The duration may be too long for some systems. In this research, we applied a multi-agent approach to enable continuous updating of data warehouse views as transactions are executed at the sources. This technique, called Automatic Progressive View Maintenance (APVM), eliminates view maintenance down time for the data warehouse - a crucial requirement for Internet-based applications. Through the use of cooperation between agents, the data consistency problem usually associated with APVM is solved. In addition, a fuzzy agent scheduling system was developed to prioritize tasks for the agents. The results from this research showed that the proposed multi-agent system drastically increases the availability of the data warehouse while preserving a stringent requirement of data consistency.

Keywords


Automatic Progressive View Maintenance, Data Consistency, Fuzzy Agent, Online Analytical Processing, Strobe, Sweep.

Full Text:

PDF

References


A. Gupta, I.S. Mumick, V.S. Subrahmanian, “Maintaining Views Incrementally”,. in Proc. of the ACM SIGMOD Conference, Washington DC, USA, May 1993.

A. Haddadi, .”Communication and Cooperation in Agent Systems”,. Lecture Notes in Artificial Intelligence 1056, Springer, London, UK, 1995.

A. Kawaguchi, D. Lieuwen, I. Mumick, D. Quass, K. Ross, .”Concurrency Control Theory for Deferred Materialized Views”,. in Proc. of the International Conference on Database Theory, Athens, Greece, January 1997.

B. Lewis, D.J. Berg, “Multithreaded Programming with Java Technology”, Prentice Hall, Upper Saddle River, NJ, USA, 2000.

C. J. White, Sybase Adaptive Server IQ – “A High-Performance Database for Decision Processing”, January 1999. http://www.sybase.com/detail_list/1,3691,2291,00.html (February 11, 2001)

C. Marshall, Enterprise Modeling With UML: “Designing Successful Software Through Business Analysis”, Addison-Wesley, Reading, MA, USA, 2000.

D. Agrawal, A. El Abbadi, et al.,”Efficient View Maintenance at Data Warehouses”,. in Proc. of the ACM SIGMOD Conference, Tucson, AZ, USA, May 1997.

Y. Zhuge, H. Garcia-Molina, J. L. Wiener, “Consistency Algorithms for Multi-Source Warehouse View Maintenance”,. in Journal of Distributed and Parallel Databases, Vol. 6, No. 1, January 1998.

W.H. Inmon, J. A. Zachman, J. G. Geiger, “Data Stores, Data Warehousing, and the Zachman Framework: Managing Enterprise Knowledge”, McGraw-Hill, NY, USA, 1997.

W.H. Inmon, Data Warehouse Performance, John Wiley, NY, USA, 1999.

H. Garcia-Molina, W. J. Labio, J. L. Wiener, Y. Zhuge, . “Distributed and Parallel Computing Issues in Data Warehousing,. in Proc. of ACM Principles of Distributed Computing Conference”, 1999.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.