Open Access Open Access  Restricted Access Subscription or Fee Access

Mining Temporal Reservoir Data Using Sliding Window Technique

Wan Hussain Wan Ishak, Ku-Ruhana Ku-Mahamud, Norita Md Norwawi

Abstract


Decision on reservoir water release is crucial during both intense and less intense rainfall seasons. Even though reservoir water release is guided by the procedures, decision usually made based on the past experiences. Past experiences are recorded either hourly, daily, or weekly in the reservoir operation log book. In a few years this log book will become knowledge-rich repository, but very difficult and time consuming to be referred. In addition, the temporal relationship between the data cannot be easily identified. In this study window sliding technique is applied to extract information from the reservoir operational database: a digital version of the reservoir operation log book. Several data sets were constructed based on different sliding window size. Artificial neural network was used as modelling tool. The findings indicate that eight days is the significant time lags between upstream rainfall and reservoir water level. The best artificial neural network model is 24-15-3.

Keywords


Neural Network, Sliding Window, Reservoir Management, Reservoir Water Level, Temporal Data Mining

Full Text:

PDF

References


M. H. Dunham, Data Mining: Introductory and Advance Topics, New Jersey, Pearson Education Inc., 2002

S. Laxman, and P. S. Sastry, “A Survey of Temporal Data Mining”, Sadhana, 31(2), pp: 173-198, 2006

W. Lin, M. A. Orgun, and G. J. Williams, “An Overview of Temporal Data Mining”. In Simoff, S. J., Williams, G. J., Hegland, M., Proceedings of the 1st Australian Data Mining Workshop (ADM02) pp: 83-90, 2002

C. M. Antunes, and A. L. Oliveira, A. L. “Temporal Data Mining; an Overview”, Proceedings of Workshop on Temporal Data Mining (KDD'01) , pp: 1-13, 2001

W. H. Wan-Ishak, K. R. Ku-Mahamud, N. M. Norwawi, “Conceptual Model of Intelligent Decision Support System Based on Naturalistic Decision Theory for Reservoir Operation during Emergency Situation”, International Journal of Civil & Environmental Engineering, 11(2), pp: 06-11, 2011

K. Smith, and R. Ward, Floods: Physical Processes and Human Impacts. England: John Wiley, 1998

S. P. Simonovic, “Reservoir Systems Analysis: Closing Gap Between Theory and Practice”, Journal of Water Resources Planning and Management, 118(3), pp: 262-280, 1992

T. Dubrovin, A. Jolma, and E. Turunen, “Fuzzy Model for Real-Time Reservoir Operation”. Journal of Water Resources Planning and Management, 128(1), pp: 66-73, 2002

J. Shanmugasundaram, M. V. N. Prasad, and A. Gupta. “Temporal Data Mining”, Working Paper PROFIT-97-31, Massachusetts Institute of Technology, 1997

R. J. Povinelli, “Identifying Temporal Patterns for Characterization and Prediction of Financial Time Series Events”, Proc. of Int. Workshop on Temporal, Spatial and Spatio-Temporal Data Mining: TSDM2000, Lyon, France pp. 46-61, 2000

R. L. M. Moisao, and F. M. Pires, “Prediction Model, Based on Neural Networks, for Time Series with Origin in Chaotic Systems”, Proceedings of the Workshop on Artificial Intelligence for Financial Time Series Analysis, Univ. of Porto, 2001

D. H. Diggs, and R. J. Povinelli, “A Temporal Pattern Approach for Predicting Weekly Financial Time Series”, Proceedings of Artificial Neural Networks in Engineering, pp: 707-712, 2003

M. Samia, “A Representation of Time Series for Temporal Web Mining”, Proceedings of the 16th GI-Workshop on the Foundations of Databases, pp: 103-107, 2004

F. Zehraoui, and Y. Bennani, “New Self-Organizing Maps for Multivariate Sequences Processing”, International Journal of Computational Intelligence and Applications, 5(4), pp: 439-456, 2005

P. L. Brantingham, U. Glasser, B. Kinney, K. Singh, and M. Vajihollahi, “A Computational Model for Simulating Spatial and Temporal Aspects of Crime in Urban Environments”, IEEE International Conference on Systems, Man and Cybernetics, Vol. 4, pp: 3667 – 3674, 2005

J. F. Roddick, and M. Spiliopoulou, “A Survey of Temporal Knowledge Discovery Paradigms and Methods”, IEEE Transactions on Knowledge and Data Engineering, 14(4), pp: 750-767, 2002

R. J. Povinelli, and X. Feng, “Temporal Pattern Identification of Time Series Data Using Pattern Wavelets and Genetic Algorithms”, Proceedings of Artificial Neural Networks in Engineering, pp: 691-696, 1998

T. Oates, L. Firoiu, P. R. and Cohen, “Clustering Time Series with Hidden Markov Models and Dynamic Time Warping”, IJCAI-99 Workshop on Sequence Learning, pp: 17-21, 1999

J. M. Ale, and G. H. Rossi, “An Approach to Discovering Temporal Association Rules”, Proceedings of the 2000 ACM symposium on Applied computing, Vol. 1, 294 – 300, 2000

C. Juang, “Construction of Dynamic Fuzzy If-Then Rules through Genetic Reinforcement Learning for Temporal Problems Solving”, Joint 9th IFSA World Congress and 20th NAFIPS International Conference, Vol. 4, pp: 2341 – 2346, 2001

L. Xu, and B. Y. Choueiry, “A New Efficient Algorithm for Solving the Simple Temporal Problem”, Proc. of the 10th Int. Sym. on Temporal Representation and Reasoning and Fourth Int. Conf. on Temporal Logic (TIME-ICTL‟03), pp: 210 - 220, 2003

R. J. Povinelli, “A New Temporal Pattern Identification Method for Characterization and Prediction of Complex Time Series Events”. IEEE Transactions on Knowledge and data Engineering, 15(2), pp. 339-352, 2003

R. J. Povinelli, M. T. Johnson, A. C. Lindgren, and J. Ye, “Time Series Classification Using Gaussian Mixture Models of Reconstructed Phase Spaces”, IEEE Transactions on Knowledge and Data Engineering, 16(6), pp: 779-783, 2004

A. D. Lattner, O. and Herzog, “Unsupervised Learning of Sequential Patterns”, Proceedings of Temporal Data Mining: Algorithms, Theory and Applications. Brighton, UK, 2004

F. Guil, A. Bosch, and R. Marin, “TSETMAX: An Algorithm for Mining Frequent Maximal Temporal Patterns”, Proceedings of Temporal Data Mining: Algorithms, Theory and Applications. Brighton, UK, 2004

I. Batyrshin, R. Herrera-Avelar, L. Seremetov, and A. Panova, “Association Networks in Time Series data Mining”, Annual Meeting of the North American Fuzzy Information Processing Society, 2005. NAFIPS 2005, pp: 754 – 759, 2005.

E. Winarko, and J. F. Roddick, “Discovering Richer Temporal Association Rules from Interval-Based Data: Extended Report”, Technical Report SIE-05-003, School of Informatics and Engineering, 2005

K.R. Ku-Mahamud, N. Zakaria, N. Katuk and M. Shbier, "Flood Pattern Detection Using Sliding Window Technique", Third Asia International Conference on Modeling & Simulation, pp. 45-50, 2009

Li, H. F. & Lee, S. Y. (2009) Mining Frequent Itemsets Over Data Streams using Efficient Window Sliding Techniques. Expert Systems with Applications, 36, pp: 1466–1477

C. C. Chong and J.C. Jia “Assessments of neural network output codings for classification of multispectral images using Hamming distance measure”, Proceedings of the 12th IAPR International. Conference on Pattern Recognition, Vol. 2, pp: 526 – 528, 1994

W. Sarle, “Stopped Training and Other Remedies for Overfitting”, Proceedings of the 27th Symposium on the Interface of Computing Science and Statistics, pp. 352-360, 1995 Retrieved March 18, 2002 from World Wide Web: ftp://ftp.sas.com/pub/neural/


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.