Open Access Open Access  Restricted Access Subscription or Fee Access

Wavelet Network-Based Narmax Model for Nonlinear System Identification

Dr. Nivin A. Ghamry

Abstract


Wavelet Networks, which combine the properties of wavelet decomposition with the characteristics of neural networks, have been successfully applied in model structure for nonlinear system identification in recent years. One the basic challenges of such wavelet network-based models is the identification of high-dimensional systems with a small number of variables to solve the problem known as the cruse of dimensionality. In this paper B-spline-wavelet network-based NARMAX model are developed for the identification of nonlinear systems. By adopting the analysis of variance (ANOVA) expansion and using truncated wavelet decompositions, the multivariate nonlinear wavelet networks are converted into linear-in-the-parameter equations, which can be solved by least square methods. Significant model term selection is improved by combing the Orthogonal Forward Regression (OFR) selection method with the Bayesian information criterion (BIC). Simulations are carried out by Matlab and standard errors on the estimated model coefficients are calculated. One of the simulation examples illustrated in this work considers SIMO system model of gas exhaust operation during the warm-up period of an ignition engine. The results show that the introduction of wavelet networks improves the prediction ability of the model when compared with wavelets with the same number of regressors.

Keywords


NARMAX, Nonlinear System Identification, Orthogonal Forward Regression, Wavelet Networks.

Full Text:

PDF

References


S.A. Billings and I.J.Leontaritis, “Parameter estimation techniques for nonlinear systems”,Proceedings of the 6th IFAC Symposium on Identification and Systems Parameter Estimation, Washington DC 1982, pp. 427-432.

K.P. Pearson, , “Nonlinear input/output modeling”, Journal of Process Control, vol. 5, Issue 4, Aug. 1995, pp. 197-211.

S.A. Billings, and H.L. Wei ,“The wavelet-NARMAX representation: A hybrid model structure combining polynomial models with multiresolution wavelet decompositions”, International Journal of Systems Science, vol. 36, no. 3, Feb. 2005, pp.137–152,.

S.A. Billings, and H.L. Wei,and M. A. Balikhin, “Wavelet based non-parametric NARX models for nonlinear input–output system

identification”, International Journal of Systems Science Dec. 2006, vol. 37, pp.1089–1096.

M. Ibnkahla, “Nonlinear system identification using neural networks trained with natural gradient descent”, EURASIP Journal on Applied Signal Processing, vol. 2003, 2003, pp. 1229-1237.

Z.Zhang, Z.Tang, S. Gao, “Training elman neural network for dynamical system identification using stochastic dynamic batch local search algorithm”, International Journal of Innovative Computing, Information and Control ICIC International, 2010, vol. 6, pp. 1883–1892.

J. G. Daugman, “Complete discrete 2-D gabor transforms by neural networks for image analysis and compression,” IEEE Trans. Acoust.,Speech, Signal Process., vol. 36, July 1988, pp. 1169–1179.

Q. Zhang and A. Benveniste, “Wavelet networks“, IEEE Trans. on neural networks, 1992, vol. 3, pp. 889–898.

S. Hong-li , C.Yuan-li and Q. Zu-lian, “Improved system identification approach using wavelet networks”, Journal of Shanghai University (English Edition)2005, vol. 9, pp. 159-163.

P. Aadaleesan, N. Miglan, R. Sharma and P. Saha,“Nonlinear system identification using Wiener type Laguerre-Wavelet network model”,Chemical Engineering Science2008,vol. 63, pp.3932-3941.

W. Hassouneh, R. Dhaouadi, and Y. Al-Assaf, “Dynamic modeling of nonlinear systems using wavelet networks”, Journal of Robotics and Mechatronics 2008, vol.20, pp. 178-187.

H. L. Wei, S. A. Billings, Y. F. Zhao, L. Z. Guo, “An adaptive wavelet neural network for spatio-temporal system identification”, Neural Networks, 2010, vol. 23, Elsevier pp.1286-1299.

S.A. Billings, and H.L. Wei, “A new class of wavelet networks for nonlinear system identification”, IEEE Trans. Neural Network 2005, vol. 16, pp.862-874.

X. Jinhua, “GA-optimized wavelet neural networks for system identification”,First International Conference onInnovative Computing, Information and ControlICICIC,Beijing, Aug.2006, pp. 214-217.

D. A. Freedman, et al., Statistics, 4th edition, W.W. Norton & Company, 2007.

G. Y. Li, C. Rosenthal, and H. Rabits, “High dimensional model representations,” Journal Phys. Chem. A ,Aug. 2001, vol. 105, pp. 7765–7777.

S.G. Mallat, “A theory for multiresolution signal decomposition: The wavelet representation”, IEEE Transaction of Pattern analysis and machine intelligence,1989, vol. 7, pp. 674-693,

C. K.Chui, and J. H .Wang, “On compactly supported spline wavelets and a duality principle”, Trans. of the American Mathematical Society, 1992, vol. 330, pp. 903-915.

H. Cheng, W. Chen, and T. Xie, “Wavelet network solution for the inverse kinematics problem in robotics manipulator”,Journal of Zhejiang University SCIENCE 2006, vol. 4, pp.525–529.

S., Chen, X.X., Wang, C.J, Harris, “NARX-based nonlinear system identification using orthogonal least squares basis hunting”, IEEE Transactions on Control Systems Technology, Jan.2008,vol. 16, pp. 78 – 84.

H., Wan-jun, Q.,Yan-hui, Q., Wen-yi, “Nonlinear system identification based on adaptive competitive clustering and OLS ”, Proceedings of Control and Decision Conference, CCDC '092009, pp.1178 – 1183.

N. A. Ghamry, “B-Spline wavelet-based narx and narmax models for nonlinear system identification”,International Review of Automatic Control (I.RE.A.CO.), May 2011, vol. 4, pp.370-377.

Schwarz, G., “Estimating the dimension of a model”, The Annals of Statistics, 1978, vol. 6, pp. 461–464.


Refbacks

  • There are currently no refbacks.