Open Access Open Access  Restricted Access Subscription or Fee Access

Modified K- Nearest Neighbor Classifier Using Group Prototypes and its Application to Fault Diagnosis.

P.S. Dhabe, S.G. Lade, Snehal Pingale, Rachana Prakash, M.L. Dhore

Abstract


This paper describes, proposed modified K-NN (MKNN) classifier, which calculates group prototypes from several patterns belonging to the same class and uses these prototypes for the recognition of patterns. Number of prototypes created by MKNN classifier is dependant on the distance factor d. More prototypes are created for smaller value of d and vice versa. We have compared performance of original KNN and MKNN using a fault diagnosis databases. From the experimentation, one can conclude that performance of MKNN is better than original KNN, in terms of percentage recognition rate and recall time per pattern, classification and classification time. MKNN, thus has increased the scope of original KNN for its application to large data sets, which was not possible previously.

Keywords


KNN Classifier, Group Prototypes, Pattern Recognition, Document Classification, Fault Diagnosis.

Full Text:

PDF

References


Elaine Rich and Kevin Knight, ―Artificial Intelligence‖ , 2nd ed., Tata McGraw-Hill, 1991.

Rolf Isermann, ―Fault diagnosis systems: an introduction from fault detection to fault tolerance‖, Springer, 2006.

Fix, E., Hodges, J.L. Discriminatory analysis, nonparametric discrimination: Consistency properties. Technical Report 4, USAF School of Aviation Medicine, Randolph Field, Texas, 1951

Thomas M. Cover and Peter E. Hart, "Nearest neighbor pattern classification," IEEE Transactions on Information Theory, (1967) Vol. 13 (1) pp. 21-27

R.O. Duda, P.E. Hart, and D.G. Stork, ―Pattern Classification‖, New York: John Wiley & Sons, 2001.

Cover, T.M., Hart, P.E. Nearest neighbor pattern classification. IEEE Trans. Inform. Theory, IT-13(1):21–27, 1967.

Tom Mitchell, ― Machine Learning‖ , McGraw Hill, 1997.

Hellman, M.E. The nearest neighbor classification rule with a reject option. IEEE Trans. Syst. Man Cybern., 3:179–185, 1970.

Fukunaga, K., Hostetler, L. k-nearest-neighbor bayes-risk estimation. IEEE Trans. Information Theory, 21(3), 285-293, 1975.

Dudani, S.A. The distance-weighted k-nearest-neighbor rule. IEEE Trans. Syst. Man Cybern., SMC-6:325–327, 1976.

Bailey, T., Jain, A. A note on distance-weighted k-nearest neighbor rules. IEEE Trans. Systems, Man, Cybernetics, Vol. 8, pp. 311-313, 1978.

Bermejo, S. Cabestany, J. Adaptive soft k-nearest-neighbour classifiers. Pattern Recognition, Vol. 33, pp. 1999-2005, 2000.

Jozwik, A. A learning scheme for a fuzzy k-nn rule. Pattern Recognition Letters, 1:287–289, 1983.

Keller, J.M., Gray, M.R., Givens, J.A. A fuzzy k-nn neighbor algorithm. IEEE Trans. Syst. Man Cybern., SMC-15(4):580–585, 1985.

ITQON, K. Shunichi and I. Satoru, Improving Performance of k-Nearest Neighbor Classifier by Test Features, Springer Transactions of the Institute of Electronics, Information and Communication Engineers 2001

Arif, M., Akram, M. U., and Afsar, F. A., Arrhythmia Beat Classification using pruned fuzzy K-nearest neighbor classifier, Proceedings of International Conference on Soft Computing and Pattern Recognition, SoCPaR, pp 37–42, 2009.

Nigsch, F.; A. Bender, B. van Buuren, J. Tissen, E. Nigsch & J.B.O. Mitchell (2006). "Melting Point Prediction Employing k-nearest Neighbor Algorithms and Genetic Parameter Optimization". Journal of Chemical Information and Modeling 46 (6): 2412–2422.

Oliver Stegle and Karsten Borgwardt, ― Project 5: k-nearest neighbor classification Data Mining in Bioinformatics‖, available [online] http://agbs.kyb.tuebingen.mpg.de/wikis/bg/project_5.pdf

Scott Poll , available [online] https://dashlink.arc.nasa.gov/data/adapt-an-electrical-power-system-testbed/ -

Milind E. Rane, Dhabe P.S, and J. B. Patil, ―Multi-prototype Fuzzy pattern matching for handwritten character recognition‖, Int. journal of WESAS transactions on electronics, Issue-3, Vol.1, pp.520-525, July 2004.

P.K. Simpson, Fuzzy min-max neural networks — Part 1: Classification, IEEE Trans. Neural Networks 3 (5) (1992), pp. 776–786

John D. Owens, David Luebke, Naga Govindaraju, Mark Harris, Jens Krüger, Aaron E. Lefohn, and Timothy J. Purcell, ― A Survey of General-Purpose Computation on Graphics Hardware‖, pp.21-51, Eurographics, 2005.

John D. Owens, Mike Houston, David Luebke, Simon Green, John E. Stone, and James C. Phillip "GPU Computing," Proc. IEEE, vol. 96, no. 5, 2008, pp. 879–899.

John Nickolls, William J. Dally, "The GPU Computing Era," IEEE Micro, vol. 30, no. 2, pp. 56-69, Mar./Apr. 2010.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.