Open Access Open Access  Restricted Access Subscription or Fee Access

Soft Computing Techniques based Recursive Error Correcting Output Code for Multi-Class Pattern Classification

D. Chandrakala, Dr.S. Sumathi, S. Karthi

Abstract


The pattern recognition methods like speech recognition, text classification, image recognition results in the solving of multi-class problems. This can be achieved by means of classifying multi-class problems into several two class problems using the Soft Computing techniques such as Neural Networks and Support Vector Machines. The best code matrix for a given problem cannot be designed taking into account only the features of the code matrix, viz., overall classifier accuracy, minimum hamming distance and margin of classification, but also the features of the problem, viz., attributes, samples and classes are to be considered. Conventionally, code matrix is designed based on either the features of the problem or the features of the code matrix. The proposed work, focused on designing a new code matrix based on both the features of the problem and code matrix. In order to improve the accuracy and reduce computation time, the generation of feature dependent code matrix through an evolutionary algorithm is proposed. This model aims at developing a hybrid version of Recursive Error Correcting Output Code with Biogeography Based Optimization to achieve maximum classification accuracy and minimum computational time.

Keywords


Biogeography Based Optimization, C5.0 Binary Search Tree, Radial Basis Function Neural Network, Recursive Error Correcting Output Codes, Support Vector Machine

Full Text:

PDF

References


Nicolas Garcia-Pedrajas and Colin Fyfe, ‘Evolving Output Codes for Multi-class Problems’, IEEE Transactions on Evolutionary Computation, 2008, Vol. 12, No.1, pp. 93-106.

Dan Simon, ‘Biogeography Based Optimization’, IEEE Transactions on Evolutionary Computation, 2008, Vol. 12, No. 6, pp. 702-713.

O Pujol, P Radeva and J Vitria, ‘Discriminant ECOC: A Heuristic Method For Application Dependent Design of Error Correcting Output Codes,’ IEEE Transaction on Pattern Analysis Machine Intelligence, 2006, Vol. 28, No. 6, pp. 1007–1012.

E L Allwein, R E Schapire and Y Singer, ‘Reducing Multi-class to Binary: A Unifying Approach for Margin Classifiers,’ Journal of Machine Learning Research, 2000, Vol. 1, pp. 113–141.

T W Anderson, ‘An Introduction to Multivariate Statistical Analysis, ser. Wiley Series in Probability and Mathematical Statistics’, 1984, Wiley, New York .

K Crammer and Y Singer, ‘On the Learnability and Design of Output Codes for Multiclass Problems’, Machine Learning, 2002,Vol. 47, pp. 201–233.

N Cristianini and J Shawe-Taylor, ‘An Introduction To Support Vector Machines,’ 2000, Cambridge Univ. Press, Cambridge, U.K .

Leonardo Ornella and Elizabeth Tapia, ‘A Classification Approach for Heterotic Performance Prediction based on Molecular Marker Data’, SADIO Electronic Journal of Information and Operations Research, 2007, Vol. 7, No. 1, pp. 24-30.

T G Dietterich and G Bakiri, ‘Solving multiclass learning problems via error-correcting output codes,’ Journal of Artificial Intelligence Research, 1995, Vol. 2, pp. 263–286.

S Hettich, C L Blake and C J Merz, 1998, ‘UCI repository of machine learning databases’,[Online]. Available: http://www.ics.uci.edu/ ~mlearn/MLRepository.html

Andrea Passerini, Massimiliano Pontil and Paolo Frasconi, ‘New results on Error Correcting Output Codes of Kernel Machines’, IEEE Transaction on Neural Network, 2004, Vol. 15, No. 1.

J R Quinlan, ‘C5: Programs for Machine Learning,’ 1998, CA: Morgan Kaufmann, San Mateo.

S Knerr, L Personnaz and G Dreyfus, ‘Single-layer learning revisited: A stepwise procedure for building and training a neural network,’ Neurocomputing : Algorithms, Architectures and Applications, F. Fo-gelman, J. Herault ed., Springer-Verlag, 1990,New York.

Yoshihiko Hasegawa and Hitoshi Iba, ‘A Bayesian Network Approach to Program Generation’, IEEE Transaction on Evolutionary Computation, 2008, Vol. 12, No.3

Ranga Chari Anand, Krishan Mehrotra, Chilukuri K. Mohan and Sanjay Ranka, ‘Efficient Classification for Multi-class Problems using Modular Neural Networks’, IEEE Transaction on Neural Network, 1995, Vol. 6, No. 1.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.