Open Access Open Access  Restricted Access Subscription or Fee Access

Dynamic Hand Gesture Recognition System for Robot Control with Minimal Number of Combined Feature Extraction Using Support Vector Machines

J. Rekha, N. Anshar Ali

Abstract


In this paper we proposed a vision based hand gesture recognition system that can recognize the hand gestures of a user in a real time environment. The recognized hand gestures are used as commands to activate robot motion. Proposed approach follows three main stages hand detection, hand posture recognition and gesture classification. The predefined gesture commands are recognized and classified in a real time environment. In real time situation, recognizing the gestures with good accuracy and speed is a great challenge. Our approach stands stable against multiple issues like occlusion, affine, illumination and cluttered background. Real time data is pre-processed with image enhancement techniques. Efficient hand detection is achieved through SURF features with Adaboost classifier. Hand postures are recognized using moment invariant and four morphological features with Support Vector Machine (SVM) classifier. Hidden Markov Model (HMM) with four states is used as a dynamic gesture classifier. Experimental results of the proposed approach shows good performance when compared with other existing methods.

Keywords


Hidden Markov Model (HMM), Principal Component Analysis (PCA), Real-time Gesture Recognition, Speeded Up Robust Features (SURF), Support Vector Machines (SVM).

Full Text:

PDF

References


Rekha.J & Anshar Ali.N, ―Dynamic Hand Gesture Recognition for Robot Control‖, In proceedings of International Conference on Smart Technologies ICST’11 chennai, 2011.

P.Garg, N.Aggarwal & S.Sofat, ―Vision Based Hand Gesture Recognition‖, World Academy of Science, Engineering and Technology 49 2009.

G.R.S.Murthy & R.S. Jadon,―A Review of vision based hand gestures recognition‖, International Journal of Information Technology and Knowledge Management, Vol-2,pp. 405-410, July-December 2009.

S.Mitra & T.Acharya, ―Gesture Recognition: A survey‖, IEEE Transcations on Systems, Man and Cybernetics, part c: Applications and Reviews, Vol.37, No.3 May 2007.

Chan Wah Ng, Surendra Ranganath, ―Real-Time Gesture Recognition system and application‖, Image and Vision Computing 20 (2002) 993-1007.

Y.Fang, K.Wang, J.Cheng & H.Lu, ―A Real Time hand gesture recognition method‖, IEEE 2007.

Tarek M.Mahmoud, ―A New fast skin colour detection technique‖, World Academy of Science, Engineering and Technology 43 2008.

Paul Viola & Michael Jones, ―Robust Real-Time Object Detection‖, Second International Workshop on Statistical and Computational Theories of Vision-Modelling, Learning, Computing and Sampling, Vancouver, Canada, July 13 2001.

Nils Petersen & Didier Stricker, ―Fast Hand Detection Using Posture Invariant Constraints‖, Springer-Verlag Berlin Heidelberg LNAI 5803, pp.106-113, 2009.

Salleh, Jias, Mazalan, Ismail, Yussof, Ahmad, Anuar & Mohamad, ―Sign Language to Voice Recognition: Hand Detection Techniques for Vision-Based Approach‖, In Conference Current Developments in Technology-Asssisted Education , FORMATEX 2006.

Chieh-Chih Wang & Ko-Chih Wang, ―Hand Posture Recognition Using Adaboost with SIFT for Human Robot Interaction‖, In Springer-Verlag Berlin-Recent Progress in Robotics, LNCIS 370, pp.317-329, 2008.

David G.Lowe, ―Distinctive Image Features from Scale-Invariant Keypoints‖, International Journal of Computer Vision 60(2), 91-110, 2004.

Q.Chen, N.Georganas & M.Petriu, ―Real Time Vision based hand gesture recognition using haar-like features‖, Instrumentation and Measurement Technology Conference – IMTC, Warsaw, Poland, May 1-3, 2007.

H.Francke, J.Ruiz-del-solar & R.Verschae, ―Real-Time Hand Gesture Detection and Recognition Using Boosted classifiers and Active Learning‖, Springer-Verlag Berlin Heidelberg LNCS 4872, pp.533-547, 2007.

T.Dinh, V.Dang & D.Duong, ―Hand gesture classification using boosted cascade of classifiers‖, IEEE 2006.

M.Elmezain, A.Al-Hamadi & B.Michaelis, ―Hand Gesture Recognition based on combined features extraction‖, World Academy of Science, Engineering and Technology 60 2009.

H.Zhou, D.Lin & T.S.Huang, ―Static Hand Gesture Recognition based on Local Orientation Histogram Feature Distribution Model‖, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops CVPRW’04 2004.

T.Starner & A.Pentland, ―Real-Time American Sign Language Recognition from video Using Hidden Markov Models‖, IEEE 1995.

G.Rigoll, A.Kosmala & S.Eickeler, ―High Performance Real-time Gesture Recognition Using Hidden Markov Models‖, Gerhard-Mercator-University, Duisburg-Germany.

R.Liang & M.Ouhyoung, ―A Real Time Continuous Gesture Recognition System for sign language‖, Shih-Chien University Taipei-Taiwan.

H.Bay, T.Tuytelaars & Luc V.Gool, ―SURF: Speeded Up Robust Features‖, Computer Vision and Image Understanding (CVIU), Vol.110, No. 3, pp. 346—359, 2008.

Dustin Boswell, ―Introduction to Support Vector Machines‖, 2002, retrieved November 5, 2007, from http://www.work.caltech.edu/»boswell/IntroToSVM.pdf.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.