Open Access Open Access  Restricted Access Subscription or Fee Access

Human-Computer Interface Technology

C. Praveen, P. Anbhazhagan


This paper discusses about the human computer interface(HCI) through body languages namely the hand gesture and facial expression, which can be used for intelligent space application such as smart home application, It is achieved by capturing human actions with the camera, processing meaning of the actions and then interfacing them with the computer process or applications.HCI modalities has been developed to allow human to interact naturally and intuitively with these intelligent space through non-verbal body-language modalities which include facial expressions, eye movement, hand gestures, body postures and walking style. This paper deals with how to interact with a computer using hand gesture and facial expressions.


Hand gesture, Hand posture, Facial expression, Anthropometric-Expression, Computer vision.

Full Text:



A. Mulder, “Hand gestures for HCI”, Technical Report 96-1, vol. Simon Fraster University, 1996

F. Quek, “Towards a Vision Based Hand Gesture Interface”, pp. 17-31, in Proceedings of Virtual Reality Software and Technology, Singapore, 1994.

Ying Wu, Thomas S Huang, “ Vision based Gesture Recognition : A Review”, Lecture Notes In Computer Science; Vol. 1739 , Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction, 1999

K G Derpains, “A review of Vision-based Hand Gestures”, Internal Report, Department of Computer Science. York University, February 2004

Richard Watson, “A Survey of Gesture Recognition Techniques”, Technical Report TCD-CS-93-11, Department of Computer Science, Trinity College Dublin, 1993.

Y. Wu and T.S. Huang, “Hand modeling analysis and recognition for vision-based human computer interaction”, IEEE Signal Processing Mag. – Special issue on Immersive Interactive Technology, vol.18, no.3, pp. 51-60, May 2001

H. Zhou, T.S. Huang, “Tracking articulated hand motion with Eigen dynamics analysis”, In Proc. Of International Conference on Computer Vision, Vol 2, pp. 1102-1109, 2003 .

JM Rehg, T Kanade, “Visual tracking of high DOF articulated structures: An application to human hand tracking” ,In Proc. European Conference on Computer Vision, 1994

A. J. Heap and D. C. Hogg, “Towards 3-D hand tracking using a deformable model”, In 2nd International Face and Gesture Recognition Conference, pages 140–145, Killington, USA,Oct. 1996.

Y. Wu, L. J. Y., and T. S. Huang. “Capturing natural hand Articulation”. In Proc. 8th Int. Conf. on Computer Vision, volume II, pages 426–432, Vancouver, Canada, July 2001.

B. Stenger P. R. S. Mendonc¸a R. Cipolla, “Model-Based 3D Tracking of an Articulated Hand”, In proc. British Machine Vision Conference, volume I, Pages 63-72, Manchester, UK, September 2001

[Online] Available from: [11.09.2008]

B. Stenger, A. Thayananthan, P.H.S. Torr, R. Cipolla , “Model-based hand tracking using a hierarchical Bayesian filter” , IEEE transactions on pattern analysis and machine intelligence, September 2006

Elena Sánchez-Nielsen, Luis Antón-Canalís, Mario Hernández-Tejera, “Hand Getsure recognition for Human Machine Intercation”, In Proc. 12th International Conference on Computer Graphics, Visualization and Computer Vision : WSCG, 2004

B. Stenger, “Template based Hand Pose recognition using multiple cues”, In Proc. 7th Asian Conference on Computer Vision : ACCV 2006

Lars Bretzner, Ivan Laptev and Tony Lindeberg, “Hand gesture recognition using multiscale color features, hieracrchichal models and particle filtering”, in Proceedings of Int. Conf. on Automatic face and Gesture recognition, Washington D.C., May 2002

M. Black, & Jepson, “ Eigen tracking: Robust matching and tracking of articulated objects using a view-based representation”, In European Conference on Computer Vision, 1996.

C C Wang, K C Wang, “Hand Posture recognition using Adaboost with SIFT for human robot interaction”, Springer Berlin, ISSN 0170-8643, Volume 370/2008

R. Lienhart and J. Maydt, “An extended set of Haar-like features for rapid object detection,” in Proc. IEEE Int. Conf. Image Process., 2002, vol. 1, pp. 900–903.

Andre L. C. Barczak, Farhad Dadgostar, “Real-time hand tracking using a set of co-operative classifiers based on Haar-like features”, Res. Lett. Inf. Math. Sci., 2005, Vol. 7, pp 29-42

Qing Chen , N.D. Georganas, E.M Petriu, “Real-time Vision based Hand Gesture Recognition Using Haar-like features”, IEEE Transactions on Instrumentation and Measurement -2007

P. Viola and M. Jones, “Robust real-time object detection,” Cambridge Res. Lab., Cambridge, MA, pp. 1–24, Tech. Rep. CRL2001/01, 2001.

Ju, S., Black, M., Minneman, S., Kimber, D, “Analysis of Gesture and Action in Technical Talks for Video Indexing”, IEEE Conf. on Computer Vision and Pattern Recognition, CVPR 97, 1997.

Berry,G.: Small-wall, “A Multimodal Human Computer Intelligent Interaction Test Bed with Applications”, Dept. of ECE, University of Illinois at Urbana-Champaign, MS thesis (1998).

Zeller, M., et al, “ A Visual Computing Environment for Very Large Scale Biomolecular Modeling”, Proc. IEEE Int. Conf. on Application specific Systems, Architectures and Processors (ASAP), Zurich, pp. 3-12, 1997.

Thad Starner and Alex Pentland, “Real time American Sign Language Recognition from Video using Hidden Markov Models”, Technical Report 375, MIT Media Lab,1995

A Malima, E Ozgur, M Cetin, “A fast algorithm for Vision based hand gesture recognition for robot control”, 14th IEEE conference on Signal Processing and Communications Applications, April 2006.

Hongmo Je Jiman Kim Daijin , “Hand Gesture Recognition to Understand Musical Conducting Action” 16th IEEE International Symposium on Robot and Human interactive Communication, 2007, ROMAN, 2007, pg 163-168

Dong Guo Yonghua, “ Vision-Based Hand Gesture Recognition for Human-Vehicle Interaction”, International Conference on Control, Automation and Computer Vision, 1998.

Hand-Gesture and Facial-Expression Human-Computer Interfaces for Intelligent Space Applications Qing Chen1, Marius D. Cordea1, Emil M. Petriu1, Thomas E. Whalen2 Imre J. Rudas3, and Annamaria Varkonyi-Koczy4 1University of Ottawa, ON, Canada, 2CRC, Ottawa, ON, Canada, 3Budapest Tech Polytechnic Institution, Hungary, 4Budapest University of Technology and Economics, Hungary.


  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.