Open Access Open Access  Restricted Access Subscription or Fee Access

Hand Gesture and Speech Giving New Dimensions in Design of Intelligent Machine Using Kalman Fusion

Richa Golash, Yogendra Kumar Jain

Abstract


Developing Intelligent Machines is old concept but new era of advancement. Different researches are being carried out and many achievements has also been achieved to design smart machine having brain. The aim of this paper is to discuss and analyze two main challenges in this field, First  is discussion based on  human way of communication Hand Gesture and Speech can be the best combination to design user-friendly machine as they are co-expressive to each other and capable of giving complete meaning to any command. Second, comparing various level of fusion of heterogeneous inputs and discussing the steps and advantage of Kalman fusion in detail. This paper will help in will be helpful in improving the efficiency in Human Machine Interaction using Multimodalities.


Keywords


Feature Level Fusion, Hand Gesture, Intelligent Machine Kalman Fusion, Speech

Full Text:

PDF

References


R. A. Bolt, “ Put-That-There: Voice and Gesture in the Graphics Interface”, Computer Graphics, ACM SIGGRAPH, 14(3):262–270, 1980

R. Sharma, V. Pavlovic and T. Huang, “Toward multimodal human-computer interface”, Proceedings of the IEEE, Vol.86, No. 5, pp. 853-869, 1998.

A. Jaimes, and N. Sebe, "Multimodal human–computer interaction: a survey", Computer Vision and Image Understanding, vol. 108, no.1-2,pp. 116-134, 2007.

M. Pantic, A. Pentland, A. Nijholt and T.S. Huang, “Human computing and machine understanding of human behavior: a survey”, Artificial Intelligence For Human Computing, Eds. Springer, Lecture Notes in Artificial Intelligence, vol. 4451, pp. 47-71, 2007.

B.-T. Zhang and M.A. Orgun, “Speech Recognition forMobile Devices at Google” PRICAI 2010, LNAI6230, pp.8–10, 2010._c Springer-Verlag BerlinHeidelberg 2010

G.H. Matthews “Analysis by synthesis of sentences of Natural languages” Inter-National conference onmachine translation of language and applied language analysis,Taddington,U.K.,5-8Sept 2007

L. Kessous, G. Castellano and G. Caridakis, “Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis”, Journal on Multimodal User Interfaces, Vol. 3, No. 1-2, March 2010.

Weissman, T., “EE378 Handout: Kalman Filter”,Lecture notes on EE378 Statistical Signal Processing,http://eeclass.stanford.edu/ee378/.

Nathan Funk, “A Study of the Kalman Filter applied to Visual Tracking", University of Alberta, Project for CMPUT 652,December 7, 2003

C. Sanderson and K. K. Paliwal, “Information Fusion and Person Verification Using Speechand Face Information,” Research Paper IDIAP-RR 02-33, IDIAP, September 2002.

Cohen, P. R, Johnston, M., McGee, D., Oviatt, S. L., Clow, J., Smith, I. (1997). The Efficiency of Multimodal Interaction: A Case Study. Proceedings of the International Conference on SpokenLanguage.


Refbacks

  • There are currently no refbacks.