Open Access Open Access  Restricted Access Subscription or Fee Access

Facial Expressions based Emotion Recognition System with Outcome usability in Healthcare

Bharati Dixit, Dr.A.N. Gaikwad

Abstract


Facial expressions are form of non verbal communication which conveys the emotional state/ mood of a person. Emotions are integral part of human personality. Scientists have established that emotions can play pivotal role in rational intelligence (memory, decision making etc) and social intelligence (Communication, adaption etc). Study of emotions of any person can be interlinked with learning capabilities, behavioral aspect of that person. Efficient monitoring of human emotional states may provide important and useful medical information with diagnostic value which can be very useful for clinical practices. Existing health care systems do not take in to account the emotional state of the patients while treating them but potential of emotional aspects of health can be incorporated in disease prevention, therapy and rehabilitation. Useful outcomes of the proposed system add value to clinical practices, health care systems and services. This paper is basically literature survey paper revealing the work done so far in the area of emotion recognition through facial expression recognition with applicability in healthcare domain.

Keywords


Emotions, Face Recognition, Human Health, Action Units

Full Text:

PDF

References


Emily Mower, Maja J. Mataric, “A Frame work for Automatic Human Emotion Classification Using Emotion Profiles” IEEE Transactions on Audio, Speech and Language Processing, Vol 19, No. 5, pp1057-1070, July 2011.

Tarik Taleb, Nidal Nasser, “A Novel Middleware Solution to Improve Ubiquitous healthcare Systems Aided by Affective Information” IEEE Transactions on Information Technology and Biomedicine, Vol 14, No. 2, pp. 335-349, March 2010.

Aurna Chakraborty, Amit Konar “Emotion Recognition From Facial Expressions and Its Control Using Fuzzy Logic” IEEE Transactions on System, Man and Cybernetics – part A: Systems and Humans, Vol 39, No. 4, pp. 726-743, July 2009.

Wenfei Gu, Cheng Xiang “Facial Expression Recognition using radial encoding of local Gabor features and classifier synthesis” Elsevier Journal on Pattern Recognition published in May 2011 pp 80 – 91.

Pohsiang Tsai, Longbing Cao, Tom Hintz, Tony Jan “A bi modal face framework integrating facial expression with facial appearance” Elsevier Journal on pattern recognition letters 30 (2009) 1096 – 1100 available on line in may 2009.

Seyed Mehdi Lajevardi, Zahir M. Hussain, “Higher order orthogonal moments for invariant facial expression recognition”, Elsevier Journal on Digital Signal Processing, available online from march 2010, pp 1771 – 1779.

Butalia Ayesha, Dr. A.K. Ramani, Dr. Parag Kulkarni “Emotional Recognition and towards context based Decision”, International Journal of computer applications, vol 9 No. [3] pp 42 – 53, November 2010.

Gianluca Donato, Marian Steward Bartlett, Joseph C. Hager, Paul Ekman, and Terrence J. Sejnowski,Classifying FacialActions. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21(10), pp. 974-989, 1999.

K. Mase, Recognition of facial expression from optical flow. IEICE Transactions E, vol.74(10), pp. 3474-3483, 1991.

M. Rosenblum, Y. Yacoob, and L. Davis, Human expression recognition from motion using a radial basis function network architecture. IEEE Trans. Neural Networks, vol.7 (5), pp. 1121-1138, 1996.

A. Lanitis, C. Taylor, and T. Cootes, Automatic interpretation and coding of face images using flexible models. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19(7), pp. 743-756, 1997.

J.G. Daugman, Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression. IEEE Trans.Pattern Anal.Machine Intell. vol. 36, pp. 1169-1179, 1988.

P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman, EigenFaces vs. FisherFaces: Recognition Using Class Specific Linear Projection. IEEE Trans.Pattern Anal. Machine Intell., vol. 19(7), pp. 711-720, 1996.

P.S. Penev and J.J. Atick, Local feature analysis: a generalstatistical theory for object epresentation Network: Computation in Neural Systems, vol. 7(3), pp. 477-500, 1996.

M.S. Bartlett and T. Sejnowski, Viewpoint invariant face recognition using independent component analysis and attractor networks, in Advances in Neural Information Processing Systems, M. Mozer, M. Jordan, and T. Petsche, Editors, MIT Press: Cambridge, MA, 1997.

Liyang C. De Silva, Pei Chi Ng “Bimodal Emotion Recognition”.

J. Platt, Fast Training of Support Vector Machines using Sequential Minimal Optimization, in Advances in Kernel Methods - Support Vector Learning, B. Scholkopf, C. Burges, and A. Smola, Editors, MIT Press, pp. 185-208, 1998.

D. Aha and D. Kibler, Instance based learning algorithms.Machine Learning. Machine Learning, vol. 6, pp. 37-66, 1991.

M. White, “Effect of photographic negation on matching the expressions and identities of faces,” Perception, vol. 30, no. 8, pp. 969–981, 2001.

Stan Z. U. and Anil K. Jain, “Handbook of Face Recognition” published by Springer, in 2005.

Paul Ekman and Wallace V. Friesen, “Unmasking the Face” published by Maylor Books in 2003.

Radoslaw Niewiadomski , Catherine Pelachaud, “Affect expression in ECAs: Application to politeness displays” published by Elsevier in international Journl of Human computer Studies in July 2010, pp 851 – 871.

Zakia Hammal, mirimum Kunz et al “Pain Monitoring: A dynamic and context sensitive system” Elsevier Journal on Pattern Recognition September 2011

Qing Zhang, Minho Lee “A hierarchical positive and negative emotion understanding system based on integrated analysis of visual and brain signals” Elsevier Journal on Neurocomputing 73 (2010) 1264 – 1272 available online on may 2010.

Aurna Chakraborty, Amit Konar “Emotion Recognition From Facial Expressions and Its Control Using Fuzzy Logic” IEEE Transactions on System, Man and Cybernetics – part A: Systems and Humans, Vol 39, No. 4, pp. 726-743, July 2009.

Panagiotis C. Pentronakis, Leontios J. H. “Emotion Recognition from Brain Signals using Hybrid Adaptive Filtering and Higher Order Crossings Analysis” IEEE Transactions on Affective Computing , Vol 1, No. 2, pp. 81 -97, July – December 2010.

Christos A. Frantzidis, Charalampos, “On the Classification of Emotional Biosignals Evoked while Viewing Affective Pictures: An Integrated Data Mining Based Approach for Healthcare Applications” IEEE Transactions on Information Technology and Biomedicine, Vol 14, No. 2, pp. 309-318, March 2010.

Patric Lucey, Simon Lucey, “Automatically Detecting pain in Video Through Facial Action Units” IEEE Transactions on System, Man and Cybernetics – part B:Cybernetics, Vol 41, No. 3, pp. 664-674, June 2011.

Panagiotis C. Pentronakis, Leontios J. H. “Emotion Recognition from EEG using Higher order Crossings” IEEE Transactions on Information Technology and Biomedicine, Vol 14, No. 2, pp. 186 -197, March – 2010.

Ligang Zhang and Dian Tjondronegoro, “Facial expression Recognition Using Facial Movement Features” IEEE Transaction on Affective Computing, vol 2 No. 4 Oct. Nov 2011 pp 219 – 228.

Xuding Xie and Kin Man Lam, “Facial Expression Recognition based on shape and Texture” published in pattern Recognition journal of Elsevier in June 2008 pp 1003 – 1011.

Ahmad Poursaberi, Hossein Ahmadi, Svetlana N. Yanushkevich and Marina Gavrilova, “Gauss – Laguerre wavelet textural feature fusion with geometrical information for facial expression identification” published in Eurasip Journal on Image and Video Processing of SpringerOpen in 2012 .


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.