Open Access Open Access  Restricted Access Subscription or Fee Access

Feature Extraction Techniques for Facial Expression Recognition

Garima Sharma, Dr. Sumanlata Gautam, Prerna Singal

Abstract


The area of automatic Facial Expression recognition has received an increasing attention from the researchers over last two decades due to its applications in various areas like human-computer interaction systems, Human Machine Intelligent Interaction (HMII), intelligent robotics, human centered transportation system for driver’s fatigue measurement, tools for people with lower vision and health care robots etc. An efficient feature extraction technique is an essential component of an automatic FER system. The feature extraction techniques widely used are categorized into: Appearance based methods and Geometric methods. Several works presented by the researchers use a hybrid approach combining both methods to create the feature vector for classification. In this paper, a survey is presented on different types of feature extraction techniques.


Keywords


Facial Expression Recognition, Feature Extraction, Geometric Features, Appearance Features, Hybrid Features.

Full Text:

PDF

References


Goyani, Mahesh M., and Narendra M. Patel. "Judgmental Feature Based Facial Expression Recognition Systems and FER Datasets-A Comprehensive Study." International Journal of Next-Generation Computing 8, no. 1 (2017).

Dhall, Abhinav, Roland Goecke, Shreya Ghosh, Jyoti Joshi, Jesse Hoey, and Tom Gedeon. "From individual to group-level emotion recognition: EmotiW 5.0." In Proceedings of the 19th ACM International Conference on Multimodal Interaction, pp. 524-528. ACM, 2017.

Sharma, Garima, Akansha Singh, A. K. Yadav, and Krishna Kant Singh. "Face detection from digital images: A comparative study." In Communication and Computing Systems: Proceedings of the International Conference on Communication and Computing Systems (ICCCS 2016), Gurgaon, India, 9-11 September, 2016, p. 107. CRC Press, 2017.

Martinez, B., Valstar, M.F., Jiang, B. and Pantic, M., 2017. Automatic analysis of facial actions: A survey. IEEE Transactions on Affective Computing.

Sun N, Chen Z, Day R. Facial Expression Recognition Using Digitalised Facial Features Based on Active Shape Model. International Conference on Computer Science, Engineering & Applications. 2016:39--46.

Walecki, Robert, Ognjen Rudovic, V. Pavlovic, B. Schuller, and Maja Pantic. "Deep structured learning for facial expression intensity estimation." In CVPR. 2017.

Datta Rakshit, Rinku, Subhas Chandra Nath, and Dakshina Ranjan Kisku. "An improved local pattern descriptor for biometrics face encoding: a LC–LBP approach toward face identification." Journal of the Chinese institute of engineers 40, no. 1 (2017): 82-92.

Tran, Chi-Kien, Chin-Dar Tseng, Pei-Ju Chao, Chin-Shiuh Shieh, Liyun Chang, and Tsair-Fwu Lee. "Face Recognition under Varying Lighting Conditions: A Combination of Weber-face and Local Directional Pattern for Feature Extraction and Support Vector Machines for Classification." source: Journal of Information Hiding and Multimedia Signal Processing 8, no. 5 (2017): 1010-1020.

Lee, Woo-Young, Kwang-Eun Ko, and Kwee-Bo Sim. "Robust lip detection based on histogram of oriented gradient features and convolutional neural network under effects of light and background." Optik-International Journal for Light and Electron Optics 136 (2017): 462-469.

Goyani, Mahesh, and Narendra Patel. "Multi-Level Haar Wavelet based Facial Expression Recognition using Logistic Regression." Indian Journal of Science and Technology 10, no. 9 (2017).

Dora, Lingraj, Sanjay Agrawal, Rutuparna Panda, and Ajith Abraham. "An evolutionary single Gabor kernel based filter approach to face recognition." Engineering Applications of Artificial Intelligence 62 (2017): 286-301.

S. Zhang, X. Zhao, and B. Lei, “Facial expression recognition based on local binary patterns and local Fisher discriminant analysis,” WSEAS Trans. Signal Process. vol. 8, no. 1, pp. 21–31, 2012.

Liu, Yanpeng, Yibin Li, Xin Ma, and Rui Song. "Facial expression recognition with fusion features extracted from salient facial areas." Sensors 17, no. 4 (2017): 712

Valstar, Michel F., Enrique Sánchez-Lozano, Jeffrey F. Cohn, László A. Jeni, Jeffrey M. Girard, Zheng Zhang, Lijun Yin, and Maja Pantic. "Fera 2017-addressing head pose in the third facial expression recognition and analysis challenge." In Automatic Face & Gesture Recognition (FG 2017), 2017 12th IEEE International Conference on, pp. 839-847. IEEE, 2017.

Monkaresi, Hamed, Nigel Bosch, Rafael A. Calvo, and Sidney K. D'Mello. "Automated detection of engagement using video-based estimation of facial expressions and heart rate." IEEE Transactions on Affective Computing 8, no. 1 (2017): 15-28.

Uddin, Md Zia, Mohammad Mehedi Hassan, Ahmad Almogren, Atif Alamri, Majed Alrubaian, and Giancarlo Fortino. "Facial expression recognition utilizing local direction-based robust features and deep belief network." IEEE Access 5 (2017): 4525-4536.

Ryu, Byungyong, Adín Ramírez Rivera, Jaemyun Kim, and Oksam Chae. "Local directional ternary pattern for facial expression recognition." IEEE Transactions on Image Processing 26, no. 12 (2017): 6006-6018.

Qayyum, Huma, Muhammad Majid, Syed Muhammad Anwar, and Bilal Khan. "Facial expression recognition using stationary wavelet transform features." Mathematical Problems in Engineering 2017 (2017).

Kim, Dae Hoe, Wissam Baddar, Jinhyeok Jang, and Yong Man Ro. "Multi-objective based spatio-temporal feature representation learning robust to expression intensity variations for facial expression recognition." IEEE Transactions on Affective Computing (2017).

Liu, Yanpeng, Yibin Li, Xin Ma, and Rui Song. "Facial expression recognition with fusion features extracted from salient facial areas." Sensors 17, no. 4 (2017): 712.

Ghimire, Deepak, Sunghwan Jeong, Joonwhoan Lee, and San Hyun Park. "Facial expression recognition based on local region specific features and support vector machines." Multimedia Tools and Applications 76, no. 6 (2017): 7803-7821.

Sajjad, Muhammad, Adnan Shah, Zahoor Jan, Syed Inayat Shah, Sung Wook Baik, and Irfan Mehmood. "Facial appearance and texture feature-based robust facial expression recognition framework for sentiment knowledge discovery." Cluster Computing (2017): 1-19.

Liu, Yanpeng, Yibin Li, Xin Ma, and Rui Song. "Facial expression recognition with fusion features extracted from salient facial areas." Sensors 17, no. 4 (2017): 712.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.