Open Access Open Access  Restricted Access Subscription or Fee Access

Facial Expressions Recognition Based on ULBP and Edge Map

Vipan Vipan, Amandeep Kaur


This paper presents an algorithm for automatic facial expressions recognition. The algorithm is based on the Local Binary Patterns (LBP). The proposed algorithm first calculates the horizontal and vertical edges of the input image that gives important information of facial expressions. Facial expressions are generated by movement of muscles that are better represented in the form of edges. Next LBP histograms are extracted from both the edge maps after dividing the edge image into blocks. In addition, in order to reduce the dimensions of LBP histogram only uniform patterns (ULBP) are used, which reduces the computational complexity of facial expressions recognition. The proposed algorithm is tested on standard facial expressions databases TFEID & JAFFE. The experimental result shows that the proposed algorithm can obtain average recognition rate of 80% on TFEID images when using fixed and adaptive weights. In case of JAFFE images, recognition rate is 80% and 74% respectively.


Facial Expression Recognition, Facial Image Analysis, Sobel, Uniform Local Binary Pattern

Full Text:



Y. Tian, L. Brown, A. Hampapur, S. Pankanti, A. Senior, and R. Bolle, “Real world real-time automatic recognition of facial expression”, in IEEE PETS, Australia, March 2003.

Lianghua He, Cairong Zou, Li Zhao, Die Hu, “An Enhanced LBP Feature Based on Facial Expression Recognition”, Engineering in Medicine and Biology 27th Annual Conference Shanghai, pp 3300- 33303, 2005.

M.Pantic and L.Rothkrantz, “Automatic Analysis of Facial Expressions: The State of the Art”, IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 22, 2000, pp. 1424-1445.

B.Fasel and J.Luettin, “Automatic Facial Expression Analysis: A Survey”, Pattern Recognition, Vol.36, 2003, pp. 259-275.

W.Fellenz, J.Taylor, N.Tsapatsoulis, and S.Kollias, “Comparing Template-based, Feature based and Supervised Classification of Facial Expression from Static Images”, Computational Intelligence and Applications, 1999.

A.J. Calder, A.M. Burton, P. Miller, etc., “A principal component analysis of facial expressions”, Vision Research, 41:1179-1208, 2001

Yongzhao ZHAN, Jingfu YE, Dejiao NIU, Peng CAO, “Facial

Expression Recognition Based on Gabor Wavelet Transformation and Elastic Templates Matching”, Proceedings of the Third International Conference on Image and Graphics (2004)

Hui Jin, Wen Gao, “The Human Facial Combined Expression Recognition System”, Chinese Journal of Computer, 23(6):602-608, 2000.

M. Pardas, A. Bonafonte, “Facial animation parameters extraction and expression recognition using Hidden Markov Models”, Signal Processing: Image Communication, 17:675-688, 2002.

T. Ojala, M. Pietikinen, and D. Harwood, “A comparative study of texture measures with classification based on featured distribution”, Pattern Recognition, vol. 29, no. 1, 1996.

T. Ojala, M. Pietikinen, and T. Menp, “Multiresolution grayscale and rotation invariant texture classi_cation with local binary patterns”, IEEE PAMI, vol. 24, no. 7, July 2002.

T. Ahonen, A. Hadid, and M. Pietikinen, “Face recognition with local binary patterns”, in ECCV, 2004, pp. 469.481.

A. Hadid, M. Pietikinen, and T. Ahonen, “A discriminative feature space for detecting and recognizing faces”, in IEEE CVPR, June 2004, pp. 797.804.

N. Tan, L. Huang, C. Liu, “Face Recognition Based on a Single Image and Local Binary Pattern”. Intelligent Information Technology Application, 365-370, 2008.

B. Guo, KM Lam, WC Siu, S. Yang, “Human Face Recognition Based on Spatially Weighted Hausdroff Distance”. Pattern Recognition Letter. Vol.24, pp. 499-507, 2003.

Y. Gao, Maylor KH Leung. “Face Recognition Using Line Edge Map”, PAMI, VOL.24, No.6

I. Cohen, N. Sebe, Garg A., L. Chen and T. Huang, “Facial expression recognition from video sequences: Temporal and static modelling”, CVIU, Vol. 91, pp. 160-187, 2003.

M.S. Bartlett, G. Littlewort, I. Fasel, and R. Movellan, “Real time face detection and facial expression recognition: development and application to human computer interaction”, In CVPR Workshop on CVPR for HCI, 2003.

Maja Pantic, Student Member, IEEE, and Leon J.M. Rothkrantz, “Automatic Analysis of Facial Expressions: The State of the Art”, IEEE Transactions, VOL. 22, NO. 12, 2000.

Caifeng Shan, Shaogang Gong and Peter W. McOwan, “Robust Facial Expression Recognition Using Local Binary Patterns”, IEEE Transactions, 2005.

Xiaoyi Feng, “Facial Expression Recognition Based on Local Binary Patterns and Coarse-to-Fine Classification”, CIT, 2004.


  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.