scholarly journals VIDEO SEQUENCING BASED FACIAL EXPRESSION DETECTION WITH 3D LOCAL BINARY PATTERN VARIANTS

Author(s):  
Kennedy Chengeta ◽  
Serestine Viriri
Author(s):  
Gopal Krishan Prajapat ◽  
Rakesh Kumar

Facial feature extraction and recognition plays a prominent role in human non-verbal interaction and it is one of the crucial factors among pose, speech, facial expression, behaviour and actions which are used in conveying information about the intentions and emotions of a human being. In this article an extended local binary pattern is used for the feature extraction process and a principal component analysis (PCA) is used for dimensionality reduction. The projections of the sample and model images are calculated and compared by Euclidean distance method. The combination of extended local binary pattern and PCA (ELBP+PCA) improves the accuracy of the recognition rate and also diminishes the evaluation complexity. The evaluation of proposed facial expression recognition approach will focus on the performance of the recognition rate. A series of tests are performed for the validation of algorithms and to compare the accuracy of the methods on the JAFFE, Extended Cohn-Kanade images database.


Author(s):  
Zhen-Tao Liu ◽  
Si-Han Li ◽  
Wei-Hua Cao ◽  
Dan-Yun Li ◽  
Man Hao ◽  
...  

The efficiency of facial expression recognition (FER) is important for human-robot interaction. Detection of the facial region, extraction of discriminative facial expression features, and identification of categories of facial expressions are all related to the recognition accuracy and time-efficiency. An FER framework is proposed, in which 2D Gabor and local binary pattern (LBP) are combined to extract discriminative features of salient facial expression patches, and extreme learning machine (ELM) is adopted to identify facial expression categories. The combination of 2D Gabor and LBP can not only describe multiscale and multidirectional textural features, but also capture small local details. The FER of ELM and support vector machine (SVM) is performed using the Japanese female facial expression database and extended Cohn-Kanade database, respectively, in which both ELM and SVM achieve an accuracy of more than 85%, and the computational efficiency of ELM is higher than that of SVM. The proposed framework has been used in the multimodal emotional communication based humans-robots interaction system, in which FER within 2 seconds enables real-time human-robot interaction.


Emotion analysis is an area which is been widely used in the forensic crime detection domain, a mentoring device for depressed students, psychologically affected patient treatment. The current system helps only in identifying the emotions but not in identifying the level of emotions like whether the individual is truly happy/sad or pretending to be happy /sad. In this proposed work a novel methodology has been introduced. We have rebuilt the Traditional Local Binary Pattern (LBP) feature operator to image the expression and combine the abstract characteristics of facial expression learned from the neural network of deep convolution with the modified features of the texture of the LBP facial expression in the full connection layer. These extracted features have been subjected as input for CNN Alex Net to classify the level of emotions. The results obtained in this phase are used in the confusion matrix for analysis of grading of emotions like Grade-1, Grade-2, and Grade-3 obtained an accuracy of 87.58% in the comparative analysis.


Sign in / Sign up

Export Citation Format

Share Document