Pose-specific non-linear mappings in feature space towards multiview facial expression recognition

2017 ◽  
Vol 58 ◽  
pp. 38-46 ◽  
Author(s):  
Mahdi Jampour ◽  
Vincent Lepetit ◽  
Thomas Mauthner ◽  
Horst Bischof
Keyword(s):  
Facial Expression ◽  
Facial Expression Recognition ◽  
Feature Space ◽  
Expression Recognition ◽  
Non Linear

scholarly journals Self-Difference Convolutional Neural Network for Facial Expression Recognition

Sensors ◽  
2021 ◽  
Vol 21 (6) ◽  
pp. 2250
Author(s):  
Leyuan Liu ◽  
Rubin Jiang ◽  
Jiao Huo ◽  
Jingying Chen
Keyword(s):  
Facial Expression ◽  
Facial Expressions ◽  
Facial Expression Recognition ◽  
Low Cost ◽  
Feature Space ◽  
Expression Recognition ◽  
Generative Adversarial Network ◽  
Convolutional Network ◽  
Online Processing ◽  
Adversarial Network

Facial expression recognition (FER) is a challenging problem due to the intra-class variation caused by subject identities. In this paper, a self-difference convolutional network (SD-CNN) is proposed to address the intra-class variation issue in FER. First, the SD-CNN uses a conditional generative adversarial network to generate the six typical facial expressions for the same subject in the testing image. Second, six compact and light-weighted difference-based CNNs, called DiffNets, are designed for classifying facial expressions. Each DiffNet extracts a pair of deep features from the testing image and one of the six synthesized expression images, and compares the difference between the deep feature pair. In this way, any potential facial expression in the testing image has an opportunity to be compared with the synthesized “Self”—an image of the same subject with the same facial expression as the testing image. As most of the self-difference features of the images with the same facial expression gather tightly in the feature space, the intra-class variation issue is significantly alleviated. The proposed SD-CNN is extensively evaluated on two widely-used facial expression datasets: CK+ and Oulu-CASIA. Experimental results demonstrate that the SD-CNN achieves state-of-the-art performance with accuracies of 99.7% on CK+ and 91.3% on Oulu-CASIA, respectively. Moreover, the model size of the online processing part of the SD-CNN is only 9.54 MB (1.59 MB ×6), which enables the SD-CNN to run on low-cost hardware.

scholarly journals Multiparameter Space Decision Voting and Fusion Features for Facial Expression Recognition

2020 ◽  
Vol 2020 ◽  
pp. 1-17
Author(s):  
Yan Wang ◽  
Ming Li ◽  
Xing Wan ◽  
Congxuan Zhang ◽  
Yue Wang
Keyword(s):  
Facial Expression ◽  
Facial Expression Recognition ◽  
Nearest Neighbor ◽  
Feature Space ◽  
Expression Recognition ◽  
Linear Discriminant ◽  
Training Samples ◽  
Feature Spaces ◽  
Fusion Feature ◽  
Fusion Features

Obtaining a valid facial expression recognition (FER) method is still a research hotspot in the artificial intelligence field. In this paper, we propose a multiparameter fusion feature space and decision voting-based classification for facial expression recognition. First, the parameter of the fusion feature space is determined according to the cross-validation recognition accuracy of the Multiscale Block Local Binary Pattern Uniform Histogram (MB-LBPUH) descriptor filtering over the training samples. According to the parameters, we build various fusion feature spaces by employing multiclass linear discriminant analysis (LDA). In these spaces, fusion features composed of MB-LBPUH and Histogram of Oriented Gradient (HOG) features are used to represent different facial expressions. Finally, to resolve the inconvenient classifiable pattern problem caused by similar expression classes, a nearest neighbor-based decision voting strategy is designed to predict the classification results. In experiments with the JAFFE, CK+, and TFEID datasets, the proposed model clearly outperformed existing algorithms.

Sign in / Sign up

Export Citation Format

Share Document