scholarly journals Convolutional neural net face recognition works in non-human-like ways

2020 ◽  
Vol 7 (10) ◽  
pp. 200595 ◽  
Author(s):  
Peter J. B. Hancock ◽  
Rosyl S. Somai ◽  
Viktoria R. Mileva
Keyword(s):  
Neural Networks ◽  
Face Recognition ◽  
State Of The Art ◽  
Poor Performance ◽  
Neural Net ◽  
Human Face ◽  
Face Matching ◽  
Similarity Space ◽  
Recognition Systems ◽  
Human Participants

Convolutional neural networks (CNNs) give the state-of-the-art performance in many pattern recognition problems but can be fooled by carefully crafted patterns of noise. We report that CNN face recognition systems also make surprising ‘errors'. We tested six commercial face recognition CNNs and found that they outperform typical human participants on standard face-matching tasks. However, they also declare matches that humans would not, where one image from the pair has been transformed to appear a different sex or race. This is not due to poor performance; the best CNNs perform almost perfectly on the human face-matching tasks, but also declare the most matches for faces of a different apparent race or sex. Although differing on the salience of sex and race, humans and computer systems are not working in completely different ways. They tend to find the same pairs of images difficult, suggesting some agreement about the underlying similarity space.

scholarly journals Surgical face masks impair human face matching performance for familiar and unfamiliar faces

2020 ◽  
Vol 5 (1) ◽  
Author(s):  
Daniel J. Carragher ◽  
Peter J. B. Hancock
Keyword(s):  
Face Recognition ◽  
Recognition System ◽  
Human Face ◽  
Face Matching ◽  
Face Recognition System ◽  
Surgical Masks ◽  
The Face ◽  
Matching Performance ◽  
Recognition Systems ◽  
Unfamiliar Faces

AbstractIn response to the COVID-19 pandemic, many governments around the world now recommend, or require, that their citizens cover the lower half of their face in public. Consequently, many people now wear surgical face masks in public. We investigated whether surgical face masks affected the performance of human observers, and a state-of-the-art face recognition system, on tasks of perceptual face matching. Participants judged whether two simultaneously presented face photographs showed the same person or two different people. We superimposed images of surgical masks over the faces, creating three different mask conditions: control (no masks), mixed (one face wearing a mask), and masked (both faces wearing masks). We found that surgical face masks have a large detrimental effect on human face matching performance, and that the degree of impairment is the same regardless of whether one or both faces in each pair are masked. Surprisingly, this impairment is similar in size for both familiar and unfamiliar faces. When matching masked faces, human observers are biased to reject unfamiliar faces as “mismatches” and to accept familiar faces as “matches”. Finally, the face recognition system showed very high classification accuracy for control and masked stimuli, even though it had not been trained to recognise masked faces. However, accuracy fell markedly when one face was masked and the other was not. Our findings demonstrate that surgical face masks impair the ability of humans, and naïve face recognition systems, to perform perceptual face matching tasks. Identification decisions for masked faces should be treated with caution.

scholarly journals Automatic Recognition Systems and Human Computer Interaction in Face Matching

2021 ◽  
pp. 193-215
Author(s):  
Eilidh Noyes ◽  
Matthew Q. Hill
Keyword(s):  
Face Recognition ◽  
Human Computer Interaction ◽  
Automatic Recognition ◽  
Image Similarity ◽  
Human Face ◽  
Identification Task ◽  
Face Matching ◽  
Recognition Systems ◽  
Computer Recognition ◽  
Automatic Systems

The human face facilitates identification in security and policing scenarios. In these settings, automatic face recognition systems have increased in prevalence and accuracy in recent years. As a result, the identification task, which once fell entirely to humans, is now a process performed by man and machine. Automatic face recognition systems provide image similarity comparisons and can create candidate lists to narrow down potential targets. There is increasing interest in the accuracy of these systems, and the role that algorithms can play in the identification effort. The design, operational usage, and effectiveness of these automatic systems, as well as the interaction of human and computer recognition are the topics of this chapter.

scholarly journals Surgical face masks impair human face matching performance for familiar and unfamiliar faces

2020 ◽  
Author(s):  
Daniel James Carragher ◽  
Peter Hancock
Keyword(s):  
Face Recognition ◽  
Recognition System ◽  
Human Face ◽  
Face Matching ◽  
Face Recognition System ◽  
Surgical Masks ◽  
The Face ◽  
Matching Performance ◽  
Recognition Systems ◽  
Unfamiliar Faces

In response to the COVID-19 pandemic, many governments around the world now recommend, or require, that their citizens cover the lower half of their face in public. Consequently, many people now wear surgical face masks in public. We investigated whether surgical face masks affected the performance of human observers, and a state-of-the-art face recognition system, on tasks of perceptual face matching. Participants judged whether two simultaneously presented face photographs showed the same person or two different people. We superimposed images of surgical masks over the faces, creating three different mask conditions: control (no masks), mixed (one face wearing a mask), and masked (both faces wearing masks). We found that surgical face masks have a large detrimental effect on human face matching performance, and that the degree of impairment is the same regardless of whether one or both faces in each pair are masked. Surprisingly, this impairment is similar in size for both familiar and unfamiliar faces. When matching masked faces, human observers are biased to reject unfamiliar faces as “mismatches” and to accept familiar faces as “matches”. Finally, the face recognition system showed very high classification accuracy for control and masked stimuli, even though it had not been trained to recognise masked faces. However, accuracy fell markedly when one face was masked and the other was not. Our findings demonstrate that surgical face masks impair the ability of humans, and naïve face recognition systems, to perform perceptual face matching tasks. Identification decisions for masked faces should be treated with caution.

scholarly journals Efficient Detection of Occlusion prior to Robust Face Recognition

2014 ◽  
Vol 2014 ◽  
pp. 1-10 ◽  
Author(s):  
Rui Min ◽  
Abdenour Hadid ◽  
Jean-Luc Dugelay
Keyword(s):  
Face Recognition ◽  
Facial Expression ◽  
Video Surveillance ◽  
Real World ◽  
State Of The Art ◽  
Efficient Detection ◽  
Art Works ◽  
Enormous Amount ◽  
Recognition Systems ◽  
Robust Face Recognition

While there has been an enormous amount of research on face recognition under pose/illumination/expression changes and image degradations, problems caused by occlusions attracted relatively less attention. Facial occlusions, due, for example, to sunglasses, hat/cap, scarf, and beard, can significantly deteriorate performances of face recognition systems in uncontrolled environments such as video surveillance. The goal of this paper is to explore face recognition in the presence of partial occlusions, with emphasis on real-world scenarios (e.g., sunglasses and scarf). In this paper, we propose an efficient approach which consists of first analysing the presence of potential occlusion on a face and then conducting face recognition on the nonoccluded facial regions based on selective local Gabor binary patterns. Experiments demonstrate that the proposed method outperforms the state-of-the-art works including KLD-LGBPHS, S-LNMF, OA-LBP, and RSC. Furthermore, performances of the proposed approach are evaluated under illumination and extreme facial expression changes provide also significant results.

Age-Invariant Face Recognition Using Triangle Geometric Features

2015 ◽  
Vol 29 (05) ◽  
pp. 1556006 ◽  
Author(s):  
Amal Seralkhatem Osman Ali ◽  
Vijanth Sagayan Asirvadam ◽  
Aamir Saeed Malik ◽  
Mohamed Meselhy Eltoukhy ◽  
Azrina Aziz
Keyword(s):  
Face Recognition ◽  
State Of The Art ◽  
Facial Recognition ◽  
Research Network ◽  
Facial Features ◽  
Age Difference ◽  
Facial Aging ◽  
The Face ◽  
Recognition Systems ◽  
Mathematical Relationships

Whilst facial recognition systems are vulnerable to different acquisition conditions, most notably lighting effects and pose variations, their particular level of sensitivity to facial aging effects is yet to be researched. The face recognition vendor test (FRVT) 2012's annual statement estimated deterioration in the performance of face recognition systems due to facial aging. There was about 5% degradation in the accuracies of the face recognition systems for each single year age difference between a test image and a probe image. Consequently, developing an age-invariant platform continues to be a significant requirement for building an effective facial recognition system. The main objective of this work is to address the challenge of facial aging which affects the performance of facial recognition systems. Accordingly, this work presents a geometrical model that is based on extracting a number of triangular facial features. The proposed model comprises a total of six triangular areas connecting and surrounding the main facial features (i.e. eyes, nose and mouth). Furthermore, a set of thirty mathematical relationships are developed and used for building a feature vector for each sample image. The areas and perimeters of the extracted triangular areas are calculated and used as inputs for the developed mathematical relationships. The performance of the system is evaluated over the publicly available face and gesture recognition research network (FG-NET) face aging database. The performance of the system is compared with that of some of the state-of-the-art face recognition methods and state-of-the-art age-invariant face recognition systems. Our proposed system yielded a good performance in term of classification accuracy of more than 94%.

MULTI-MODULAR NEURAL NETWORK ARCHITECTURES: APPLICATIONS IN OPTICAL CHARACTER AND HUMAN FACE RECOGNITION

1993 ◽  
Vol 07 (04) ◽  
pp. 721-755 ◽  
Author(s):  
FRANÇOISE FOGELMAN SOULIE ◽  
EMMANUEL VIENNET ◽  
BERTRAND LAMY
Keyword(s):  
Neural Networks ◽  
Face Recognition ◽  
Optical Character Recognition ◽  
General Mechanism ◽  
Human Face ◽  
Human Face Recognition ◽  
Trade Off ◽  
Practical Applications ◽  
Optical Character ◽  
Modular Architectures

In practical applications, recognition accuracy is sometimes not the only criterion; capability to reject erroneous patterns might also be needed. We show that there is a trade-off between these two properties. An efficient solution to this trade-off is brought about by the use of different algorithms implemented in various modules, i.e. multi-modular architectures. We present a general mechanism for designing and training multi-modular architectures, integrating various neural networks into a unique pattern recognition system, which is globally trained. It is possible to realize, within the system, feature extraction and recognition in successive modules which are cooperatively trained. We discuss various rejection criteria for neural networks and multi-modular architectures. We then give two examples of such systems, study their rejection capabilities and show how to use them for segmentation. In handwritten optical character recognition, our system achieves performances at state-of-the-art level, but is eight times faster. In human face recognition, our system is intended to work in the real world.

Sign in / Sign up

Export Citation Format

Share Document