Development of the human face tracking algorithm based on the optical flow application

2018 ◽  
Vol 10 (5) ◽  
pp. 86-101
Author(s):  
A.A. Druki ◽  
V.G. Spitsyn ◽  
Yu.A. Bolotova ◽  
D. Oliva ◽  
A.V. Gelginberg
Author(s):  
V. V. Kniaz ◽  
Z. N. Smirnova

Human emotion identification from image sequences is highly demanded nowadays. The range of possible applications can vary from an automatic smile shutter function of consumer grade digital cameras to Biofied Building technologies, which enables communication between building space and residents. The highly perceptual nature of human emotions leads to the complexity of their classification and identification. The main question arises from the subjective quality of emotional classification of events that elicit human emotions. A variety of methods for formal classification of emotions were developed in musical psychology. This work is focused on identification of human emotions evoked by musical pieces using human face tracking and optical flow analysis. Facial feature tracking algorithm used for facial feature speed and position estimation is presented. <br><br> Facial features were extracted from each image sequence using human face tracking with local binary patterns (LBP) features. Accurate relative speeds of facial features were estimated using optical flow analysis. Obtained relative positions and speeds were used as the output facial emotion vector. The algorithm was tested using original software and recorded image sequences. The proposed technique proves to give a robust identification of human emotions elicited by musical pieces. The estimated models could be used for human emotion identification from image sequences in such fields as emotion based musical background or mood dependent radio.


2014 ◽  
Vol 687-691 ◽  
pp. 564-571 ◽  
Author(s):  
Lin Bao Xu ◽  
Shu Ming Tang ◽  
Jin Feng Yang ◽  
Yan Min Dong

This paper proposes a robust tracking algorithm for an autonomous car-like robot, and this algorithm is based on the Tracking-Learning-Detection (TLD). In this paper, the TLD method is extended to track the autonomous car-like robot for the first time. In order to improve accuracy and robustness of the proposed algorithm, a method of symmetry detection of autonomous car-like robot rear is integrated into the TLD. Moreover, the Median-Flow tracker in TLD is improved with a pyramid-based optical flow tracking method to capture fast moving objects. Extensive experiments and comparisons show the robustness of the proposed method.


2011 ◽  
pp. 5-44 ◽  
Author(s):  
Daijin Kim ◽  
Jaewon Sung

Face detection is the most fundamental step for the research on image-based automated face analysis such as face tracking, face recognition, face authentication, facial expression recognition and facial gesture recognition. When a novel face image is given we must know where the face is located, and how large the scale is to limit our concern to the face patch in the image and normalize the scale and orientation of the face patch. Usually, the face detection results are not stable; the scale of the detected face rectangle can be larger or smaller than that of the real face in the image. Therefore, many researchers use eye detectors to obtain stable normalized face images. Because the eyes have salient patterns in the human face image, they can be located stably and used for face image normalization. The eye detection becomes more important when we want to apply model-based face image analysis approaches.


2007 ◽  
Author(s):  
Zhanqing Wang ◽  
Youfu Fan ◽  
Guilin Zhang ◽  
Ruolan Hu

2010 ◽  
Vol 37 (7Part3) ◽  
pp. 3900-3901
Author(s):  
TP-T Teo ◽  
RN Crow ◽  
D Sasaki ◽  
S Pistorius

2020 ◽  
Vol 1518 ◽  
pp. 012021
Author(s):  
Qing Lei ◽  
Zhijun Li ◽  
Motao Wang ◽  
Jun Feng ◽  
Rui Zhang

2019 ◽  
Vol 11 (19) ◽  
pp. 2278
Author(s):  
Tao Yang ◽  
Dongdong Li ◽  
Yi Bai ◽  
Fangbing Zhang ◽  
Sen Li ◽  
...  

In recent years, UAV technology has developed rapidly. Due to the mobility, low cost, and variable monitoring altitude of UAVs, multiple-object detection and tracking in aerial videos has become a research hotspot in the field of computer vision. However, due to camera motion, small target size, target adhesion, and unpredictable target motion, it is still difficult to detect and track targets of interest in aerial videos, especially in the case of a low frame rate where the target position changes too much. In this paper, we propose a multiple-object-tracking algorithm based on dense-trajectory voting in aerial videos. The method models the multiple-target-tracking problem as a voting problem of the dense-optical-flow trajectory to the target ID, which can be applied to aerial-surveillance scenes and is robust to low-frame-rate videos. More specifically, we first built an aerial video dataset for vehicle targets, including a training dataset and a diverse test dataset. Based on this, we trained the neural network model by using a deep-learning method to detect vehicles in aerial videos. Thereafter, we calculated the dense optical flow in adjacent frames, and generated effective dense-optical-flow trajectories in each detection bounding box at the current time. When target IDs of optical-flow trajectories are known, the voting results of the optical-flow trajectories in each detection bounding box are counted. Finally, similarity between detection objects in adjacent frames was measured based on the voting results, and tracking results were obtained by data association. In order to evaluate the performance of this algorithm, we conducted experiments on self-built test datasets. A large number of experimental results showed that the proposed algorithm could obtain good target-tracking results in various complex scenarios, and performance was still robust at a low frame rate by changing the video frame rate. In addition, we carried out qualitative and quantitative comparison experiments between the algorithm and three state-of-the-art tracking algorithms, which further proved that this algorithm could not only obtain good tracking results in aerial videos with a normal frame rate, but also had excellent performance under low-frame-rate conditions.


Sign in / Sign up

Export Citation Format

Share Document