scholarly journals Channel-Wise Spatiotemporal Aggregation Technology for Face Video Forensics

2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Yujiang Lu ◽  
Yaju Liu ◽  
Jianwei Fei ◽  
Zhihua Xia
Keyword(s):  
Feature Fusion ◽  
Generative Models ◽  
Personal Privacy ◽  
Frame Sequence ◽  
Face Region ◽  
Video Frames ◽  
Spatiotemporal Feature ◽  
The Face ◽  
Spatiotemporal Aggregation ◽  
The Difference

Recent progress in deep learning, in particular the generative models, makes it easier to synthesize sophisticated forged faces in videos, leading to severe threats on social media about personal privacy and reputation. It is therefore highly necessary to develop forensics approaches to distinguish those forged videos from the authentic. Existing works are absorbed in exploring frame-level cues but insufficient in leveraging affluent temporal information. Although some approaches identify forgeries from the perspective of motion inconsistency, there is so far not a promising spatiotemporal feature fusion strategy. Towards this end, we propose the Channel-Wise Spatiotemporal Aggregation (CWSA) module to fuse deep features of continuous video frames without any recurrent units. Our approach starts by cropping the face region with some background remained, which transforms the learning objective from manipulations to the difference between pristine and manipulated pixels. A deep convolutional neural network (CNN) with skip connections that are conducive to the preservation of detection-helpful low-level features is then utilized to extract frame-level features. The CWSA module finally makes the real or fake decision by aggregating deep features of the frame sequence. Evaluation against a list of large facial video manipulation benchmarks has illustrated its effectiveness. On all three datasets, FaceForensics++, Celeb-DF, and DeepFake Detection Challenge Preview, the proposed approach outperforms the state-of-the-art methods with significant advantages.

Face detection in single and multiple images using different skin color models

2020 ◽  
Vol 13 ◽  
Author(s):  
Manpreet Kaur ◽  
Jasdev Bhatti ◽  
Mohit Kumar Kakkar ◽  
Arun Upmanyu
Keyword(s):  
Face Detection ◽  
Skin Color ◽  
Input Image ◽  
Morphological Operations ◽  
Reliability Model ◽  
Multiple Images ◽  
Face Region ◽  
Bounding Box ◽  
The Face ◽  
Precision And Accuracy

Introduction: Face Detection is used in many different steams like video conferencing, human-computer interface, in face detection, and in the database management of image. Therefore, the aim of our paper is to apply Red Green Blue ( Methods: The morphological operations are performed in the face region to a number of pixels as the proposed parameter to check either an input image contains face region or not. Canny edge detection is also used to show the boundaries of a candidate face region, in the end, the face can be shown detected by using bounding box around the face. Results: The reliability model has also been proposed for detecting the faces in single and multiple images. The results of the experiments reflect that the algorithm been proposed performs very well in each model for detecting the faces in single and multiple images and the reliability model provides the best fit by analyzing the precision and accuracy. Moreover Discussion: The calculated results show that HSV model works best for single faced images whereas YCbCr and TSL models work best for multiple faced images. Also, the evaluated results by this paper provides the better testing strategies that helps to develop new techniques which leads to an increase in research effectiveness. Conclusion: The calculated value of all parameters is helpful for proving that the proposed algorithm has been performed very well in each model for detecting the face by using a bounding box around the face in single as well as multiple images. The precision and accuracy of all three models are analyzed through the reliability model. The comparison calculated in this paper reflects that HSV model works best for single faced images whereas YCbCr and TSL models work best for multiple faced images.

The Difference in Facial Movement Between the Medial and the Lateral Midface: A 3D Skin Surface Vector Analysis

2021 ◽  
Author(s):  
David L Freytag ◽  
Michael G Alfertshofer ◽  
Konstantin Frank ◽  
Dmitry V Melnikov ◽  
Nicholas Moellhoff ◽  
...  
Keyword(s):  
3D Imaging ◽  
Functional Anatomy ◽  
Skin Surface ◽  
Facial Movements ◽  
Anatomic Location ◽  
Objective Evidence ◽  
The Face ◽  
Functional Boundary ◽  
The Mean ◽  
The Difference

Abstract Background Our understanding of the functional anatomy of the face is constantly improving. To date, it is unclear whether the anatomic location of the line of ligaments has any functional importance during normal facial movements such as smiling. Objectives It is the objective of the present study to identify differences in facial movements between the medial and lateral midface by means of skin vector displacement analyses derived from 3D imaging and to further ascertain whether the line of ligaments has both a structural and functional significance in these movements. Methods The study sample consisted of 21 healthy volunteers (9 females & 12 males) of Caucasian ethnic background with a mean age of 30.6 (8.3) years and a mean BMI of 22.57 (2.5) kg/m 2. 3D images of the volunteers’ faces in repose and during smiling (Duchenne type) were taken. 3D imaging-based skin vector displacement analyses were conducted. Results The mean horizontal skin displacement was 0.08 (2.0) mm in the medial midface (lateral movement) and was -0.08 (1.96) mm in the lateral midface (medial movement) (p = 0.711). The mean vertical skin displacement (cranial movement of skin toward the forehead/temple) was 6.68 (2.4) mm in the medial midface whereas it was 5.20 (2.07) mm in the lateral midface (p = 0.003). Conclusions The results of this study provide objective evidence for an antagonistic skin movement between the medial and the lateral midface. The functional boundary identified by 3D imaging corresponds to the anatomic location of the line of ligaments.

scholarly journals The Value of a Decrease in Temperature by One Degree Celsius of the Regional Microclimate—The Cooling Effect of the Paddy Field

Atmosphere ◽  
2021 ◽  
Vol 12 (3) ◽  
pp. 353
Author(s):  
Ya-Wen Chiueh ◽  
Chih-Hung Tan ◽  
Hsiang-Yi Hsu
Keyword(s):  
Land Use ◽  
Surface Temperature ◽  
Paddy Field ◽  
Research Area ◽  
Paddy Fields ◽  
Cooling Effect ◽  
Field Temperature ◽  
Bare Land ◽  
The Face ◽  
The Difference

In the face of climate change, extreme climates are becoming more frequent. There were severe droughts in Taiwan in 2020, 2014–2015, and 2002. In these years, the paddy fields were kept fallow to save water and transfer agricultural water to non-agricultural use. On the other hand, with global warming, the existence of paddy fields may be one of the natural solutions to regional temperature mitigation. This study used remote sensing to quantify the difference in temperature between paddy fields and urban areas. The result of overall surface temperature deductive analysis revealed that the temperature in the whole Taoyuan research area was 1.2 °C higher in 2002 than in 2003 because of fallowing of the paddy field, while in the Hsinchu research area, it was 1.5 °C higher in 2002 than in 2003, due to the same reason described above. In terms of the difference in land use, for the Hsinchu research area, the surface temperature deductive result showed that the average paddy field temperature in 2002 was 22.3 °C (sample area average), which was 7.7 °C lower than that of the building and road point and 4.3 °C lower than that of the bare land point. The average paddy field temperature in 2003 was 19.2 °C (sample area average), which was 10.1 °C lower than that of the building and road point and 8.3 °C lower than that of the bare land point. Then this study evaluated the economic valuation of the paddy field cooling effect using the contingent valuation method. Through the paddy field cooling effect and in the face of worsening extreme global climate, the willingness to pay (WTP) of the respondents in Taiwan for a decrease of 1 °C with regard to the regional microclimate was evaluated. It was found that people in Taiwan are willing to pay an extra 8.89 USD/per kg rice/year for the paddy for a decrease in temperature by 1 °C in the regional microclimate due to the paddy field. Furthermore, this study applied the benefits transfer method to evaluate the value of a decrease of 1 °C in the regional microclimate in Taiwan. The value of a decrease of 1 °C in the regional microclimate in Taiwan is 9,693,144,279 USD/year. In this regard, the economic value of 1 °C must not be underestimated. In conclusion, more caution is needed while making decisions to change the land use of paddy fields to other land uses.

Face Image Segmentation Using Color Information and Saliency Map

2011 ◽  
Vol 55-57 ◽  
pp. 77-81
Author(s):  
Hui Ming Huang ◽  
He Sheng Liu ◽  
Guo Ping Liu
Keyword(s):  
Image Segmentation ◽  
Human Skin ◽  
Skin Color ◽  
Saliency Map ◽  
Face Image ◽  
Color Information ◽  
Attention Model ◽  
Face Area ◽  
Face Region ◽  
The Face

In this paper, we proposed an efficient method to address the problem of color face image segmentation that is based on color information and saliency map. This method consists of three stages. At first, skin colored regions is detected using a Bayesian model of the human skin color. Then, we get a chroma chart that shows likelihoods of skin colors. This chroma chart is further segmented into skin region that satisfy the homogeneity property of the human skin. The third stage, visual attention model are employed to localize the face region according to the saliency map while the bottom-up approach utilizes both the intensity and color features maps from the test image. Experimental evaluation on test shows that the proposed method is capable of segmenting the face area quite effectively，at the same time, our methods shows good performance for subjects in both simple and complex backgrounds, as well as varying illumination conditions and skin color variances.

Associated change in plantar temperature and sweating after transthoracic endoscopic T2–3 sympathectomy for palmar hyperhidrosis

2001 ◽  
Vol 95 (1) ◽  
pp. 58-63 ◽  
Author(s):  
Han-Jung Chen ◽  
Cheng-Loong Liang ◽  
Kang Lu
Keyword(s):  
Skin Temperature ◽  
Temperature Change ◽  
The Body ◽  
Palmar Hyperhidrosis ◽  
Compensatory Sweating ◽  
Content Type ◽  
Postoperative Changes ◽  
The Face ◽  
The Difference ◽  
Fine Print

Object. Transthoracic endoscopic T2–3 sympathectomy is currently the treatment of choice for palmar hyperhidrosis. Compensatory sweating of the face, trunk, thigh, and sole of the foot was found in more than 50% of patients who underwent this procedure. The authors conducted this study to investigate the associated intraoperative changes in plantar skin temperature and postoperative plantar sweating. Methods. One hundred patients with palmar hyperhidrosis underwent bilateral transthoracic endoscopic T2–3 sympathectomy. There were 60 female and 40 male patients who ranged in age from 13 to 40 years (mean age 21.6 years). Characteristics studied included changes in palmar and plantar skin temperature measured intraoperatively, as well as pre- and postoperative changes in plantar sweating and sympathetic skin responses (SSRs). In 59 patients (59%) elevation of plantar temperature was demonstrated at the end of the surgical procedure. In this group, plantar sweating was found to be exacerbated in three patients (5%); plantar sweating was improved in 52 patients (88.1%); and no change was demonstrated in four patients (6.8%). In the other group of patients in whom no temperature change occurred, increased plantar sweating was demonstrated in three patients (7.3%); plantar sweating was improved in 20 patients (48.8%); and no change was shown in 18 patients (43.9%). The difference between temperature and sweating change was significant (p = 0.001). Compared with the presympathectomy rate, the rate of absent SSR also significantly increased after sympathectomy: from 20 to 76% after electrical stimulation and 36 to 64% after deep inspiration stimulation, respectively (p < 0.05). Conclusions. In contrast to compensatory sweating in other parts of the body after T2–3 sympathetomy, improvement in plantar sweating was shown in 72% and worsened symptoms in 6% of patients. The intraoperative plantar skin temperature change and perioperative SSR demonstrated a correlation between these changes.

scholarly journals State model based face mask detection

2018 ◽  
Vol 7 (2.22) ◽  
pp. 35
Author(s):  
Kavitha M ◽  
Mohamed Mansoor Roomi S ◽  
K Priya ◽  
Bavithra Devi K
Keyword(s):  
Face Mask ◽  
Search Space ◽  
Gaussian Mixture ◽  
Detection Algorithm ◽  
State Model ◽  
Face Region ◽  
Automatic Teller Machine ◽  
Foreground Region ◽  
The Face ◽  
Surveillance Mechanism

The Automatic Teller Machine plays an important role in the modern economic society. ATM centers are located in remote central which are at high risk due to the increasing crime rate and robbery.These ATM centers assist with surveillance techniques to provide protection. Even after installing the surveillance mechanism, the robbers fool the security system by hiding their face using mask/helmet. Henceforth, an automatic mask detection algorithm is required to, alert when the ATM is at risk. In this work, the Gaussian Mixture Model (GMM) is applied for foreground detection to extract the regions of interest (ROI) i.e. Human being. Face region is acquired from the foreground region through  the torso partitioning and applying Viola-Jones algorithm in this search space. Parts of the face such as Eye pair, Nose, and Mouth are extracted and a state model is developed to detect  mask.  

The Design of Real-Time Face Detection System Based on FPGA

2013 ◽  
Vol 473 ◽  
pp. 231-234
Author(s):  
Su Hua Chen ◽  
Xu Fang ◽  
Yong Guang Liu ◽  
Jun Wang
Keyword(s):  
Processing Speed ◽  
Detection System ◽  
Main Body ◽  
Infrared Source ◽  
Difference Image ◽  
Small Influence ◽  
The Face ◽  
The Difference ◽  
Locating System ◽  
Image Difference

The design attempts for thefirst time to realize face locating system on the FPGA platform using themethod combined initiative infrared source with image difference. Through imagedifference process, the system obtains a difference image without backgroundinterference which takes the face as the main body. It can obtain the personface boundary by projecting the difference image in the horizontal and verticaldirection. The system processing speed amount s to the video source frequency25 frame per second, satisfying the timely request; the method of initiativeinfrared source makes the exterior have small influence on the image andguarantees the robustness of the system.

Anatomic patterning in the expression of vestibulosympathetic reflexes

2000 ◽  
Vol 279 (1) ◽  
pp. R109-R117 ◽  
Author(s):  
I. A. Kerman ◽  
B. J. Yates ◽  
R. M. McAllen
Keyword(s):  
Relative Proportion ◽  
Vestibular Stimulation ◽  
Nerve Fibers ◽  
Spike Shape ◽  
The Face ◽  
Nerve Fascicle ◽  
The Difference ◽  
Vestibulosympathetic Reflexes

To investigate the possibility that expression of vestibulosympathetic reflexes (VSR) is related to a nerve's anatomic location rather than its target organ, we compared VSR recorded from the same type of postganglionic fiber [muscle vasoconstrictor (MVC)] located at three different rostrocaudal levels: hindlimb, forelimb, and face. Experiments were performed on chloralose-anesthetized cats, and vestibular afferents were stimulated electrically. Single MVC unit activity was extracted by spike shape analysis of few-fiber recordings, and unit discrimination was confirmed by autocorrelation. Poststimulus time histogram analysis revealed that about half of the neurons were initially inhibited by vestibular stimulation (type 1 response), whereas the other MVC fibers were initially strongly excited (type 2 response). MVC units with types 1 and 2 responses were present in the same nerve fascicle. Barosensitivity was equivalent in the two groups, but fibers showing type 1 responses fired significantly faster than those giving type 2 responses (0.29 ± 0.04 vs. 0.20 ± 0.02 Hz). Nerve fibers with type 1 responses were most common in the hindlimb (21 of 29 units) and least common in the face (2 of 11 units), the difference in relative proportion being significant ( P < 0.05, χ2 test). These results support the hypothesis that VSR are anatomically patterned.

scholarly journals Research on a Face Real-time Tracking Algorithm Based on Particle Filter Multi-Feature Fusion

Sensors ◽  
2019 ◽  
Vol 19 (5) ◽  
pp. 1245 ◽  
Author(s):  
Tao Wang ◽  
Wen Wang ◽  
Hui Liu ◽  
Tianping Li
Keyword(s):  
Big Data ◽  
Particle Filter ◽  
Skin Color ◽  
Feature Fusion ◽  
Average Distance ◽  
Histogram Method ◽  
Face Features ◽  
The Face ◽  
Edge Features ◽  
Tracking Object

With the revolutionary development of cloud computing and internet of things, the integration and utilization of “big data” resources is a hot topic of the artificial intelligence research. Face recognition technology information has the advantages of being non-replicable, non-stealing, simple and intuitive. Video face tracking in the context of big data has become an important research hotspot in the field of information security. In this paper, a multi-feature fusion adaptive adjustment target tracking window and an adaptive update template particle filter tracking framework algorithm are proposed. Firstly, the skin color and edge features of the face are extracted in the video sequence. The weighted color histogram are extracted which describes the face features. Then we use the integral histogram method to simplify the histogram calculation of the particles. Finally, according to the change of the average distance, the tracking window is adjusted to accurately track the tracking object. At the same time, the algorithm can adaptively update the tracking template which improves the accuracy and accuracy of the tracking. The experimental results show that the proposed method improves the tracking effect and has strong robustness in complex backgrounds such as skin color, illumination changes and face occlusion.

Sign in / Sign up

Export Citation Format

Share Document