scholarly journals Three-Dimensional Face Reconstruction Using Multi-View-Based Bilinear Model

Sensors ◽  
2019 ◽  
Vol 19 (3) ◽  
pp. 459
Author(s):  
Liang Tian ◽  
Jing Liu ◽  
Wei Guo

Face reconstruction is a popular topic in 3D vision system. However, traditional methods often depend on monocular cues, which contain few feature pixels and only use their location information while ignoring a lot of textural information. Furthermore, they are affected by the accuracy of the feature extraction method and occlusion. Here, we propose a novel facial reconstruction framework that accurately extracts the 3D shapes and poses of faces from images captured at multi-views. It extends the traditional method using the monocular bilinear model to the multi-view-based bilinear model by incorporating the feature prior constraint and the texture constraint, which are learned from multi-view images. The feature prior constraint is used as a shape prior to allowing us to estimate accurate 3D facial contours. Furthermore, the texture constraint extracts a high-precision 3D facial shape where traditional methods fail because of their limited number of feature points or the mostly texture-less and texture-repetitive nature of the input images. Meanwhile, it fully explores the implied 3D information of the multi-view images, which also enhances the robustness of the results. Additionally, the proposed method uses only two or more uncalibrated images with an arbitrary baseline, estimating calibration and shape simultaneously. A comparison with the state-of-the-art monocular bilinear model-based method shows that the proposed method has a significantly higher level of accuracy.

2014 ◽  
Vol 577 ◽  
pp. 1008-1011
Author(s):  
Chao Hui Lü ◽  
Jia Ying Pan ◽  
Chen Zhang ◽  
Hui Ren

Three-dimensional video technology is becoming more and more popular, because it can provide a better natural depth perception. In this paper, a stereoscopic video player for a time-division display is designed and implemented, and people can use 3D Shutter Glasses to watch stereoscopic video by the player. It mainly focuses on the process of designing a Direct3D application, and the special handling of NVIDIA 3D Vision system for stereoscopic video. Upon examination, the stereoscopic video player can provide stereoscopic perception and good immersive experience.


2011 ◽  
Vol 177 ◽  
pp. 1-9 ◽  
Author(s):  
Józef Bednarczyk ◽  
Andrzej Sioma

This paper discusses a visual method of measuring the geometric parameters of elements produced by electrodynamic stamping. This paper presents also electrodynamic method which is an unconventional machining technology, which complements the capabilities of traditional technologies, in particular as regards the formation of metal elements with low-profile dies of complex shape. The article discusses issues related to resolution of the vision system, resolution of laser beam analysis, and resolution relating to the measurement of the height profile on the surface of the product. Based on the model constructed in such a way, measurements are presented in order to assess the dimensional parameters. Based on tests and analyses of the three-dimensional model, a range of inspection tasks using 3D vision systems is indicated.


Author(s):  
XIUQING YE ◽  
JILIN LIU ◽  
WEIKANG GU

In this paper an integrated vision system for autonomous land vehicle is described. The vision system includes 2D and 3D vision modules and information fusion module. The task of 2D vision is to provide the physical and geometry information of road, and the task of 3D vision system is to detect the obstacles in the surrounding. Fusion module combines 2D and 3D information to generate a feasible region provided for vehicle navigation.


2013 ◽  
Vol 437 ◽  
pp. 471-474
Author(s):  
Zhuo Wu ◽  
Ke Yi Sun ◽  
Ming Song ◽  
Min Zheng

Shortages of skilled labor,extensive dangerous work,and technological advances are forcing rapid change in the construction industry, thus motivating construction automation,research and development of unmanned execution technologies for use to enhance safety has been undertaken.This paper presents an outline of research and development concerning automation of hydraulic excavator performed by applying a 3D vision system,3D information control system, a safety system, a 3D measurement system,and an operator interface communication system.As a result of the verification of the excavation motion suggest the technical possibility of achieving autonomous robotic excavation in moving toward construction automation.


Author(s):  
Yang Qi ◽  
◽  
Yuan Li

Efficient and precise three-dimensional (3D) measurement is an important issue in the field of machine vision. In this paper, a measurement method for indoor key points is proposed with structured lights and omnidirectional vision system and the system can achieve the wide field of view and accurate results. In this paper, the process of obtaining indoor key points is as follows: Firstly, through the analysis of the system imaging model, an omnidirectional vision system based on structured light is constructed. Secondly, the full convolution neural network is used to estimate the scene for the dataset. Then, according to the geometric relationship between the scenery point and its reference point in structured light, for obtaining the 3D coordinates of the unstructured light point is presented. Finally, combining the full convolution network model and the structured light 3D vision model, the 3D mathematical representation of the key points of the indoor scene frame is completed. The experimental results proved that the proposed method can accurately reconstruct indoor scenes, and the measurement error is about 2%.


2014 ◽  
Vol 678 ◽  
pp. 290-294
Author(s):  
Ai Hua Chen ◽  
Bing Wei He ◽  
Cheng Hui Gao

In this paper, the artificial compound eye vision system is used to develop an effective algorithm for acquiring 3D information of object. According to compound eye vision system constructed, the imaging principle and correlation between the object point and the imaging point is analyzed. Then the cross correlation matching algorithm is present to extract the depth and obtain the 3D information. The influence factors such as number of matched elemental images and matching window size are considered and analyzed. The experimental is implemented to verify the validity of the proposed method.


2011 ◽  
Vol 177 ◽  
pp. 125-134 ◽  
Author(s):  
Andrzej Sioma ◽  
Andrzej Tytko

This paper discusses a visual method of measuring the geometric parameters of ropes and evaluating their wear based on measurements of a three-dimensional rope model. The 3D model is created using the method of laser triangulation. Selection of appropriate geometry of camera and laser lighting arrangement allows collection of the height profile of the observed rope surface in the selected cross-section and, subsequently, building of a 3D model. The resulting model is a representation of the actual dimensions of the rope and allows determination of the parameters describing its basic geometric dimensions and condition of rope surface. Determination of those values and parameters allows estimation of the degree of rope wear. The article discusses issues related to resolution of the vision system, resolution of laser beam analysis, and resolution relating to the measurement of the height profile on the surface of the rope. Based on the model constructed in such a way, measurements are presented in order to assess the dimensional parameters and surface defects in sample rope structures. Based on tests and analyses of the three-dimensional model, a range of inspection tasks using 3D vision systems is indicated.


Inventions ◽  
2019 ◽  
Vol 4 (4) ◽  
pp. 58
Author(s):  
Svenner ◽  
Fan ◽  
Forsman ◽  
Shabo ◽  
Hallbeck ◽  
...  

In laparoscopy, novel three-dimensional laparoscopic vision systems (3D LVS) without glasses (3D−) have been invented. While standard 3D LVS with glasses (3D+) have shown advantages over original two-dimensional systems, quantitative comparisons of surgical performance between 3D− and 3D+ systems are still lacking. The aim is to compare the systems in simulated robotic surgery tasks. In a crossover study, 18 medical students performed four basic laparoscopic tasks in the validated Simball Box simulator with authentic surgical instruments by using the 3D+ and 3D− systems. Performance was measured by the number of errors and the task’s duration. Subjective ratings of perceptions and preference were assessed after each test. There were significant, but still minor, advantages for the conventional 3D+ system regarding spatial orientation and sense of depth. Overall, ten and eight subjects preferred 3D+ and 3D− systems, respectively. No significant differences were found in performance, post-operative physicals or eye symptoms. The novel 3D− system was similar to the conventional 3D+ system regarding performance and overall preference, while there were minor advantages for the 3D+ system in the subjective ratings. Since the 3D− system is a new invention, it should have a higher potential of usability improvements.


2013 ◽  
Vol 58 (3) ◽  
pp. 643-654 ◽  
Author(s):  
Grzegorz Olszyna ◽  
Andrzej Sioma ◽  
Andrzej Tytko

Abstract This article discusses a vision method of measuring the geometric parameters of ropes and evaluating their wear based on measurements made in a three-dimensional projection of rope surface. The purposes of this method include assessment of the condition of all kinds of ropes working in the mining industry. The proposed method is novel, eliminates the shortcomings of previously used mandatory visual methods, removes their constraints, and is an important complement to magnetic methods. The article discusses the method of construction of a three-dimensional image based on mapping of the actual dimensions of the rope and on algorithms that allow determination of the parameters describing its basic geometrical dimensions and surface condition. The article discusses issues related to resolution of the vision system, resolution of laser beam analysis, and resolution relating to the measurement of the height profile on the surface of the rope. Based on the image constructed in such a way, measurements are presented in order to assess the dimensional parameters and surface defects in sample rope structures. Based on tests and analyses of the three-dimensional image, a range of inspection tasks using 3D vision systems is indicated.


2021 ◽  
Vol 13 (3) ◽  
pp. 223-231
Author(s):  
S Restaino ◽  
V Vargiu ◽  
A Rosati ◽  
M Bruno ◽  
G Dinoi ◽  
...  

Background: The introduction of ultra-high-definition laparoscopic cameras (4K), by providing stronger monocular depth perception, could challenge the existing 3D technology. There are few available studies on this topic, especially in gynaecological setting. Objectives: Prospective, single institution, randomised clinical trial (NCT04209036). Materials and Methods: The two laparoscopes utilised were the 0°ULTRA Telescopes with 4K technology and the 0°3D-HD by Olympus. The surgeons were all trainees and in their last year of residency and who had obtained the certificate of first or second level of the Gynaecological Endoscopic Surgical Education and Assessment program - GESEA program. Twenty-nine patients with benign uterine pathology were enrolled. Main outcome measures: To compare if the use three-dimensional (3D) versus ultra-high-definition laparoscopic vision system (4K) for total laparoscopic hysterectomy performed by trainees was associated with a shorter operative time. Results: The 3D vision system did not prove to be superior to the 4K vision system. Operators reported significantly more vision-related side effects when using 3D than 4K. Completing the GESEA training program was the only factor with a positive and statistically significant impact on the overall time of the procedure, especially when greater dexterity and tissue handling were required. Conclusions: Neither technology used proved superior to the other, although operators showed a preference for 4K over 3D due to the lower number of visual side effects. Attendance at courses on laparoscopic simulators and training programs allowed trainees to demonstrate excellent surgical skills.


Sign in / Sign up

Export Citation Format

Share Document