scholarly journals An Automatic Marker–Object Offset Calibration Method for Precise 3D Augmented Reality Registration in Industrial Applications

2019 ◽  
Vol 9 (20) ◽  
pp. 4464 ◽  
Author(s):  
Xuyue Yin ◽  
Xiumin Fan ◽  
Xu Yang ◽  
Shiguang Qiu ◽  
Zhinan Zhang
Keyword(s):  
Augmented Reality ◽  
Calibration Method ◽  
Industrial Applications ◽  
Target Object ◽  
Initial Position ◽  
Normal Direction ◽  
3D Image ◽  
3D Tracking ◽  
Registration Method ◽  
Calibration Tool

Industrial augmented reality (AR) applications demand high on the visual consistency of virtual-real registration. To present, the marker-based registration method is most popular because it is fast, robust, and convenient to obtain the registration matrix. In practice, the registration matrix should multiply an offset matrix that describes the transformation between the attaching position and the initial position of the marker relative to the object. However, the offset matrix is usually measured, calculated, and set manually, which is not accurate and convenient. This paper proposes an accurate and automatic marker–object offset matrix calibration method. First, the normal direction of the target object is obtained by searching and matching the top surface of the CAD model. Then, the spatial translation is estimated by aligning the projected and the imaged top surface. Finally, all six parameters of the offset matrix are iteratively optimized using a 3D image alignment framework. Experiments were performed on the publicity monocular rigid 3D tracking dataset and an automobile gearbox. The average translation and rotation errors of the optimized offset matrix are 2.10 mm and 1.56 degree respectively. The results validate that the proposed method is accurate and automatic, which contributes to a universal offset matrix calibration tool for marker-based industrial AR applications.

scholarly journals Detecting the normal-direction in automated aircraft manufacturing based on adaptive alignment

2020 ◽  
Vol 103 (4) ◽  
pp. 003685042098121
Author(s):  
Ying Zhang ◽  
Hongchang Ding ◽  
Changfu Zhao ◽  
Yigen Zhou ◽  
Guohua Cao
Keyword(s):  
Calibration Method ◽  
Adaptive Method ◽  
Normal Direction ◽  
Detection Accuracy ◽  
Average Deviation ◽  
Important Indicator ◽  
Aircraft Manufacturing ◽  
Direction Detection ◽  
Hole Making ◽  
Vertical Accuracy

In aircraft manufacturing, the vertical accuracy of connection holes is important indicator of the quality of holes making. Aircraft products have high requirements for the vertical accuracy of holes positions. When drilling and riveting are performed by an automatic robotic system, assembly errors, bumps, offsets and other adverse conditions, can affects the accuracy of manufacturing and detection, and in turn the fatigue performance of the entire structure. To solve this problem, we proposed a technology for detecting the normal-direction based on the adaptive alignment method, built a mathematical model for posture alignment, and studied the calibration method and mechanism of the detection device. Additionally, we investigated techniques for error compensation using an electronic theodolite and other devices when the adaptive method is used for detection. In verification experiments of the method, multiple sets of results demonstrated that the key technical indicators are as follows: normal accuracy <0.5°, average deviation after correction =0.0667°. This method can effectively compensate the errors affecting hole making work in automated manufacturing, and further improve the positioning accuracy and normal-direction detection accuracy of the robot.

Augmented Reality Overlay System for Computer-guided Needle Procedures

1969 ◽  
Author(s):  
Zachary Baum
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Region Of Interest ◽  
Calibration Method ◽  
Position Error ◽  
Ct Image ◽  
Entire System ◽  
Projected Image ◽  
Needle Interventions

Purpose: Augmented reality overlay systems can be used to project a CT image directly onto a patient during procedures. They have been actively trialed for computer-guided procedures, however they have not become commonplace in practice due to restrictions of previous systems. Previous systems have not been handheld, and have had complicated calibration procedures. We put forward a handheld tablet-based system for assisting with needle interventions. Methods: The system consists of a tablet display and a 3-D printed reusable and customizable frame. A simple and accurate calibration method was designed to align the patient to the projected image. The entire system is tracked via camera, with respect to the patient, and the projected image is updated in real time as the system is moved around the region of interest. Results: The resulting system allowed for 0.99mm mean position error in the plane of the image, and a mean position error of 0.61mm out of the plane of the image. This accuracy was thought to be clinically acceptable for tool using computer-guidance in several procedures that involve musculoskeletal needle placements. Conclusion: Our calibration method was developed and tested using the designed handheld system. Our results illustrate the potential for the use of augmented reality handheld systems in computer-guided needle procedures. 

scholarly journals The Design of Augmented Reality Using Unity 3D Image Marker Detection for Smart Bus Transportation

2021 ◽  
Vol 15 (17) ◽  
pp. 33
Author(s):  
Murizah Kassim ◽  
Ahmad Syafiq Aiman A Bakar
Keyword(s):  
Augmented Reality ◽  
Public Transportation ◽  
Mobile Application ◽  
Positive Impact ◽  
Smartphone Application ◽  
3D Image ◽  
Unity 3D ◽  
Bus Services ◽  
Marker Detection ◽  
Bus Transportation

Public bus transportation has become an integral part of society, but the disrup-tion of bus services is one of the major concerns. This project presents the devel-opment of Smart Bus Transportation using Augmented Reality (TRANSPAR) that was developed on a mobile application. One of the major issues with public transportation is on real-time responsiveness. Most bus schedules are presented online but customers still faced many failures. Some bus schedules are not updat-ed when changes happened through time. Some existing bus schedules system is fixed to the bus stations. This research is to identify the bus schedules and its routes characteristics. A 3D AR animation based on identified characteristics was designed using the Unity 3D image marker detection on a mobile Android plat-form. A smartphone application was developed using Vuforia and Google Fire-base. TRANSPAR shows an AR mobile application for acquiring the bus time-tables. The phone camera is applied for marker image detection and scanning the bus station’s images. AR and normal image scanner were designed. Google Fire-base Database is used to retrieve and store each timetable data for every bus sta-tion. Analysis of interactivity and benefits of TRANSPAR shows about 90% agreed on the use of AR and more than 76% agreed on its functionality based on 50 taken samples. This shows a positive impact on the designed TRANSPAR. The research is significant to encourage and experience the public with new tech-nological application for public transportation and it impact the society.

scholarly journals A Fast Medical 3D Image Registration Method Based on a Parametric Representation

2009 ◽  
Vol 129 (9) ◽  
pp. 1699-1704
Author(s):  
Yoshito MEKADA ◽  
Kousuke Hirasawa ◽  
Kazuhiko Sumi ◽  
Hiroshi MURASE
Keyword(s):  
Image Registration ◽  
Parametric Representation ◽  
3D Image ◽  
Registration Method ◽  
3D Image Registration

Calibration method for initial position of miss distance in femtosecond laser tracker

2017 ◽  
Vol 46 (1) ◽  
pp. 117001 ◽  
Author(s):  
崔成君 Cui Chengjun ◽  
劳达宝 Lao Dabao ◽  
董登峰 Dong Dengfeng ◽  
高强 Gao Qiang ◽  
周维虎 Zhou Weihu
Keyword(s):  
Femtosecond Laser ◽  
Calibration Method ◽  
Initial Position ◽  
Laser Tracker ◽  
Miss Distance

Augmented Reality Recognition Registration Method Based on Text Features

2020 ◽  
Vol 57 (2) ◽  
pp. 021502
Author(s):  
李雪婷 Li Xueting ◽  
党建武 Dang Jianwu ◽  
王阳萍 Wang Yangping ◽  
高凡一 Gao Fanyi
Keyword(s):  
Augmented Reality ◽  
Registration Method ◽  
Text Features

scholarly journals A Robust Registration Method for Autonomous Driving Pose Estimation in Urban Dynamic Environment Using LiDAR

Electronics ◽  
2019 ◽  
Vol 8 (1) ◽  
pp. 43 ◽  
Author(s):  
Rendong Wang ◽  
Youchun Xu ◽  
Miguel Angel Sotelo ◽  
Yulin Ma ◽  
Thompson Sarkodie-Gyan ◽  
...  
Keyword(s):  
Dynamic Environment ◽  
Point Clouds ◽  
Autonomous Driving ◽  
Initial Position ◽  
Urban Environments ◽  
Data Set ◽  
Registration Method ◽  
Position Errors ◽  
Initial Errors ◽  
High Dynamic

The registration of point clouds in urban environments faces problems such as dynamic vehicles and pedestrians, changeable road environments, and GPS inaccuracies. The state-of-the-art methodologies have usually combined the dynamic object tracking and/or static feature extraction data into a point cloud towards the solution of these problems. However, there is the occurrence of minor initial position errors due to these methodologies. In this paper, the authors propose a fast and robust registration method that exhibits no need for the detection of any dynamic and/or static objects. This proposed methodology may be able to adapt to higher initial errors. The initial steps of this methodology involved the optimization of the object segmentation under the application of a series of constraints. Based on this algorithm, a novel multi-layer nested RANSAC algorithmic framework is proposed to iteratively update the registration results. The robustness and efficiency of this algorithm is demonstrated on several high dynamic scenes of both short and long time intervals with varying initial offsets. A LiDAR odometry experiment was performed on the KITTI data set and our extracted urban data-set with a high dynamic urban road, and the average of the horizontal position errors was compared to the distance traveled that resulted in 0.45% and 0.55% respectively.

Sign in / Sign up

Export Citation Format

Share Document