scholarly journals A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery

Sensors ◽  
2021 ◽  
Vol 21 (9) ◽  
pp. 2931
Author(s):  
Yuan Gao ◽  
Yuyun Zhao ◽  
Le Xie ◽  
Guoyan Zheng

In the medical field, guidance to follow the surgical plan is crucial. Image overlay projection is a solution to link the surgical plan with the patient. It realizes augmented reality (AR) by projecting computer-generated image on the surface of the target through a projector, which can visualize additional information to the scene. By overlaying anatomical information or surgical plans on the surgery area, projection helps to enhance the surgeon’s understanding of the anatomical structure, and intuitively visualizes the surgical target and key structures of the operation, and avoid the surgeon’s sight diversion between monitor and patient. However, it still remains a challenge to project the surgical navigation information on the target precisely and efficiently. In this study, we propose a projector-based surgical navigation system. Through the gray code-based calibration method, the projector can be calibrated with a camera and then be integrated with an optical spatial locator, so that the navigation information of the operation can be accurately projected onto the target area. We validated the projection accuracy of the system through back projection, with average projection error of 3.37 pixels in x direction and 1.51 pixels in y direction, and model projection with an average position error of 1.03 ± 0.43 mm, and carried out puncture experiments using the system with correct rate of 99%, and qualitatively analyzed the system’s performance through the questionnaire. The results demonstrate the efficacy of our proposed AR system.

2021 ◽  
pp. 105566562110577
Author(s):  
Yuying Zhang ◽  
Jiawei Dai ◽  
Xiazhou Fu ◽  
Jiegang Yang ◽  
Yuchuan Fu ◽  
...  

Objectives: To present the use of dynamic navigation system in the repair of alveolar cleft. Patients and Participants: A total of three non-syndromic patients with unilateral alveolar cleft were involved in this study. Real-time computer-aided navigation were used to achieve restoration and reconstruction with standardized surgical technique. Methods: With the individual virtual 3-dimensional (3-D) modeling based on computed tomography (CT) data, preoperative planning and surgical simulation were carried out with the navigation system. During preoperative virtual planning, the defect volume or the quantity of graft is directly assessed at the surgical region. With the use of this system, the gingival periosteum flap incision can be tracked in real-time, and the bone graft can be navigated under the guidance of the 3-D views until it matches the preoperatively planned position. Results: Three patients with alveolar cleft were successfully performed under navigation guidance. Through the model alignment procedure, accurate matches between the actual intraoperative position and the CT images were achieved within the systematic error of 0.3 mm. The grafted bone was implanted according to the preoperative plan with the aid of instrument- and probe-based navigation. All the patients were healed well without serious complications. Conclusions: These findings suggest that image-guided surgical navigation, including preoperative planning, surgical simulation, postoperative assessment, and computer-assisted navigation was feasible and yielded good clinical outcomes. Clinical relevance: This dynamic navigation could be proved to be a valuable option for this complicated surgical procedure in the management of alveolar cleft repair.


2020 ◽  
Vol 19 (1) ◽  
Author(s):  
Long Chen ◽  
Fengfeng Zhang ◽  
Wei Zhan ◽  
Minfeng Gan ◽  
Lining Sun

Abstract Background The traditional navigation interface was intended only for two-dimensional observation by doctors; thus, this interface does not display the total spatial information for the lesion area. Surgical navigation systems have become essential tools that enable for doctors to accurately and safely perform complex operations. The image navigation interface is separated from the operating area, and the doctor needs to switch the field of vision between the screen and the patient’s lesion area. In this paper, augmented reality (AR) technology was applied to spinal surgery to provide more intuitive information to surgeons. The accuracy of virtual and real registration was improved via research on AR technology. During the operation, the doctor could observe the AR image and the true shape of the internal spine through the skin. Methods To improve the accuracy of virtual and real registration, a virtual and real registration technique based on an improved identification method and robot-assisted method was proposed. The experimental method was optimized by using the improved identification method. X-ray images were used to verify the effectiveness of the puncture performed by the robot. Results The final experimental results show that the average accuracy of the virtual and real registration based on the general identification method was 9.73 ± 0.46 mm (range 8.90–10.23 mm). The average accuracy of the virtual and real registration based on the improved identification method was 3.54 ± 0.13 mm (range 3.36–3.73 mm). Compared with the virtual and real registration based on the general identification method, the accuracy was improved by approximately 65%. The highest accuracy of the virtual and real registration based on the robot-assisted method was 2.39 mm. The accuracy was improved by approximately 28.5% based on the improved identification method. Conclusion The experimental results show that the two optimized methods are highly very effective. The proposed AR navigation system has high accuracy and stability. This system may have value in future spinal surgeries.


Sign in / Sign up

Export Citation Format

Share Document