scholarly journals An Exploration of Augmented Reality in Computer Assisted Orthopaedic Surgery

10.29007/72d4 ◽  
2018 ◽  
Author(s):  
He Liu ◽  
Edouard Auvinet ◽  
Joshua Giles ◽  
Ferdinando Rodriguez Y Baena
Keyword(s):  
Augmented Reality ◽  
Three Dimensional ◽  
Hole Drilling ◽  
Depth Information ◽  
Computer Assisted ◽  
Pilot Hole ◽  
Surgical Workflow ◽  
Processing Depth ◽  
Computer Assisted Orthopaedic Surgery ◽  
Preoperative Plan

Computer Aided Surgery (CAS) is helpful, but it clutters an already overcrowded operating theatre, and tends to disrupt the workflow of conventional surgery. In order to provide seamless computer assistance with improved immersion and a more natural surgical workflow, we propose an augmented-reality based navigation system for CAS. Here, we choose to focus on the proximal femoral anatomy, which we register to a plan by processing depth information of the surgical site captured by a commercial depth camera. Intra-operative three-dimensional surgical guidance is then provided to the surgeon through a commercial augmented reality headset, to drill a pilot hole in the femoral head, so that the user can perform the operation without additional physical guides. The user can interact intuitively with the system by simple gestures and voice commands, resulting in a more natural workflow. To assess the surgical accuracy of the proposed setup, 30 experiments of pilot hole drilling were performed on femur phantoms. The position and the orientation of the drilled guide holes were measured and compared with the preoperative plan, and the mean errors were within 2mm and 2°, results which are in line with commercial computer assisted orthopedic systems today.

Frequency Shift in Drilling due to Margin Engagement

2005 ◽  
Vol 127 (2) ◽  
pp. 271-276 ◽  
Author(s):  
D. N. Dilley ◽  
D. A. Stephenson ◽  
P. V. Bayly ◽  
A. J. Schaut
Keyword(s):  
Frequency Shift ◽  
Three Dimensional ◽  
Hole Drilling ◽  
Frequency Increase ◽  
Element Analysis ◽  
Pilot Hole ◽  
Frequency Matching ◽  
The Past ◽  
Chatter Prediction ◽  
Embedded Model

Drill chatter degrades hole roundness, hole size, and tool life. This wastes time and money in tools, scrap, and hole rework. Chatter prediction in milling and turning has shown significant benefit to industry; however, researchers have been unable to accurately predict chatter in drilling applications. In the past, the drill, including the chisel edge, was modeled as either a fixed-fixed or fixed-pinned beam (Tekinalp, O., and Ulsoy, A. G., 1989, “Modeling and Finite Element Analysis of Drill Bit Vibrations,” ASME J. Eng. Indust. 111, pp. 148–154), but more recent research (Dilley, D. N., Bayly, P. V., and Schaut, A. J., 2005, “Effects of the Chisel Edge on the Chatter Frequency in Drilling,” J. Sound Vib., 281, pp. 423–428) has shown that a fixed-embedded model using springs improves frequency matching. The effects of the drill margins on dynamics have not been studied. The fixed-fixed or fixed-pinned model will be shown to be inappropriate for modeling the effects of margin engagement, while the spring-end boundary condition can better approximate the frequency increase observed experimentally as the drill margins engage deeper into the hole. In addition, the shifted frequency is well below the frequency found from an analytical fixed-fixed or fixed-pinned beam. Evidence that the margins cause the frequency shift is seen in three-dimensional waterfall plots that show this shift for pilot hole drilling (in which the margins are engaged), but not for tube drilling (in which margins are not engaged).

scholarly journals Virtual reality and augmented reality applications and simulation in vascular access management with three-dimensional visualization

2019 ◽  
Vol 20 (1_suppl) ◽  
pp. 65-70
Author(s):  
Itsuo Yokoyama ◽  
Tsuyosi Sarai ◽  
Toshinori Asai ◽  
Nobuyuki Kitou ◽  
Hirotaka Nozaki ◽  
...  
Keyword(s):  
Virtual Reality ◽  
Augmented Reality ◽  
Vascular Access ◽  
Three Dimensional ◽  
Computer Assisted ◽  
Access Management ◽  
Computer Assisted Tomography ◽  
Graphics Software ◽  
Anatomical Information ◽  
Tomography Scan

Obtaining adequate and precise anatomical information is mandatory to prevent vascular access–related complications in dialysis patients. For this purpose, we underwent Doppler ultrasound, vascular access angiogram, and plain computer-assisted tomography scan of the arm with vascular access. With the use of computer graphics software, the anatomical structure of the vascular access can be visualized three dimensionally which is shared among the staffs for precise and better recognition. Furthermore, created object is applicable for virtual reality and/or augmented reality presentation that provides useful means for education and practical procedures in the management of vascular access.

scholarly journals Interventional 3D Augmented Reality in Orthopedic, Trauma and Vascular Surgery

2018 ◽  
Vol 8 (2) ◽  
pp. 25-29
Author(s):  
Sheila Esmeralda Gonzalez-Reyna ◽  
Pascal Fallavollita
Keyword(s):  
Optimal Control ◽  
Augmented Reality ◽  
Mixed Reality ◽  
Computer Assisted ◽  
Orthopedic Trauma ◽  
Surgical Team ◽  
X Ray ◽  
Surgical Workflow ◽  
Video Images ◽  
Real Time Visualization

The Medical Education, Training and Computer Assisted Interventions (METRICS) Laboratory aims to integrate novel mixed-reality technologies with application in computer assisted interventions. We showcase two technologies with specific aims at optimizing surgical workflow and minimizing radiation exposure in orthopedic, trauma, and vascular surgeries. The first is an Augmented Reality C-arm fluoroscope, which provides intuitive real-time visualization by accurately overlaying X-ray to video images. The second is a ‘Desired-views’ user interface which resolves the challenges involved in the optimal control of C-arm fluoroscopes for their constant repositioning during surgery by either the interventionalist or the surgical team.

scholarly journals Trackerless 3D Ultrasound Stitching for Computer-Assisted Orthopaedic Surgery and Pelvic Fractures

10.29007/3wlw ◽  
2018 ◽  
Author(s):  
Prashant Pandey ◽  
Rafeef Abugharbieh ◽  
Antony J. Hodgson
Keyword(s):  
Pelvic Fracture ◽  
Orthopaedic Surgery ◽  
Intraoperative Imaging ◽  
Three Dimensional ◽  
3D Ultrasound ◽  
Field Of View ◽  
Surrounding Tissue ◽  
Computer Assisted ◽  
Surgical Guidance ◽  
Computer Assisted Orthopaedic Surgery

In pelvic fracture surgeries, percutaneous screws must be placed accurately for effective fixation and to prevent damage to surrounding tissue structures. Fluoroscopy is currently used to image the pelvis to provide guidance, but this produces harmful ionising radiation and does not allow three-dimensional (3D) visualisation. Ultrasound offers three-dimensional, non-ionising, real-time, and inexpensive imaging. It has thus emerged as an alternative to fluoroscopy for intraoperative imaging in computer-assisted orthopaedic surgery (CAOS). However, ultrasound-based surgical guidance is challenging because ultrasound produces inherently noisy images with limited field-of-view. While several techniques have been proposed to improve bone clarity in ultrasound scans, there is limited work on enhancing ultrasound’s field-of-view for CAOS. In particular, improving the field-of-view for surgical guidance for pelvic fracture surgeries would be needed to achieve accurate and reliable registration to preoperative data, and accurate screw placement in the pelvis.We propose and evaluate the feasibility of a trackerless method for stitching volumetric ultrasound to achieve an extended field-of-view. Stitching is performed using corresponding features in the overlap between three ultrasound volumes, extracted using an implementation of the 3D scale-invariant feature transform. The volumes are processed using confidence-map weighted phase symmetry detection. Alignment between the volumes is calculated using coherent point drift rigid registration.We succeeded in extending the field-of-view of 3D ultrasound by creating a 39×43×115mm volume from three initial overlapping volumes, with reasonable overall accuracy. We show a mean post-registration surface error of 0.54mm, compared to 0.33mm achieved by previous tracking-based stitching. Our method achieved a mean distance error of 5.1%, compared to 2% in a similar tracked and 3D SIFT-based technique. Our stitching method does not use tracking, thus contributing towards simpler surgical navigation.

scholarly journals Fusion Coding of 3D Real and Virtual Scenes Information for Augmented Reality-Based Holographic Stereogram

2021 ◽  
Vol 9 ◽  
Author(s):  
Yunpeng Liu ◽  
Xingpeng Yan ◽  
Xinlei Liu ◽  
Xi Wang ◽  
Tao Jing ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Three Dimensional ◽  
Depth Map ◽  
Depth Information ◽  
Sampling System ◽  
The Real ◽  
Coding Method ◽  
Holographic Stereogram ◽  
3D Scene ◽  
Instance Segmentation

In this paper, an optical field coding method for the fusion of real and virtual scenes is proposed to implement an augmented reality (AR)-based holographic stereogram. The occlusion relationship between the real and virtual scenes is analyzed, and a fusion strategy based on instance segmentation and depth determination is proposed. A real three-dimensional (3D) scene sampling system is built, and the foreground contour of the sampled perspective image is extracted by the Mask R-CNN instance segmentation algorithm. The virtual 3D scene is rendered by a computer to obtain the virtual sampled images as well as their depth maps. According to the occlusion relation of the fusion scenes, the pseudo-depth map of the real scene is derived, and the fusion coding of 3D real and virtual scenes information is implemented by the depth information comparison. The optical experiment indicates that AR-based holographic stereogram fabricated by our coding method can reconstruct real and virtual fused 3D scenes with correct occlusion and depth cues on full parallax.

scholarly journals Automatic Bone Surface Restoration for Markerless Computer-assisted Orthopaedic Surgery

2021 ◽  
Author(s):  
Xue Hu ◽  
Ferdinando Rodriguez y Baena
Keyword(s):  
Synthetic Data ◽  
Computer Assisted ◽  
Bone Surface ◽  
Tracking Accuracy ◽  
Surgical Workflow ◽  
Registration Algorithm ◽  
Computer Assisted Orthopaedic Surgery ◽  
Femur Geometry ◽  
Conventional Computer ◽  
Intact Femur

Abstract An automatic markerless knee tracking and registration algorithm has been proposed in the literature to avoid the marker insertion required by conventional computer-assisted knee surgery, resulting in a shorter and less invasive surgical workflow. However, such an algorithm considers intact femur geometry only. The bone surface modification is inevitable due to intra-operative intervention. The mismatched correspondences will degrade the reliability of registered target pose. To solve this problem, this work proposed a supervised deep neural network to automatically restore the surface of processed bone. The network was trained on a synthetic dataset that consists of real depth captures of a model leg and simulated realistic femur cutting. According to the evaluation on both synthetic data and real-time captures, the registration quality can be effectively improved by surface reconstruction. The improvement in tracking accuracy is only evident over test data, indicating the need for future enhancement of the dataset and network.

scholarly journals Augmented-Reality within Computer Assisted Orthopaedic Surgery Workflows: A Proof of Concept Study

10.29007/dswz ◽  
2019 ◽  
Author(s):  
Hisham Iqbal ◽  
Fabio Tatti ◽  
Ferdinando Rodriguez Y Baena
Keyword(s):  
Augmented Reality ◽  
Qualitative Evaluation ◽  
Computer Assisted Surgery ◽  
Medical Robotics ◽  
Patient Specific ◽  
Computer Assisted ◽  
Specific Data ◽  
Cluttered Environment ◽  
Computer Assisted Orthopaedic Surgery ◽  
Completion Times

The integration of augmented-reality (AR) in medical robotics has been shown to reduce cognitive burden and improve information management in the typically cluttered environment of computer-assisted surgery. A key benefit of such systems is the ability to generate a composite view of medical-informatics and the real environment, streamlining the pathway for delivering patient-specific data. Consequently, AR was integrated within an orthopaedic setting by designing a system that captured and replicated the user- interface of a commercially available surgical robot onto a commercial head mounted see through display. Thus, a clinician could simultaneously view the operating-site and real- time informatics when carrying out an assisted patellofemoral-arthroplasty (PFA). The system was tested with 10 surgeons to examine its usability and impact on procedure- completion times when conducting simulated PFA on sawbone models. A statistically insignificant mean increase in procedure completion-time (+23.7s, p=0.240) was found, and the results of a post-operative qualitative-evaluation indicated a strongly positive consensus on the system, with a large majority of subjects agreeing the system provided value to the procedure without incurring noticeable physical discomfort. Overall, this study provides an encouraging insight into the high levels of engagement AR has with a clinical audience as well as its ability to enhance future generations of medical robotics.

scholarly journals A Novel Computer-Assisted Workflow for Treatment of Osteochondral Lesions in the Knee

10.29007/m4z1 ◽  
2020 ◽  
Author(s):  
Fabio Tatti ◽  
Hisham Iqbal ◽  
Branislav Jaramaz ◽  
Ferdinando Rodriguez Y Baena
Keyword(s):  
Surgical Planning ◽  
Surgical Instruments ◽  
Osteochondral Lesions ◽  
Computer Assisted ◽  
Osteochondral Defects ◽  
Surgical Workflow ◽  
Computer Assisted Orthopaedic Surgery ◽  
Accuracy And Repeatability ◽  
Cause Of Pain ◽  
Surgical System

Computer-Assisted Orthopaedic Surgery (CAOS) is now becoming more prevalent, especially in knee arthroplasty. CAOS systems have the potential to improve the accuracy and repeatability of surgical procedures by means of digital preoperative planning and intraoperative tracking of the patient and surgical instruments.One area where the accuracy and repeatability of computer-assisted interventions could prove especially beneficial is the treatment of osteochondral defects (OCD). OCDs represent a common problem in the patient population, and are often a cause of pain and discomfort. The use of synthetic implants is a valid option for patients who cannot be treated with regenerative methods, but the outcome can be negatively impacted by incorrect positioning of the implant and lack of congruency with the surrounding anatomy.In this paper, we present a novel computer-assisted surgical workflow for the treatment of osteochondral defects. The software we developed automatically selects the implant that most closely matches the patient’s anatomy and computes the best pose. By combining this software with the existing capabilities of the Navio™ surgical system (Smith & Nephew inc.), we were able to create a complete workflow that incorporates both surgical planning and assisted bone preparation.Our preliminary testing on plastic bone models was successful and demonstrated that the workflow can be used to select and position an appropriate implant for a given defect.

scholarly journals Projector-Based Augmented Reality System for Computer Assisted Orthopaedic Surgery

10.29007/9sb7 ◽  
2020 ◽  
Author(s):  
Yuan Gao ◽  
Le Xie ◽  
Guoyan Zheng
Keyword(s):  
Augmented Reality ◽  
Orthopaedic Surgery ◽  
Clinical Information ◽  
Computer Assisted ◽  
Alignment Error ◽  
Augmented Reality System ◽  
Projection Distance ◽  
Computer Assisted Orthopaedic Surgery ◽  
3D Printed

This paper presents a projector-based augmented reality (AR) system for Computer- Assisted Orthopaedic Surgery (CAOS). After calibration, our AR system allows for projection of not only the virtual model directly on the surface of the target organ to create an augmented reality but also important clinical information such as distance and angular deviations from a surgical plan, which are important for various computer-assisted surgical procedures such as trajectory drilling and fracture reduction. The feasibility and accuracy of the system is experimentally validated on a 3D printed phantom model with pyramid shape, a dry goat bone and an in vitro pig leg. An average projection distance error of 1.03±0.58mm and an average drill alignment error of 1.17±0.43°were found. The results demonstrate the efficacy of the proposed AR system.

scholarly journals Combining Augmented Reality and 3D Printing to Improve Surgical Workflows in Orthopedic Oncology: Smartphone Application and Clinical Evaluation

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1370
Author(s):  
Rafael Moreta-Martinez ◽  
Alicia Pose-Díez-de-la-Lastra ◽  
José Antonio Calvo-Haro ◽  
Lydia Mediavilla-Santos ◽  
Rubén Pérez-Mañanes ◽  
...  
Keyword(s):  
Augmented Reality ◽  
3D Printing ◽  
Surgical Navigation ◽  
Three Dimensional ◽  
Smartphone Application ◽  
Navigation Systems ◽  
Surgical Workflow ◽  
Orthopedic Oncology ◽  
Innovative Solution ◽  
3D Printed

During the last decade, orthopedic oncology has experienced the benefits of computerized medical imaging to reduce human dependency, improving accuracy and clinical outcomes. However, traditional surgical navigation systems do not always adapt properly to this kind of interventions. Augmented reality (AR) and three-dimensional (3D) printing are technologies lately introduced in the surgical environment with promising results. Here we present an innovative solution combining 3D printing and AR in orthopedic oncological surgery. A new surgical workflow is proposed, including 3D printed models and a novel AR-based smartphone application (app). This app can display the patient’s anatomy and the tumor’s location. A 3D-printed reference marker, designed to fit in a unique position of the affected bone tissue, enables automatic registration. The system has been evaluated in terms of visualization accuracy and usability during the whole surgical workflow. Experiments on six realistic phantoms provided a visualization error below 3 mm. The AR system was tested in two clinical cases during surgical planning, patient communication, and surgical intervention. These results and the positive feedback obtained from surgeons and patients suggest that the combination of AR and 3D printing can improve efficacy, accuracy, and patients’ experience.

Sign in / Sign up

Export Citation Format

Share Document