Are today's Mixed Reality experience pillars and hardware architectures well aligned with the specific needs of medical imaging and surgical guidance? (Conference Presentation)

2020 ◽  
Author(s):  
Bernard C. Kress
Keyword(s):  
Medical Imaging ◽  
Mixed Reality ◽  
Surgical Guidance ◽  
Hardware Architectures

Augmented and mixed reality for collaborative cardiac planning using 3D and 4D medical imaging data

2020 ◽  
Author(s):  
Didi-Liliana Popa ◽  
Mihai-Lucian Mocanu ◽  
Radu-Teodoru Popa ◽  
Lucian-Florentin Barbulescu ◽  
Linda Nicoleta Barbulescu ◽  
...  
Keyword(s):  
Medical Imaging ◽  
Mixed Reality ◽  
Imaging Data ◽  
Medical Imaging Data

scholarly journals Waveguide combiners for mixed reality headsets: a nanophotonics design perspective

Nanophotonics ◽  
2020 ◽  
Vol 10 (1) ◽  
pp. 41-74
Author(s):  
Bernard C. Kress ◽  
Ishan Chatterjee
Keyword(s):  
Visual Perception ◽  
Mixed Reality ◽  
Deep Understanding ◽  
Large Field ◽  
High Angular Resolution ◽  
List Type ◽  
Human Visual Perception ◽  
Perception System ◽  
Social Comfort ◽  
Hardware Architectures

AbstractThis paper is a review and analysis of the various implementation architectures of diffractive waveguide combiners for augmented reality (AR), mixed reality (MR) headsets, and smart glasses. Extended reality (XR) is another acronym frequently used to refer to all variants across the MR spectrum. Such devices have the potential to revolutionize how we work, communicate, travel, learn, teach, shop, and are entertained. Already, market analysts show very optimistic expectations on return on investment in MR, for both enterprise and consumer applications. Hardware architectures and technologies for AR and MR have made tremendous progress over the past five years, fueled by recent investment hype in start-ups and accelerated mergers and acquisitions by larger corporations. In order to meet such high market expectations, several challenges must be addressed: first, cementing primary use cases for each specific market segment and, second, achieving greater MR performance out of increasingly size-, weight-, cost- and power-constrained hardware. One such crucial component is the optical combiner. Combiners are often considered as critical optical elements in MR headsets, as they are the direct window to both the digital content and the real world for the user’s eyes.Two main pillars defining the MR experience are comfort and immersion. Comfort comes in various forms: –wearable comfort—reducing weight and size, pushing back the center of gravity, addressing thermal issues, and so on–visual comfort—providing accurate and natural 3-dimensional cues over a large field of view and a high angular resolution–vestibular comfort—providing stable and realistic virtual overlays that spatially agree with the user’s motion–social comfort—allowing for true eye contact, in a socially acceptable form factor.Immersion can be defined as the multisensory perceptual experience (including audio, display, gestures, haptics) that conveys to the user a sense of realism and envelopment. In order to effectively address both comfort and immersion challenges through improved hardware architectures and software developments, a deep understanding of the specific features and limitations of the human visual perception system is required. We emphasize the need for a human-centric optical design process, which would allow for the most comfortable headset design (wearable, visual, vestibular, and social comfort) without compromising the user’s sense of immersion (display, sensing, and interaction). Matching the specifics of the display architecture to the human visual perception system is key to bound the constraints of the hardware allowing for headset development and mass production at reasonable costs, while providing a delightful experience to the end user.

scholarly journals Telementoring in Leg Fasciotomies via Mixed-Reality: Clinical Evaluation of the STAR Platform

2020 ◽  
Vol 185 (Supplement_1) ◽  
pp. 513-520
Author(s):  
Edgar Rojas-Muñoz ◽  
Maria Eugenia Cabrera ◽  
Chengyuan Lin ◽  
Natalia Sánchez-Tamayo ◽  
Dan Andersen ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Mixed Reality ◽  
Confidence Score ◽  
Experimental Conditions ◽  
Surgical Guidance ◽  
Head Mounted Display ◽  
Operating Field ◽  
Life Saving ◽  
Health Practitioners ◽  
Expert Surgeon

ABSTRACT Introduction Point-of-injury (POI) care requires immediate specialized assistance but delays and expertise lapses can lead to complications. In such scenarios, telementoring can benefit health practitioners by transmitting guidance from remote specialists. However, current telementoring systems are not appropriate for POI care. This article clinically evaluates our System for Telementoring with Augmented Reality (STAR), a novel telementoring system based on an augmented reality head-mounted display. The system is portable, self-contained, and displays virtual surgical guidance onto the operating field. These capabilities can facilitate telementoring in POI scenarios while mitigating limitations of conventional telementoring systems. Methods Twenty participants performed leg fasciotomies on cadaveric specimens under either one of two experimental conditions: telementoring using STAR; or without telementoring but reviewing the procedure beforehand. An expert surgeon evaluated the participants’ performance in terms of completion time, number of errors, and procedure-related scores. Additional metrics included a self-reported confidence score and postexperiment questionnaires. Results STAR effectively delivered surgical guidance to nonspecialist health practitioners: participants using STAR performed fewer errors and obtained higher procedure-related scores. Conclusions This work validates STAR as a viable surgical telementoring platform, which could be further explored to aid in scenarios where life-saving care must be delivered in a prehospital setting.

scholarly journals Hardware Architectures for Real-Time Medical Imaging

Electronics ◽  
2021 ◽  
Vol 10 (24) ◽  
pp. 3118
Author(s):  
Eduardo Alcaín ◽  
Pedro R. Fernández ◽  
Rubén Nieto ◽  
Antonio S. Montemayor ◽  
Jaime Vilas ◽  
...  
Keyword(s):  
Medical Imaging ◽  
Real Time ◽  
Hardware Acceleration ◽  
Software Systems ◽  
Imaging Data ◽  
Real Time Processing ◽  
Acceleration Techniques ◽  
History Of ◽  
Hardware Architectures ◽  
The Cost

Medical imaging is considered one of the most important advances in the history of medicine and has become an essential part of the diagnosis and treatment of patients. Earlier prediction and treatment have been driving the acquisition of higher image resolutions as well as the fusion of different modalities, raising the need for sophisticated hardware and software systems for medical image registration, storage, analysis, and processing. In this scenario and given the new clinical pipelines and the huge clinical burden of hospitals, these systems are often required to provide both highly accurate and real-time processing of large amounts of imaging data. Additionally, lowering the prices of each part of imaging equipment, as well as its development and implementation, and increasing their lifespan is crucial to minimize the cost and lead to more accessible healthcare. This paper focuses on the evolution and the application of different hardware architectures (namely, CPU, GPU, DSP, FPGA, and ASIC) in medical imaging through various specific examples and discussing different options depending on the specific application. The main purpose is to provide a general introduction to hardware acceleration techniques for medical imaging researchers and developers who need to accelerate their implementations.

scholarly journals Multimodal mixed reality visualisation for intraoperative surgical guidance

2020 ◽  
Vol 15 (5) ◽  
pp. 819-826 ◽  
Author(s):  
João Cartucho ◽  
David Shapira ◽  
Hutan Ashrafian ◽  
Stamatia Giannarou
Keyword(s):  
Operating Room ◽  
User Study ◽  
Mixed Reality ◽  
Intraoperative Imaging ◽  
Imaging Modalities ◽  
Great Effort ◽  
Volumetric Data ◽  
Surgical Guidance ◽  
Extensive Evaluation ◽  
Multiple Imaging

Abstract Purpose In the last decade, there has been a great effort to bring mixed reality (MR) into the operating room to assist surgeons intraoperatively. However, progress towards this goal is still at an early stage. The aim of this paper is to propose a MR visualisation platform which projects multiple imaging modalities to assist intraoperative surgical guidance. Methodology In this work, a MR visualisation platform has been developed for the Microsoft HoloLens. The platform contains three visualisation components, namely a 3D organ model, volumetric data, and tissue morphology captured with intraoperative imaging modalities. Furthermore, a set of novel interactive functionalities have been designed including scrolling through volumetric data and adjustment of the virtual objects’ transparency. A pilot user study has been conducted to evaluate the usability of the proposed platform in the operating room. The participants were allowed to interact with the visualisation components and test the different functionalities. Each surgeon answered a questionnaire on the usability of the platform and provided their feedback and suggestions. Results The analysis of the surgeons’ scores showed that the 3D model is the most popular MR visualisation component and neurosurgery is the most relevant speciality for this platform. The majority of the surgeons found the proposed visualisation platform intuitive and would use it in their operating rooms for intraoperative surgical guidance. Our platform has several promising potential clinical applications, including vascular neurosurgery. Conclusion The presented pilot study verified the potential of the proposed visualisation platform and its usability in the operating room. Our future work will focus on enhancing the platform by incorporating the surgeons’ suggestions and conducting extensive evaluation on a large group of surgeons.

Effects of Using Mixed Reality With Coaching on the Interprofessional Communication Skills of Speech-Language Pathology Graduate Students

2021 ◽  
pp. 1-21
Author(s):  
Jacqueline A. Towson ◽  
Matthew S. Taylor ◽  
Diana L. Abarca ◽  
Claire Donehower Paul ◽  
Faith Ezekiel-Wilder
Keyword(s):  
Graduate Students ◽  
Self Efficacy ◽  
Mixed Reality ◽  
Role Play ◽  
Speech Language Pathology ◽  
Traditional Role ◽  
Allied Health Professionals ◽  
Interprofessional Communication ◽  
Language Pathology ◽  
The Individual

Purpose Communication between allied health professionals, teachers, and family members is a critical skill when addressing and providing for the individual needs of patients. Graduate students in speech-language pathology programs often have limited opportunities to practice these skills prior to or during externship placements. The purpose of this study was to research a mixed reality simulator as a viable option for speech-language pathology graduate students to practice interprofessional communication (IPC) skills delivering diagnostic information to different stakeholders compared to traditional role-play scenarios. Method Eighty graduate students ( N = 80) completing their third semester in one speech-language pathology program were randomly assigned to one of four conditions: mixed-reality simulation with and without coaching or role play with and without coaching. Data were collected on students' self-efficacy, IPC skills pre- and postintervention, and perceptions of the intervention. Results The students in the two coaching groups scored significantly higher than the students in the noncoaching groups on observed IPC skills. There were no significant differences in students' self-efficacy. Students' responses on social validity measures showed both interventions, including coaching, were acceptable and feasible. Conclusions Findings indicated that coaching paired with either mixed-reality simulation or role play are viable methods to target improvement of IPC skills for graduate students in speech-language pathology. These findings are particularly relevant given the recent approval for students to obtain clinical hours in simulated environments.

Introduction to Medical Imaging

2009 ◽  
Author(s):  
Nadine Barrie Smith ◽  
Andrew Webb
Keyword(s):  
Medical Imaging
Sign in / Sign up

Export Citation Format

Share Document