Effects of Haptic and 3D Audio Feedback on Operator Performance and Workload for Quadrotor UAVs in Indoor Environments

2014 ◽  
Vol 26 (5) ◽  
pp. 580-591 ◽  
Author(s):  
Robert M. Philbrick ◽  
◽  
Mark B. Colton ◽  
Keyword(s):  
Visual Feedback ◽  
Haptic Feedback ◽  
Mental Workload ◽  
Indoor Environments ◽  
Pilot Performance ◽  
Audio Feedback ◽  
Additional Information ◽  
3D Audio ◽  
Potential Applications ◽  
Subject Experiment

<div class=""abs_img""><img src=""[disp_template_path]/JRM/abst-image/00260005/06.jpg"" width=""300"" />Haptic and audio 3D feedback</div> Unmanned aerial vehicles (UAVs) have many potential applications in indoor environments. However, limited visual feedback makes it difficult to pilot UAVs in cluttered and enclosed spaces. Haptic feedback combined with visual feedback has been shown to reduce the number of collisions of UAVs in indoor environments, but has generally resulted in an increase in the mental workload of the operator. This paper investigates the potential of combining novel haptic and 3D audio feedback to provide additional information to operators of UAVs to improve performance and reduce workload. Two haptic feedback and two 3D audio feedback algorithms are presented and tested in a simulation-based human subject experiment. Operator workload is quantified using standard measures and a novel application of behavioral entropy. Experimental results indicate that 3D haptic feedback improved UAV pilot performance. Pilot workload was also improved for one of the haptic algorithms in one of the control directions (lateral). The 3D audio feedback algorithms investigated in this study neither improved nor degraded pilot performance. </span>

scholarly journals Review of the Augmented Reality Systems for Shoulder Rehabilitation

Information ◽  
2019 ◽  
Vol 10 (5) ◽  
pp. 154 ◽  
Author(s):  
Rosanna Maria Viglialoro ◽  
Sara Condino ◽  
Giuseppe Turini ◽  
Marina Carbone ◽  
Vincenzo Ferrari ◽  
...  
Keyword(s):  
Clinical Trials ◽  
Augmented Reality ◽  
Visual Feedback ◽  
Haptic Feedback ◽  
Tactile Feedback ◽  
Audio Feedback ◽  
Wearable Technologies ◽  
Body Regions ◽  
Head Mounted Displays ◽  
Wearable Interface

Literature shows an increasing interest for the development of augmented reality (AR) applications in several fields, including rehabilitation. Current studies show the need for new rehabilitation tools for upper extremity, since traditional interventions are less effective than in other body regions. This review aims at: Studying to what extent AR applications are used in shoulder rehabilitation, examining wearable/non-wearable technologies employed, and investigating the evidence supporting AR effectiveness. Nine AR systems were identified and analyzed in terms of: Tracking methods, visualization technologies, integrated feedback, rehabilitation setting, and clinical evaluation. Our findings show that all these systems utilize vision-based registration, mainly with wearable marker-based tracking, and spatial displays. No system uses head-mounted displays, and only one system (11%) integrates a wearable interface (for tactile feedback). Three systems (33%) provide only visual feedback; 66% present visual-audio feedback, and only 33% of these provide visual-audio feedback, 22% visual-audio with biofeedback, and 11% visual-audio with haptic feedback. Moreover, several systems (44%) are designed primarily for home settings. Three systems (33%) have been successfully evaluated in clinical trials with more than 10 patients, showing advantages over traditional rehabilitation methods. Further clinical studies are needed to generalize the obtained findings, supporting the effectiveness of the AR applications.

scholarly journals Surgical Audio Guidance: Feasibility Check for Robotic Surgery Procedures

2020 ◽  
Vol 6 (3) ◽  
pp. 571-574
Author(s):  
Anna Schaufler ◽  
Alfredo Illanes ◽  
Ivan Maldonado ◽  
Axel Boese ◽  
Roland Croner ◽  
...  
Keyword(s):  
Robotic Surgery ◽  
Haptic Feedback ◽  
Acoustic Emissions ◽  
Surgical Instruments ◽  
Additional Information ◽  
Tissue Interactions ◽  
Haptic Interactions ◽  
Visual Clues ◽  
To Receive ◽  
Expected Signal

AbstractIn robot-assisted procedures, the surgeon controls the surgical instruments from a remote console, while visually monitoring the procedure through the endoscope. There is no haptic feedback available to the surgeon, which impedes the assessment of diseased tissue and the detection of hidden structures beneath the tissue, such as vessels. Only visual clues are available to the surgeon to control the force applied to the tissue by the instruments, which poses a risk for iatrogenic injuries. Additional information on haptic interactions of the employed instruments and the treated tissue that is provided to the surgeon during robotic surgery could compensate for this deficit. Acoustic emissions (AE) from the instrument/tissue interactions, transmitted by the instrument are a potential source of this information. AE can be recorded by audio sensors that do not have to be integrated into the instruments, but that can be modularly attached to the outside of the instruments shaft or enclosure. The location of the sensor on a robotic system is essential for the applicability of the concept in real situations. While the signal strength of the acoustic emissions decreases with distance from the point of interaction, an installation close to the patient would require sterilization measures. The aim of this work is to investigate whether it is feasible to install the audio sensor in non-sterile areas far away from the patient and still be able to receive useful AE signals. To determine whether signals can be recorded at different potential mounting locations, instrument/tissue interactions with different textures were simulated in an experimental setup. The results showed that meaningful and valuable AE can be recorded in the non-sterile area of a robotic surgical system despite the expected signal losses.

scholarly journals Visual Feedback And Pseudo–Haptic Feedback Improve Manual Lifting Performance

2008 ◽  
Vol 49 (1) ◽  
Author(s):  
Faieza Abdul Aziz ◽  
D. T. Pham ◽  
Shamsuddin Sulaiman ◽  
Napsiah Ismail ◽  
Mohd Khairol Anuar Ariffin ◽  
...  
Keyword(s):  
Visual Feedback ◽  
Haptic Feedback ◽  
Manual Lifting

scholarly journals Complementary spatial and timing control in rhythmic arm movements

2019 ◽  
Vol 121 (4) ◽  
pp. 1543-1560 ◽  
Author(s):  
Robert W. Nickl ◽  
M. Mert Ankarali ◽  
Noah J. Cowan
Keyword(s):  
Visual Feedback ◽  
Haptic Feedback ◽  
Motor Behavior ◽  
Hand Movement ◽  
Arm Movements ◽  
Timing Synchronization ◽  
Sufficient Information ◽  
Spatial Accuracy ◽  
Rhythmic Movements ◽  
Spatial Error

Volitional rhythmic motor behaviors such as limb cycling and locomotion exhibit spatial and timing regularity. Such rhythmic movements are executed in the presence of exogenous visual and nonvisual cues, and previous studies have shown the pivotal role that vision plays in guiding spatial and temporal regulation. However, the influence of nonvisual information conveyed through auditory or touch sensory pathways, and its effect on control, remains poorly understood. To characterize the function of nonvisual feedback in rhythmic arm control, we designed a paddle juggling task in which volunteers bounced a ball off a rigid elastic surface to a target height in virtual reality by moving a physical handle with the right hand. Feedback was delivered at two key phases of movement: visual feedback at ball peaks only and simultaneous audio and haptic feedback at ball-paddle collisions. In contrast to previous work, we limited visual feedback to the minimum required for jugglers to assess spatial accuracy, and we independently perturbed the spatial dimensions and the timing of feedback. By separately perturbing this information, we evoked dissociable effects on spatial accuracy and timing, confirming that juggling, and potentially other rhythmic tasks, involves two complementary processes with distinct dynamics: spatial error correction and feedback timing synchronization. Moreover, we show evidence that audio and haptic feedback provide sufficient information for the brain to control the timing synchronization process by acting as a metronome-like cue that triggers hand movement. NEW & NOTEWORTHY Vision contains rich information for control of rhythmic arm movements; less is known, however, about the role of nonvisual feedback (touch and sound). Using a virtual ball bouncing task allowing independent real-time manipulation of spatial location and timing of cues, we show their dissociable roles in regulating motor behavior. We confirm that visual feedback is used to correct spatial error and provide new evidence that nonvisual event cues act to reset the timing of arm movements.

The Vigilance Decrement Reflects Limitations in Effortful Attention, Not Mindlessness

2003 ◽  
Vol 45 (3) ◽  
pp. 349-359 ◽  
Author(s):  
Rebecca A. Grier ◽  
Joel S. Warm ◽  
William N. Dember ◽  
Gerald Matthews ◽  
Traci L. Galinsky ◽  
...  
Keyword(s):  
Mental Workload ◽  
Vigilance Task ◽  
Neutral Stimulus ◽  
Button Press ◽  
Vigilance Decrement ◽  
Vigilance Performance ◽  
Critical Signal ◽  
Potential Applications ◽  
Nasa Tlx ◽  
Over Time

Robertson, Manly, Andrade, Baddeley, and Yiend (1997) proposed that the decline in performance efficiency over time in vigilance tasks (the vigilance decrement) is characterized by “mindlessness” or a withdrawal of attentional effort from the monitoring assignment. We assessed that proposal using measures of perceived mental workload (NASA-TLX) and stress (Dundee Stress State Questionnaire). Two types of vigilance task were employed: a traditional version, wherein observers made button-press responses to signify detection of rarely occurring critical signals, and a modified version, developed by Robertson et al. to promote mindlessness via routinization, wherein button-press responses acknowledged frequently occurring neutral stimulus events and response withholding signified critical signal detection. The vigilance decrement was observed in both tasks, and both tasks generated equally elevated levels of workload and stress, the latter including cognitions relating to performance adequacy. Vigilance performance seems better characterized by effortful attention (mindfulness) than by mindlessness. Actual or potential applications of this research include procedures to reduce the information-processing demand imposed by vigilance tasks and the stress associated with such tasks.

Evaluation of a Haptic Mixed Reality System for Interactions with a Virtual Control Panel

2005 ◽  
Vol 14 (6) ◽  
pp. 677-696 ◽  
Author(s):  
Christoph W. Borst ◽  
Richard A. Volz
Keyword(s):  
Task Performance ◽  
Visual Feedback ◽  
Direct Contact ◽  
Force Feedback ◽  
Haptic Feedback ◽  
Mixed Reality ◽  
Control Panel ◽  
Combined Approach ◽  
Subjective Ratings ◽  
Virtual Control

We present a haptic feedback technique that combines feedback from a portable force-feedback glove with feedback from direct contact with rigid passive objects. This approach is a haptic analogue of visual mixed reality, since it can be used to haptically combine real and virtual elements in a single display. We discuss device limitations that motivated this combined approach and summarize technological challenges encountered. We present three experiments to evaluate the approach for interactions with buttons and sliders on a virtual control panel. In our first experiment, this approach resulted in better task performance and better subjective ratings than the use of only a force-feedback glove. In our second experiment, visual feedback was degraded and the combined approach resulted in better performance than the glove-only approach and in better ratings of slider interactions than both glove-only and passive-only approaches. A third experiment allowed subjective comparison of approaches and provided additional evidence that the combined approach provides the best experience.

scholarly journals Grasping Embodiment: Haptic Feedback for Artificial Limbs

2021 ◽  
Vol 15 ◽  
Author(s):  
Charles H. Moore ◽  
Sierra F. Corbin ◽  
Riley Mayr ◽  
Kevin Shockley ◽  
Paula L. Silva ◽  
...  
Keyword(s):  
Visual Feedback ◽  
Daily Living ◽  
Haptic Feedback ◽  
Sense Of Self ◽  
The Body ◽  
Artificial Limbs ◽  
Body Parts ◽  
Vibrotactile Feedback ◽  
Feedback Type ◽  
Upper Limb Prostheses

Upper-limb prostheses are subject to high rates of abandonment. Prosthesis abandonment is related to a reduced sense of embodiment, the sense of self-location, agency, and ownership that humans feel in relation to their bodies and body parts. If a prosthesis does not evoke a sense of embodiment, users are less likely to view them as useful and integrated with their bodies. Currently, visual feedback is the only option for most prosthesis users to account for their augmented activities. However, for activities of daily living, such as grasping actions, haptic feedback is critically important and may improve sense of embodiment. Therefore, we are investigating how converting natural haptic feedback from the prosthetic fingertips into vibrotactile feedback administered to another location on the body may allow participants to experience haptic feedback and if and how this experience affects embodiment. While we found no differences between our experimental manipulations of feedback type, we found evidence that embodiment was not negatively impacted when switching from natural feedback to proximal vibrotactile feedback. Proximal vibrotactile feedback should be further studied and considered when designing prostheses.

scholarly journals An era of brain-computer interface: BCI migration into space

2021 ◽  
Vol 3 (5) ◽  
pp. 4-12
Author(s):  
Tamara Hummadi ◽  
Indranath Chatterjee
Keyword(s):  
Communication Systems ◽  
Mental Workload ◽  
New Technology ◽  
New Ventures ◽  
Computer Interface ◽  
Health And Wellbeing ◽  
The Past ◽  
Long Duration ◽  
Potential Applications ◽  
Intelligent Communication

Brain-computer interface's (BCI) potential applications increased tremendously over the past decade. The rising of this new technology is providing promising solutions in the field of aerospace and space exploration.  As astronauts face diverse challenges in long-duration spaceflight, BCI can help astronauts deal with complicated tasks with a minimal mental workload. It may provide intelligent communication systems, maximize safety and security, facilitate space discovery missions, and enhance astronauts' overall health and wellbeing. In new ventures such as SpaceX, Starlink, and Neuralink, pioneers adopt futuristic strategies that use BCI as their main anchor. Such efforts are valuable in neuroscience as they will reveal information that will allow neuroscientists to deeper understand the brain's mechanisms.

scholarly journals The Role of microRNAs in the Infection by T. gondii in Humans

2021 ◽  
Vol 11 ◽  
Author(s):  
Geraldo Magela de Faria Junior ◽  
Fernando Henrique Antunes Murata ◽  
Hernan Alejandro Lorenzi ◽  
Bruno Bello Pede Castro ◽  
Letícia Carolina Paraboli Assoni ◽  
...  
Keyword(s):  
Messenger Rna ◽  
Mrna Translation ◽  
Laboratory Diagnosis ◽  
Host Cells ◽  
Diagnostic Tools ◽  
Parasitic Infections ◽  
Additional Information ◽  
Non Invasive ◽  
Potential Applications ◽  
Transcriptional Gene Regulation

MicroRNAs are molecules belonging to an evolutionarily conserved family of small non-coding RNAs, which act on post-transcriptional gene regulation, causing messenger RNA (mRNA) degradation or inhibiting mRNA translation into proteins. These molecules represent potential biomarkers for diagnosis, non-invasive prognosis, and monitoring the development of the disease. Moreover, they may provide additional information on the pathophysiology of parasitic infections and guide strategies for treatment. The Apicomplexan parasite Toxoplasma gondii modifies the levels of microRNAs and mRNAs in infected host cells by modulating the innate and adaptive immune responses, facilitating its survival within the host. Some studies have shown that microRNAs are promising molecular markers for developing diagnostic tools for human toxoplasmosis. MicroRNAs can be detected in human specimens collected using non-invasive procedures. changes in the circulating host microRNAs have been associated with T. gondii infection in mice and ocular toxoplasmosis in humans. Besides, microRNAs can be amplified from samples using sensitive and molecular-specific approaches such as real-time PCR. This review presents recent findings of the role that microRNAs play during T. gondii infection and discuss their potential use of these small nuclei acid molecules to different approaches such as laboratory diagnosis, modulation of cell and tissue infected as other potential applications in human toxoplasmosis.

Haptic Rendering for Laparoscopic Surgery Simulation & Related Studies

2008 ◽  
pp. 636-645 ◽  
Author(s):  
Ryan McColl ◽  
Ian Brown ◽  
Cory Seligman ◽  
Fabian Lim ◽  
Amer Alsaraira
Keyword(s):  
Laparoscopic Surgery ◽  
Visual Feedback ◽  
Haptic Feedback ◽  
Sensory System ◽  
Vital Role ◽  
Tissue Manipulation ◽  
Anatomical Objects ◽  
Surgery Simulator ◽  
Sense Of Touch ◽  
Human Sense

This project concerns the application of haptic feedback to a virtual reality laparoscopic surgery simulator. It investigates the hardware required to display haptic forces, and the software required to generate realistic and stable haptic properties. A number of surgery-based studies are undertaken using the developed haptic device. The human sense of touch, or haptic sensory system, is investigated in the context of laparoscopic surgery, where the long laparoscopic instruments reduce haptic sensation. Nonetheless, the sense of touch plays a vital role in navigation, palpation, cutting, tissue manipulation, and pathology detection in surgery. The overall haptic effect has been decomposed into a finite number of haptic attributes. The haptic attributes of mass, friction, stiction, elasticity, and viscosity are individually modeled, validated, and applied to virtual anatomical objects in visual simulations. There are times in surgery when the view from the camera cannot be depended upon. When visual feedback is impeded, haptic feedback must be relied upon more by the surgeon. A realistic simulator should include some sort of visual impedance. Results from a simple tissue holding task suggested the inclusion of haptic feedback in a simulator aids the user when visual feedback is impeded.

Sign in / Sign up

Export Citation Format

Share Document