scholarly journals Integrating Eye- and Mouse-Tracking with Assistant Based Speech Recognition for Interaction at Controller Working Positions

Aerospace ◽  
2021 ◽  
Vol 8 (9) ◽  
pp. 245
Author(s):  
Oliver Ohneiser ◽  
Jyothsna Adamala ◽  
Ioan-Teodor Salomea

Assistant based speech recognition (ABSR) prototypes for air traffic controllers have demonstrated to reduce controller workload and aircraft flight times as a result. However, two aspects of ABSR could enhance benefits, i.e., (1) the predicted controller commands that speech recognition engines use can be more accurate, and (2) the confirmation process of ABSR recognition output, such as callsigns, command types, and values by the controller, can be less intrusive. Both tasks can be supported by unobtrusive eye- and mouse-tracking when using operators’ gaze and interaction data. First, probabilities for predicted commands should consider controllers’ visual focus on the situation data display. Controllers will more likely give commands to aircraft that they focus on or where there was a mouse interaction on the display. Furthermore, they will more likely give certain command types depending on the characteristics of multiple aircraft being scanned. Second, it can be determined via eye-tracking instead of additional mouse clicks if the displayed ABSR output has been checked by the controller and remains uncorrected for a certain amount of time. Then, the output is assumed to be correct and is usable by other air traffic control systems, e.g., short-term conflict alert. If the ABSR output remains unchecked, an attention guidance functionality triggers different escalation levels to display visual cues. In a one-shot experimental case study with two controllers for the two implemented techniques, (1) command prediction probabilities improved by a factor of four, (2) prediction error rates based on an accuracy metric for three most-probable aircraft decreased by a factor of 25 when combining eye- and mouse-tracking data, and (3) visual confirmation of ABSR output promises to be an alternative for manual confirmation.

2019 ◽  
Vol 49 (6) ◽  
pp. 623-632 ◽  
Author(s):  
Clark Borst ◽  
Roeland M. Visser ◽  
Marinus M. van Paassen ◽  
Max Mulder

Aerospace ◽  
2021 ◽  
Vol 8 (7) ◽  
pp. 170
Author(s):  
Ricardo Palma Fraga ◽  
Ziho Kang ◽  
Jerry M. Crutchfield ◽  
Saptarshi Mandal

The role of the en route air traffic control specialist (ATCS) is vital to maintaining safety and efficiency within the National Airspace System (NAS). ATCSs must vigilantly scan the airspace under their control and adjacent airspaces using an En Route Automation Modernization (ERAM) radar display. The intent of this research is to provide an understanding of the expert controller visual search and aircraft conflict mitigation strategies that could be used as scaffolding methods during ATCS training. Interviews and experiments were conducted to elicit visual scanning and conflict mitigation strategies from the retired controllers who were employed as air traffic control instructors. The interview results were characterized and classified using various heuristics. In particular, representative visual scanpaths were identified, which accord with the interview results of the visual search strategies. The highlights of our findings include: (1) participants used systematic search patterns, such as circular, spiral, linear or quadrant-based, to extract operation-relevant information; (2) participants applied an information hierarchy when aircraft information was cognitively processed (altitude -> direction -> speed); (3) altitude or direction changes were generally preferred over speed changes when imminent potential conflicts were mitigated. Potential applications exist in the implementation of the findings into the training curriculum of candidates.


Author(s):  
Jamie D. Barrett ◽  
Brett Torrence ◽  
Michelle Bryant ◽  
Linda Pierce ◽  
Julia Buck

The primary mission of the Federal Aviation Administration (FAA) is to maintain the safety of the National Airspace System (NAS). As part of this mission, the FAA is tasked with ensuring that future air traffic controllers are adequately trained to perform the high-risk job of directing air traffic. The FAA Academy curriculum for newly hired controllers involves 3-4 months of intensive lessons and performance assessments. It has been suggested that this training program is quite stressful, and successful trainees tend to be those who can better manage stress. To support ATC trainees, researchers at the Civil Aerospace Medical Institute (CAMI) have conducted operational research to develop and evaluate a stress management training to help trainees manage their stress during training at the FAA Academy.


2011 ◽  
Vol 2011 ◽  
pp. 1-8 ◽  
Author(s):  
Liang Wang ◽  
Yaohua Wang ◽  
Xiaoqiang Yang ◽  
Kai Cheng ◽  
Haishan Yang ◽  
...  

Reliability studies for coding contributing factors of incident reports in high hazard industries are rarely conducted and reported. Although the Human Factors Analysis and Classification System (HFACS) appears to have a larger number of such studies completed than most other systems doubt exists as the accuracy and comparability of results between studies due to aspects of methodology and reporting. This paper reports on a trial conducted on HFACS to determine its reliability in the context of military air traffic control (ATC). Two groups participated in the trial: one group comprised of specialists in the field of human factors, and the other group comprised air traffic controllers. All participants were given standardized training via a self-paced workbook and then read 14 incident reports and coded the associated findings. The results show similarly low consensus for both groups of participants. Several reasons for the results are proposed associated with the HFACS model, the context within which incident reporting occurs in real organizations and the conduct of the studies.


Author(s):  
Priyanka Peter ◽  
Prof. Vaibhav S. Umap

Aviation crashes all over the world have recently been on the high rise, stemming from negligence, mechanical faults, weather, ground control errors, pilot errors, taxing and maintenance crew errors as are probable reasons for such accidents. This case study models the probabilistic risk assessment of runway incursion data endeavored to determine the correlation in between the reported incursions that occurred at Nagpur airport between fiscal years 2005 and 2015 and the meteorological conditions, times of day, and presence of an air traffic control tower of Nagpur Airport. With runway incursions long-plaguing the safety of aviators, their passengers, and aviation refining the body of knowledge underpinning incursions coupled with ongoing prevention efforts aspire to diminish the annual incidence of incursions, increase safety, and save lives. In accordance with this mission, mining the Civil Organization (ICAO), and Federal Aviation Association (FAA) runway incursion databases and analyzing the resulting hours, and at airport with an air traffic control tower.


1992 ◽  
Vol 36 (17) ◽  
pp. 1326-1330 ◽  
Author(s):  
Richard E. Redding ◽  
John R. Cannon ◽  
Thomas L. Seamster

The Federal Aviation Administration has embarked on a major curriculum redesign effort to improve the training efficiency of en route air traffic controllers. Included in this effort was a comprehensive cognitive task analysis conducted in several phases, spanning several years. Eight different types of data collection and analysis procedures were used, resulting in an integrated model of controller expertise. This paper provides a description of controller expertise, and describes the training program under development. This is one of the first examples of cognitive task analysis being applied to study expertise in complex cognitive tasks performed in time-constrained, multi-tasking environments.


Sign in / Sign up

Export Citation Format

Share Document