Prediction of subjective ratings of air traffic controller performance by computer-derived measures and behavioral observations.

2000 ◽  
Author(s):  
Carol A. Manning ◽  
Scott H. Mills ◽  
Henry J. Mogilka ◽  
Jerry W. Hedge ◽  
Kenneth W. Bruskiewicz ◽  
...  
Keyword(s):  
Air Traffic ◽  
Subjective Ratings ◽  
Air Traffic Controller ◽  
Behavioral Observations ◽  
Controller Performance

scholarly journals May I Interrupt? The effect of SPAM Probe Questions on Air Traffic Controller Performance

2015 ◽  
Vol 3 ◽  
pp. 2998-3004 ◽  
Author(s):  
Jillian Keeler ◽  
Henri Battiste ◽  
Elyse C. Hallett ◽  
Zach Roberts ◽  
Alice Winter ◽  
...  
Keyword(s):  
Air Traffic ◽  
Air Traffic Controller ◽  
Controller Performance

Another Look at air Traffic Controller Performance Evaluation

1996 ◽  
Vol 40 (12) ◽  
pp. 574-578
Author(s):  
Earl S. Stein ◽  
Randy L. Sollenberger
Keyword(s):  
Rating Scales ◽  
Rating Scale ◽  
Evaluation Criteria ◽  
Air Traffic ◽  
Group Discussions ◽  
Air Traffic Controller ◽  
Rater Reliability ◽  
Controller Performance ◽  
Performance Area ◽  
Mutual Evaluation

This paper describes a study that evaluated the reliability of a recently developed rating form designed to assess air traffic controller performance. Six supervisors from different radar approach control facilities nationwide viewed 20 video tapes of controllers working traffic from a previously recorded simulation study. The observer/raters used a new evaluation form that consisted of 24 different rating scales measuring specific areas of controller performance. An important part of this study was observer training. The training consisted of practice rating sessions followed by group discussions. In discussion, observers established mutual evaluation criteria for each performance area. Inter-rater reliability was assessed using intraclass correlations, and intra-rater reliability was assessed using Pearson product-moment correlations on repeated video tapes. In general, the reliability of the form was quite good, however, a few rating scales were much less reliable than the others. Reasons for the differences in rating scale reliability are discussed.

Sign in / Sign up

Export Citation Format

Share Document