Multiple resources questionnaire and workload profile: Application of competing models to subjective workload measurement

Armstrong Laboratory, Logistics Research Division performed an evaluation to determine whether flightline maintenance was improved by using a computerized, integrated maintenance information system (IMIS) for different types of users. The laboratory's evaluation overcame several logistical problems common to conducting research outside a laboratory setting. Such problems include obtaining representative subjects, controlling for extraneous variables, and gathering adequate sample data. The present study includes 24 maintenance technicians (12 avionics specialists and 12 crew chief non-specialists). Each subject performed 12 maintenance tasks (6 using electronic and 6 using paper presentation). Subjective workload ratings and objective performance times were measured. Subjective workload (using National Aeronautics and Space Administration-Task Load Index (NASA-TLX)) and objective performance results revealed similar interactions. Using paper-based presentations, crew chiefs gave significantly higher subjective workload ratings than avionics specialists and significantly longer total performance time (e.g., time-to-complete). However, there were no significant differences between the two groups when using electronic-based presentations.

Download Full-text

Evaluating control activity as a measure of workload in flight test

Proceedings of the Human Factors and Ergonomics Society Annual Meeting ◽

10.1177/154193120504900115 ◽

2005 ◽

Vol 49 (1) ◽

pp. 64-67

Author(s):

S. Jennings ◽

G. Craig ◽

Stephan Carignan ◽

Kris Ellis ◽

D. Thorndycraft Qinetiq

Keyword(s):

Flight Test ◽

Measurement Tool ◽

Control Activity ◽

Handling Qualities ◽

Subjective Workload ◽

Workload Measurement ◽

Dynamic Interface ◽

Interface Modeling ◽

Short Test ◽

Cyclic Control

This paper describes an investigation of a workload measurement technique based on pilot control movements. The Dynamic Interface Modeling and Simulation System Product Metric (DIMSS PM) assumes that pilot control activity can be used to evaluate pilot workload. Three qualified test pilots flew the fly-bywire NRC Bell 205 helicopter in a short test program that compared the DIMSS PM with subjective workload ratings and handling qualities ratings. The pilots performed a variation of an ADS-33E bob-up with varying levels of simulated turbulence and modified cyclic control characteristics. Good agreement was found for most in-flight test conditions between DIMSS Workload Metric scores and subjective workload ratings from the Bedford Workload Scale and Cooper-Harper handling qualities ratings. While, the DIMSS Workload Metric did not accurately reflect workload increases due to variations in the cyclic stick characteristics, the metric shows promise as an objective measurement tool of pilot workload in well-defined tests.

Download Full-text