The Challenges of Measuring Human Performance in Complex Operational Environments

2016 ◽  
Vol 60 (1) ◽  
pp. 2053-2057
Author(s):  
Pam Savage-Knepshield ◽  
David Hullinger ◽  
Rachael Lund ◽  
Carol Manning ◽  
Linda Pierce ◽  
...  
Keyword(s):  
Job Performance ◽  
Human Factors ◽  
Systems Engineering ◽  
Human Performance ◽  
Human Factors Engineering ◽  
Predicting Factors ◽  
Wide Range ◽  
Industrial Organizational Psychology ◽  
Human Systems Integration ◽  
Industry Sectors

A panel of experienced human factors practitioners and researchers discusses the challenges encountered when measuring and quantifying human performance on the job and during system design and development. The panel, comprised of government/military researchers with expertise in human factors engineering, human systems integration, research psychology, industrial/organizational psychology, physics, systems engineering, and mechanical engineering, focuses not only on the challenges they have encountered, but also on the underlying human performance measurement issues and various approaches they have taken to address them. Understanding, measuring, evaluating and predicting factors that influence human performance is not only critical for the design of effective systems and programs of instruction, but also for overall job performance and mission effectiveness. Panelists will discuss critical factors and insights that are generalizable across a wide range of products and industry sectors as well as those that warrant further investigation.

3.4.4 THE HUMAN FACTORS ENGINEERING SPECIALTY WITHIN THE SYSTEMS ENGINEERING PROCESS

1995 ◽  
Vol 5 (1) ◽  
pp. 782-789 ◽  
Author(s):  
Christopher Rogers ◽  
Kristina Densler ◽  
Mary Englert ◽  
Taylor King ◽  
Michael Tulloch
Keyword(s):  
Human Factors ◽  
Systems Engineering ◽  
Human Factors Engineering ◽  
Engineering Process

The Human Systems Integration Framework: Enhanced HSI support for System Acquisition

2017 ◽  
Vol 61 (1) ◽  
pp. 1720-1724
Author(s):  
Frank C. Lacson ◽  
Matthew R. Risser ◽  
John W. Gwynne ◽  
William D. Kosnik
Keyword(s):  
Systems Engineering ◽  
System Performance ◽  
Web Application ◽  
Human Performance ◽  
Systems Integration ◽  
Integrated System ◽  
Total System ◽  
Human Systems Integration ◽  
System Acquisition ◽  
Human Systems

Ensuring that human performance factors are adequately considered during the system engineering process has proven to be a challenging task for Human Factors and Human Systems Integration (HSI) practitioners. Programs that do not sufficiently include HSI as an integral aspect of planning and execution are at risk of diminished user performance and total system performance, leading to costly and time-consuming re-work. To encourage a greater involvement of HSI in systems engineering, the HSI Framework (HSIF) was developed to explicitly incorporate HSI tasks and products in all stages of system acquisition. The HSIF is a web application that contains general and domain-specific HSI activities, references, and related products. For HSI Practitioners and System Engineers, the HSIF provides technical guidance and best practices, thereby fostering early, explicit, and properly-scoped HSI efforts. In turn, Program Managers and Technical Authorities are provided with the information needed to accurately assess and manage human performance-related risks, leading to relevant, effective, and integrated system performance.

Human Factors Engineering Technology Integration into the Naval Ship Acquisition Process

1977 ◽  
Vol 21 (6) ◽  
pp. 528-531
Author(s):  
Thomas B. Malone ◽  
Phillip J. Andrews ◽  
Warren Lewis ◽  
James McGuinness
Keyword(s):  
Human Factors ◽  
Systems Engineering ◽  
Human Factors Engineering ◽  
Training Design ◽  
Design Work ◽  
Acquisition Process ◽  
Study Approach ◽  
Test And Evaluation ◽  
Surface Ship ◽  
Machine Systems

A Navy surface ship represents one of the most complex man-machine systems in existence today. Performance capabilities of personnel required in the propulsion systems, weapon systems, command-control systems, operations systems, supply systems and auxiliary systems should demand that human factors engineering (HFE) receive primary consideration in the design of ships. And yet there is no formal HFE program for ship acquisition. HFE responsibilities are not integrated with each other or with ship systems engineering efforts. There is little or no standardization of HFE methods and data beyond that provided in the design work study approach. Finally, HFE has no formal status within the ship acquisition process. The Navy Sea Systems Command recently moved to correct these problems in implementation of HFE for ships. A ship HFE technology program has been established which has as its primary objectives the integration of available applicable HFE techniques, methods, principles and data into the ship acquisition process. The effort to integrate HFE technology into the ship acquisition process began with a definition of the process itself, with emphasis on the specific events and milestones within the process. The next step entailed identification of HFE requirements appropriate for each event. HFE requirements were described in terms of activities to be completed and products to be provided to the ship design effort. HFE requirements were developed for five major functional areas: manning and training, design for operability, design for maintainability, design for habitability, and test and evaluation. After identification of HFE requirements in each of these areas, determinations were made of the degree to which available HFE technologies were appropriate to satisfy the requirements. HFE technologies consisted of HFE principles, data, methods and techniques which have been reported in the HFE literature. These technology assessments represented the best estimates of the research team concerning the applicability of available technologies for specific HFE requirements.

Stress and Sonar Operations: Concerns and Research Methodology

1985 ◽  
Vol 29 (5) ◽  
pp. 452-456 ◽  
Author(s):  
Malcolm J Smith ◽  
Robert R Mackie ◽  
C Dennis Wylie
Keyword(s):  
Literature Review ◽  
Human Factors ◽  
Research Methodology ◽  
Human Performance ◽  
Applied Research ◽  
Survey Methodology ◽  
Stress Factors ◽  
Wide Range

This paper is the first in a series of three concerned with the effects of a wide range of stress factors on human Performance in current naval sonar operations. It is argued, from the viewpoint of a human factors consultant, that most research has had very little impact in helping to solve problems of sustained operations at sea. Semantic difficulties in applied research using trained sonar operators are discussed, and a translation of sonar tasks and behavioural elements is described. As an introduction to the following contributions, a combined survey methodology and literature review are outlined.

Aircraft Development and Design

2012 ◽  
pp. 858-886
Author(s):  
Dujuan B. Sevillian
Keyword(s):  
Product Design ◽  
Systems Engineering ◽  
Aerospace Industry ◽  
Aviation Safety ◽  
Development Stage ◽  
Human Factors Engineering ◽  
Product Lifecycle ◽  
System Safety ◽  
Design Considerations ◽  
Human Systems Integration

Effective Human Factors Engineering (HFE) has provided the aerospace industry with design considerations that promote aviation safety in the development of complex aircraft systems, as well as the operators and maintainers that utilize those systems. HFE is an integral aspect within the systems engineering process. Measuring the effectiveness of Human Systems Integration (HSI) in the research & development stage is critical for the design of new and modified systems. This chapter focuses on how providing effective HFE design solutions enhances product design and system safety. Providing the customer with safe and reliable products augments mission capabilities throughout the product lifecycle.

Liveware Survey of Human Systems Integration (HSI) Technologies: Need for Comprehensive Survey and Available Database

1992 ◽  
Vol 36 (15) ◽  
pp. 1133-1137 ◽  
Author(s):  
Frank C. Gentner ◽  
Mona J. Crissey
Keyword(s):  
Systems Engineering ◽  
North Atlantic ◽  
Health Hazard ◽  
Appropriate Technology ◽  
Human Factors Engineering ◽  
Defense Acquisition ◽  
The Past ◽  
Comprehensive Survey ◽  
Human Systems Integration ◽  
Technology Identification

Downsizing the Department of Defense (DoD) means accomplishing more with fewer people. Enlightened design that considers all requirement and interaction issues simultaneously is the key to productivity. In the past, human issues have been difficult to quantify or depict during the systems engineering process. Recently, there has been an explosion of affordable HSI technologies. Despite the new DoD directives that require HSI analyses throughout acquisition, it is difficult to identify the most appropriate technology for HSI analyses. Defense acquisition managers, contractors, and the HSI research and development (R&D) community need a database of information about HSI tools, databases, and test facilities. They need this database to identify technology available in each of the Liveware domains of Manpower, Personnel, Training, (MPT) Safety, Health Hazard Prevention, and Human Factors Engineering (HFE) and to fully integrate human consideration into the acquisition process. However, no comprehensive catalog of HSI technology exists. Under the sponsorship of the Office of the Assistant Secretary of Defense (Force Management and Personnel) HSI office and North Atlantic Treaty Organization (NATO) Research Study Group.21 (RSG.21), TPDC and CSERIAC are surveying the HSI community for a comprehensive database of HSI technologies, an ambitious effort requiring the help of all HSI technology developers, owners, and users. This paper reviews previous HSI-related technology studies. It supports the thesis that a comprehensive survey and database are needed to improve prioritization of HSI technology R&D aid in HSI technology identification and use; and take full advantage of the new acquisition climate. It also describes the survey and database which is now being populated, and highlights the need for HSI community participation.

Human Factors Engineering Test and Evaluation in the US Military

1985 ◽  
Vol 29 (5) ◽  
pp. 499-503
Author(s):  
Thomas G. O'Brien
Keyword(s):  
Human Factors ◽  
Human Performance ◽  
Evaluation Process ◽  
Human Factors Engineering ◽  
Us Army ◽  
Test And Evaluation ◽  
Current Test ◽  
Operational Test ◽  
The Us ◽  
Critical Issues

The paper summarizes current test and evaluation methods employed by the US Army. The role of human factors in weapons systems acquisition is discussed along with the author's perspective on problems related to the test and evaluation process. Utilization of human performance operational test data to improve the human-materiel interface before type classification or transition into the next phase of development is of particular concern. The paper suggests an alternative to current methods which would combine engineering and operational testing to address both technical and operational system critical issues.

Network Modeling of Nuclear Operator Procedures

1994 ◽  
Vol 38 (4) ◽  
pp. 210-214 ◽  
Author(s):  
Ron Laughery ◽  
J. Persensky
Keyword(s):  
Human Factors ◽  
Human Performance ◽  
Network Modeling ◽  
Network Models ◽  
Human Factors Engineering ◽  
Actual Performance ◽  
Modeling Technology ◽  
Emergency Procedures ◽  
Predicting Performance ◽  
Model Predictions

Research and evaluation on human factors issues can be very expensive owing to 1) the high cost of running experiments and 2) high inter-team variability which makes it necessary to run large numbers of subjects to get stable estimates of performance. Increasingly, the engineering disciplines are looking towards computer modeling as a means of predicting performance as a function of engineering design. Human factors engineering has that goal as well. This paper presents the results of a validation study that evaluated a human performance modeling technology termed task network modeling. Task network models were built of a crew executing two emergency procedures and one normal procedure. For each of these three procedures, one model was built reflecting the use of paper procedures and one reflecting the use of computerized procedures. Model predictions were then compared to data on actual crews performing under identical conditions. In general, the model predictions were representative of actual performance, although a number of issues arose that should be addressed prior to using these models as a technical basis for regulatory action.

Reshaping Human Factors Education in Times of Big Data: Practitioner Perspectives

2021 ◽  
Vol 65 (1) ◽  
pp. 1574-1578
Author(s):  
Bella Yigong Zhang ◽  
Mark Chignell
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Human Factors ◽  
Task Analysis ◽  
Data Science ◽  
Data Sets ◽  
Human Factors Engineering ◽  
Design Data ◽  
Wide Range ◽  
Human Use

Human Factors Engineering (HFE) is an applied discipline that uses a wide range of methodologies to better the design of systems and devices for human use. Underpinning all human factors design is the maxim to fit the human to the task/machine/system rather than vice versa. While some HFE methods such as task analysis and anthropometrics remain relatively fixed over time, areas such as human-technology interaction are strongly influenced by the fast-evolving technological trend. In times of big data, human factors engineers need to have a good understanding of topics like machine learning, advanced data analytics, and data visualization so that they can design data-driven products that involve big data sets. There is a natural lag between industrial trends and HFE curricula, leading to gaps between what people are taught and what they will need to know. In this paper, we present the results of a survey involving HFE practitioners (N=101) and we demonstrate the need for including data science and machine learning components in HFE curricula.

Sign in / Sign up

Export Citation Format

Share Document