TEST AND VERIFY HUMAN FACTORS REQUIREMENTS 

Purpose

This section discusses the determination of human factors testing roles and requirements for the Integrated Product Team (IPT) to ensure that human factors considerations are adequately integrated into the system acquisition test and evaluation (T&E) program. Testing is performed to assess the operational effectiveness and suitability of the products to meet system requirements.  The purpose of human factors in system testing is to produce evidence of the degree to which the total system can be operated and maintained by members of the target population in an operational environment. If the total system exhibits performance deficiencies when operated or maintained by members of the target population, the testing should produce human factors causal information.

Timing

Human factors planning for test and evaluation (T&E) activities is initiated early in the acquisition process during Investment Analysis. Specific human factors-related T&E tasks and activities are outlined in the Integrated Human Factors Plan (IHFP) as identified in the Integrated Program Plan and in the system testing documentation.  The conduct of the human factors T&E is integrated with the system T&E program which is largely performed during Solution Implementation but should include demonstrations and assessments conducted during system analysis early in the program. Post deployment assessments that include human performance parameters assist in lifecycle planning and continuous improvement.

“How To”

Key principles for addressing human factors requirements in system testing are:

Coordinate human factors test planning early in the acquisition program.

Measure human performance of critical tasks during testing in terms of time, accuracy, and operational performance.

Leverage human factors data collection by integrating efforts with system performance data collection.

Make recommendations for human factors design and implementation changes and human performance improvements.

Providing human factors in system testing entails an early start and a continuous process. Figure 10-1 illustrates the flow of this process.  During the conduct of a front-end analysis, and in conjunction with developing the Human Factors Program, plans and analyses help identify the system functions.  The human factors experts review the system functions and identify the human tasks that may be critical to the performance of those functions.

Simulations, studies, analyses, prototype evaluations, research, and trade-off studies may be required by the human factors experts to determine the effect of human performance on system performance.  Using the system’s mission objectives, critical operating issues and related criteria; the human factors experts derive measures of effectiveness, measures of suitability, and the criteria and performance thresholds associated with these measures.  Data requirements and data collection plans are formulated along with resources required (e.g., funding, analytical personnel, data collection equipment). Human performance is then tested, analyzed, and evaluated for its impact on system performance. Since the purpose of incorporating human factors in system acquisition is to produce safer, more effective systems, a continuous feedback loop is established to the other IPT members and the user representative to recommend design and implementation changes and possible staffing and training solutions.

Steps

Step 1 Conduct Front-End Analysis

Step 2 Develop Human Factors Testing Requirements

Step 3 Conduct Human Performance Testing

Step 4 Apply Results of Human Performance Testing

Checklist