Evaluating HSI with AI-Enabled Systems: What should you consider in a TEMP?

reportActive / Technical Report | Accesssion Number: AD1211270 | Open PDF

Abstract:

The Institute for Defense Analyses and the Joint AI Center (JAIC) are developing a framework to support testers as they evaluate Human Systems Integration (HSI) with AI-enabled systems. This product is a short briefing that gives an overview of the framework, conveys a sense of what the fuller framework looks like, and ends with an example of how increased autonomy in aviation led to the loss of Air France 447. We are creating this framework because HSI expertise in the DOD Test and Evaluation workforce is rare and increasingly important with more automation in systems. This briefing focuses on the portion of the framework which introduces non-experts to core HSI concerns to help testers write and assess TEMPs. This briefing covers a subset of HSI topics included in the framework, including mental models, trust, workload, and function allocation. HSI will continue to be a vital component of creating and adopting effective, suitable, and trustworthy AI-enabled systems.

Author(s):
Haga, Rachel A. ; Vickers, Brian D. ; Porter, Daniel J.
Author Organization(s):
INSTITUTE FOR DEFENSE ANALYSES ALEXANDRIA VA
Funding Organization(s):
DEPARTMENT OF DEFENSE WASHINGTON DC, WASHINGTON , DC
Document Type:
Technical Report/Briefing Charts
Publication Date:
2022 Apr 14
Pagination:
29

Security Markings

DOCUMENT & CONTEXTUAL SUMMARY

Distribution Code:
A - Approved For Public Release
Distribution Statement: Public Release

RECORD

Collection: TRECMS
Subject Terms
Modernization Areas:
Autonomy
Communities of Interest:
Human Systems
Descriptor(s):
test and evaluation, human-computer interaction, department of defense, artificial intelligence, workload, automation, human systems integration, classification, governments, contracts, instructions, security, atlantic ocean, complex systems, engineering, national governments
Keyword(s):
Artificial intelligence (AI), Human systems Interactions (HSI), Joint Artificial Intelligence (AI) Center (JAIC)
Creation Date:
2023 Sep 25
Update Date:
2023 Sep 25