Evaluating the Effectiveness of Artificial Intelligence Systems in Intelligence Analysis

reportActive / Technical Report | Accesssion Number: AD1146077 | Open PDF

Abstract:

This research develops methodologies for understanding the mission impact of deploying artificial intelligence (AI) systems to support intelligence missions as a function of the performance achieved by the system. A two-pronged approach is pursued, with a general frame work enabling qualitative analysis and a supplemental model of a particular class of systems with quantitative results. Our results underscore the importance of critically assessing how the performance of AI systems is measured and tailoring the metrics chosen to the function the system will perform.

Author(s):
Ish, Daniel ; Ettinger, Jared ; Ferris, Christopher
Author Organization(s):
RAND CORP SANTA MONICA CA
Funding Organization(s):
DEPARTMENT OF DEFENSE WASHINGTON DC, WASHINGTON , DC
Document Type:
Technical Report/Research Report
Publication Date:
2020 Jan 01
Pagination:
109

Security Markings

DOCUMENT & CONTEXTUAL SUMMARY

Distribution Code:
A - Approved For Public Release
Distribution Statement: Public Release

RECORD

Collection: TRECMS
Subject Terms
Modernization Areas:
Autonomy
Communities of Interest:
Autonomy
Descriptor(s):
intelligence cycle, computational science, artificial intelligence software, national security, intelligence community (united states), drone targeting, neural networks, computer languages, machine learning, artificial intelligence, computers, detectors, information systems, natural language processing, cyberattacks, information science, bayesian networks
Keyword(s):
AI(ARTIFICIAL INTELLIGENCE), AIM(AUGMENTING INTELLIGENCE USING MACHINES), BETTER(BETTER EXTRACTION FROM TEXT TOWARDS ENHANCED RETRIEVAL), CAUSE(CYBER-ATTACK AUTOMATED UNCONVENTIONAL SENSOR ENVIRONMENT), GEOINT(GEOSPATIAL INTELLIGENCE), GIS(GEOGRAPHIC INFORMATION SYSTEM), OSI(OPEN-SOURCE INDICATORS)
Subject Categories:
Military Sciences; Military Sciences
Creation Date:
2021 Aug 27
Update Date:
2021 Sep 20