What Counts as Progress in the T and E of Autonomy?
[Technical Report, Briefing Charts]
INSTITUTE FOR DEFENSE ANALYSES ALEXANDRIA VA
Pagination or Media Count:
Organizations across the Department of Defense have recognized that autonomous systems will pose significant new test and evaluation challenges. IDA researchers have been exploring the implications of autonomy for instrumentation, facilities, measurement, and assurance case development. Dr. David Tate was invited by the Scientific Test and Analysis Techniques Center of Excellence to present at the upcoming Advances in the Test and Evaluation of Autonomy workshop. This is the briefing he presented. It lays out a framework for thinking about what kind of assurance cases for autonomous capabilities would be convincing to certification authorities, what kinds of arguments those assurance cases would use, what kinds of measurements or other evidence could support those arguments, and what kind of instrumentation or computational tools would be needed to collect that evidence. It also describes how that framework is currently being used as the basis for Defense Acquisition University online continuous learning module CLE002, Introduction to Test and Evaluation of Autonomous Systems.
- Test Facilities, Equipment and Methods