Dimensions of Autonomous Decision making: A First Step in Transforming the Policies and Ethics Principles Regarding Autonomous Systems into Practical System Engineering Requirements

reportActive / Technical Report | Accesssion Number: AD1181791 | Open PDF

Abstract:

This study identifies the dimensions of autonomous decision-making (DADs) - the categories and causes of potential risk that one should consider before transferring decision-making capabilities to an intelligent autonomous system (IAS). The objective of this study was to provide some of the tools needed to implement existing policies with respect to the legal, ethical, and militarily effective use of IAS. These tools help to identify and either mitigate or accept the risks associated with the use of IAS that might result in a negative outcome. The 13 identified DADs were developed from a comprehensive list of 559 "risk elements" drawn from hundreds of documents authored by parties in favor of, and opposed to, the use of autonomy technology in weapons systems. We record these elements in the form of a question so that they can be used by the acquisition community to develop requirements documents that ensure the ethical use of autonomous systems, and be used by military commanders as a risk assessment checklist to ensure that autonomous systems are not used in an unethical manner. In this way, the Department of Defense can make fully-informed risk assessment decisions before developing or deploying autonomous systems.

Author(s):
Stumborg, Michael F ; Roh, Becky ; Rosen, Mark ; Bendett, Sam ; Pollpeter, Kevin
Author Organization(s):
Center for Naval Analyses
Funding Organization(s):
Office of Naval Research, Washington , DC
Document Type:
Technical Report/Final Report
Publication Date:
2021 Sep 01
Pagination:
116

Security Markings

DOCUMENT & CONTEXTUAL SUMMARY

Distribution Code:
A - Approved For Public Release
Distribution Statement: Public Release

RECORD

Collection: TRECMS
Identifying Numbers
Contract Number(s):
N00014-16-D-5003
Task Number(s):
E317.00
Program Element Number(s):
0605154N
Project Number(s):
R0148
Subject Terms
Modernization Areas:
Autonomy
Communities of Interest:
Autonomy
Descriptor(s):
autonomous weapons, war colleges, unmanned aerial systems, unmanned aerial vehicles, civil rights, military science, national security, unmanned underwater vehicles, drone targeting, international law, national governments, warfare, department of defense, intelligence community (united states), united states government, air force, aircrafts
Keyword(s):
artificial intelligence, autonomy, ethics
Creation Date:
2022 Oct 05
Update Date:
2022 Dec 08