'Obsolescence:' Evaluating an Educational Serious Game on Artificial Intelligence Impacts to Military Strategic Goals
[Technical Report, Master's Thesis]
AIR FORCE INSTITUTE OF TECHNOLOGY WRIGHT-PATTERSON AFB OH
Pagination or Media Count:
Artificial Intelligence AI threatens to bring significant disruption to all aspects of military operations. This research develops a Serious Game SG and assessment methodology to provide education on the mindsets required for engaging with disruptive AI technologies. The game, Obsolescence, teaches strategic-level concepts recommended to the Department of Defense DoD from a compilation of reports on the current and future state of AI and warfighting. The methodology for assessing the educational value of Obsolescence addresses common challenges such as subjective reporting, control groups, population sizes, and measuring abstract or high levels of learning. The games proposed educational value is tested using a pre-and post-test format against a baseline established by official sources and experts in the fields of AI and strategic planning. The assessment includes metrics based on both self-reported learning and measurements of changes to participant responses to LO-related questions post-gameplay. The experiment found a strong correlation between the measured learning and participants self-reported learning, and both metrics confirm that Obsolescence achieves its educational goals. This research includes the steps necessary to utilize the assessment methodology and presents recommendations both for Obsolescence and for future research in the field of educational game assessment.
- Military Operations, Strategy and Tactics