Accession Number : ADA567387


Title :   A Methodology to Assess UrbanSim Scenarios


Descriptive Note : Master's thesis


Corporate Author : NAVAL POSTGRADUATE SCHOOL MONTEREY CA


Personal Author(s) : Vogt, Brian D


Full Text : https://apps.dtic.mil/dtic/tr/fulltext/u2/a567387.pdf


Report Date : Sep 2012


Pagination or Media Count : 101


Abstract : Turn-based strategy games and simulations are vital tools for military education, training, and readiness. In an era of increasingly constrained resources and expanding demand for training solutions, the need for validated, effective solutions will increase. Appropriate performance feedback is an important component of any training solution. Current methods for designing and testing the performance feedback provided in turn-based simulation are limited to well-structured problems and do not adequately address ill-structured problems that better replicate problems facing military leaders in today's complex operating environment. This thesis develops and explores new methods for assessing the feedback mechanisms of turn-based strategy games. Using UrbanSim, a game for training strategic approaches to COIN operations as an exemplar, this thesis developed and explored two unique methods for evaluating the reward structure of the UrbanSim scenarios. The first method evaluates different student strategies using a batch-run method. The second method uses a reinforcement-learning algorithm to explore the decision space. These scenario evaluation methodologies are shown to be able to provide insights about a game's performance feedback mechanism that was not previously available. These methodologies can be used for formative evaluation during game scenario development. Additionally, these evaluation methodologies are generalizable to other training and education games that focus on ill-structured problems and decisionmaking at discrete intervals.


Descriptors :   *GAME THEORY , *MILITARY TRAINING , *SCENARIOS , *SIMULATION , DECISION MAKING , DISCRETE DISTRIBUTION , ENVIRONMENTS , FEEDBACK , INTERVALS , METHODOLOGY , MILITARY COMMANDERS , OPERATIONAL READINESS , PERFORMANCE(HUMAN) , RESOURCES , SOLUTIONS(GENERAL) , STRATEGY , STUDENTS , TEST AND EVALUATION , THESES , TOOLS


Subject Categories : Computer Programming and Software


Distribution Statement : APPROVED FOR PUBLIC RELEASE