View The Document

Accession Number:

AD1122393

Title:

Statistical Design and Analysis Challenges in Defense Testing

Author(s):

Author Organization(s):

Report Date:

2019-01-01

Abstract:

Before the DoD acquires any major new capability, that system must undergo realistic testing in its intended environment with military users. The complex, data-limited, highly variable nature of the test environment presents many unique statistical challenges. The set of conditions in which a system will operate is typically large, and important variables are often uncontrollable during test, making rigorous experimental design a challenge. Data sets obtained from tests are almost always messy. Issues such as lurking variables, small and unbalanced sample sizes, and ordinal responses necessitate creative and sometimes sophisticated data analysis approaches. This document examines some of these defense-testing situations in detail and discusses how statisticians in the test and evaluation community have approached associated design and analysis challenges.

Pages:

45

File Size:

5.71MB

Descriptors:

Identifiers:

SubjectCategory:

Distribution Statement:

Approved For Public Release

View The Document