Use of the Fisher Exact Test for the Design of Observer Tests

reportActive / Technical Report | Accession Number: ADA458136 | Open PDF

Abstract:

This paper presents techniques to aid in the design of an observer test. To select an appropriate number of observation opportunities, the test designer can use the Fisher Exact Test to calculate the number of observation opportunities required so that a given experimental difference in probability of detection will be statistically significant. Alternatively, the designer can select the number of observation opportunities to guard against rejecting a real difference in probability of detection. These criteria require calculating the probabilities of so-called Type I and Type II errors in hypothesis testing.

Author(s):
Bennett, John G.
Author Organization(s):
ARMY TANK-AUTOMOTIVE AND ARMAMENTS COMMAND WARREN MI
Supplementary Note:
DOI: 10.21236/ADA458136
Pagination:
0018

Security Markings

DOCUMENT & CONTEXTUAL SUMMARY

Distribution:
Approved For Public Release
Distribution Statement:
Approved For Public Release; Distribution Is Unlimited.

RECORD

Collection: TR
Identifying Numbers
Monitor Series:
AMSTA-QH
 Subject Terms
Joint Capability Areas:
JCA_5_Command and Control; JCA_5.3_Planning; JCA_1.2.5_Lessons Learned
Communities of Interest:
Human Systems
Descriptor(s):
*TEST AND EVALUATION, *OBSERVERS, *PLANNING, *TEST METHODS, DETECTION, OBSERVATION, HYPOTHESES, PROBABILITY
Field(s)/Group(s):
Test Facilities, Equipment and Methods
Keyword(s):
FISHER EXACT TEST
Report Date:
2001 Jan 01
Creation Date:
2006 Dec 20