Air Force Officer Qualifying Test (AFOQT) Form T: Psychometric Evaluation of the Situational Judgment Test
Abstract:
The Air Force Officer Qualifying Test (AFOQT) is used to qualify applicants for officer commissioning or for aircrew training as pilots, combat system operators, air battle managers, and remotely-piloted aircraft pilots. This technical report summarizes an item-level and subtest-level psychometric evaluation of the Situational Judgment Test (SJT) included in the AFOQT Form T. Overall, the SJT was found to be relatively easy, with low-to-moderate ability to differentiate among the test-takers with varying standings on the latent trait, and low-to-moderate internal consistency. Analyses at the item-level revealed mostly small mean score subgroup differences, except for one response on Form T1 and two responses on Form T2. Analyses at the subtest-level revealed small to moderate mean score subgroup differences, with Black/African-American test-takers having the largest effect sizes, followed by Asian test-takers. Test-retest reliability and alternate forms reliability were acceptable.