Development, Validation, and Fairness of a Biographical Data Questionnaire for the Air Traffic Control Specialist Occupation
FEDERAL AVIATION ADMINISTRATION OKLAHOMA CITY OK CIVIL AEROSPACE MEDICAL INST
Pagination or Media Count:
Development and validation of a biographical data biodata instrument for selection into the Air Traffic Control Specialist occupation is described. Bootstrapping was used to estimate correlations between item responses to the Applicant Background Assessment ABA 142 items n266, Biographical Questionnaire BQ 145 items n482, and average supervisory job performance ratings. Scoring keys were developed for the most predictive 80, 100, and 120 items from the instruments. Reliabilities for the proposed scales ranged from .74 to .78. Criterion-related validities were .59, .62, and .63 for the 80-, 100-, and 120-item versions, respectively. Each version of the biodata scale had significant incremental validity over the AT-SAT composite score, accounting for 29 to 32 additional variance in average job performance ratings. Score distributions and cut-scores by race and sex were investigated. Differences d in mean scores by gender and ethnicity were generally low ranging from -.08 to .37. Finally, cut score analyses were performed to examine pass rates of demographic subgroups using banding and percentiles. Based on the findings of this study, it is recommended that the 80-item biodata scale, renamed the Controller Background Assessment Survey CBAS, be further developed as a potential ATCS selection procedure.
- Personnel Management and Labor Relations