DID YOU KNOW? DTIC has over 3.5 million final reports on DoD funded research, development, test, and evaluation activities available to our registered users. Click HERE
to register or log in.
Peer Ratings: Scoring Strategy Development and Reliability Demonstration on Air Force Basic Trainees
PERSONNEL DECISIONS RESEARCH INST MINNEAPOLIS MN
Pagination or Media Count:
Peer ratings were obtained from over 27,000 Basic Trainees. An effective method was developed for scoring them by algebraically summing the positive and negative ratings. A modification of the Spearman-Brown prophecy formula was used to determine interrater reliability coefficients which were adjusted to the mean number of trainees in the flights. The peer ratings yielded uniformly high interrater reliability coefficients which indicated substantial agreement among raters. It was concluded that the method developed for norming peer ratings from different size groups was valuable and could be applied to standardize future peer ratings. Peer ratings thus show promise for performance appraisal when normed using this method.
APPROVED FOR PUBLIC RELEASE