Rating Delay and Rating Outcomes in Laboratory-Based Performance Evaluations.
AIR FORCE INST OF TECH WRIGHT-PATTERSON AFB OH
Pagination or Media Count:
Intervals of rating delay and levels of true halo were examined for relationships with rater errors, rater accuracy Cronbach, 1955, and convergentdiscriminant validity. Relationships among these rating outcomes were also examined. Delay intervals did not affect systematic distortion, convergent, or discriminant validity, but resulted in lower Differential Elevation DEL accuracy and higher Absolute Halo Error AHE after a two-day interval. Significant intercorrelations were found among measures of rater error and rater accuracy. Elevation accuracy correlated positively with Observed Halo OH, Observed Leniency and convergent validity. DEL correlated negatively with OH and positively with Restriction of Range. Both Stereotype Accuracy and Differential Accuracy were positively related to OH and negatively related to AHE. True halo, rather than rating delay, moderated relationships between several rater errors and rater accuracy measures. It was concluded that the delay intervals studied had few strong influences on rating outcomes and that rater error measures could not in all cases serve as meaningful measures of rating inaccuracy. Levels of true halo in rated performances need to be considered as well.
- Statistics and Probability