The Impact of Performance Consistency and Performance Level on Alternative Measures of Rater Accuracy.
MICHIGAN STATE UNIV EAST LANSING DEPT OF PSYCHOLOGY
Pagination or Media Count:
This report attempts to understand factors that influence raters ability to provide accurate ratings have, on occasion, focused on static characteristics of ratees e.g., race and gender. The present study investigated dynamic characteristIcs related to the pattern and level of performance displayed by the ratee. In a repeated measures design, 37 raters were required to rate the performance of 4 subordinates who differed from each other in the level of their performance and its consistency. It was hypothesized that performance characteristics would have differential impact on several types of performance accuracy measures. Cronbachs overall accuracy as well as two indices of accuracy based on signal detection theory, labeled classification and behavioral accuracy by Lord 1985, were compared. Results showed that characteristics of ratee performance did effect the accuracy measures differentially. Keywords Information processing.