Development of a Man-to-Man Rating Scale for Evaluating Performance.
NAVAL POSTGRADUATE SCHOOL MONTEREY CALIF
Pagination or Media Count:
Over the years a continuous problem with performance rating systems has been the leniency and the non-comparability of marks assigned by different evaluators. By utilizing a computer, a method was developed which overcomes this problem. In this new method the evaluators must compare their ratees to other specific ratees anchors who are under other evaluators. All ratees receive their scale value based on their relative position to the anchoring points that were used by the evaluator. A trial of the method was made on ten groups, each composed of 12 students. Each group has two evaluators. The characteristics rated were Industry, Academic Ability, Judgment, and Cooperation. These were considered as relevant characteristics to the job of being a student. The groups had been relatively intact for approximately one year prior to the evaluations. A comparison of the results of using the standard fitness report rating method RAW and the man-to-man method MM and MMQ revealed that the man-to-man method was superior based on certain statistical qualities. The man-to-man method resulted in a greater spread of scores and, more importantly, resulted in higher inter-rater agreement than the standard rating method. An outside cirterion of Quality Point Average was available for the Academic Ability scale. Both the standard methodology and the man-to-man methodology produced rating values which were highly related to this outside criterion, .68 and .71 respectively. Author Modified Abstract
- Personnel Management and Labor Relations