Comprehensive Occupational Data Analysis Programs (CODAP): Use of REXALL to Identify Divergent Raters.
Interim rept. May-Sep 76,
AIR FORCE HUMAN RESOURCES LAB BROOKS AFB TEX
Pagination or Media Count:
REXALL is a very powerful and flexible program within the CODAP Comprehensive Occupational Data Analysis Programs system. It was designed primarily for analysing judges task-factor ratings, and may be used for identifying divergent raters. Divergent raters are those whose ratings are significantly different from the other raters ratings. They may be the non-cooperative raters who simply generate an arbitrary pattern of responses rather than try to follow the instructions, or they may invert the rating scale or they may actually perceive the tasks differently. Some divergent raters must be eliminated from the study to preserve the validity of the task means computed from the ratings. This report uses data from an actual study to show how REXALL is used to detect divergent raters, and to decide whether or not to delete them from the study. It then uses the raw data from the study to verify the validity of the decisions made on the basis of the REXALL output.
- Personnel Management and Labor Relations