Testing for Agreement Between Two Groups of Judges.
FLORIDA STATE UNIV TALLAHASSEE DEPT OF STATISTICS
Pagination or Media Count:
The problem of m rankings so named by Kendall and studied extensively by Kendall, Babington Smith, and others, considers the relationship between the rankings that a group of m judges assigns to a set of k objects. Suppose there are two groups of judges ranking the objects. Given that there is agreement within each group of judges, how can we test for evidence of agreement between the two groups. This question, recently posed to us by Kendall, has been studied by Schucany, Frawley and Li. In this paper we show that the test of agreement proposed by Schucany and Frawley, and further advanced by Li and Schucany, is misleading and does not provide a satisfactory answer to Kendalls question. After pinpointing various defects of the Schucany-Frawley test, we adapt a procedure, proposed by Wald and Wolfowitz in a slightly different context, to furnish a new test for agreement between two groups of judges.
- Statistics and Probability