RELATIONSHIP OF EXPRESSED CONFIDENCE TO ACCURACY OF TRANSCRIPTION BY OPERATIONAL COMMUNICATIONS PERSONNEL
Technical research note
ARMY BEHAVOIR AND SYSTEMS RESEARCH LAB ARLINGTON VA
Pagination or Media Count:
The study sought to determine whether operational communications personnel can rate their performance in transcribing voice radio messages partially embedded in noise with sufficient precision for the ratings to have potential operational utility. Eight experienced communications operators rated their confidence in the accuracy of their reception and transcription of messages received at three signal-to-noise ratios -6 db, 0 db, 6 db, using a five-point rating scale. As a control, subjects also received and transcribed the messages without making ratings. Measures of transcript accuracy and expressed confidence in transcription were compared with results from a prior study in which subjects had no formal training or experience in communications or transcription. Experienced operators were highly successful in judging their own accuracy, the relationship between confidence and accuracy being r sub tet .78. Some overconfidence at the upper end of the rating scale and underconfidence at the lower end were evident. Intelligibility improved from 20 to 88 as signal-to-noise ratio increased. The communications operators performed better than the non-communications trained subjects in the former study both in accuracy of transcription and in precision of confidence ratings. Judging the transcription did not affect the average accuracy of the transcripts in either study. In both studies, subjects tended to make effective use of less than all five points of the confidence rating scale.
- Personnel Management and Labor Relations
- Voice Communications