TRANSCRIBER CONFIDENCE IN RELATION TO ACCURACY OF TRANSCRIPTION.
Technical research note,
ARMY PERSONNEL RESEARCH OFFICE WASHINGTON D C
Pagination or Media Count:
Measures of two aspects of performance--message intelligibility and expressed confidence in the correctness of transcription--were obtained from 8 Army enlisted men untrained in communications transcribing word lists received at 3 signal-to-noise ratios. Confidence was expressed through the use of a five-point rating scale ranging from fully confident to not at all confident, and a separate rating was assigned to each word in a list as it was transcribed. A significant relationship was obtained between transcriber confidence and accuracy of transcription. As expected, both mean intelligibility and mean confidence ratings increased as a direct function of signal-to-noise ratio. Signal-to-noise ratio did not similarly affect the relationship between confidence and accuracy. Because of generally unpredictable and unstable listening conditions in the field, the relationship between confidence and accuracy--averaged across signal-to-noise ratios--appears to provide a stable measure which is the best practical basis for estimating transcript accuracy. Conclusion was that a positive relationship exists between transcriber confidence of correct reception and message intelligibility, even when personnel untrained in communications serve as transcribers. While far from perfect, the relationship is sufficient to warrant further research using trained communications transcribers. Author
- Voice Communications