Article/Report  |   December 2007
Listener Agreement for Auditory-Perceptual Ratings of Dysarthria
Author Affiliations & Notes
  • Kate Bunton
    Waisman Center, Madison, WI
  • Raymond D. Kent
    Waisman Center, Madison, WI
  • Joseph R. Duffy
    Mayo Clinic, Rochester, MN
  • John C. Rosenbek
    William S. Middleton Memorial Veterans Hospital, Madison, WI
  • Jane F. Kent
    Waisman Center
  • Contact author: Kate Bunton, who is now with the Department of Speech, Language, and Hearing Sciences, University of Arizona, P.O. Box 210071, Tucson, AZ 85721-0071. E-mail: bunton@u.arizona.edu.
  • John C. Rosenbek is now with the University of Florida in Gainesville.
    John C. Rosenbek is now with the University of Florida in Gainesville.×
Speech, Voice & Prosodic Disorders / Dysarthria / Speech, Voice & Prosody / Speech
Article/Report   |   December 2007
Listener Agreement for Auditory-Perceptual Ratings of Dysarthria
Journal of Speech, Language, and Hearing Research December 2007, Vol.50, 1481-1495. doi:10.1044/1092-4388(2007/102)
History: Accepted 28 May 2007 , Received 03 Aug 2005 , Revised 20 Feb 2006
Journal of Speech, Language, and Hearing Research December 2007, Vol.50, 1481-1495. doi:10.1044/1092-4388(2007/102)
History: Accepted 28 May 2007 , Received 03 Aug 2005 , Revised 20 Feb 2006

Purpose: Darley, Aronson, and Brown (1969a, 1969b) detailed methods and results of auditory-perceptual assessment for speakers with dysarthrias of varying etiology. They reported adequate listener reliability for use of the rating system as a tool for differential diagnosis, but several more recent studies have raised concerns about listener reliability using this approach.

Method: In the present study, the authors examined intrarater and interrater agreement for perceptual ratings of 47 speakers with various dysarthria types by 2 listener groups (inexperienced and experienced). The entire set of perceptual features proposed by Darley et al. was rated based on a 40-s conversational speech sample.

Results: No differences in levels of agreement were found between the listener groups. Agreement was within 1 scale value or better for 67% of the pairwise comparisons. Levels of agreement were lower when the average rating fell in the mid-range of the scale compared with samples that had an average rating near either of the scale endpoints; agreement was above chance level. No significant differences in agreement were found between the perceptual features.

Discussion: The levels of listener agreement that were found indicate that auditory-perceptual ratings show promise during clinical assessment for identifying salient features of dysarthria for speakers with various etiologies.

Order a Subscription
Pay Per View
Entire Journal of Speech, Language, and Hearing Research content & archive
24-hour access
This Article
24-hour access

Related Articles

An Internet-Based Telerehabilitation System for the Assessment of Motor Speech Disorders: A Pilot Study
American Journal of Speech-Language Pathology February 2006, Vol.15, 45-56. doi:10.1044/1058-0360(2006/006)
An Exploration of Listener Variability in Intelligibility Judgments
American Journal of Speech-Language Pathology May 2011, Vol.20, 119-123. doi:10.1044/1058-0360(2010/10-0059)
Reliability of the Multi-Dimensional Voice Program for the Analysis of Voice Samples of Subjects With Dysarthria
American Journal of Speech-Language Pathology May 1999, Vol.8, 129-136. doi:10.1044/1058-0360.0802.129
Reliability and Agreement of Ratings of Ataxic Dysarthric Speech Samples With Varying Intelligibility
Journal of Speech, Language, and Hearing Research April 1991, Vol.34, 285-293. doi:10.1044/jshr.3402.285
Rasch Analysis of Word Identification and Magnitude Estimation Scaling Responses in Measuring Naïve Listeners' Judgments of Speech Intelligibility of Children With Severe-to-Profound Hearing Impairments
Journal of Speech, Language, and Hearing Research October 2008, Vol.51, 1124-1137. doi:10.1044/1092-4388(2008/06-0218)