Listener Agreement for Auditory-Perceptual Ratings of Dysarthria Purpose: Darley, Aronson, and Brown (1969a, 1969b) detailed methods and results of auditory-perceptual assessment for speakers with dysarthrias of varying etiology. They reported adequate listener reliability for use of the rating system as a tool for differential diagnosis, but several more recent studies have raised concerns about listener reliability ... Article/Report
Article/Report  |   December 2007
Listener Agreement for Auditory-Perceptual Ratings of Dysarthria
 
Author Affiliations & Notes
  • Kate Bunton
    Waisman Center, Madison, WI
  • Raymond D. Kent
    Waisman Center, Madison, WI
  • Joseph R. Duffy
    Mayo Clinic, Rochester, MN
  • John C. Rosenbek
    William S. Middleton Memorial Veterans Hospital, Madison, WI
  • Jane F. Kent
    Waisman Center
  • Contact author: Kate Bunton, who is now with the Department of Speech, Language, and Hearing Sciences, University of Arizona, P.O. Box 210071, Tucson, AZ 85721-0071. E-mail: bunton@u.arizona.edu.
  • John C. Rosenbek is now with the University of Florida in Gainesville.
    John C. Rosenbek is now with the University of Florida in Gainesville.×
  • © 2007 American Speech-Language-Hearing AssociationAmerican Speech-Language-Hearing Association
Article Information
Speech, Voice & Prosodic Disorders / Dysarthria / Speech, Voice & Prosody / Speech
Article/Report   |   December 2007
Listener Agreement for Auditory-Perceptual Ratings of Dysarthria
Journal of Speech, Language, and Hearing Research, December 2007, Vol. 50, 1481-1495. doi:10.1044/1092-4388(2007/102)
History: Received August 3, 2005 , Revised February 20, 2006 , Accepted May 28, 2007
 
Journal of Speech, Language, and Hearing Research, December 2007, Vol. 50, 1481-1495. doi:10.1044/1092-4388(2007/102)
History: Received August 3, 2005; Revised February 20, 2006; Accepted May 28, 2007
Web of Science® Times Cited: 21

Purpose: Darley, Aronson, and Brown (1969a, 1969b) detailed methods and results of auditory-perceptual assessment for speakers with dysarthrias of varying etiology. They reported adequate listener reliability for use of the rating system as a tool for differential diagnosis, but several more recent studies have raised concerns about listener reliability using this approach.

Method: In the present study, the authors examined intrarater and interrater agreement for perceptual ratings of 47 speakers with various dysarthria types by 2 listener groups (inexperienced and experienced). The entire set of perceptual features proposed by Darley et al. was rated based on a 40-s conversational speech sample.

Results: No differences in levels of agreement were found between the listener groups. Agreement was within 1 scale value or better for 67% of the pairwise comparisons. Levels of agreement were lower when the average rating fell in the mid-range of the scale compared with samples that had an average rating near either of the scale endpoints; agreement was above chance level. No significant differences in agreement were found between the perceptual features.

Discussion: The levels of listener agreement that were found indicate that auditory-perceptual ratings show promise during clinical assessment for identifying salient features of dysarthria for speakers with various etiologies.

Acknowledgment
This work was supported in part by National Institutes of Health Grants NIH R01 DC00319, awarded to Ray Kent, and NIH R03 DC005902, awarded to Kate Bunton.
Order a Subscription
Pay Per View
Entire Journal of Speech, Language, and Hearing Research content & archive
24-hour access
This Article
24-hour access