Tri-Word Presentations With Phonemic Scoring for Practical High-Reliability Speech Recognition Assessment Speech recognition test reliability is optimized with 450 test items, and the Computer Assisted Speech Recognition Assessment (CASRA) test is a practical approach for achieving this goal by combining 50 presentations of 3 consonantvowel nucleus-consonant (CNC) words each with phonemic scoring (S. A. Gelfand, 1998). However, optimized reliability might not ... Research Article
Research Article  |   April 01, 2003
Tri-Word Presentations With Phonemic Scoring for Practical High-Reliability Speech Recognition Assessment
 
Author Affiliations & Notes
  • Stanley A. Gelfand, PhD
    Queens College of The City University of New York
  • Contact author: Stanley A. Gelfand, PhD, Department of Linguistics and Communication Disorders, Queens College of the City University of New York, 65-30 Kissena Boulevard, Flushing, NY 11367. E-mail: sgelfand@qcl.qc.edu
Article Information
Hearing & Speech Perception / Speech, Voice & Prosody / Hearing / Research Articles
Research Article   |   April 01, 2003
Tri-Word Presentations With Phonemic Scoring for Practical High-Reliability Speech Recognition Assessment
Journal of Speech, Language, and Hearing Research, April 2003, Vol. 46, 405-412. doi:10.1044/1092-4388(2003/033)
History: Received March 25, 2002 , Accepted December 13, 2002
 
Journal of Speech, Language, and Hearing Research, April 2003, Vol. 46, 405-412. doi:10.1044/1092-4388(2003/033)
History: Received March 25, 2002; Accepted December 13, 2002
Web of Science® Times Cited: 7

Speech recognition test reliability is optimized with 450 test items, and the Computer Assisted Speech Recognition Assessment (CASRA) test is a practical approach for achieving this goal by combining 50 presentations of 3 consonantvowel nucleus-consonant (CNC) words each with phonemic scoring (S. A. Gelfand, 1998). However, optimized reliability might not be essential if reliability is as high as possible in light of practical constraints and what the clinician is trying to do with the results. The CASRA paradigm addresses these compromise goals with a reduced number of 3-word sets: 25 sets yield 25 (groups) x 3 (words) x 3 (phonemes) = 225 test items, 20 sets give 20 x 3 x 3 = 180 items, and 10 sets provide 10 x 3x 3= 90 items. This study addressed the empirical reliability of such an approach, and the extent to which results on shortened versions predict full-test scores. Test and retest scores were obtained for 10-, 20-, and 25-set versions of the CASRA for 144 participants with a wide range of hearing ability. For group data, first and second scores were highly correlated and not significantly different from each other for all 3 test sizes. Performance based on 20 and 25 sets accounted for roughly 97% of the variance of full (50-set) test scores, and scores based on 10 sets accounted for about 88% of the full-test variance. Individual test-retest reliability agreed with theoretical expectations based on 95% binomial confidence intervals. Cases outside the 95% confidence limits were 7.6% for 10 sets, and 3.5% for 20 and 25 sets with phoneme scoring, and 4.9% for 10 and 20 sets and 3.5% for 25 sets with word scoring. The shortened CASRA is a practical way to achieve improvements in reliability over traditional word tests. The 20-set version may approximate the strongest compromise when trying to shorten test size without appreciably reducing reliability for clinical purposes. However, the 10-set version is probably a more practical approach for routine use because it accounts for 88% of full-test variance, is more reliable than a traditional 75-word test, and does not appear to be subject to significant short-term learning effects.

Acknowledgments
The author gratefully acknowledges Tova Itzkovitz, Audrey Parraga, and Kim Pantino for their assistance in collecting and summarizing the data, and Dr. Craig A. Champlin and Dr. Craig Formby for their many valuable and constructive comments and suggestions. This work was supported in part by City University of New York PSC-BHE Grants 665535, 666535, 61649, and 62738
Order a Subscription
Pay Per View
Entire Journal of Speech, Language, and Hearing Research content & archive
24-hour access
This Article
24-hour access