Spatial Frequency Requirements and Gaze Strategy in Visual-Only and Audiovisual Speech Perception Purpose The aim of this article is to examine the effects of visual image degradation on performance and gaze behavior in audiovisual and visual-only speech perception tasks. Method We presented vowel–consonant–vowel utterances visually filtered at a range of frequencies in visual-only, audiovisual congruent, and audiovisual incongruent conditions (Experiment ... Research Article
Research Article  |   August 01, 2016
Spatial Frequency Requirements and Gaze Strategy in Visual-Only and Audiovisual Speech Perception
 
Author Affiliations & Notes
  • Amanda H. Wilson
    Psychology Department, Queen's University, Kingston, Ontario, Canada
    Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
  • Agnès Alsius
    Psychology Department, Queen's University, Kingston, Ontario, Canada
  • Martin Paré
    Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
  • Kevin G. Munhall
    Psychology Department, Queen's University, Kingston, Ontario, Canada
    Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
  • Disclosure: The authors have declared that no competing interests existed at the time of publication.
    Disclosure: The authors have declared that no competing interests existed at the time of publication. ×
  • Correspondence to Agnès Alsius: aalsius@gmail.com
  • Editor: Jody Kreiman
    Editor: Jody Kreiman×
  • Associate Editor: Ewa Jacewicz
    Associate Editor: Ewa Jacewicz×
Article Information
Hearing & Speech Perception / Audiologic / Aural Rehabilitation / Speech, Voice & Prosody / Speech / Research Articles
Research Article   |   August 01, 2016
Spatial Frequency Requirements and Gaze Strategy in Visual-Only and Audiovisual Speech Perception
Journal of Speech, Language, and Hearing Research, August 2016, Vol. 59, 601-615. doi:10.1044/2016_JSLHR-S-15-0092
History: Received March 4, 2015 , Revised September 16, 2015 , Accepted October 7, 2015
 
Journal of Speech, Language, and Hearing Research, August 2016, Vol. 59, 601-615. doi:10.1044/2016_JSLHR-S-15-0092
History: Received March 4, 2015; Revised September 16, 2015; Accepted October 7, 2015
Web of Science® Times Cited: 1

Purpose The aim of this article is to examine the effects of visual image degradation on performance and gaze behavior in audiovisual and visual-only speech perception tasks.

Method We presented vowel–consonant–vowel utterances visually filtered at a range of frequencies in visual-only, audiovisual congruent, and audiovisual incongruent conditions (Experiment 1; N = 66). In Experiment 2 (N = 20), participants performed a visual-only speech perception task and in Experiment 3 (N = 20) an audiovisual task while having their gaze behavior monitored using eye-tracking equipment.

Results In the visual-only condition, increasing image resolution led to monotonic increases in performance, and proficient speechreaders were more affected by the removal of high spatial information than were poor speechreaders. The McGurk effect also increased with increasing visual resolution, although it was less affected by the removal of high-frequency information. Observers tended to fixate on the mouth more in visual-only perception, but gaze toward the mouth did not correlate with accuracy of silent speechreading or the magnitude of the McGurk effect.

Conclusions The results suggest that individual differences in silent speechreading and the McGurk effect are not related. This conclusion is supported by differential influences of high-resolution visual information on the 2 tasks and differences in the pattern of gaze.

Acknowledgments
Amanda H. Wilson, Agnès Alsius, and this research have been supported by the Canadian Institutes of Health Research (CIHR) and the Natural Sciences and Engineering Research Council of Canada (NSERC).
Order a Subscription
Pay Per View
Entire Journal of Speech, Language, and Hearing Research content & archive
24-hour access
This Article
24-hour access