Temporal and Spectral Cues for Musical Timbre Perception in Electric Hearing PurposeThe purpose of this study was to investigate musical timbre perception in cochlear-implant (CI) listeners using a multidimensional scaling technique to derive a timbre space.MethodsSixteen stimuli that synthesized western musical instruments were used (McAdams, Winsberg, Donnadieu, De Soete, & Krimphoff, 1995). Eight CI listeners and 15 normal-hearing (NH) listeners participated. ... Article
Article  |   June 01, 2011
Temporal and Spectral Cues for Musical Timbre Perception in Electric Hearing
 
Author Affiliations & Notes
  • Ying-Yee Kong
    Northeastern University, Boston, MA
    Northeastern University, Boston, MA
  • Ala Mullangi
    Northeastern University, Boston, MA
    Northeastern University, Boston, MA
  • Jeremy Marozeau
    Northeastern University, Boston, MA
    Northeastern University, Boston, MA
  • Michael Epstein
    Northeastern University, Boston, MA
    Northeastern University, Boston, MA
  • Correspondence to Ying-Yee Kong: yykong@neu.edu
  • Editor: Robert Schlauch
    Editor: Robert Schlauch×
  • Associate Editor: Christopher Turner
    Associate Editor: Christopher Turner×
Article Information
Hearing & Speech Perception / Acoustics / Hearing Aids, Cochlear Implants & Assistive Technology / Hearing
Article   |   June 01, 2011
Temporal and Spectral Cues for Musical Timbre Perception in Electric Hearing
Journal of Speech, Language, and Hearing Research, June 2011, Vol. 54, 981-994. doi:10.1044/1092-4388(2010/10-0196)
History: Received July 14, 2010 , Accepted October 15, 2010
 
Journal of Speech, Language, and Hearing Research, June 2011, Vol. 54, 981-994. doi:10.1044/1092-4388(2010/10-0196)
History: Received July 14, 2010; Accepted October 15, 2010
Web of Science® Times Cited: 16

PurposeThe purpose of this study was to investigate musical timbre perception in cochlear-implant (CI) listeners using a multidimensional scaling technique to derive a timbre space.

MethodsSixteen stimuli that synthesized western musical instruments were used (McAdams, Winsberg, Donnadieu, De Soete, & Krimphoff, 1995). Eight CI listeners and 15 normal-hearing (NH) listeners participated. Each listener made judgments of dissimilarity between stimulus pairs. Acoustical analyses that characterized the temporal and spectral characteristics of each stimulus were performed to examine the psychophysical nature of each perceptual dimension.

ResultsFor NH listeners, the timbre space was best represented in three dimensions, one correlated with the temporal envelope (log-attack time) of the stimuli, one correlated with the spectral envelope (spectral centroid), and one correlated with the spectral fine structure (spectral irregularity) of the stimuli. The timbre space from CI listeners, however, was best represented by two dimensions, one correlated with temporal envelope features and the other weakly correlated with spectral envelope features of the stimuli.

ConclusionsTemporal envelope was a dominant cue for timbre perception in CI listeners. Compared to NH listeners, CI listeners showed reduced reliance on both spectral envelope and spectral fine structure cues for timbre perception.

Acknowledgments
We gratefully acknowledge the support provided by National Institute on Deafness and Other Communication Disorders Grant R03 DC009684-02 to the first author and Northeastern University Provost Faculty Development Research Grant to the first and fourth authors. We are grateful to all listeners for their participation in the experiment. We would like to thank Professor Stephen McAdams for providing the stimuli.
Order a Subscription
Pay Per View
Entire Journal of Speech, Language, and Hearing Research content & archive
24-hour access
This Article
24-hour access