Cookies Policy
X

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies.

I accept this policy

Find out more here

Forty Years After Hearing Lips and Seeing Voices: the McGurk Effect Revisited

No metrics data to plot.
The attempt to load metrics for this article has failed.
The attempt to plot a graph for these metrics has failed.
The full text of this article is not currently available.

Brill’s MyBook program is exclusively available on BrillOnline Books and Journals. Students and scholars affiliated with an institution that has purchased a Brill E-Book on the BrillOnline platform automatically have access to the MyBook option for the title(s) acquired by the Library. Brill MyBook is a print-on-demand paperback copy which is sold at a favorably uniform low price.

Access this article

+ Tax (if applicable)
Add to Favorites
You must be logged in to use this functionality

image of Multisensory Research
For more content, see Seeing and Perceiving and Spatial Vision.

Since its discovery 40 years ago, the McGurk illusion has been usually cited as a prototypical paradigmatic case of multisensory binding in humans, and has been extensively used in speech perception studies as a proxy measure for audiovisual integration mechanisms. Despite the well-established practice of using the McGurk illusion as a tool for studying the mechanisms underlying audiovisual speech integration, the magnitude of the illusion varies enormously across studies. Furthermore, the processing of McGurk stimuli differs from congruent audiovisual processing at both phenomenological and neural levels. This questions the suitability of this illusion as a tool to quantify the necessary and sufficient conditions under which audiovisual integration occurs in natural conditions. In this paper, we review some of the practical and theoretical issues related to the use of the McGurk illusion as an experimental paradigm. We believe that, without a richer understanding of the mechanisms involved in the processing of the McGurk effect, experimenters should be really cautious when generalizing data generated by McGurk stimuli to matching audiovisual speech events.

Affiliations: 1: Psychology Department, Queen’s University, Humphrey Hall, 62 Arch St., Kingston, Ontario, K7L 3N6 Canada

*To whom correspondence should be addressed. E-mail: aalsius@gmail.com
Loading

Full text loading...

/content/journals/10.1163/22134808-00002565
Loading

Data & Media loading...

1. Alm M., Behne D. M., Wang Y., Eg R. (2009). "Audio-visual identification of place of articulation and voicing in white and babble noise", J. Acoust. Soc. Am. Vol 126, 377387. [Crossref]
2. Aloufy S., Lapidot M., Myslobodskym M. (1996). "Differences in susceptibility to the “blending illusion” among native Hebrew and English speakers", Brain Lang. Vol 53, 5157. [Crossref]
3. Alsius A., Wayne R., Paré M., Munhall K. G. (2016). "High visual resolution matters in audiovisual speech perception, but only for some", Attent. Percept. Psychophys. Vol 78, 14721487. [Crossref]
4. Andersen T. S., Tiippana K., Laarni J., Kojo I., Sams M. (2009). "The role of visual spatial attention in audiovisual speech perception", Speech Commun. Vol 51, 184193. [Crossref]
5. Bastien-Toniazzo M., Stroumza A., Cavé C. (2009). "Audio-visual perception and integration in developmental dyslexia: an exploratory study using the McGurk effect", Curr. Psychol. Lett. Vol 25, 214.
6. Basu Mallick D., Magnotti J. F., Beauchamp M. S. (2015). "Variability and stability in the McGurk effect: contributions of participants, stimuli, time, and response type", Psychonom. Bull. Rev. Vol 22, 12991307. [Crossref]
7. Baum S. H., Martin R. C., Hamilton A. C., Beauchamp M. S. (2012). "Multisensory speech perception without the left superior temporal sulcus", NeuroImage Vol 62, 18251832. [Crossref]
8. Beauchamp M. S., Nath A. R., Pasalar S. (2010). "fMRI-guided transcranial magnetic stimulation reveals that the superior temporal sulcus is a cortical locus of the McGurk effect", J. Neurosci. Vol 30, 24142417. [Crossref]
9. Bebko J. M., Schroeder J. H., Weiss J. A. (2013). "The McGurk effect in children with autism and Asperger syndrome", Autism Res. Vol 7, 5059. [Crossref]
10. Benoit M. M., Raij T., Lin F. H., Jaaskelainen I. P., Stufflebeam S. (2010). "Primary and multisensory cortical activity is correlated with audiovisual percepts", Hum. Brain Mapp. Vol 31, 526538.
11. Berger C. C., Ehrsson H. H. (2013). "Mental imagery changes multisensory perception", Curr. Biol. Vol 23, 13671372. [Crossref]
12. Bernstein L. E., Auer E. T. Jr, Wagner M., Ponton C. W. (2008). "Spatiotemporal dynamics of audiovisual speech processing", NeuroImage Vol 39, 423435. [Crossref]
13. Bertelson P., Vroomen J., De Gelder B. (2003). "Visual recalibration of auditory speech identification: a McGurk aftereffect", Psychol. Sci. Vol 14, 592597. [Crossref]
14. Bishop C. W., Miller L. M. (2011). "Speech cues contribute to audiovisual spatial integration", PLoS One Vol 6, e24016. DOI:10.1371/journal.pone.0024016.
15. Böhning M., Campbell R., Karmiloff-Smith A. (2002). "Audiovisual speech perception in Williams syndrome", Neuropsychologia Vol 40, 13961406. [Crossref]
16. Boliek C., Keintz C., Norrix L., Obrzut J. (2010). "Auditory-visual perception of speech in children with learning disabilities: the McGurk effect", Can. J. Speech-Lang. Pathol. Audiol. Vol 34, 124131.
17. Brancazio L. (2004). "Lexical influences in audiovisual speech perception", J. Exp. Psychol. Hum. Percept. Perform. Vol 30, 445463. [Crossref]
18. Brancazio L., Miller J. L. (2005). "Use of visual information in speech perception: evidence for a visual rate effect both with and without a McGurk effect", Percept. Psychophys. Vol 67, 759769. [Crossref]
19. Brancazio L., Miller J. L., Paré M. A. (2013). "Visual influences on the internal structure of phonetic categories", Percept. Psychophys. Vol 65, 591601. [Crossref]
20. Buchan J. N., Munhall K. G. (2011). "The influence of selective attention to auditory and visual speech on the integration of audiovisual speech information", Perception Vol 40, 11641182. [Crossref]
21. Burnham D., Dodd B. (2004). "Auditory-visual speech integration by pre-linguistic infants: perception of an emergent consonant in the McGurk effect", Dev. Psychobiol. Vol 44, 209220. [Crossref]
22. Calvert G. A., Campbell R., Brammer M. J. (2000). "Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex", Curr. Biol. Vol 10, 649657. [Crossref]
23. Campbell C., Massaro D. (1997). "Perception of visible speech: influence of spatial quantization", Perception Vol 26, 129146. [Crossref]
24. Cienkowski K. M., Carney A. E. (2002). "Auditory-visual speech perception and aging", Ear Hear. Vol 23, 439449. [Crossref]
25. Colin C., Radeau M., Deltenre P., Demolin D., Soquet A. (2002). "The role of sound intensity and stop-consonant voicing on McGurk fusions and combinations", Eur. J. Cogn. Psychol. Vol 14, 475491. [Crossref]
26. Colin C., Radeau M., Deltenre P. (2005). "Top-down and ottom-up modulation of audiovisual integration in speech", Eur. J. Cogn. Psychol. Vol 17, 541560. [Crossref]
27. Cotton J. C. (1935). "Normal ‘visual hearing’", Science Vol 82, 592593. [Crossref]
28. De Gelder B., Vroomen J., Annen L., Masthof E., Hodiamont P. (2003). "Audio-visual integration in schizophrenia", Schizophr. Res. Vol 59, 211218. [Crossref]
29. Dekle D., Fowler C., Funnell M. (1992). "Auditory-visual integration in perception of real words", Percept. Psychophys. Vol 51, 355362. [Crossref]
30. Delbeuck X., Collette F., Van der Linden M. (2007). "Is Alzheimer’s disease a disconnection syndrome? Evidence from a crossmodal audio-visual illusory experiment", Neuropsychologia Vol 45, 33153323. [Crossref]
31. Demorest M. E., Bernstein L. E. (1992). "Sources of variability of speechreading sentences: a generalizability analysis", J. Speech Hear. Res. Vol 35, 876891. [Crossref]
32. Déry C., Campbell N. K. J., Lifshitz M., Raz A. (2014). "Suggestion overrides automatic audiovisual integration", Consc. Cogn. Vol 24, 3337. [Crossref]
33. Desai S., Stickney G., Zeng F. G. (2008). "Auditory-visual speech perception in normal-hearing and cochlear-implant listeners", J. Acoust. Soc. Am. Vol 123, 428440. [Crossref]
34. Desjardins R. N., Werker J. F. (2004). "Is the integration of heard and seen speech mandatory for infants?" Dev. Psychobiol. Vol 45, 187203. [Crossref]
35. Easton R. D., Basala M. (1982). "Perceptual dominance during lipreading", Percept. Psychophys. Vol 32, 562570. [Crossref]
36. Erickson L. C., Zielinski B. A., Zielinski J. E., Liu G., Turkeltaub P. E., Leaver A. M., Rauschecker J. P. (2014). "Distinct cortical locations for integration of audiovisual speech and the McGurk effect", Front. Psychol. Vol 5, 534. DOI:10.3389/fpsyg.2014.00534. [Crossref]
37. Erlebacher A., Sekuler R. (1971). "Response frequency equalization: a bias model for psychophysics", Percept. Psychophys. Vol 9, 315320. [Crossref]
38. Eskelund K., Tuomainen J., Andersen T. S. (2011). "Multistage audiovisual integration of speech: dissociating identification and detection", Exp. Brain Res. Vol 208, 447457. [Crossref]
39. Eskelund K., MacDonald E. N., Andersen T. S. (2015). "Face configuration affects speech perception: evidence from a McGurk mismatch negativity study", Neuropsychologia Vol 66, 4854. [Crossref]
40. Fingelkurts A. A., Krause C. M., Mottonen R., Sams M. (2003). "Cortical operational synchrony during audio-visual speech integration", Brain Lang. Vol 85, 97312. [Crossref]
41. Fingelkurts A. A., Fingelkurts A. A., Krause C. M. (2007). "Composition of brain oscillations and their functions in the maintenance of auditory, visual and audio-visual speech percepts: an exploratory study", Cogn. Proc. Vol 8, 183199. [Crossref]
42. Fixmer E., Hawkins S. (1998). "The influence of quality of information on the McGurk effect", in: Proceedings of AVSP’98, Terrigal, Sydney, Australia, pp.  2732.
43. Gagné J. P., Masterson V., Munhall K. G., Bilida N., Querengesser C. (1994). "Across talker variability in auditory, visual, and audiovisual speech intelligibility for conversational and clear speech", J. Acad. Rehabil. Audiol. Vol 27, 135158.
44. Gentilucci M., Cattaneo L. (2005). "Automatic audiovisual integration in speech perception", Exp. Brain Res. Vol 167, 6675. [Crossref]
45. Grant K. W., Seitz P. F. (1998). "Measures of auditory-visual integration in nonsense syllables and sentences", J. Acoust. Soc. Am. Vol 104, 24382450. [Crossref]
46. Green K. P., Kuhl P. K. (1991). "Integral processing of visual place and auditory voicing information during phonetic perception", J. Exp. Psychol. Hum. Percept. Perform. Vol 17, 278288. [Crossref]
47. Green K., Norrix L. (1997). "Acoustic cues to place of articulation and the McGurk effect: the role of release bursts, aspiration and formant transitions", J. Speech Lang. Hear. Res. Vol 40, 646665. [Crossref]
48. Green K. P., Kuhl P. K., Meltzoff A. N. (1988). "Factors affecting the integration of auditory and visual information in speech: the effect of vowel environment", J. Acoust. Soc. Am. Vol 84, S155. DOI:10.1121/1.2025888. [Crossref]
49. Green K., Kuhl P., Meltzoff A., Stevens E. (1991). "Integrating speech information across talkers, gender, and sensory modality: female faces and male voices in the McGurk effect", Percept. Psychophys. Vol 50, 524536. [Crossref]
50. Gurler D., Doyle N., Walker E., Magnotti J., Beauchamp M. (2015). "A link between individual differences in multisensory speech perception and eye movements", Attent. Percept. Psychophys. Vol 77, 13331341. [Crossref]
51. Hardison D. M. (1996). "Bimodal speech perception by native and nonnative speakers of English: factors influencing the McGurk effect", Lang. Learn. Vol 46, 373. [Crossref]
52. Hessler D., Jonkers R., Stowe L., Bastiaanse R. (2013). "The whole is more than the sum of its parts — audiovisual processing of phonemes investigated with ERPs", Brain Lang. Vol 124, 213224. [Crossref]
53. Hietanen J. K., Manninen P., Sams M., Surakka V. (2001). "Does audiovisual speech perception use information about facial configuration?" Eur. J. Cogn. Psychol. Vol 13, 395407. [Crossref]
54. Hillock-Dunn A., Grantham D. W., Wallace M. T. (2016). "The temporal binding window for audiovisual speech: children are like little adults", Neuropsychologia Vol 88, 7482. [Crossref]
55. Hirvenkari L., Jousmäki V., Lamminmäki S., Saarinen V. M., Sams M. E., Hari R. (2010). "Gaze-direction-based MEG averaging during audiovisual speech perception", Front. Hum. Neurosci. Vol 4, 17.
56. Irwin J. R., Whalen D. H., Fowler C. A. (2006). "A sex difference in visual influence on heard speech", Percept. Psychophys. Vol 68, 582592. [Crossref]
57. Irwin J. R., Mencl W. E., Frost S. J., Chen H., Fowler C. (2011). "Functional activation for imitation of seen and heard speech", J. Neurolinguist. Vol 24, 611618. [Crossref]
58. Jiang J., Bernstein L. E. (2011). "Psychophysics of the McGurk and other audiovisual speech integration effects", J. Exp. Psychol. Hum. Percept. Perform. Vol 37, 11931209. [Crossref]
59. Jones J., Callan D. (2003). "Brain activity during audiovisual speech perception: an fMRI study of the McGurk effect", NeuroReport Vol 14, 11291133. [Crossref]
60. Jones J., Jarick M. (2006). "Multisensory integration of speech signals: the relationship between space and time", Exp. Brain Res. Vol 174, 588594. [Crossref]
61. Jones J. A., Munhall K. (1997). "The effects of separating auditory and visual sources on audiovisual integration of speech", Can. Acoust. Vol 25, 1319.
62. Jordan T. R., Bevan K. (1997). "Seeing and hearing rotated faces: influences of facial orientation on visual and audio-visual speech recognition", J. Exp. Psychol. Hum. Percept. Perform. Vol 23, 388403. [Crossref]
63. Jordan T. R., Sergeant P. (1998). "Effects of facial image size on visual and audio visual speech recognition", in: Hearing by Eye II. The Psychology of Speechreading and Audiovisual Speech, Campbell R., Dodd B., Burnham D. (Eds), pp.  155176. Psychology Press, London, UK.
64. Jordan T. R., Sergeant P. C. (2000). "Effects of distance on visual and audio-visual speech recognition", Lang. Speech Vol 43, 107124. [Crossref]
65. Jordan T. R., Thomas S. (2001). "Effects of horizontal viewing angle on visual and audiovisual speech recognition", J. Exp. Psychol. Hum. Percept. Perform. Vol 27, 13861403. [Crossref]
66. Jordan T. R., McCotter M. V., Thomas S. M. (2000). "Visual and audiovisual speech perception with color and gray scale facial images", Percept. Psychophys. Vol 62, 13941404. [Crossref]
67. Kanaya S., Yokosawa K. (2011). "Perceptual congruency of audio-visual speech affects ventriloquism with bilateral visual stimuli", Psychonom. Bull. Rev. Vol 18, 123128. [Crossref]
68. Keane B. P., Rosenthal O., Chun N. H., Shams L. (2010). "Audiovisual integration in high functioning adults with autism", Res. Autism Spectr. Disord. Vol 4, 276289. [Crossref]
69. Keil J., Müller N., Ihssen N., Weisz N. (2012). "On the variability of the McGurk effect: audiovisual integration depends on prestimulus brain states", Cereb. Cortex Vol 22, 221231. [Crossref]
70. Kislyuk D. S., Möttönen R., Sams M. (2008). "Visual processing affects the neural basis of auditory discrimination", J. Cogn. Neurosci. Vol 20, 21752184. [Crossref]
71. Lansing C. R., McConkie G. W. (2003). "Word identification and eye fixation locations in visual and visual-plus-auditory presentations of spoken sentences", Percept. Psychophys. Vol 65, 536552. [Crossref]
72. Leybaert J., Macchi L., Huyse A., Champoux F., Bayard C., Colin C., Berthommier F. (2014). "Atypical audio-visual speech perception and McGurk effects in children with specific language impairment", Front. Psychol. Vol 5, 422. DOI:10.3389/fpsyg.2014.00422. [Crossref]
73. Lifshitz M., Aubert Bonn N., Fischer A., Kashem I. F., Raz A. (2013). "Using suggestion to modulate automatic processes: from Stroop to McGurk and beyond", Cortex Vol 49, 463473. [Crossref]
74. Luckner J. L., Sebald A. M., Cooney J., Young J. III, Muir S. G. (2006). "An examination of the evidence based literacy research in deaf edducation", Am. Ann. Deaf Vol 150, 443455. [Crossref]
75. Lüttke C. S., Ekman M., Van Gerven M. A., De Lange F. P. (2016). "McGurk illusion recalibrates subsequent auditory perception", Sci. Rep. Vol 6, 32891. DOI:10.1038/srep32891. [Crossref]
76. Ma W. J., Zhou X., Ross L. A., Foxe J. J., Parra L. C. (2009). "Lip-reading aids word recognition most in moderate noise: a Bayesian explanation using high-dimensional feature space", PLoS One Vol 4, e4638. DOI:10.1371/journal.pone.0004638.
77. MacDonald J., McGurk H. (1978). "Visual influences on speech perception processes", Percept. Psychophys. Vol 24, 253257. [Crossref]
78. MacDonald J., Andersen S., Bachmann T. (2000). "Hearing by eye: how much spatial degradation can be tolerated?" Perception Vol 29, 11551168. [Crossref]
79. MacLeod A., Summerfield Q. (1990). "A procedure for measuring auditory and audio-visual speech-reception thresholds for sentences in noise: rationale, evaluation, and recommendations for use", Br. J. Audiol. Vol 24, 2943. [Crossref]
80. Magnotti J. F., Mallick D. B., Feng G., Zhou B., Zhou W., Beauchamp M. S. (2016). "Similar frequency of the McGurk effect in large samples of native Mandarin Chinese and American English speakers", Exp. Brain Res. Vol 233, 25812586. [Crossref]
81. Malfait N., Fonlupt P., Centelles L., Nazarian B., Brown L. E., Caclin A. (2014). "Different neural networks are involved in audiovisual speech perception depending on the context", J. Cogn. Neurosci. Vol 26, 15721586. [Crossref]
82. Massaro D. W. (1998). Perceiving Talking Faces: from Speech Perception to a Behavioural Principle. MIT Press, Cambridge, MA, USA.
83. Massaro D. W., Cohen M. M. (1983). "Evaluation and integration of visual and auditory information in speech perception", J. Exp. Psychol. Hum. Percept. Perform. Vol 9, 753771. [Crossref]
84. Massaro D. W., Cohen M. M. (1996). "Perceiving speech from inverted faces", Percept. Psychophys. Vol 58, 10471065. [Crossref]
85. Massaro D. W., Ferguson E. (1993). "Cognitive style and perception: the relationship between category width and speech perception, categorization, and discrimination", Am. J. Psychol. Vol 106, 2538. [Crossref]
86. Massaro D. W., Thompson L. A., Barron B., Laron E. (1986). "Developmental changes in visual and auditory contributions to speech perception", J. Exp. Child Psychol. Vol 41, 93113. [Crossref]
87. McGurk H., MacDonald J. (1976). "Hearing lips and seeing voices", Nature Vol 265, 746748. [Crossref]
88. Miller L. M., D’Esposito M. (2005). "Perceptual fusion and stimulus coincidence in the cross-modal integration of speech", J. Neurosci. Vol 25, 58845893. [Crossref]
89. Miller G. A., Nicely P. E. (1955). "An analysis of perceptual confusions among some English consonants", J. Acoust. Soc. Am. Vol 27, 338352. [Crossref]
90. Munhall K. G., Gribble P., Sacco L., Ward M. (1996). "Temporal constraints on the McGurk effect", Percept. Psychophys. Vol 58, 351362. [Crossref]
91. Munhall K. G., Ten Hove M., Brammer M., Paré M. (2009). "Audiovisual integration of speech in a bistable illusion", Curr. Biol. Vol 19, 15. [Crossref]
92. Nahorna O., Berthommier F., Schwartz J. L. (2012). "Binding and unbinding the auditory and visual streams in the McGurk effect", J. Acoust. Soc. Am. Vol 132, 10611077. [Crossref]
93. Nath A. R., Beauchamp M. S. (2011). "Dynamic changes in superior temporal sulcus connectivity during perception of noisy audiovisual speech", J. Neurosci. Vol 31, 17041714. [Crossref]
94. Nath A. R., Beauchamp M. S. (2012). "A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion", Neuroimage Vol 59, 781787. [Crossref]
95. Navarra J., Alsius A., Soto-Faraco S., Spence C. (2010). "Assessing the role of attention in the audiovisual integration of speech", Inf. Fusion Vol 11, 411. [Crossref]
96. Nelson M. A., Hodge M. M. (2000). "Effects of facial paralysis and audiovisual information on stop place identification", J. Speech Lang. Hear. Res. Vol 43, 158171. [Crossref]
97. Norrix L. W., Plante E., Vance R. (2006). "Auditory-visual speech integration by adults with and without language learning disabilities", J. Commun. Disord. Vol 39, 2236. [Crossref]
98. Olson I. R., Gatenby J. C., Gore J. C. (2002). "A comparison of bound and unbound audio-visual information processing in the human cerebral cortex", Brain Res. Vol 14, 129138.
99. Palmer T. D., Ramsey A. K. (2012). "The function of consciousness in multisensory integration", Cognition Vol 125, 353364. [Crossref]
100. Paré M., Richler R. C., Ten Hove M., Munhall K. G. (2003). "Gaze behavior in audiovisual speech perception: the influence of ocular fixations on the McGurk effect", Percept. Psychophys. Vol 65, 533567. [Crossref]
101. Peynircioǧlu Z. F., Brent W., Tatz J. R., Wyatt J. (2017). "McGurk effect in gender identification: vision trumps audition in voice judgments", J. Gen. Psychol. Vol 144, 5968. [Crossref]
102. Proverbio A. M., Massetti G., Rizzi E., Zani A. (2016). "Skilled musicians are not subject to the McGurk effect", Sci. Rep. Vol 6, 30423. DOI:10.1038/srep30423. [Crossref]
103. Roa Romero Y., Senkowski D., Keil J. (2015). "Early and late beta band power reflects audiovisual perception in the McGurk illusion", J. Neurophysiol. Vol 113, 23422350. [Crossref]
104. Roberts M., Summerfield Q. (1981). "Audiovisual presentation demonstrates that selective adaptation in speech perception is purely auditory", Percept. Psychophys. Vol 30, 309314. [Crossref]
105. Romero Y., Senkowski D., Keil J. (2015). "Early and late beta band power reflects audiovisual perception in the McGurk illusion", J. Neurophysiol. Vol 113, 23422350. [Crossref]
106. Rosenblum L. D., Saldaña H. M. (1992). "Discrimination tests of visually-influenced syllables", Percept. Psychophys. Vol 52, 461473. [Crossref]
107. Rosenblum L. D., Saldaña H. M. (1996). "An audiovisual test of kinematic primitives for visual speech perception", J. Exp. Psychol. Hum. Percept. Perform. Vol 22, 318331. [Crossref]
108. Rosenblum L. D., Johnson J. A., Saldaña H. M. (1996). "Visual kinematic information for embellishing speech in noise", J. Speech Hear. Res. Vol 39, 11591170. [Crossref]
109. Rosenblum L. D., Schmuckler M. A., Johnson J. A. (1997). "The McGurk effect in infants", Percept. Psychophys. Vol 59, 347357. [Crossref]
110. Rosenblum L. D., Yakel D. A., Green K. P. (2000). "Face and mouth inversion effects on visual and audiovisual speech perception", J. Exp. Psychol. Hum. Percept. Perform. Vol 26, 806819. [Crossref]
111. Ross L. A., Saint-Amour D., Leavitt V. M., Javitt D. C., Foxe J. J. (2007). "Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments", Cereb. Cortex Vol 17, 11471153. [Crossref]
112. Saint-Amour D., De Sanctis P., Molholm S., Ritter W., Foxe J. (2007). "Seeing voices: high-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion", Neuropsychologia Vol 45, 587597. [Crossref]
113. Sakamoto S., Mishima H., Suzuki Y. (2012). "Effect of consonance between features and voice impression on the McGurk effect", Interdiscip. Inf. Sci. Vol 18, 8385.
114. Saldaña A. G., Rosenblum L. D. (1994). "Selective adaptation in speech perception using a compelling audiovisual adaptor", J. Acoust. Soc. Am. Vol 95, 36583661. [Crossref]
115. Sams M., Manninen P., Surakka V., Helin P., Kättö R. (1998). "McGurk effect in Finnish syllables, isolated words, and words in sentences: effects of word meaning and sentence context", Speech Commun. Vol 26, 7587. [Crossref]
116. Schwartz J. L. (2010). "A reanalysis of McGurk data suggests that audiovisual fusion in speech perception is subject dependent", J. Acoust. Soc. Am. Vol 127, 15841594. [Crossref]
117. Seewald R., Ross M., Giolas T. G., Yonovitz A. (1985). "Primary modality for speech perception in children with normal and impaired hearing", J. Speech Lang. Hear. Res. Vol 28, 3646. [Crossref]
118. Sekiyama K. (1998). "Face or voice? Determinant of compellingness to the McGurk effect", in: Proceedings of AVSP’98, Terrigal, Sydney, Australia, pp.  3336.
119. Sekiyama K., Tohkura Y. (1991). "McGurk effect in non-English listeners: few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility", J. Acoust. Soc. Am. Vol 90, 17971805. [Crossref]
120. Sekiyama K., Soshi T., Sakamoto S. (2014). "Enhanced audiovisual integration with aging in speech perception: a heightened McGurk effect in older adults", Front. Psychol. Vol 5, 323. DOI:10.3389/fpsyg.2014.00323. [Crossref]
121. Sommers M., Tye-Murray N., Spehar B. (2005). "Auditory-visual speech perception and auditory-visual enhancement in normal-hearing younger and older adults", Ear Hear. Vol 26, 263275. [Crossref]
122. Soroker N., Calamaro N., Myslobodsky M. S. (1995). "Ventriloquist effect reinstates responsiveness to auditory stimuli in the ‘ignored’ space in patients with hemispatial neglect", J. Clin. Exp. Neuropsychol. Vol 17, 243255. [Crossref]
123. Soto-Faraco S., Alsius A. (2009). "Deconstructing the McGurk–MacDonald illusion", J. Exp. Psychol. Hum. Percept. Perform. Vol 35, 580587. [Crossref]
124. Stevenson R. A., Zemtsov R. K., Wallace M. T. (2012). "Individual differences in the multisensory temporal binding window predict susceptibility to audiovisual illusions", J. Exp. Psychol. Hum. Percept. Perform. Vol 38, 15171529. [Crossref]
125. Strand J., Cooperman A., Rowe J., Simenstad A. (2014). "Individual differences in susceptibility to the McGurk effect: links with lipreading and detecting audiovisual incongruity", J. Speech Lang. Hear. Res. Vol 57, 23222331. [Crossref]
126. Sumby W. H., Pollack I. (1954). "Visual contribution to speech intelligibility in noise", J. Acoust. Soc. Am. Vol 26, 212215. [Crossref]
127. Summerfield Q., McGrath M. (1984). "Detection and resolution of audio-visual incompatibility in the perception of vowels", Q. J. Exp. Psychol. A Vol 36, 5174. [Crossref]
128. Surguladze S. A., Calvert G. A., Brammer M. J., Campbell R., Bullmore E. T., Giampietro V., David A. S. (2001). "Audio-visual speech perception in schizophrenia: an fMRI study", Psychiat. Res. Vol 106, 114. [Crossref]
129. Szycik G. R., Stadler J., Tempelmann C., Münte T. F. (2012). "Examining the McGurk illusion using high-field 7 Tesla functional MRI", Front. Hum. Neurosci. Vol 6, 95. DOI:10.3389/fnhum.2012.00095. [Crossref]
130. Taylor N., Isaac C., Milne E. (2010). "A comparison of the development of audiovisual integration in children with autism spectrum disorders and typically developing children", J. Autism Dev. Disord. Vol 40, 14031411. [Crossref]
131. Thomas S. M., Jordan T. R. (2004). "Contributions of oral and extra-oral facial motion to visual and audiovisual speech perception", J. Exp. Psychol. Hum. Percept. Perform. Vol 30, 873888. [Crossref]
132. Tiippana K. (2014). "What is the McGurk effect?" Front. Psychol. Vol 5, 725. DOI:10.3389/fpsyg.2014.00725. [Crossref]
133. Tiippana K., Andersen T. S., Sams M. (2004). "Visual attention modulates audiovisual speech perception", Eur. J. Cogn. Psychol. Vol 16, 457472. [Crossref]
134. Tiippana K., Puharinen H., Möttönen R., Sams M. (2011). "Sound location can influence audiovisual speech perception when spatial attention is manipulated", See. Perceiv. Vol 24, 6790. [Crossref]
135. Traunmüller H., Öhrström N. (2007). "Audiovisual perception of openness and lip rounding in front vowels", J. Phon. Vol 35, 244258.
136. Tremblay C., Champoux F., Voss P., Bacon B. A., Lepore F., Theoret H. (2007). "Speech and non-speech audio-visual illusions: a developmental study", PLoS One Vol 2, e742. DOI:10.1371/journal.pone.0000742. [Crossref]
137. Tuomainen J., Andersen T. S., Tiippana K., Sams M. (2005). "Audiovisual speech perception is special", Cognition Vol 96, B13B22. [Crossref]
138. Valkenier B., Duyne J. Y., Andringa T. C., Baskent D. (2012). "Audiovisual perception of congruent and incongruent Dutch front vowels", J. Speech Lang. Hear. Res. Vol 55, 17881801. [Crossref]
139. Van Engen K. J., Xie Z., Chandrasekaran B. (2016). "Audiovisual sentence recognition is not predicted by susceptibility to the McGurk effect", Atten. Percept. Psychophys. Vol 79, 396403. [Crossref]
140. Van Wassenhove V., Grant K. W., Poeppel D. (2007). "Temporal window of integration in bimodal speech", Neuropsychologia Vol 45, 598607. [Crossref]
141. Venezia J. H., Thurman S. M., Matchin W., George S. E., Hickok G. (2016). "Timing in audiovisual speech perception: a mini review and new psychophysical data", Attent. Percept. Psychophys. Vol 78, 583601. [Crossref]
142. Ver Hulst P. J. (2006). Visual and auditory factors facilitating multimodal speech perception, Senior Honors Thesis, Ohio State University, Columbus, OH, USA.
143. Von Berg S., McColl D., Brancamp T. (2007). "Moebius syndrome: measures of observer intelligibility with versus without visual cues in bilateral facial paralysis", Cleft Palate Craniofacial J. Vol 44, 518522. [Crossref]
144. Walker S., Bruce V., O’Malley C. (1995). "Facial identity and facial speech processing: familiar faces and voices in the McGurk effect", Percept. Psychophys. Vol 57, 11241133. [Crossref]
145. White T. P., Wigton R. L., Joyce D. W., Bobin T., Ferragamo C., Wasim N. (2014). "Eluding the illusion? Schizophrenia, dopamine and the McGurk effect", Front. Hum. Neurosci. Vol 8, 565. DOI:10.3389/fnhum.2014.00565.
146. Wiersinga Post E., Tomaskovic S., Slabu L., Renken R., De Smit F., Duifhuis H. (2010). "Decreased BOLD responses in audiovisual processing", NeuroReport Vol 21, 11461151. [Crossref]
147. Wilson A., Alsius A., Paré M., Munhall K. (2016). "Spatial frequency requirements and gaze strategy in visual-only and audiovisual speech perception", J. Speech Lang. Hear. Res. Vol 59, 601615. [Crossref]
148. Wright T. M., Pelphrey K. A., Allison T., McKeown M. J., McCarthy G. (2003). "Polysensory interactions along lateral temporal regions evoked by audiovisual speech", Cereb. Cortex Vol 13, 10341043. [Crossref]
149. Yakel D. A., Rosenblum L. D., Fortier M. A. (2000). "Effects of talker variability on speechreading", Percept. Psychophys. Vol 62, 14051412. [Crossref]
150. Youse K. M., Cienkowski K. M., Coelho C. A. (2004). "Auditory-visual speech perception in an adult with aphasia", Brain Inj. Vol 18, 825834. [Crossref]
http://brill.metastore.ingenta.com/content/journals/10.1163/22134808-00002565
Loading

Article metrics loading...

/content/journals/10.1163/22134808-00002565
2018-01-01
2018-04-24

Sign-in

Can't access your account?
  • Tools

  • Add to Favorites
  • Printable version
  • Email this page
  • Subscribe to ToC alert
  • Get permissions
  • Recommend to your library

    You must fill out fields marked with: *

    Librarian details
    Your details
    Why are you recommending this title?
    Select reason:
     
    Multisensory Research — Recommend this title to your library
  • Export citations
  • Key

  • Full access
  • Open Access
  • Partial/No accessInformation