Cookies Policy
X

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies.

I accept this policy

Find out more here

Open Access Hearing Lips and Seeing Voices: the Origins and Development of the ‘McGurk Effect’ and Reflections on Audio–Visual Speech Perception Over the Last 40 Years

No metrics data to plot.
The attempt to load metrics for this article has failed.
The attempt to plot a graph for these metrics has failed.
The full text of this article is not currently available.

Brill’s MyBook program is exclusively available on BrillOnline Books and Journals. Students and scholars affiliated with an institution that has purchased a Brill E-Book on the BrillOnline platform automatically have access to the MyBook option for the title(s) acquired by the Library. Brill MyBook is a print-on-demand paperback copy which is sold at a favorably uniform low price.

Hearing Lips and Seeing Voices: the Origins and Development of the ‘McGurk Effect’ and Reflections on Audio–Visual Speech Perception Over the Last 40 Years

  • PDF
  • HTML
Add to Favorites
You must be logged in to use this functionality
image of Multisensory Research

Affiliations: 1: Department of Psychology, University of the West of Scotland, Paisley, PA1 2BE, UK

*Emeritus Professor of Psychology.

In 1976 Harry McGurk and I published a paper in Nature, entitled ‘Hearing Lips and Seeing Voices’. The paper described a new audio–visual illusion we had discovered that showed the perception of auditorily presented speech could be influenced by the simultaneous presentation of incongruent visual speech. This hitherto unknown effect has since had a profound impact on audiovisual speech perception research. The phenomenon has come to be known as the ‘McGurk effect’, and the original paper has been cited in excess of 4800 times. In this paper I describe the background to the discovery of the effect, the rationale for the generation of the initial stimuli, the construction of the exemplars used and the serendipitous nature of the finding. The paper will also cover the reaction (and non-reaction) to the Nature publication, the growth of research on, and utilizing the ‘McGurk effect’ and end with some reflections on the significance of the finding.

Loading

Full text loading...

/deliver/journals/22134808/22134808_00002548_text.html?itemId=/content/journals/10.1163/22134808-00002548&mimeType=html&fmt=ahah
/content/journals/10.1163/22134808-00002548
Loading

Data & Media loading...

http://brill.metastore.ingenta.com/content/journals/10.1163/22134808-00002548
Loading
Loading

Article metrics loading...

/content/journals/10.1163/22134808-00002548
2017-03-31
2017-08-19
1. Aronson E., Rosenblum S. (1971). "Space perception in early infancy: perception within a common auditory–visual space", Science Vol 172, 11611163. [Crossref]
2. Bernstein L. E., Burnham D., Schwartz J.-L. (2002). Special session: Issues in audiovisual spoken language processing (When, Where, and How?), in: Proceedings of the 7th International Conference on Spoken Language, Denver, CO, USA, pp. 1445–1448.
3. Blumstein S. E. (1986). "On acoustic invariance in speech", in: Invariance and Variability in Speech Processes, Perkell J. S., Klatt D. H. (Eds), pp.  178197. Erlbaum, Hillsdale, NJ, USA.
4. Corballis M. C. (2002). From Hand to Mouth: the Origins of Language. Princeton University Press, Priunceton, MA, USA.
5. Diehl R. L., Kluender K. R. (1989). "On the objects of speech perception", Ecol. Psychol. Vol 1, 121144. [Crossref]
6. Dodd B. (1977). "The role of vision in the perception of speech", Perception Vol 6, 3140. [Crossref]
7. Eimas P. D. (1974). "Auditory and linguistic processing of cues for place of articulation by infants", Percept. Psychophys. Vol 16, 513521. [Crossref]
8. Fowler C. A. (1996). "Listeners do hear sounds, not tongues", J. Acoust. Soc. Am. Vol 99, 17301741. [Crossref]
9. Gibson J. J. (1979). The Ecological Approach to Visual Perception. Houghton Mifflin, Boston, MA, USA.
10. Liberman A. M., Mattingly I. G. (1985). "The motor theory of speech perception", Cognition Vol 21, 133. [Crossref]
11. MacDonald J., McGurk H. (1978). "Visual influences on speech perception processes", Percept. Psychophys. Vol 24, 253257. [Crossref]
12. MacDonald J., Dwyer D., Ferris J., McGurk H. (1978). "A simple procedure for accurately manipulating face-voice synchrony when dubbing speech onto videotape", Behav. Res. Meth. Instrum. Vol 10, 845847. [Crossref]
13. MacDonald J., Andersen S., Bachmann T. (1999). Hearing by eye: Visual spatial degradation and the McGurk effect, in: Proceedings of Eurospeech ’99, G. Olaszy G. Nemeth and K. Erdohegyi (Eds), Vol. 3, pp. 1283–1286. European Speech Communication Association, Bonn, Germany.
14. MacDonald J., Andersen S., Bachmann T. (2000). "Hearing by eye: how much spatial degradation can be tolerated?" Perception Vol 29, 11551168. [Crossref]
15. MacDonald J., Andersen S., Bachmann T. (2001). Read my lips, but not too closely: What face information is used in the perception of speech? in: XII ESCOP and XVIII BPS Cognitive Section Conference, Edinburgh, UK.
16. Massaro D. W. (1998). Perceiving Talking Faces: from Speech Perception to a Behavioral Principle. MIT Press, Cambridge, MA, USA.
17. Mattingly I. G., Studdert-Kennedy M. (Eds) (1991). Modularity and the Motor Theory of Speech Perception. Erlbaum, Hillsdale, NJ, USA.
18. McGurk H., Lewis M. (1974). "Space perception in early infancy: perception within a common auditory–visual space?" Science Vol 186, 649650. [Crossref]
19. McGurk H., MacDonald J. (1976). "Hearing lips and seeing voices", Nature Vol 264, 746748. [Crossref]
20. McGurk H., MacDonald J. (1978). "Auditory–visual co-ordination in the first year of life", Int. J. Behav. Dev. Vol 1, 229239. [Crossref]
21. Nath A. R., Beauchamp M. (2012). "A neural basis for interindividual differences in the McGurk effect: a multisensory speech illusion", NeuroImage Vol 59, 781787. [Crossref]
22. Van Wassenhove V. (2013). "Speech through ears and eyes: interfacing the senses with the supramodal brain", Front. Psychol. Vol 4, 388. DOI:.
Submit comment
Close
Comment moderation successfully completed

Sign-in

Can't access your account?
  • Key

  • Full access
  • Open Access
  • Partial/No accessInformation