Cookies Policy
X

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies.

I accept this policy

Find out more here

Full Access Mouth reversal extinguishes mismatch negativity induced by the McGurk illusion

No metrics data to plot.
The attempt to load metrics for this article has failed.
The attempt to plot a graph for these metrics has failed.
The full text of this article is not currently available.

Brill’s MyBook program is exclusively available on BrillOnline Books and Journals. Students and scholars affiliated with an institution that has purchased a Brill E-Book on the BrillOnline platform automatically have access to the MyBook option for the title(s) acquired by the Library. Brill MyBook is a print-on-demand paperback copy which is sold at a favorably uniform low price.

Mouth reversal extinguishes mismatch negativity induced by the McGurk illusion

  • PDF
  • HTML
Add to Favorites
You must be logged in to use this functionality

image of Multisensory Research
For more content, see Seeing and Perceiving and Spatial Vision.

The sight of articulatory mouth movements (visual speech) influences auditory speech perception. This is demonstrated by the McGurk illusion in which incongruent visual speech alters the auditory phonetic percept. In behavioral studies, reversal of the vertical mouth direction has been reported to greatly reduce the McGurk illusion (Rosenblum et al., 2000). Such findings support the idea that audiovisual integration in speech to some extent relies on information regarding facial configuration. Here we ask whether this behavioral effect is reflected in a difference in neural activity in the auditory cortex. Mismatch Negativity (MMN) is a component in the auditory Event-Related Potential (ERP) that is elicited by a change in the auditory percept. It has been shown that the McGurk illusion can induce a MMN. We conducted an experiment in which the MMN could be elicited by the McGurk illusion induced by visual speech with either upright (unaltered) or vertically reversed mouth area. In a preliminary analysis, we found a Mismatch Negativity component induced by the McGurk illusion for 6 of 17 participants at electrode Cz when the mouth area was upright. In comparison, these participants produced no Mismatch Negativity when the mouth was reversed. These findings mirrored behavioral findings in the same subjects of a strong McGurk response for normal audiovisual speech, which was greatly reduced for stimuli with reversed mouth area.

Affiliations: 1: 1Section for Cognitive Systems, Department of Informatics and Mathematical Modelling, Technical University of Denmark, Denmark

The sight of articulatory mouth movements (visual speech) influences auditory speech perception. This is demonstrated by the McGurk illusion in which incongruent visual speech alters the auditory phonetic percept. In behavioral studies, reversal of the vertical mouth direction has been reported to greatly reduce the McGurk illusion (Rosenblum et al., 2000). Such findings support the idea that audiovisual integration in speech to some extent relies on information regarding facial configuration. Here we ask whether this behavioral effect is reflected in a difference in neural activity in the auditory cortex. Mismatch Negativity (MMN) is a component in the auditory Event-Related Potential (ERP) that is elicited by a change in the auditory percept. It has been shown that the McGurk illusion can induce a MMN. We conducted an experiment in which the MMN could be elicited by the McGurk illusion induced by visual speech with either upright (unaltered) or vertically reversed mouth area. In a preliminary analysis, we found a Mismatch Negativity component induced by the McGurk illusion for 6 of 17 participants at electrode Cz when the mouth area was upright. In comparison, these participants produced no Mismatch Negativity when the mouth was reversed. These findings mirrored behavioral findings in the same subjects of a strong McGurk response for normal audiovisual speech, which was greatly reduced for stimuli with reversed mouth area.

Loading

Full text loading...

/deliver/22134808/26/10/22134808_026_00_S98_text.html;jsessionid=qbKvu6Es1qH86uMtaSqAjZXO.x-brill-live-03?itemId=/content/journals/10.1163/22134808-000s0098&mimeType=html&fmt=ahah
/content/journals/10.1163/22134808-000s0098
Loading

Data & Media loading...

http://brill.metastore.ingenta.com/content/journals/10.1163/22134808-000s0098
Loading
Loading

Article metrics loading...

/content/journals/10.1163/22134808-000s0098
2013-05-16
2016-12-03

Sign-in

Can't access your account?
  • Key

  • Full access
  • Open Access
  • Partial/No accessInformation