Cookies Policy

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies.

I accept this policy

Find out more here

Spatial References and Audio-Tactile Interaction in Cross-Modal Dynamic Capture

No metrics data to plot.
The attempt to load metrics for this article has failed.
The attempt to plot a graph for these metrics has failed.
The full text of this article is not currently available.

Brill’s MyBook program is exclusively available on BrillOnline Books and Journals. Students and scholars affiliated with an institution that has purchased a Brill E-Book on the BrillOnline platform automatically have access to the MyBook option for the title(s) acquired by the Library. Brill MyBook is a print-on-demand paperback copy which is sold at a favorably uniform low price.

Access this article

+ Tax (if applicable)
Add to Favorites
You must be logged in to use this functionality

image of Multisensory Research
For more content, see Seeing and Perceiving and Spatial Vision.

In audiotactile dynamic capture, judgment of the direction of an apparent motion stream (such as auditory motion) was impeded (hence ‘captured’) by the presentation of a concurrent, but directionally opposite apparent motion stream (such as tactile motion) from a distractor modality, leading to a cross-modal dynamic capture (CDC) effect. That is to say, the percentage of correct reporting of the direction of the target motion was reduced. Previous studies have revealed the effect of stimulus onset asynchronies (SOAs) and the potential spatial remapping (by adopting a cross-hands posture) in CDC. However, further exploration of the dynamic capture process under different postures was not available due to the fact that only two levels of time asynchronies were employed (either synchronous or with an SOA of 500 ms). This study introduced a broad range of SOAs (−400 ms to 400 ms, tactile stream preceded auditory stream or vice versa) to explore the time course of audio-tactile interaction in CDC with two spatial references — arms-uncrossed or arms-crossed postures. Participants judged the direction of auditory apparent motion with tactile distractors. The results showed that in the arms-uncrossed condition, the CDC effect was prominent when the auditory–tactile events were in the temporal integration window (0–60 ms). However, with a preceding tactile cueing effect of SOA equal to and above 150 ms, the CDC effect was reduced, and no CDC effect was observed with the arms-crossed posture. These results suggest CDC effect is modulated by both cross-modal interaction and the spatial reference (especially for the distractors). The magnitude of the CDC effects in audiotactile interaction may be accounted for by reliability of tactile spatial-temporal information.

Affiliations: 1: 1Department of Psychology and Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 100871, China; 2: 2Institute of Acoustics, Chinese Academy of Sciences, Beijing 100190, China


Full text loading...


Data & Media loading...

1. Azañón E. , Camacho K. , Soto-Faraco S. ( 2010). "Tactile remapping beyond space", Eur. J. Neurosci. Vol 31, 18581867.
2. Azañón E. , Soto-Faraco S. ( 2008). "Changing reference frames during the encoding of tactile events", Curr. Biol. Vol 18, 10441049.
3. Brainard D. H. ( 1997). "The psychophysics toolbox", Spat. Vis. Vol 10, 433436.
4. Cadieux M. L. , Barnett-Cowan M. , Shore D. I. ( 2010). "Crossing the hands is more confusing for females than males", Exp. Brain. Res. Vol 204, 431436.
5. Chen L. , Zhou X. ( 2011). "Capture of intermodal visual/tactile apparent motion by moving and static sound", Seeing Perceiv. Vol 24, 369389.
6. Eimer M. ( 2001). "Crossmodal links in spatial attention between vision, audition, and touch: evidence from event-related brain potentials", Neuropsychologia Vol 39, 12921303.
7. Ernst M. O. , Banks M. S. ( 2002). "Humans integrate visual and haptic information in a statistically optimal fashion", Nature Vol 415, 429433.
8. Jiang Y. , Chen L. ( 2013). "Mutual influences of intermodal visual/tactile apparent motion and auditory motion with uncrossed and crossed arms", Multisensory Res. Vol 26, 1951.
9. Lloyd D. M. , Merat N. , McGlone F. , Spence C. ( 2003). "Crossmodal links between audition and touch in covert endogenous spatial attention", Percept. Psychophys. Vol 65, 901924.
10. Los S. A. , Van der Burg E. ( 2013). "Sound speeds vision through preparation, not integration", J. Exp. Psychol. Hum. Percept. Perform. Vol 39, 16121624.
11. Pöppel E. , Bao Y. ( in press). "Temporal windows as a bridge from objective to subjective time", in: Subjective Time, Lloyd D. , Arstila V. (Eds). MIT Press, Cambridge, MA, USA.
12. Sanabria D. , Soto-Faraco S. , Spence C. ( 2005). "Spatiotemporal interactions between audition and touch depend on hand posture", Exp. Brain. Res. Vol 165, 505514.
13. Sanabria D. , Soto-Faraco S. , Spence C. ( 2007a). "Spatial attention modulates audiovisual interactions in apparent motion", J. Exp. Psychol. Hum. Percept. Perform. Vol 33, 927937.
14. Sanabria D. , Spence C. , Soto-Faraco S. ( 2007b). "Perceptual and decisional contributions to audiovisual interactions in the perception of motion: a signal detection study", Cognition Vol 102, 299310.
15. Shore D. I. , Gray K. , Spry E. , Spence C. ( 2005). "Spatial modulation of tactile temporal-order judgments", Perception Vol 34, 12511262.
16. Shore D. I. , Spry E. , Spence C. ( 2002). "Confusing the mind by crossing the hands", Brain Res. Cogn. Brain Res. Vol 14, 153163.
17. Soto-Faraco S. , Azañón E. ( 2013). "Electrophysiological correlates of tactile remapping", Neuropsychologia Vol 51, 15841594.
18. Soto-Faraco S. , Lyons J. , Gazzaniga M. , Spence C. , Kingstone A. ( 2002). "The ventriloquist in motion: illusory capture of dynamic information across sensory modalities", Brain Res. Cogn. Brain Res. Vol 14, 139146.
19. Soto-Faraco S. , Spence C. , Kingstone A. ( 2004). "Congruency effects between auditory and tactile motion: extending the phenomenon of cross-modal dynamic capture", Cogn. Affect. Behav. Neurosci. Vol 4, 208217.
20. Soto-Faraco S. , Spence C. , Kingstone A. ( 2005). "Assessing automaticity in the audio-visual integration of motion", Acta Psychol. (Amst.) Vol 118, 7192.
21. Spence C. , Nicholls M. E. , Gillespie N. , Driver J. ( 1998). "Cross-modal links in exogenous covert spatial orienting between touch, audition and vision", Percept. Psychophys. Vol 60, 544557.
22. Sugita Y. , Suzuki Y. ( 2003). "Audiovisual perception: implicit estimation of sound-arrival time", Nature Vol 421, 911.
23. Wada M. , Yamamoto S. , Kitazawa S. ( 2004). "Effects of handedness on tactile temporal order judgment", Neuropsychologia Vol 42, 18871895.
24. Yamamoto S. , Kitazawa S. ( 2001). "Reversal of subjective temporal order due to arm crossing", Nat. Neurosci. Vol 4, 759765.
25. Yamamoto S. , Moizumi S. , Kitazawa S. ( 2005). "Referral of tactile sensation to the tips of L-shaped sticks", J. Neurophysiol. Vol 5, 28562863.
26. Zampini M. , Brown T. , Shore D. I. , Maravita A. , Röder B. , Spence C. ( 2005). "Audiotactile temporal order judgments", Acta Psychol. (Amst.) Vol 118, 277291.

Article metrics loading...



Can't access your account?
  • Tools

  • Add to Favorites
  • Printable version
  • Email this page
  • Subscribe to ToC alert
  • Get permissions
  • Recommend to your library

    You must fill out fields marked with: *

    Librarian details
    Your details
    Why are you recommending this title?
    Select reason:
    Multisensory Research — Recommend this title to your library
  • Export citations
  • Key

  • Full access
  • Open Access
  • Partial/No accessInformation