Cookies Policy
X

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies.

I accept this policy

Find out more here

Depth: the Forgotten Dimension in Multisensory Research

No metrics data to plot.
The attempt to load metrics for this article has failed.
The attempt to plot a graph for these metrics has failed.
The full text of this article is not currently available.

Brill’s MyBook program is exclusively available on BrillOnline Books and Journals. Students and scholars affiliated with an institution that has purchased a Brill E-Book on the BrillOnline platform automatically have access to the MyBook option for the title(s) acquired by the Library. Brill MyBook is a print-on-demand paperback copy which is sold at a favorably uniform low price.

Access this article

+ Tax (if applicable)
Add to Favorites
You must be logged in to use this functionality

image of Multisensory Research
For more content, see Seeing and Perceiving and Spatial Vision.

The last quarter of a century has seen a dramatic rise of interest in the spatial constraints on multisensory integration. However, until recently, the majority of this research has investigated integration in the space directly in front of the observer. The space around us, however, extends in three spatial dimensions in the front and to the rear beyond such a limited area. The question to be addressed in this review concerns whether multisensory integration operates according to the same rules throughout the whole of three-dimensional space. The results reviewed here not only show that the space around us seems to be divided into distinct functional regions, but they also suggest that multisensory interactions are modulated by the region of space in which stimuli happen to be presented. We highlight a number of key limitations with previous research in this area, including: (1) The focus on only a very narrow region of two-dimensional space in front of the observer; (2) the use of static stimuli in most research; (3) the study of observers who themselves have been mostly static; and (4) the study of isolated observers. All of these factors may change the way in which the senses interact at any given distance, as can the emotional state/personality of the observer. In summarizing these salient issues, we hope to encourage researchers to consider these factors in their own research in order to gain a better understanding of the spatial constraints on multisensory integration as they affect us in our everyday life.

Affiliations: 1: 1Department of Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands ; 2: 2Center for Neuroprosthetics, EPFL, Lausanne, Switzerland ; 3: 3ImpAct Team, Lyon Neuroscience Research Center, INSERM U1028, CNRS UMR5292, 69000 Lyon, France ; 4: 4School of Psychology, CNCR, University of Birmingham, Birmingham, United Kingdom ; 5: 5Department of Experimental Psychology, Oxford University, Oxford, United Kingdom

*To whom correspondence should be addressed. E-mail: N.VanderStoep@uu.nl
Loading data from figshare Loading data from figshare
Loading

Full text loading...

/content/journals/10.1163/22134808-00002525
Loading

Data & Media loading...

1. Agganis B. T. , Muday J. A. , Schirillo J. A. (2010). "Visual biasing of auditory localization in azimuth and depth", Percept. Mot. Skills Vol 111, 872892. http://dx.doi.org/10.2466/22.24.27.PMS.111.6.872-892
2. Aimola L. , Schindler I. , Simone A. M. , Venneri A. (2012). "Near and far space neglect: task sensitivity and anatomical substrates", Neuropsychologia Vol 50, 11151123. http://dx.doi.org/10.1016/j.neuropsychologia.2012.01.022
3. Alais D. , Burr D. (2004). "The ventriloquist effect results from near-optimal bimodal integration", Curr. Biol. Vol 14, 257262. http://dx.doi.org/10.1016/j.cub.2004.01.029
4. Alais D. , Carlile S. (2005). "Synchronizing to real events: subjective audiovisual alignment scales with perceived auditory depth and speed of sound", Proc. Natl Acad. Sci. USA Vol 102, 22442247. http://dx.doi.org/10.1073/pnas.0407034102
5. Alsius A. , Navarra J. , Campbell R. , Soto-Faraco S. (2005). "Audiovisual integration of speech falters under high attention demands", Curr. Biol. Vol 15, 839843. http://dx.doi.org/10.1016/j.cub.2005.03.046
6. Arnold D. H. , Johnston A. , Nishida S. (2005). "Timing sight and sound", Vis. Res. Vol 45, 12751284. http://dx.doi.org/10.1016/j.visres.2004.11.014
7. Avenanti A. , Annela L. , Serino A. (2012). "Suppression of premotor cortex disrupts motor coding of peripersonal space", Neuroimage Vol 63, 281288. http://dx.doi.org/10.1016/j.neuroimage.2012.06.063
8. Avillac M. , Deneve S. , Olivier E. , Pouget A. , Duhamel J. R. (2005). "Reference frames for representing visual and tactile locations in parietal cortex", Nat. Neurosci. Vol 8, 941949. http://dx.doi.org/10.1038/nn1480
9. Bassolino M. , Finisguerra A. , Canzoneri E. , Serino A. , Pozzo T. (2015). "Dissociating effect of upper limb non-use and overuse on space and body representations", Neuropsychologia Vol 70, 385392. http://dx.doi.org/10.1016/j.neuropsychologia.2014.11.028
10. Bertelson P. , Vroomen J. , De Gelder B. , Driver J. (2000). "The ventriloquist effect does not depend on the direction of deliberate visual attention", Percept. Psychophys. Vol 62, 321332. http://dx.doi.org/10.3758/BF03205552
11. Bisiach E. , Perani D. , Vallar G. , Berti A. (1986). "Unilateral neglect: personal and extra-personal", Neuropsychologia Vol 24, 759767. http://dx.doi.org/10.1016/0028-3932(86)90075-8
12. Bowen A. L. , Ramachandran R. , Muday J. A. , Schirillo J. A. (2011). "Visual signals bias auditory targets in azimuth and depth", Exp. Brain Res. Vol 214, 403414. http://dx.doi.org/10.1007/s00221-011-2838-1
13. Bremmer F. , Schlack A. , Shah N. J. , Zafiris O. , Kubischik M. , Hoffmann K. , Zilles K. , Fink G. R. (2001). "Polymodal motion processing in posterior parietal and premotor cortex: a human fMRI study strongly implies equivalencies between humans and monkeys", Neuron Vol 29, 287296. http://dx.doi.org/10.1016/S0896-6273(01)00198-2
14. Bremner A. , Lewkowicz D. , Spence C. (Eds) (2012). Multisensory Development. Oxford University Press, Oxford, UK.
15. Brozzoli C. , Pavani F. , Urquizar C. , Cardinali L. , Farne A. (2009). "Grasping actions remap peripersonal space", Neuroreport Vol 20, 913917. http://dx.doi.org/10.1097/WNR.0b013e32832c0b9b
16. Brozzoli C. , Cardinali L. , Pavani F. , Farnè A. (2010). "Action-specific remapping of peripersonal space", Neuropsychologia Vol 48, 796802. http://dx.doi.org/10.1016/j.neuropsychologia.2009.10.009
17. Brozzoli C. , Gentile G. , Petkova V. I. , Ehrsson H. H. (2011). "FMRI adaptation reveals a cortical mechanism for the coding of space near the hand", J. Neurosci. Vol 31, 90239031. http://dx.doi.org/10.1523/JNEUROSCI.1172-11.2011
18. Brozzoli C. , Makin T. R. , Cardinali L. , Holmes N. P. , Farnè A. (2012). "Peripersonal space: a multisensory interface for body-object interactions", in: The Neural Bases of Multisensory Processes, Murray M. M. , Wallace M. T. (Eds), pp.  447464. CRC Press, Boca Raton, FL, USA.
19. Brozzoli C. , Gentile G. , Bergouignan L. , Ehrsson H. H. (2013). "A shared representation of the space near oneself and others in the human premotor cortex", Curr. Biol. Vol 23, 17641768. http://dx.doi.org/10.1016/j.cub.2013.07.004
20. Brozzoli C. , Ehrsson H. H. , Farnè A. (2014). "Multisensory representation of the space near the hand from perception to action and interindividual interactions", Neuroscientist Vol 20, 122135. http://dx.doi.org/10.1177/1073858413511153
21. Bufacchi R. J. , Liang M. , Griffin L. D. , Iannetti G. D. (in press). "A geometric model of defensive peripersonal space", J. Neurophysiol. DOI:.
22. Burgoon J. K. , Jones S. B. (1976). "Toward a theory of personal space expectations and their violations", Hum. Commun. Res. Vol 2, 131146. http://dx.doi.org/10.1111/j.1468-2958.1976.tb00706.x
23. Calvert G. A. , Thesen T. (2004). "Multisensory integration: methodological approaches and emerging principles in the human brain", J. Physiol. Paris Vol 98, 191205. http://dx.doi.org/10.1016/j.jphysparis.2004.03.018
24. Canzoneri E. , Magosso E. , Serino A. (2012). "Dynamic sounds capture the boundaries of peripersonal space representation in humans", PLoS One Vol 7, e44306. DOI:. http://dx.doi.org/10.1371/journal.pone.0044306
25. Canzoneri E. , Ubaldi S. , Rastelli V. , Finisguerra A. , Bassolino M. , Serino A. (2013a). "Tool-use reshapes the boundaries of body and peripersonal space representations", Exp. Brain Res. Vol 228, 2542. http://dx.doi.org/10.1007/s00221-013-3532-2
26. Canzoneri E. , Marzolla M. , Amoresano A. , Verni G. , Serino A. (2013b). "Amputation and prosthesis implantation shape body and peripersonal space representations", Sci. Rep. Vol 3, 2844. DOI:. http://dx.doi.org/10.1038/srep02844
27. Cappe C. , Thut G. , Romei V. , Murray M. M. (2009). "Selective integration of auditory–visual looming cues by humans", Neuropsychologia Vol 47, 10451052. http://dx.doi.org/10.1016/j.neuropsychologia.2008.11.003
28. Cappe C. , Thelen A. , Romei V. , Thut G. , Murray M. M. (2012). "Looming signals reveal synergistic principles of multisensory integration", J. Neurosci. Vol 32, 11711182. http://dx.doi.org/10.1523/JNEUROSCI.5517-11.2012
29. Cardinali L. , Brozzoli C. , Farnè A. (2010). "Peripersonal space and body schema", in: Encyclopedia of Behavioural Neuroscience, Koob G. G. , Le Moal M. , Thompson R. F. (Eds), pp.  4046. Academic Press, Oxford, UK. http://dx.doi.org/10.1016/B978-0-08-045396-5.00216-5
30. Clark A. (2013). "Whatever next? Predictive brains, situated agents, and the future of cognitive science", Behav. Brain Sci. Vol 36, 181204. http://dx.doi.org/10.1017/S0140525X12000477
31. Cléry J. , Guipponi O. , Odouard S. , Wardak C. , Hamed S. B. (2015a). "Impact prediction by looming visual stimuli enhances tactile detection", J. Neurosci. Vol 35, 41794189. http://dx.doi.org/10.1523/JNEUROSCI.3031-14.2015
32. Cléry J. , Guipponi O. , Wardak C. , Hamed S. B. (2015b). "Neuronal bases of peripersonal and extrapersonal spaces, their plasticity and their dynamics: knowns and unknowns", Neuropsychologia Vol 70, 313326. http://dx.doi.org/10.1016/j.neuropsychologia.2014.10.022
33. Cooke D. F. , Graziano M. S. (2004). "Sensorimotor integration in the precentral gyrus: polysensory neurons and defensive movements", J. Neurophysiol. Vol 91, 16481660. http://dx.doi.org/10.1152/jn.00955.2003
34. Cooke D. F. , Taylor C. S. , Moore T. , Graziano M. S. (2003). "Complex movements evoked by microstimulation of the ventral intraparietal area", Proc. Natl Acad. Sci. USA Vol 100, 61636168. http://dx.doi.org/10.1073/pnas.1031751100
35. Corey D. P. , Hudspeth A. J. (1979). "Ionic basis of the receptor potential in a vertebrate hair cell", Nature Vol 281(5733), 675677. http://dx.doi.org/10.1038/281675a0
36. Corneil B. D. , Van Wanrooij M. , Munoz D. P. , Van Opstal A. J. (2002). "Auditory–visual interactions subserving goal-directed saccades in a complex scene", J. Neurophysiol. Vol 88, 438454.
37. Cowey A. , Small M. , Ellis S. (1994). "Left visuo–spatial neglect can be worse in far than in near space", Neuropsychologia Vol 32, 10591066. http://dx.doi.org/10.1016/0028-3932(94)90152-X
38. De Haan A. M. , Van der Stigchel S. , Nijnens C. M. , Dijkerman H. C. (2014). "The influence of object identity on obstacle avoidance reaching behaviour", Acta Psychol. Vol 150, 9499. http://dx.doi.org/10.1016/j.actpsy.2014.04.007
39. De Paepe A. L. , Crombez G. , Spence C. , Legrain V. (2014). "Mapping nociceptive stimuli in a peripersonal frame of reference: evidence from a temporal order judgment task", Neuropsychologia Vol 56, 219228. http://dx.doi.org/10.1016/j.neuropsychologia.2014.01.016
40. de Vignemont F. , Iannetti G. D. (2015). "How many peripersonal spaces?" Neuropsychologia Vol 70, 327334. http://dx.doi.org/10.1016/j.neuropsychologia.2014.11.018
41. Di Luca M. (2014). "Light source distance affects perceived audiovisual simultaneity", Procedia Soc. Behav. Sci. Vol 126, 151. http://dx.doi.org/10.1016/j.sbspro.2014.02.349
42. Dosey M. A. , Meisels M. (1969). "Personal space and self-protection", J. Pers. Soc. Psychol. Vol 11, 9397. http://dx.doi.org/10.1037/h0027040
43. Duhamel J. R. , Bremmer F. , BenHamed S. , Graf W. (1997). "Spatial invariance of visual receptive fields in parietal cortex neurons", Nature Vol 389(6653), 845848. http://dx.doi.org/10.1038/39865
44. Engel G. R. , Dougherty W. G. (1971). "Visual–auditory distance constancy", Nature Vol 234(5327), 308. http://dx.doi.org/10.1038/234308a0
45. Ernst M. O. , Banks M. S. (2002). "Humans integrate visual and haptic information in a statistically optimal fashion", Nature Vol 415(6870), 429433. http://dx.doi.org/10.1038/415429a
46. Falchier A. , Clavagnier S. , Barone P. , Kennedy H. (2002). "Anatomical evidence of multimodal integration in primate striate cortex", J. Neurosci. Vol 22, 57495759.
47. Farnè A. , Làdavas E. (2000). "Dynamic size-change of hand peripersonal space following tool use", Neuroreport Vol 11, 16451649. http://dx.doi.org/10.1097/00001756-200006050-00010
48. Farnè A. , Làdavas E. (2002). "Auditory peripersonal space in humans", J. Cogn. Neurosci. Vol 14, 10301043. http://dx.doi.org/10.1162/089892902320474481
49. Felipe N. J. , Sommer R. (1966). "Invasions of personal space", Soc. Probl. Vol 14, 206214. http://dx.doi.org/10.2307/798618
50. Ferri F. , Tajadura-Jiménez A. , Väljamäe A. , Vastano R. , Costantini M. (2015). "Motion-inducing approaching sounds shape the boundaries of multisensory peripersonal space", Neuropsychologia Vol 70, 468475. http://dx.doi.org/10.1016/j.neuropsychologia.2015.03.001
51. Fogassi L. , Gallese V. , Fadiga L. , Luppino G. , Matelli M. , Rizzolatti G. (1996). "Coding of peripersonal space in inferior premotor cortex (area F4)", J. Neurophysiol. Vol 76, 141157.
52. Frens M. A. , Van Opstal A. J. , Van der Willigen R. F. (1995). "Spatial and temporal factors determine auditory–visual interactions in human saccadic eye movements", Percept. Psychophys. Vol 57, 802816. http://dx.doi.org/10.3758/BF03206796
53. Friston K. (2005). "A theory of cortical responses", Phil. Trans. R. Soc. B Biol. Sci. Vol 360(1456), 815836. http://dx.doi.org/10.1098/rstb.2005.1622
54. Friston K. , Kiebel S. (2009). "Predictive coding under the free-energy principle", Phil. Trans. R. Soc. B Biol. Sci. Vol 364(1521), 12111221. http://dx.doi.org/10.1098/rstb.2008.0300
55. Gallace A. , Spence C. (2014). In Touch With the Future: the Sense of Touch From Cognitive Neuroscience to Virtual Reality. Oxford University Press, Oxford, UK. http://dx.doi.org/10.1093/acprof:oso/9780199644469.001.0001
56. Galli G. , Noel J. P. , Canzoneri E. , Blanke O. , Serino A. (2015). "The wheelchair as a full-body tool extending the peripersonal space", Front. Psychol. Vol 6, 639. DOI:.
57. Gardner M. B. (1968). "Proximity image effect in sound localisation", J. Acoust. Soc. Am. Vol 43, 163. http://dx.doi.org/10.1121/1.1910747
58. Gardner E. P. , Babu K. S. , Reitzen S. D. , Ghosh S. , Brown A. S. , Chen J. , Hall A. L. , Herzlinger M. D. , Kohlenstein J. B. , Ro J. Y. (2007). "Neurophysiology of prehension. I. Posterior parietal cortex and object-oriented hand behaviors", J. Neurophysiol. Vol 97, 387406. http://dx.doi.org/10.1152/jn.00558.2006
59. Gibson J. J. , Crooks L. E. (1938). "A theoretical field-analysis of automobile-driving", Am. J. Psychol. Vol 51, 453471. http://dx.doi.org/10.2307/1416145
60. Gondan M. , Minakata K. (in press). "A tutorial on testing the race model inequality", Atten. Percept. Psychophys. DOI:.
61. Graziano M. S. , Cooke D. F. (2006). "Parieto-frontal interactions, personal space, and defensive behavior", Neuropsychologia Vol 44, 845859. http://dx.doi.org/10.1016/j.neuropsychologia.2005.09.009
62. Graziano M. S. , Cooke D. F. , Taylor C. S. (2000). "Coding the location of the arm by sight", Science Vol 290(5497), 17821786. http://dx.doi.org/10.1126/science.290.5497.1782
63. Graziano M. S. A. , Gross C. G. (1994). "The representation of extrapersonal space: a possible role for bimodal visual–tactile neurons", in: The Cognitive Neurosciences, Gazzaniga M. S. (Ed.), pp.  10211034. MIT Press, Cambridge, MA, USA.
64. Graziano M. S. , Hu X. T. , Gross C. G. (1997). "Visuospatial properties of ventral premotor cortex", J. Neurophysiol. Vol 77, 22682292.
65. Graziano M. S. , Reiss L. A. , Gross C. G. (1999). "A neuronal representation of the location of nearby sounds", Nature Vol 397(6718), 428430. http://dx.doi.org/10.1038/17115
66. Hall E. T. (1966). The Hidden Dimension. Doubleday and Co., New York, NY, USA.
67. Halligan P. W. , Marshall J. C. (1991). "Left neglect for near but not far space in man", Nature Vol 350(6318), 498500. http://dx.doi.org/10.1038/350498a0
68. Harris L. , Harrar V. , Jaekl P. , Kopinska A. (2010). "Mechanisms of simultaneity constancy", in: Space and Time in Perception and Action, Nijhawan R. , Khurana B. (Eds), pp.  232253. Cambridge University Press, Cambridge, UK. http://dx.doi.org/10.1017/CBO9780511750540.015
69. Hediger H. (1955). Studies of the Psychology and Behaviour of Captive Animals in Zoos and Circuses. Criterion Books, New York, NY, USA.
70. Heed T. , Habets B. , Sebanz N. , Knoblich G. (2010). "Others’ actions reduce crossmodal integration in peripersonal space", Curr. Biol. Vol 20, 13451349. http://dx.doi.org/10.1016/j.cub.2010.05.068
71. Ho C. , Spence C. (2005). "Assessing the effectiveness of various auditory cues in capturing a driver’s visual attention", J. Exp. Psychol. Appl. Vol 11, 157174. http://dx.doi.org/10.1037/1076-898X.11.3.157
72. Ho C. , Spence C. (2006). "Verbal interface design: do verbal directional cues automatically orient visual spatial attention?" Comput. Human Behav. Vol 22, 733748. http://dx.doi.org/10.1016/j.chb.2005.12.008
73. Ho C. , Spence C. (2009). "Using peripersonal warning signals to orient a driver’s gaze", Hum. Factors Vol 51, 539556. http://dx.doi.org/10.1177/0018720809341735
74. Ho C. , Spence C. (2014). "Effectively responding to tactile stimulation: do homologous cue and effector locations really matter?" Acta Psychol. Vol 151, 3239. http://dx.doi.org/10.1016/j.actpsy.2014.05.014
75. Ho C. , Tan H. Z. , Spence C. (2005). "Using spatial vibrotactile cues to direct visual attention in driving scenes", Transp. Res. Part F: Traffic Psychol. Behav. Vol 8, 397412. http://dx.doi.org/10.1016/j.trf.2005.05.002
76. Ho C. , Tan H. Z. , Spence C. (2006). "The differential effect of vibrotactile and auditory cues on visual spatial attention", Ergonomics Vol 49, 724738. http://dx.doi.org/10.1080/00140130600589887
77. Ho C. , Reed N. , Spence C. (2007). "Multisensory in-car warning signals for collision avoidance", Hum. Factors Vol 49, 11071114. http://dx.doi.org/10.1518/001872007X249965
78. Ho C. , Gray R. , Spence C. (2014). "Reorienting driver attention with dynamic tactile cues", IEEE Trans. Haptics Vol 7, 8694. http://dx.doi.org/10.1109/TOH.2013.62
79. Holmes N. P. (2012). "Does tool use extend peripersonal space? A review and re-analysis", Exp. Brain Res. Vol 218, 273282. http://dx.doi.org/10.1007/s00221-012-3042-7
80. Huang R. S. , Chen C. F. , Tran A. T. , Holstein K. L. , Sereno M. I. (2012). "Mapping multisensory parietal face and body areas in humans", Proc. Natl Acad. Sci. USA Vol 109, 1811418119. http://dx.doi.org/10.1073/pnas.1207946109
81. Hyvarinen J. (1981). "Regional distribution of functions in parietal association area 7 of the monkey", Brain Res. Vol 206, 287303. http://dx.doi.org/10.1016/0006-8993(81)90533-3
82. Iannetti G. D. , Mouraux A. (2010). "From the neuromatrix to the pain matrix (and back)", Exp. Brain Res. Vol 205, 112. http://dx.doi.org/10.1007/s00221-010-2340-1
83. Ishida H. , Nakajima K. , Inase M. , Murata A. (2010). "Shared mapping of own and others’ bodies in visuotactile bimodal area of monkey parietal cortex", J. Cogn. Neurosci. Vol 22, 8396. http://dx.doi.org/10.1162/jocn.2009.21185
84. Kandula M. , Hofman D. , Dijkerman H. C. (2015). "Visuo-tactile interactions are dependent on the predictive value of the visual stimulus", Neuropsychologia Vol 70, 358366. http://dx.doi.org/10.1016/j.neuropsychologia.2014.12.008
85. King A. J. (2009). "Visual influences on auditory spatial learning", Phil. Trans. R. Soc. B Biol. Sci. Vol 364(1515), 331339. http://dx.doi.org/10.1098/rstb.2008.0230
86. Koelewijn T. , Bronkhorst A. , Theeuwes J. (2010). "Attention and the multiple stages of multisensory integration: a review of audiovisual studies", Acta Psychol. Vol 134, 372384. http://dx.doi.org/10.1016/j.actpsy.2010.03.010
87. Kopinska A. , Harris L. R. (2004). "Simultaneity constancy", Perception Vol 33, 10491060. http://dx.doi.org/10.1068/p5169
88. Làdavas E. , Farnè A. (2004). "Visuo-tactile representation of near-the-body space", J. Physiol. Paris Vol 98, 161170. http://dx.doi.org/10.1016/j.jphysparis.2004.03.007
89. Lee J. D. , McGehee D. V. , Brown T. L. , Reyes M. L. (2002). "Collision warning timing, driver distraction, and driver response to imminent rear-end collisions in a high-fidelity driving simulator", Hum. Factors Vol 44, 314334. http://dx.doi.org/10.1518/0018720024497844
90. Leinonen L. (1980). "Functional properties of neurones in the posterior part of area 7 in awake monkey", Acta Physiol. Scand. Vol 108, 301308. http://dx.doi.org/10.1111/j.1748-1716.1980.tb06536.x
91. Lewald J. , Guski R. (2004). "Auditory–visual temporal integration as a function of distance: no compensation for sound-transmission time in human perception", Neurosci. Lett. Vol 357, 119122. http://dx.doi.org/10.1016/j.neulet.2003.12.045
92. Lourenco S. F. , Longo M. R. , Pathman T. (2011). "Near space and its relation to claustrophobic fear", Cognition Vol 119, 448453. http://dx.doi.org/10.1016/j.cognition.2011.02.009
93. Makin T. R. , Holmes N. P. , Zohary E. (2007). "Is that near my hand? Multisensory representation of peripersonal space in human intraparietal sulcus", J. Neurosci. Vol 27, 731740. http://dx.doi.org/10.1523/JNEUROSCI.3653-06.2007
94. Makin T. R. , Holmes N. P. , Brozzoli C. , Rossetti Y. , Farne A. (2009). "Coding of visual space during motor preparation: approaching objects rapidly modulate corticospinal excitability in hand-centered coordinates", J. Neurosci. Vol 29, 1184111851. http://dx.doi.org/10.1523/JNEUROSCI.2955-09.2009
95. Makin T. R. , Holmes N. P. , Brozzoli C. , Farnè A. (2012). "Keeping the world at hand: rapid visuomotor processing for hand–object interactions", Exp. Brain Res. Vol 219, 421428. http://dx.doi.org/10.1007/s00221-012-3089-5
96. Makin T. R. , Brozzoli C. , Cardinali L. , Holmes N. P. , Farnè A. (2015). "Left or right? Rapid visuomotor coding of hand laterality during motor decisions", Cortex Vol 64, 289292. http://dx.doi.org/10.1016/j.cortex.2014.12.004
97. Maravita A. , Iriki A. (2004). "Tools for the body (schema)", Trends Cogn. Sci. Vol 8, 7986. http://dx.doi.org/10.1016/j.tics.2003.12.008
98. Maravita A. , Husain M. , Clarke K. , Driver J. (2001). "Reaching with a tool extends visual–tactile interactions into far space: evidence from cross-modal extinction", Neuropsychologia Vol 39, 580585. http://dx.doi.org/10.1016/S0028-3932(00)00150-0
99. Marzocchi N. , Breveglieri R. , Galletti C. , Fattori P. (2008). "Reaching activity in parietal area V6A of macaque: eye influence on arm activity or retinocentric coding of reaching movements?" Eur. J. Neurosci. Vol 27, 775789. http://dx.doi.org/10.1111/j.1460-9568.2008.06021.x
100. McDonald J. J. , Teder-Sälejärvi W. A. , Ward L. M. (2001). "Multisensory integration and crossmodal attention effects in the human brain", Science Vol 292(5523), 1791. http://dx.doi.org/10.1126/science.292.5523.1791a
101. Melzack R. (1999). "From the gate to the neuromatrix", Pain Vol 82, S121S126. http://dx.doi.org/10.1016/S0304-3959(99)00145-1
102. Menger R. , Van der Stigchel S. , Dijkerman H. C. (in prep.). "Multisensory interactions during obstacle avoidance".
103. Miller J. (1982). "Divided attention: evidence for coactivation with redundant signals", Cogn. Psychol. Vol 14, 247279. http://dx.doi.org/10.1016/0010-0285(82)90010-X
104. Miller J. (1986). "Timecourse of coactivation in bimodal divided attention", Percept. Psychophys. Vol 40, 331343. http://dx.doi.org/10.3758/BF03203025
105. Moayedi M. , Liang M. , Sim A. L. , Hu L. , Haggard P. , Iannetti G. D. (2015). "Laser-evoked vertex potentials predict defensive motor actions", Cereb. Cortex Vol 25(12), 47894798. http://dx.doi.org/10.1093/cercor/bhv149
106. Moeller B. , Zoppke H. , Frings C. (in press). "What a car does to your perception: distance evaluations differ from within and outside of a car", Psychonom. Bull. Rev. DOI:.
107. Moseley G. L. , Gallace A. , Spence C. (2012). "Bodily illusions in health and disease: physiological and clinical perspectives and the concept of a cortical ‘body matrix’", Neurosci. Biobehav. Rev. Vol 36, 3446. http://dx.doi.org/10.1016/j.neubiorev.2011.03.013
108. Mozolic J. L. , Hugenschmidt C. E. , Peiffer A. M. , Laurienti P. J. (2008). "Modality-specific selective attention attenuates multisensory integration", Exp. Brain Res. Vol 184, 3952. http://dx.doi.org/10.1007/s00221-007-1080-3
109. Murray M. , Spence C. , Harris L. (2013). "International Multisensory Research Forum 2012 meeting special issue", Multisens. Res. Vol 26, 287289. http://dx.doi.org/10.1163/22134808-00002416
110. Noel J. P. , Grivaz P. , Marmaroli P. , Lissek H. , Blanke O. , Serino A. (2015a). "Full body action remapping of peripersonal space: the case of walking", Neuropsychologia Vol 70, 375384. http://dx.doi.org/10.1016/j.neuropsychologia.2014.08.030
111. Noel J. P. , Pfeiffer C. , Blanke O. , Serino A. (2015b). "Peripersonal space as the space of the bodily self", Cognition Vol 144, 4957. http://dx.doi.org/10.1016/j.cognition.2015.07.012
112. Occelli V. , Spence C. , Zampini M. (2011). "Audiotactile interactions in front and rear space", Neurosci. Biobehav. Rev. Vol 35, 589598. http://dx.doi.org/10.1016/j.neubiorev.2010.07.004
113. Oosterhof N. N. , Tipper S. P. , Downing P. E. (2012). "Viewpoint (in) dependence of action representations: an MVPA study", J. Cogn. Neurosci. Vol 24, 975989. http://dx.doi.org/10.1162/jocn_a_00195
114. Pöppel E. , Artin T. (1988). Mindworks: Time and Conscious Experience. Harcourt Brace Jovanovich, San Diego, CA, USA.
115. Previc F. H. (1998). "The neuropsychology of 3-D space", Psychol. Bull. Vol 124, 123164. http://dx.doi.org/10.1037/0033-2909.124.2.123
116. Pugh E. N. , Lamb T. D. (1993). "Amplification and kinetics of the activation steps in phototransduction", Biochim. Biophys. Acta Vol 1141, 111149. http://dx.doi.org/10.1016/0005-2728(93)90038-H
117. Rizzolatti G. , Scandolara C. , Matelli M. , Gentilucci M. (1981). "Afferent properties of periarcuate neurons in macaque monkeys. II. Visual responses", Behav. Brain Res. Vol 2, 147163. http://dx.doi.org/10.1016/0166-4328(81)90053-X
118. Rizzolatti G. , Fadiga L. , Fogassi L. , Gallese V. (1997). "The space around us", Science Vol 277(5323), 190191. http://dx.doi.org/10.1126/science.277.5323.190
119. Sambo C. F. , Forster B. (2009). "An ERP investigation on visuotactile interactions in peripersonal and extrapersonal space: evidence for the spatial rule", J. Cogn. Neurosci. Vol 21, 15501559. http://dx.doi.org/10.1162/jocn.2009.21109
120. Sambo C. F. , Forster B. (2011). "When far is near: ERP correlates of crossmodal spatial interactions between tactile and mirror-reflected visual stimuli", Neurosci. Lett. Vol 500, 1015. http://dx.doi.org/10.1016/j.neulet.2011.05.233
121. Sambo C. F. , Iannetti G. D. (2013). "Better safe than sorry? The safety margin surrounding the body is increased by anxiety", J. Neurosci. Vol 33, 1422514230. http://dx.doi.org/10.1523/JNEUROSCI.0706-13.2013
122. Santangelo V. , Ho C. , Spence C. (2008). "Capturing spatial attention with multisensory cues", Psychonom. Bull. Rev. Vol 15, 398403. http://dx.doi.org/10.3758/PBR.15.2.398
123. Schnapf J. L. , Kraft T. W. , Baylor D. A. (1987). "Spectral sensitivity of human cone photoreceptors", Nature Vol 325(6103), 439441. http://dx.doi.org/10.1038/325439a0
124. Schroeder C. E. , Foxe J. J. (2002). "The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex", Brain Res.: Cogn. Brain Res. Vol 14, 187198. http://dx.doi.org/10.1016/S0926-6410(02)00073-3
125. Schroeder C. E. , Foxe J. J. (2004). "Multisensory convergence in early cortical processing", in: The Handbook of Multisensory Processes, Calvert G. A. , Spence C. , Stein B. E. (Eds), pp.  295309. MIT Press, Cambridge, MA, USA.
126. Sereno M. I. , Huang R. S. (2006). "A human parietal face area contains aligned head-centered visual and tactile maps", Nat. Neurosci. Vol 9, 13371343. http://dx.doi.org/10.1038/nn1777
127. Serino A. , Annella L. , Avenanti A. (2009). "Motor properties of peripersonal space in humans", PLoS One Vol 4, e6582. DOI:.
128. Serino A. , Canzoneri E. , Avenanti A. (2011). "Fronto-parietal areas necessary for a multisensory representation of peripersonal space in humans: an rTMS study", J. Cogn. Neurosci. Vol 23, 29562967. http://dx.doi.org/10.1162/jocn_a_00006
129. Serino A. , Canzoneri E. , Marzolla M. , Di Pellegrino G. , Magosso E. (2015). "Extending peripersonal space representation without tool-use: evidence from a combined behavioral-computational approach", Front. Behav. Neurosci. Vol 9, 4. DOI:. http://dx.doi.org/10.3389/fnbeh.2015.00004
130. Shams L. , Kamitani Y. , Shimojo S. (2000). "What you see is what you hear", Nature Vol 408(6814), 788. http://dx.doi.org/10.1038/35048669
131. Shams L. , Kamitani Y. , Thompson S. , Shimojo S. (2001). "Sound alters visual evoked potentials in humans", Neuroreport Vol 12, 38493852. http://dx.doi.org/10.1097/00001756-200112040-00049
132. Shams L. , Wozny D. R. , Kim R. , Seitz A. (2011). "Influences of multisensory experience on subsequent unisensory processing", Front. Psychol. Vol 2, 264. DOI:. http://dx.doi.org/10.3389/fpsyg.2011.00264
133. Soto-Faraco S. , Navarra J. , Alsius A. (2004). "Assessing automaticity in audiovisual speech integration: evidence from the speeded classification task", Cognition Vol 92, B13B23. http://dx.doi.org/10.1016/j.cognition.2003.10.005
134. Spence C. (2011). "Assessing the consequences of tool-use for the representation of peripersonal space in humans", in: Tool Use and Causal Cognition, McCormack T. , Hoerl C. , Butterfill S. (Eds), pp.  220247. Oxford University Press, Oxford, UK. http://dx.doi.org/10.1093/acprof:oso/9780199571154.003.0012
135. Spence C. (2012). "Drive safely with neuroergonomics", Psychologist Vol 25, 664667.
136. Spence C. (2013). "Just how important is spatial coincidence to multisensory integration? Evaluating the spatial rule", Ann. NY Acad. Sci. Vol 1296, 3149. http://dx.doi.org/10.1111/nyas.12121
137. Spence C. (2015). "Multisensory flavor perception", Cell Vol 161, 2435. http://dx.doi.org/10.1016/j.cell.2015.03.007
138. Spence C. , Driver J. (2000). "Attracting attention to the illusory location of a sound: reflexive crossmodal orienting and ventriloquism", Neuroreport Vol 11, 20572061. http://dx.doi.org/10.1097/00001756-200006260-00049
139. Spence C. , Driver J. (Eds) (2004). Crossmodal Space and Crossmodal Attention. Oxford University Press, Oxford, UK.
140. Spence C. , Ho C. (2008). "Multisensory warning signals for event perception and safe driving", Theor. Issues Ergon. Sci. Vol 9, 523554. http://dx.doi.org/10.1080/14639220701816765
141. Spence C. , Santangelo V. (2009). "Capturing spatial attention with multisensory cues: a review", Hear. Res. Vol 258, 134142. http://dx.doi.org/10.1016/j.heares.2009.04.015
142. Spence C. , Squire S. B. (2003). "Multisensory integration: maintaining the perception of synchrony", Curr. Biol. Vol 13, R519R521. http://dx.doi.org/10.1016/S0960-9822(03)00445-7
143. Spence C. , Pavani F. , Maravita A. , Holmes N. (2004). "Multisensory contributions to the 3-D representation of visuotactile peripersonal space in humans: evidence from the crossmodal congruency task", J. Physiol. Paris Vol 98, 171189. http://dx.doi.org/10.1016/j.jphysparis.2004.03.008
144. Spence C. , Pavani F. , Maravita A. , Holmes N. P. (2008). "Multi-sensory interactions", in: Haptic Rendering: Foundations, Algorithms, and Applications, Lin M. C. , Otaduy M. A. (Eds), pp.  2152. AK Peters, Wellesley, MA, USA. http://dx.doi.org/10.1201/b10636-4
145. Spence C. , Parise C. , Chen Y.-C. (2011). "The Colavita visual dominance effect", in: Frontiers in the Neural Bases of Multisensory Processes, Murray M. M. , Wallace M. (Eds), pp.  523550. CRC Press, Boca Raton, FL, USA.
146. Stein B. E. (Ed.) (2012). The New Handbook of Multisensory Processing. MIT Press, Cambridge, MA, USA.
147. Stein B. E. , Meredith M. (1990). "Multisensory integration", Ann. NY Acad. Sci. Vol 608, 5170. http://dx.doi.org/10.1111/j.1749-6632.1990.tb48891.x
148. Stein B. E. , Meredith M. A. (1993). The Merging of the Senses. MIT Press, Cambridge, MA, USA.
149. Stein B. E. , Burr D. , Constantinidis C. , Laurienti P. J. , Meredith M. A. , Perrault T. J. , Ramachandran R. , Röder B. , Rowland B. A. , Sathian K. , Schroeder C. E. , Shams L. , Stanford T. R. , Wallace M. T. , Yu L. , Lewkowicz D. J. (2010). "Semantic confusion regarding the development of multisensory integration: a practical solution", Eur. J. Neurosci. Vol 31, 17131720. http://dx.doi.org/10.1111/j.1460-9568.2010.07206.x
150. Stevenson R. A. , Fister J. K. , Barnett Z. P. , Nidiffer A. R. , Wallace M. T. (2012). "Interactions between the spatial and temporal stimulus factors that influence multisensory integration in human performance", Exp. Brain Res. Vol 219, 121137. http://dx.doi.org/10.1007/s00221-012-3072-1
151. Sugita Y. , Suzuki Y. (2003). "Audiovisual perception: implicit estimation of sound-arrival time", Nature Vol 421(6926), 911. http://dx.doi.org/10.1038/421911a
152. Tabor A. , Catley M. J. , Gandevia S. C. , Thacker M. A. , Spence C. , Moseley G. L. (2015). "The close proximity of threat: altered distance perception in the anticipation of pain", Front. Psychol. Vol 6, 626. DOI:. http://dx.doi.org/10.3389/fpsyg.2015.00626
153. Taffou M. , Viaud-Delmon I. (2014). "Cynophobic fear adaptively extends peri-personal space", Front. Psychiatry Vol 5, 122. DOI:. http://dx.doi.org/10.3389/fpsyt.2014.00122
154. Talsma D. (2015). "Predictive coding and multisensory integration: an attentional account of the multisensory mind", Front. Integr. Neurosci. Vol 9, 19. DOI:. http://dx.doi.org/10.3389/fnint.2015.00019
155. Talsma D. , Woldorff M. G. (2005). "Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity", J. Cogn. Neurosci. Vol 17, 10981114. http://dx.doi.org/10.1162/0898929054475172
156. Talsma D. , Doty T. J. , Woldorff M. G. (2007). "Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration?" Cereb. Cortex Vol 17, 679690. http://dx.doi.org/10.1093/cercor/bhk016
157. Talsma D. , Senkowski D. , Soto-Faraco S. , Woldorff M. G. (2010). "The multifaceted interplay between attention and multisensory integration", Trends Cogn. Sci. Vol 14, 400410. http://dx.doi.org/10.1016/j.tics.2010.06.008
158. Ten Brink A. F. , Nijboer T. C. W. , Van der Stoep N. , Van der Stigchel S. (2014). "The influence of vertically and horizontally aligned visual distractors on aurally guided saccadic eye movements", Exp. Brain Res. Vol 232, 13571366. http://dx.doi.org/10.1007/s00221-014-3854-8
159. Teneggi C. , Canzoneri E. , di Pellegrino G. , Serino A. (2013). "Social modulation of peripersonal space boundaries", Curr. Biol. Vol 23, 406411. http://dx.doi.org/10.1016/j.cub.2013.01.043
160. Tipper S. P. , Howard L. A. , Jackson S. R. (1997). "Selective reaching to grasp: evidence for distractor interference effects", Vis. Cogn. Vol 4, 138. http://dx.doi.org/10.1080/713756749
161. Vagnoni E. , Lourenco S. F. , Longo M. R. (2012). "Threat modulates perception of looming visual stimuli", Curr. Biol. Vol 22, R826R827. http://dx.doi.org/10.1016/j.cub.2012.07.053
162. Van der Stigchel S. , Meeter M. , Theeuwes J. (2006). "Eye movement trajectories and what they tell us", Neurosci. Biobehav. Rev. Vol 30, 666679. http://dx.doi.org/10.1016/j.neubiorev.2005.12.001
163. Van der Stoep N. , Di Luca M. (in prep.). "Audiovisual integration in near and far extrapersonal space".
164. Van der Stoep N. , Visser-Meily J. M. A. , Kappelle L. J. , De Kort P. L. M. , Huisman K. D. , Eijsackers A. L. , Kouwenhoven M. , Van der Stigchel S. , Nijboer T. C. W. (2013). "Exploring near and far regions of space: distance specific visuospatial neglect after stroke", J. Clin. Exp. Neuropsychol. Vol 35, 799811. http://dx.doi.org/10.1080/13803395.2013.824555
165. Van der Stoep N. , Nijboer T. C. W. , Van der Stigchel S. (2014). "Exogenous orienting of crossmodal attention in 3-D space: support for a depth-aware crossmodal attentional system", Psychonom. Bull. Rev. Vol 21, 708714.
166. Van der Stoep N. , Nijboer T. C. W. , Van der Stigchel S. , Spence C. (2015a). "Multisensory interactions in the depth-plane in front and rear space: a review", Neuropsychologia Vol 70, 335349. http://dx.doi.org/10.1016/j.neuropsychologia.2014.12.007
167. Van der Stoep N. , Van der Stigchel S. , Nijboer T. C. W. (2015b). "Exogenous spatial attention decreases audiovisual integration", Atten. Percept. Psychophys. Vol 77, 464482. http://dx.doi.org/10.3758/s13414-014-0785-1
168. Van der Stoep N. , Spence C. , Nijboer T. C. W. , Van der Stigchel S. (2015c). "On the relative contributions of multisensory integration and crossmodal exogenous spatial attention to multisensory response enhancement", Acta Psychol. Vol 162, 2028. http://dx.doi.org/10.1016/j.actpsy.2015.09.010
169. Van der Stoep N. , Van der Stigchel S. , Nijboer T. C. W. , Van der Smagt M. J. (in press). "Audiovisual integration in near and far space: effects of changes in distance and stimulus effectiveness", Exp. Brain Res. DOI:.
170. Vroomen J. , Keetels M. (2010). "Perception of intersensory synchrony: a tutorial review", Atten. Percept. Psychophys. Vol 72, 871884. http://dx.doi.org/10.3758/APP.72.4.871
171. Vroomen J. , Bertelson P. , De Gelder B. (2001). "The ventriloquist effect does not depend on the direction of automatic visual attention", Percept. Psychophys. Vol 63, 651659. http://dx.doi.org/10.3758/BF03194427
172. Vuilleumier P. , Valenza N. , Mayer E. , Reverdin A. , Landis T. (1998). "Near and far visual space in unilateral neglect", Ann. Neurol. Vol 43, 406410. http://dx.doi.org/10.1002/ana.410430324
173. Wallace M. T. , Stein B. E. (2007). "Early experience determines how the senses will interact", J. Neurophysiol. Vol 97, 921926. http://dx.doi.org/10.1152/jn.00497.2006
174. Wallace M. T. , Perrault T. J. , Hairston W. D. , Stein B. E. (2004). "Visual experience is necessary for the development of multisensory integration", J. Neurosci. Vol 24, 95809584. http://dx.doi.org/10.1523/JNEUROSCI.2535-04.2004
175. Yue Z. , Jiang Y. , Li Y. , Wang P. , Chen Q. (2015). "Enhanced visual dominance in far space", Exp. Brain Res. Vol 233, 28332843. http://dx.doi.org/10.1007/s00221-015-4353-2
176. Zou H. , Müller H. J. , Shi Z. (2012). "Non-spatial sounds regulate eye movements and enhance visual search", J. Vis. Vol 12, 2. DOI:.
http://brill.metastore.ingenta.com/content/journals/10.1163/22134808-00002525
Loading

Article metrics loading...

/content/journals/10.1163/22134808-00002525
2016-06-08
2018-01-22

Sign-in

Can't access your account?
  • Tools

  • Add to Favorites
  • Printable version
  • Email this page
  • Subscribe to ToC alert
  • Get permissions
  • Recommend to your library

    You must fill out fields marked with: *

    Librarian details
    Your details
    Why are you recommending this title?
    Select reason:
     
    Multisensory Research — Recommend this title to your library
  • Export citations
  • Key

  • Full access
  • Open Access
  • Partial/No accessInformation