Cookies Policy
X

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies.

I accept this policy

Find out more here

Vision and Haptics Share Spatial Attentional Resources and Visuotactile Integration Is Not Affected by High Attentional Load

No metrics data to plot.
The attempt to load metrics for this article has failed.
The attempt to plot a graph for these metrics has failed.
The full text of this article is not currently available.

Brill’s MyBook program is exclusively available on BrillOnline Books and Journals. Students and scholars affiliated with an institution that has purchased a Brill E-Book on the BrillOnline platform automatically have access to the MyBook option for the title(s) acquired by the Library. Brill MyBook is a print-on-demand paperback copy which is sold at a favorably uniform low price.

Access this article

+ Tax (if applicable)
Add to Favorites
You must be logged in to use this functionality

image of Multisensory Research
For more content, see Seeing and Perceiving and Spatial Vision.

Human information processing is limited by attentional resources. Two questions that are discussed in multisensory research are (1) whether there are separate spatial attentional resources for each sensory modality and (2) whether multisensory integration is influenced by attentional load. We investigated these questions using a dual task paradigm: Participants performed two spatial tasks (a multiple object tracking [‘MOT’] task and a localization [‘LOC’] task) either separately (single task condition) or simultaneously (dual task condition). In the MOT task, participants visually tracked a small subset of several randomly moving objects. In the LOC task, participants either received visual, tactile, or redundant visual and tactile location cues. In the dual task condition, we found a substantial decrease in participants’ performance and an increase in participants’ mental effort (indicated by an increase in pupil size) relative to the single task condition. Importantly, participants performed equally well in the dual task condition regardless of whether they received visual, tactile, or redundant multisensory (visual and tactile) location cues in the LOC task. This result suggests that having spatial information coming from different modalities does not facilitate performance, thereby indicating shared spatial attentional resources for the tactile and visual modality. Also, we found that participants integrated redundant multisensory information optimally even when they experienced additional attentional load in the dual task condition. Overall, findings suggest that (1) spatial attentional resources for the tactile and visual modality overlap and that (2) the integration of spatial cues from these two modalities occurs at an early pre-attentive processing stage.

Affiliations: 1: 1Institute of Cognitive Science, Universität Osnabrück, Osnabrück, Germany

Loading

Full text loading...

/content/journals/10.1163/22134808-00002482
Loading

Data & Media loading...

1. Alais D. , Morrone C. , Burr D. ( 2006). "Separate attentional resources for vision and audition", Proc. Biol. Sci. Vol 273( 1592), 13391345. http://dx.doi.org/10.1098/rspb.2005.3420
2. Alnæs D. , Sneve M. H. , Espeseth T. , Endestad T. , Van de Pavert S. H. P. , Laeng B. ( 2014). "Pupil size signals mental effort deployed during multiple object tracking and predicts brain activity in the dorsal attention network and the locus coeruleus", J. Vis. Vol 14( 4), 1. DOI: .
3. Alsius A. , Navarra J. , Campbell R. , Soto-Faraco S. ( 2005). "Audiovisual integration of speech falters under high attention demands", Curr. Biol. Vol 15, 839843. http://dx.doi.org/10.1016/j.cub.2005.03.046
4. Alsius A. , Navarra J. , Soto-Faraco S. ( 2007). "Attention to touch weakens audiovisual speech integration", Exp. Brain Res. Vol 183, 399404. http://dx.doi.org/10.1007/s00221-007-1110-1
5. Alvarez G. A. , Franconeri S. L. ( 2007). "How many objects can you track?: Evidence for a resource-limited attentive tracking mechanism", J. Vis. Vol 7( 13), 14.
6. Arnell K. M. , Jenkins R. ( 2004). "Revisiting within-modality and cross-modality attentional blinks: effects of target–distractor similarity", Percept. Psychophys. Vol 66, 11471161. http://dx.doi.org/10.3758/BF03196842
7. Arnell K. M. , Larson J. M. ( 2002). "Cross-modality attentional blinks without preparatory task-set switching", Psychonom Bull. Rev. Vol 9, 497506. http://dx.doi.org/10.3758/BF03196305
8. Arrighi R. , Lunardi R. , Burr D. ( 2011). "Vision and audition do not share attentional resources in sustained tasks", Front. Psychol. Vol 2, 56. DOI: . http://dx.doi.org/10.3389/fpsyg.2011.00056
9. Bates D. , Maechler M. , Bolker B. , Walker S. ( 2014). lme4: linear mixed-effects models using Eigen and S4 (R package version 1.1-5 ed.), .
10. Beatty J. ( 1982). "Task-evoked pupillary responses, processing load, and the structure of processing resources", Psychol. Bull. Vol 91, 276296. http://dx.doi.org/10.1037/0033-2909.91.2.276
11. Bertelson P. , Vroomen J. , De Gelder B. , Driver J. ( 2000). "The ventriloquist effect does not depend on the direction of deliberate visual attention", Percept. Psychophys. Vol 62, 321332. http://dx.doi.org/10.3758/BF03205552
12. Bonnel A.-M. , Prinzmetal W. ( 1998). "Dividing attention between the color and the shape of objects", Percept. Psychophys. Vol 60, 113124. http://dx.doi.org/10.3758/BF03211922
13. Bruin J. ( 2014). R library: contrast coding systems for categorical variables.
14. Busse L. , Roberts K. C. , Crist R. E. , Weissman D. H. , Woldorff M. G. ( 2005). "The spread of attention across modalities and space in a multisensory object", Proc. Natl Acad. Sci. U.S.A. Vol 102, 1875118756. http://dx.doi.org/10.1073/pnas.0507704102
15. Calhoun G. L. , Draper M. H. , Ruff H. A. , Fontejon J. V. ( 2002). "Utility of a tactile display for cueing faults", Proc. Hum. Fact. Ergon. Soc. Annu. Meet. Vol 46, 21442148. http://dx.doi.org/10.1177/154193120204602609
16. Chun M. M. , Golomb J. D. , Turk-Browne N. B. ( 2011). "A taxonomy of external and internal attention", Annu. Rev. Psychol. Vol 62, 73101. http://dx.doi.org/10.1146/annurev.psych.093008.100427
17. Coren S. , Ward L. M. , Enns J. T. ( 2004). Sensation and Perception, 6th edn. Wiley, New York, NY, USA.
18. Duncan J. , Martens S. , Ward R. ( 1997). "Restricted attentional capacity within but not between sensory modalities", Nature Vol 397, 808810. http://dx.doi.org/10.1038/42947
19. Ernst M. O. ( 2006). "A Bayesian view on multimodal cue integration", in: Human Body Perception from the Inside Out, Knoblich G. , Thornton I. M. , Grosjean M. , Shiffrar M. (Eds), pp.  105131. Oxford University Press, New York, NY, USA.
20. Ernst M. O. , Bülthoff H. H. ( 2004). "Merging the senses into a robust percept", Trends Cogn. Sci. Vol 8, 162169. http://dx.doi.org/10.1016/j.tics.2004.02.002
21. Gepshtein S. , Burge J. , Ernst M. O. , Banks M. S. ( 2005). "The combination of vision and touch depends on spatial proximity", J. Vis. Vol 5, 10131023.
22. Green C. S. , Bavelier D. ( 2006). "Enumeration versusmultiple object tracking: the case of action video game players", Cognition Vol 101, 217245. http://dx.doi.org/10.1016/j.cognition.2005.10.004
23. Hagen M. C. , Franzén O. , McGlone F. , Essick G. , Dancer C. , Pardo J. V. ( 2002). "Tactile motion activates the human middle temporal/v5 (mt/v5) complex", Eur. J. Neurosci. Vol 16, 957964. http://dx.doi.org/10.1046/j.1460-9568.2002.02139.x
24. Hein G. , Parr A. , Duncan J. ( 2006). "Within-modality and cross-modality attentional blinks in a simple discrimination task", Percept. Psychophys. Vol 68, 5461. http://dx.doi.org/10.3758/BF03193655
25. Hess E. H. , Polt J. M. ( 1964). "Pupil size in relation to mental activity during simple problem-solving", Science Vol 143( 3611), 11901192. http://dx.doi.org/10.1126/science.143.3611.1190
26. Hillstrom A. P. , Shapiro K. L. , Spence C. ( 2002). "Attentional limitations in processing sequentially presented vibrotactile targets", Percept. Psychophys. Vol 64, 10681082. http://dx.doi.org/10.3758/BF03194757
27. Holmes N. P. , Spence C. ( 2005). "Multisensory integration: space, time and superadditivity", Curr. Biol. Vol 15, R762R764. http://dx.doi.org/10.1016/j.cub.2005.08.058
28. James W. ( 1890). The Principles of Psychology. Harvard University Press, Cambridge, MA, USA. http://dx.doi.org/10.1037/11059-000
29. Jolicoeur P. ( 1999). "Restricted attentional capacity between sensory modalities", Psychonom. Bull. Rev. Vol 6, 8792. http://dx.doi.org/10.3758/BF03210813
30. Kietzmann T. C. , Geuter S. , König P. ( 2011). "Overt visual attention as a causal factor of perceptual awareness", PloS One Vol 6, e22614. http://dx.doi.org/10.1371/journal.pone.0022614
31. Koelewijn T. , Bronkhorst A. , Theeuwes J. ( 2010). "Attention and the multiple stages of multisensory integration: a review of audiovisual studies", Acta Psychol. Vol 134, 372384. http://dx.doi.org/10.1016/j.actpsy.2010.03.010
32. LaBerge D. ( 1995). Attentional Processing: The Brain’s Art of Mindfulness, Vol Vol. 2. Harvard University Press, Cambridge, MA. USA. http://dx.doi.org/10.4159/harvard.9780674183940
33. Leifeld P. ( 2013). "texreg: conversion of statistical model output in R to LATEX and HTML tables", J. Stat. Softw. Vol 55( 8), 124.
34. Livingstone M. , Hubel D. ( 1988). "Segregation of form, color, movement, and depth: anatomy, physiology, and perception", Science Vol 240( 4853), 740749. http://dx.doi.org/10.1126/science.3283936
35. Marois R. , Ivanoff J. ( 2005). "Capacity limits of information processing in the brain", Trends Cogn. Sci. Vol 9, 296305. http://dx.doi.org/10.1016/j.tics.2005.04.010
36. McGurk H. , MacDonald J. ( 1976). "Hearing lips and seeing voices", Nature Vol 264( 5588), 746748. http://dx.doi.org/10.1038/264746a0
37. Meredith M. A. , Stein B. E. ( 1983). "Interactions among converging sensory inputs in the superior colliculus", Science Vol 221( 4608), 389391. http://dx.doi.org/10.1126/science.6867718
38. Mozolic J. L. , Hugenschmidt C. E. , Peiffer A. M. , Laurienti P. J. ( 2008). "Modality-specific selective attention attenuates multisensory integration", Exp. Brain Res. Vol 184, 3952. http://dx.doi.org/10.1007/s00221-007-1080-3
39. Nagel S. K. , Carl C. , Kringe T. , Märtin R. , König P. ( 2005). "Beyond sensory substitution — learning the sixth sense", J. Neural Eng. Vol 2, R13R26. http://dx.doi.org/10.1088/1741-2560/2/4/R02
40. Nikolic M. I. , Sklar A. E. , Sarter N. B. ( 1998). "Multisensory feedback in support of pilot-automation coordination: the case of uncommanded mode transitions", Proc. Hum. Fact. Ergon. Soc. Annu. Meet. Vol 42, 239243. http://dx.doi.org/10.1177/154193129804200312
41. Potter M. C. , Chun M. M. , Banks B. S. , Muckenhoupt M. ( 1998). "Two attentional deficits in serial target search: the visual attentional blink and an amodal task-switch deficit", J. Exp. Psychol. Learn. Mem. Cogn. Vol 24, 979992. http://dx.doi.org/10.1037/0278-7393.24.4.979
42. Pylyshyn Z. W. , Storm R. W. ( 1988). "Tracking multiple independent targets: evidence for a parallel tracking mechanism", Spat. Vis. Vol 3, 179197. http://dx.doi.org/10.1163/156856888X00122
43. Reed C. L. , Klatzky R. L. , Halgren E. ( 2005). "What vs.where in touch: an fMRI study", Neuroimage Vol 25, 718726. http://dx.doi.org/10.1016/j.neuroimage.2004.11.044
44. Sklar A. E. , Sarter N. B. ( 1999). "Good vibrations: tactile feedback in support of attention allocation and human-automation coordination in event-driven domains", Hum. Fact. Vol 41, 543552. http://dx.doi.org/10.1518/001872099779656716
45. Soto-Faraco S. , Spence C. ( 2002). "Modality-specific auditory and visual temporal processing deficits", Q. J. Exp. Psychol. Vol 55, 2340. http://dx.doi.org/10.1080/02724980143000136
46. Soto-Faraco S. , Spence C. , Fairbank K. , Kingstone A. , Hillstrom A. P. , Shapiro K. ( 2002). "A crossmodal attentional blink between vision and touch", Psychonom. Bull. Rev. Vol 9, 731738. http://dx.doi.org/10.3758/BF03196328
47. Soto-Faraco S. , Navarra J. , Alsius A. ( 2004). "Assessing automaticity in audiovisual speech integration: evidence from the speeded classification task", Cognition Vol 92, B13B23. http://dx.doi.org/10.1016/j.cognition.2003.10.005
48. Stein B. E. , Stanford T. R. ( 2008). "Multisensory integration: current issues from the perspective of the single neuron", Nat. Rev. Neurosci. Vol 9, 255266. http://dx.doi.org/10.1038/nrn2331
49. Talsma D. , Woldorff M. G. ( 2005). "Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity", J. Cogn. Neurosci. Vol 17, 10981114. http://dx.doi.org/10.1162/0898929054475172
50. Talsma D. , Doty T. J. , Strowd R. , Woldorff M. G. ( 2006). "Attentional capacity for processing concurrent stimuli is larger across sensory modalities than within a modality", Psychophysiology Vol 43, 541549. http://dx.doi.org/10.1111/j.1469-8986.2006.00452.x
51. Talsma D. , Doty T. J. , Woldorff M. G. ( 2007). "Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration?" Cereb. Cortex Vol 17, 679690. http://dx.doi.org/10.1093/cercor/bhk016
52. Tremblay S. , Vachon F. , Jones D. M. ( 2005). "Attentional and perceptual sources of the auditory attentional blink", Percept. Psychophys. Vol 67, 195208. http://dx.doi.org/10.3758/BF03206484
53. Twisk J. W. ( 2006). Applied Multilevel Analysis. Cambridge University Press, Cambridge, MA, USA. http://dx.doi.org/10.1017/CBO9780511610806
54. Van der Burg E. , Olivers C. N. L. , Bronkhorst A. W. , Koelewijn T. , Theeuwes J. ( 2007). "The absence of an auditory–visual attentional blink is not due to echoic memory", Percept. Psychophys. Vol 69, 12301241. http://dx.doi.org/10.3758/BF03193958
55. Van der Burg E. , Olivers C. N. , Bronkhorst A. W. , Theeuwes J. ( 2008). "Pip and pop: nonspatial auditory signals improve spatial visual search", J. Exp. Psychol. Hum. Percept. Perform. Vol 34, 10531065. http://dx.doi.org/10.1037/0096-1523.34.5.1053
56. Van Erp J. B. , Van Veen H. A. ( 2004). "Vibrotactile in-vehicle navigation system", Transp. Res. Part F: Traffic Psychol. Behav. Vol 7, 247256. http://dx.doi.org/10.1016/j.trf.2004.09.003
57. Vroomen J. , Bertelson P. , De Gelder B. ( 2001). "The ventriloquist effect does not depend on the direction of automatic visual attention", Percept. Psychophys. Vol 63, 651659. http://dx.doi.org/10.3758/BF03194427
58. Wickham H. ( 2009). ggplot2: Elegant Graphics for Data Analysis. Springer, New York, NY, USA.
http://brill.metastore.ingenta.com/content/journals/10.1163/22134808-00002482
Loading

Article metrics loading...

/content/journals/10.1163/22134808-00002482
2015-04-30
2017-04-26

Sign-in

Can't access your account?
  • Tools

  • Add to Favorites
  • Printable version
  • Email this page
  • Subscribe to ToC alert
  • Get permissions
  • Recommend to your library

    You must fill out fields marked with: *

    Librarian details
    Your details
    Why are you recommending this title?
    Select reason:
     
    Multisensory Research — Recommend this title to your library
  • Export citations
  • Key

  • Full access
  • Open Access
  • Partial/No accessInformation