Cookies Policy
X

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies.

I accept this policy

Find out more here

A Potential Role of Auditory Induced Modulations in Primary Visual Cortex

No metrics data to plot.
The attempt to load metrics for this article has failed.
The attempt to plot a graph for these metrics has failed.
The full text of this article is not currently available.

Brill’s MyBook program is exclusively available on BrillOnline Books and Journals. Students and scholars affiliated with an institution that has purchased a Brill E-Book on the BrillOnline platform automatically have access to the MyBook option for the title(s) acquired by the Library. Brill MyBook is a print-on-demand paperback copy which is sold at a favorably uniform low price.

Access this article

+ Tax (if applicable)
Add to Favorites
You must be logged in to use this functionality

For more content, see Seeing and Perceiving and Spatial Vision.

A biologically relevant event is normally the source of multiple, typically correlated, sensory inputs. To optimize perception of the outer world, our brain combines the independent sensory measurements into a coherent estimate. However, if sensory information is not readily available for every pertinent sense, the brain tries to acquire additional information via covert/overt orienting behaviors or uses internal knowledge to modulate sensory sensitivity based on prior expectations. Cross-modal functional modulation of low-level auditory areas due to visual input has been often described; however, less is known about auditory modulations of primary visual cortex. Here, based on some recent evidence, we propose that an unexpected auditory signal could trigger a reflexive overt orienting response towards its source and concomitantly increase the primary visual cortex sensitivity at the locations where the object is expected to enter the visual field. To this end, we propose that three major functionally specific pathways are employed in parallel. A stream orchestrated by the superior colliculus is responsible for the overt orienting behavior, while direct and indirect (via higher-level areas) projections from A1 to V1 respectively enhance spatiotemporal sensitivity and facilitate object detectability.

Loading

Full text loading...

/content/journals/10.1163/22134808-00002494
Loading

Data & Media loading...

1. Adams D. L. , Horton J. C. ( 2003). "A precise retinotopic map of primate striate cortex generated from the representation of angioscotomas", J. Neurosci. Vol 23, 37713789.
2. Baizer J. S. , Lock T. M. , Youakim M. ( 1997). "Projections from the claustrum to the prelunate gyrus in the monkey", Exp. Brain Res. Vol 113, 564568. http://dx.doi.org/10.1007/PL00005607
3. Barone P. , Batardiere A. , Knoblauch K. , Kennedy H. ( 2000). "Laminar distribution of neurons in extrastriate areas projecting to visual areas V1 and V4 correlates with the hierarchical rank and indicates the operation of a distance rule", J. Neurosci. Vol 20, 32633281.
4. Benevento L. A. , Rezak M. ( 1976). "The cortical projections of the inferior pulvinar and adjacent lateral pulvinar in the rhesus monkey ( Macaca mulatta): an autoradiographic study", Brain Res. Vol 108, 124. http://dx.doi.org/10.1016/0006-8993(76)90160-8
5. Blank H. , Anwander A. , von Kriegstein K. ( 2011). "Direct structural connections between voice- and face-recognition areas", J. Neurosci. Vol 31, 1290612915. http://dx.doi.org/10.1523/JNEUROSCI.2091-11.2011
6. Bolognini N. , Senna I. , Maravita A. , Pascual-Leone A. , Merabet L. B. ( 2010). "Auditory enhancement of visual phosphene perception: the effect of temporal and spatial factors and of stimulus intensity", Neurosci. Lett. Vol 477, 109114. http://dx.doi.org/10.1016/j.neulet.2010.04.044
7. Callaway E. M. ( 1998). "Local circuits in primary visual cortex of the macaque monkey", Annu. Rev. Neurosci. Vol 21, 4774. http://dx.doi.org/10.1146/annurev.neuro.21.1.47
8. Calvert G. A. ( 2001). "Crossmodal processing in the human brain: insights from functional neuroimaging studies", Cereb. Cortex Vol 11, 11101123. http://dx.doi.org/10.1093/cercor/11.12.1110
9. Calvert G. A. , Brammer M. J. , Bullmore E. T. , Campbell R. , Iversen S. D. , David A. S. ( 1999). "Response amplification in sensory-specific cortices during crossmodal binding", NeuroReport Vol 10, 26192623. http://dx.doi.org/10.1097/00001756-199908200-00033
10. Carlisle N. B. , Arita J. T. , Pardo D. , Woodman G. F. ( 2011). "Attentional templates in visual working memory", J. Neurosci. Vol 31, 93159322. http://dx.doi.org/10.1523/JNEUROSCI.1097-11.2011
11. Chennu S. , Noreika V. , Gueorguiev D. , Blenkmann A. , Kochen S. , Ibáñez A. , Owen A. M. , Bekinschtein T. A. ( 2013). "Expectation and attention in hierarchical auditory prediction", J. Neurosci. Vol 33, 1119411205. http://dx.doi.org/10.1523/JNEUROSCI.0114-13.2013
12. Chklovskii D. B. , Koulakov A. A. ( 2004). "Maps in the brain: what can we learn from them?" Annu. Rev. Neurosci. Vol 27, 369392. http://dx.doi.org/10.1146/annurev.neuro.27.070203.144226
13. Clavagnier S. , Falchier A. , Kennedy H. ( 2004). "Long-distance feedback projections to area V1: implications for multisensory integration, spatial awareness, and visual consciousness", Cogn. Affect. Behav. Neurosci. Vol 4, 117126. http://dx.doi.org/10.3758/CABN.4.2.117
14. Corneil B. D. , Munoz D. P. ( 2014). "Overt responses during covert orienting", Neuron Vol 82, 12301243. http://dx.doi.org/10.1016/j.neuron.2014.05.040
15. Ernst M. O. , Banks M. S. ( 2002). "Humans integrate visual and haptic information in a statistically optimal fashion", Nature Vol 415( 6870), 429433. http://dx.doi.org/10.1038/415429a
16. Falchier A. , Clavagnier S. , Barone P. , Kennedy H. ( 2002). "Anatomical evidence of multimodal integration in primate striate cortex", J. Neurosci. Vol 22, 57495759.
17. Felleman D. J. , Van Essen D. C. ( 1991). "Distributed hierarchical processing in the primate cerebral cortex", Cereb. Cortex Vol 1, 147. http://dx.doi.org/10.1093/cercor/1.1.1
18. Fetsch C. R. , DeAngelis G. C. , Angelaki D. E. ( 2013). "Bridging the gap between theories of sensory cue integration and the physiology of multisensory neurons", Nat. Rev. Neurosci. Vol 14, 429442. http://dx.doi.org/10.1038/nrn3503
19. Freese J. L. , Amaral D. G. ( 2005). "The organization of projections from the amygdala to visual cortical areas TE and V1 in the macaque monkey", J. Comp. Neurol. Vol 486, 295317. http://dx.doi.org/10.1002/cne.20520
20. Friston K. ( 2005). "A theory of cortical responses", Philos. Trans. R. Soc. Lond. B Biol. Sci. Vol 360( 1456), 815836. http://dx.doi.org/10.1098/rstb.2005.1622
21. Ghazanfar A. A. , Schroeder C. E. ( 2006). "Is neocortex essentially multisensory?" Trends Cogn. Sci. Vol 10, 278285. http://dx.doi.org/10.1016/j.tics.2006.04.008
22. Ghazanfar A. A. , Maier J. X. , Hoffman K. L. , Logothetis N. K. ( 2005). "Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex", J. Neurosci. Vol 25, 50045012. http://dx.doi.org/10.1523/JNEUROSCI.0799-05.2005
23. Ghazanfar A. A. , Chandrasekaran C. , Logothetis N. K. ( 2008). "Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integration in rhesus monkeys", J. Neurosci. Vol 28, 44574469. http://dx.doi.org/10.1523/JNEUROSCI.0541-08.2008
24. Henson D. B. ( 1993). Visual Fields, 1st edn. Oxford Medical Publications, Oxford, UK.
25. Hubel D. H. , Wiesel T. N. ( 1968). "Receptive fields and functional architecture of monkey striate cortex", J. Physiol. Vol 195, 215243. http://dx.doi.org/10.1113/jphysiol.1968.sp008455
26. Issa N. P. , Trepel C. , Stryker M. P. ( 2000). "Spatial frequency maps in cat visual cortex", J. Neurosci. Vol 20, 85048514.
27. Jay M. F. , Sparks D. L. ( 1984). "Auditory receptive fields in primate superior colliculus shift with changes in eye position", Nature Vol 309( 5966), 345347. http://dx.doi.org/10.1038/309345a0
28. Kaas J. H. , Hackett T. A. ( 2000). "Subdivisions of auditory cortex and processing streams in primates", Proc. Natl Acad. Sci. USA Vol 97, 1179311799. http://dx.doi.org/10.1073/pnas.97.22.11793
29. Kanwisher N. ( 2010). "Functional specificity in the human brain: a window into the functional architecture of the mind", Proc. Natl Acad. Sci. USA Vol 107, 1116311170. http://dx.doi.org/10.1073/pnas.1005062107
30. Kara P. , Boyd J. D. ( 2009). "A micro-architecture for binocular disparity and ocular dominance in visual cortex", Nature Vol 458( 7238), 627631. http://dx.doi.org/10.1038/nature07721
31. Kayser C. , Petkov C. I. , Augath M. , Logothetis N. K. ( 2007). "Functional imaging reveals visual modulation of specific fields in auditory cortex", J. Neurosci. Vol 27, 18241835. http://dx.doi.org/10.1523/JNEUROSCI.4737-06.2007
32. Kayser C. , Petkov C. I. , Logothetis N. K. ( 2008). "Visual modulation of neurons in auditory cortex", Cereb. Cortex Vol 18, 15601574. http://dx.doi.org/10.1093/cercor/bhm187
33. Klier E. M. , Wang H. , Crawford J. D. ( 2003). "Three-dimensional eye-head coordination is implemented downstream from the superior colliculus", J. Neurophysiol. Vol 89, 28392853. http://dx.doi.org/10.1152/jn.00763.2002
34. Knill D. C. , Pouget A. ( 2004). "The Bayesian brain: the role of uncertainty in neural coding and computation", Trends Neurosci. Vol 27, 712719. http://dx.doi.org/10.1016/j.tins.2004.10.007
35. Kok P. , Jehee J. F. M. , De Lange F. P. ( 2012). "Less is more: expectation sharpens representations in the primary visual cortex", Neuron Vol 75, 265270. http://dx.doi.org/10.1016/j.neuron.2012.04.034
36. Kok P. , Brouwer G. J. , Van Gerven M. A. , De Lange F. P. ( 2013). "Prior expectations bias sensory representations in visual cortex", J. Neurosci. Vol 33, 1627516284. http://dx.doi.org/10.1523/JNEUROSCI.0742-13.2013
37. Kok P. , Failing M. F. , De Lange F. P. ( 2014). "Prior expectations evoke stimulus templates in the primary visual cortex", J. Cogn. Neurosci. Vol 26, 15461554. http://dx.doi.org/10.1162/jocn_a_00562
38. Krauzlis R. J. , Liston D. , Carello C. D. ( 2004). "Target selection and the superior colliculus: goals, choices and hypotheses", Vis. Res. Vol 44, 14451451. http://dx.doi.org/10.1016/j.visres.2004.01.005
39. Kustov A. A. , Robinson D. L. ( 1996). "Shared neural control of attentional shifts and eye movements", Nature Vol 384( 6604), 7477. http://dx.doi.org/10.1038/384074a0
40. Lakatos P. , Chen C. M. , O’Connell M. N. , Mills A. , Schroeder C. E. ( 2007). "Neuronal oscillations and multisensory interaction in primary auditory cortex", Neuron Vol 53, 279292. http://dx.doi.org/10.1016/j.neuron.2006.12.011
41. Lakatos P. , Karmos G. , Mehta A. D. , Ulbert I. , Schroeder C. E. ( 2008). "Entrainment of neuronal oscillations as a mechanism of attentional selection", Science Vol 320( 5872), 110113. http://dx.doi.org/10.1126/science.1154735
42. Lakatos P. , O’Connell M. N. , Barczak A. , Mills A. , Javitt D. C. , Schroeder C. E. ( 2009). "The leading sense: supramodal control of neurophysiological context by attention", Neuron Vol 64, 419430. http://dx.doi.org/10.1016/j.neuron.2009.10.014
43. Landisman C. E. , Ts’o D. Y. ( 2002). "Color processing in macaque striate cortex: relationships to ocular dominance, cytochrome oxidase, and orientation", J. Neurophysiol. Vol 87, 31263137.
44. Lee J. , Groh J. M. ( 2012). "Auditory signals evolve from hybrid- to eye-centered coordinates in the primate superior colliculus", J. Neurophysiol. Vol 108, 227242. http://dx.doi.org/10.1152/jn.00706.2011
45. Leung J. , Alais D. , Carlile S. ( 2008). "Compression of auditory space during rapid head turns", Proc. Natl Acad. Sci. USA Vol 105, 64926497. http://dx.doi.org/10.1073/pnas.0710837105
46. Lu H. D. , Roe A. W. ( 2008). "Functional organization of color domains in V1 and V2 of macaque monkey revealed by optical imaging", Cereb. Cortex Vol 18, 516533. http://dx.doi.org/10.1093/cercor/bhm081
47. Lupyan G. , Ward E. J. ( 2013). "Language can boost otherwise unseen objects into visual awareness", Proc. Natl Acad. Sci. USA Vol 110, 1419614201. http://dx.doi.org/10.1073/pnas.1303312110
48. Macaluso E. , Driver J. ( 2005). "Multisensory spatial interactions: a window onto functional integration in the human brain", Trends Neurosci. Vol 28, 264271. http://dx.doi.org/10.1016/j.tins.2005.03.008
49. McDonald J. J. , Teder-Sälejärvi W. A. , Hillyard S. A. ( 2000). "Involuntary orienting to sound improves visual perception", Nature Vol 407( 6806), 906908. http://dx.doi.org/10.1038/35038085
50. McManus J. N. J. , Li W. , Gilbert C. D. ( 2011). "Adaptive shape processing in primary visual cortex", Proc. Natl Acad. Sci. USA Vol 108, 97399746. http://dx.doi.org/10.1073/pnas.1105855108
51. McPeek R. M. , Keller E. L. ( 2004). "Deficits in saccade target selection after inactivation of superior colliculus", Nat. Neurosci. Vol 7, 757763. http://dx.doi.org/10.1038/nn1269
52. Meredith M. A. , Stein B. E. ( 1986). "Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration", J. Neurophysiol. Vol 56, 640662.
53. Meredith M. A. , Clemo H. R. , Stein B. E. ( 1991). "Somatotopic component of the multisensory map in the deep laminae of the cat superior colliculus", J. Comp. Neurol. Vol 312, 353370. http://dx.doi.org/10.1002/cne.903120304
54. Middlebrooks J. C. , Knudsen E. I. ( 1984). "A neural code for auditory space in the cat’s superior colliculus", J. Neurosci. Vol 4, 26212634.
55. Morrell F. ( 1972). "Visual system’s view of acoustic space", Nature Vol 238( 5358), 4446. http://dx.doi.org/10.1038/238044a0
56. Ohki K. , Chung S. , Ch’ng Y. H. , Kara P. , Reid R. C. ( 2005). "Functional imaging with cellular resolution reveals precise micro-architecture in visual cortex", Nature Vol 433( 7026), 597603. http://dx.doi.org/10.1038/nature03274
57. Oliver D. L. , Beckius G. E. , Bishop D. C. , Loftus W. C. , Batra R. ( 2003). "Topography of interaural temporal disparity coding in projections of medial superior olive to inferior colliculus", J. Neurosci. Vol 23, 74387449.
58. Posner M. I. , Nissen M. J. , Ogden W. C. ( 1978). "Attended and unattended processing modes: the role of set for spatial location", in: Modes of Perceiving and Processing Information, Pick H. , Saltzmann E. (Eds), pp.  137157. John Wiley and Sons Inc., Hillsdale, NJ, USA.
59. Rao R. P. , Ballard D. H. ( 1999). "Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects", Nat. Neurosci. Vol 2, 7987. http://dx.doi.org/10.1038/4580
60. Reser D. H. ( 2000). "Binaural interactions in primary auditory cortex of the awake macaque", Cereb. Cortex Vol 10, 574584. http://dx.doi.org/10.1093/cercor/10.6.574
61. Rockland K. S. , Ojima H. ( 2003). "Multisensory convergence in calcarine visual areas in macaque monkey", Int. J. Psychophysiol. Vol 50, 1926. http://dx.doi.org/10.1016/S0167-8760(03)00121-1
62. Rolke B. , Hofmann P. ( 2007). "Temporal uncertainty degrades perceptual processing", Psychonom. Bull. Rev. Vol 14, 522526. http://dx.doi.org/10.3758/BF03194101
63. Romei V. , Murray M. M. , Merabet L. B. , Thut G. ( 2007). "Occipital transcranial magnetic stimulation has opposing effects on visual and auditory stimulus detection: implications for multisensory interactions", J. Neurosci. Vol 27, 1146511472. http://dx.doi.org/10.1523/JNEUROSCI.2827-07.2007
64. Romei V. , Murray M. M. , Cappe C. , Thut G. ( 2009). "Preperceptual and stimulus-selective enhancement of low-level human visual cortex excitability by sounds", Curr. Biol. Vol 19, 17991805. http://dx.doi.org/10.1016/j.cub.2009.09.027
65. Romei V. , Gross J. , Thut G. ( 2012). "Sounds reset rhythms of visual cortex and corresponding human visual perception", Curr. Biol. Vol 22, 807813. http://dx.doi.org/10.1016/j.cub.2012.03.025
66. Saenz M. , Langers D. R. M. ( 2014). "Tonotopic mapping of human auditory cortex", Hearing Res. Vol 307, 4252. http://dx.doi.org/10.1016/j.heares.2013.07.016
67. Schroeder C. E. , Foxe J. ( 2005). "Multisensory contributions to low-level, ‘unisensory’ processing", Curr. Opin. Neurobiol. Vol 15, 454458. http://dx.doi.org/10.1016/j.conb.2005.06.008
68. Schwarz D. A. , Lebedev M. A. , Hanson T. L. , Dimitrov D. F. , Lehew G. , Meloy J. , Rajangam S. , Subramanian V. , Ifft P. J. , Li Z. , Ramakrishnan A. , Tate A. , Zhuang K. Z. , Nicolelis M. A. ( 2014). "Chronic, wireless recordings of large-scale brain activity in freely moving rhesus monkeys", Nat. Meth. Vol 11, 670676. http://dx.doi.org/10.1038/nmeth.2936
69. Shams L. , Kim R. ( 2010). "Crossmodal influences on visual perception", Phys. Life Rev. Vol 7, 269284. http://dx.doi.org/10.1016/j.plrev.2010.04.006
70. Shams L. , Kamitani Y. , Shimojo S. ( 2000). "Illusions. What you see is what you hear", Nature Vol 408( 6814), 788. http://dx.doi.org/10.1038/35048669
71. Sharma J. , Sugihara H. , Katz Y. , Schummers J. , Tenenbaum J. , Sur M. ( in press). "Spatial attention and temporal expectation under timed uncertainty predictably modulate neuronal responses in monkey V1", Cereb. Cortex.
72. Sparks D. L. ( 1999). "Conceptual issues related to the role of the superior colliculus in the control of gaze", Curr. Opin. Neurobiol. Vol 9, 698707. http://dx.doi.org/10.1016/S0959-4388(99)00039-2
73. Sprague J. M. ( 1996). "Neural mechanisms of visual orienting responses", Prog. Brain Res. Vol 112, 115.
74. Stein B. E. , Meredith M. A. ( 1993). The Merging of the Senses. MIT Press, Cambridge, MA, USA.
75. Stein B. E. , Meredith M. A. , Wallace M. T. ( 1993). "The visually responsive neuron and beyond: multisensory integration in cat and monkey", Prog. Brain Res. Vol 95, 7990.
76. Stein B. E. , Stanford T. R. , Rowland B. A. ( 2009). "The neural basis of multisensory integration in the midbrain: its organization and maturation", Hearing Res. Vol 258, 415. http://dx.doi.org/10.1016/j.heares.2009.03.012
77. Stein B. E. , Stanford T. R. , Rowland B. A. ( 2014). "Development of multisensory integration from the perspective of the individual neuron", Nat. Rev. Neurosci. Vol 15, 520535. http://dx.doi.org/10.1038/nrn3742
78. Summerfield C. , Egner T. ( 2009). "Expectation (and attention) in visual cognition", Trends Cogn. Sci. Vol 13, 403409. http://dx.doi.org/10.1016/j.tics.2009.06.003
79. Talsma D. , Senkowski D. , Soto-Faraco S. , Woldorff M. G. ( 2010). "The multifaceted interplay between attention and multisensory integration", Trends Cogn. Sci. Vol 14, 400410. http://dx.doi.org/10.1016/j.tics.2010.06.008
80. Van der Burg E. , Talsma D. , Olivers C. N. , Hickey C. , Theeuwes J. ( 2011). "Early multisensory interactions affect the competition among multiple visual objects", NeuroImage Vol 55, 12081218. http://dx.doi.org/10.1016/j.neuroimage.2010.12.068
81. Vanduffel W. , Zhu Q. , Orban G. A. ( 2014). "Monkey cortex through fMRI glasses", Neuron Vol 83, 533550. http://dx.doi.org/10.1016/j.neuron.2014.07.015
82. Vaney D. I. , Sivyer B. , Taylor W. R. ( 2012). "Direction selectivity in the retina: symmetry and asymmetry in structure and function", Nat. Rev. Neurosci. Vol 13, 194208.
83. Vroomen J. , De Gelder B. ( 2000). "Sound enhances visual perception: cross-modal effects of auditory organization on vision", J. Exp. Psychol. Hum. Percept. Perform. Vol 26, 15831590. http://dx.doi.org/10.1037/0096-1523.26.5.1583
84. Wang Y. , Celebrini S. , Trotter Y. , Barone P. ( 2008). "Visuo-auditory interactions in the primary visual cortex of the behaving monkey: electrophysiological evidence", BMC Neurosci. Vol 9, 79.
85. Watkins S. , Shams L. , Tanaka S. , Haynes J. D. , Rees G. ( 2006). "Sound alters activity in human V1 in association with illusory visual perception", NeuroImage Vol 31, 12471256. http://dx.doi.org/10.1016/j.neuroimage.2006.01.016
86. Watkins S. , Shams L. , Josephs O. , Rees G. ( 2007). "Activity in human V1 follows multisensory perception", NeuroImage Vol 37, 572578. http://dx.doi.org/10.1016/j.neuroimage.2007.05.027
87. Wei T. , Liang X. , He Y. , Zang Y. , Han Z. , Caramazza A. , Bi Y. ( 2012). "Predicting conceptual processing capacity from spontaneous neuronal activity of the left middle temporal gyrus", J. Neurosci. Vol 32, 481489. http://dx.doi.org/10.1523/JNEUROSCI.1953-11.2012
88. Werner S. , Noppeney U. ( 2010). "Distinct functional contributions of primary sensory and association areas to audiovisual integration in object categorization", J. Neurosci. Vol 30, 26622675. http://dx.doi.org/10.1523/JNEUROSCI.5091-09.2010
89. White B. J. , Munoz D. P. ( 2011). "The superior colliculus", in: The Oxford Handbook of Eye Movements, Liversedge S. P. , Gilchrist I. D. , Everling S. (Eds), pp.  195214. Oxford University Press, Oxford, UK.
90. Witten I. B. , Knudsen E. I. ( 2005). "Why seeing is believing: merging auditory and visual worlds", Neuron Vol 48, 489496. http://dx.doi.org/10.1016/j.neuron.2005.10.020
91. Wurtz R. H. , Albano J. E. ( 1980). "Visual-motor function of the primate superior colliculus", Annu. Rev. Neurosci. Vol 3, 189226. http://dx.doi.org/10.1146/annurev.ne.03.030180.001201
http://brill.metastore.ingenta.com/content/journals/10.1163/22134808-00002494
Loading

Article metrics loading...

/content/journals/10.1163/22134808-00002494
2015-04-30
2017-09-19

Sign-in

Can't access your account?
  • Tools

  • Add to Favorites
  • Printable version
  • Email this page
  • Subscribe to ToC alert
  • Get permissions
  • Recommend to your library

    You must fill out fields marked with: *

    Librarian details
    Your details
    Why are you recommending this title?
    Select reason:
     
    Multisensory Research — Recommend this title to your library
  • Export citations
  • Key

  • Full access
  • Open Access
  • Partial/No accessInformation