Cookies Policy
X

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies.

I accept this policy

Find out more here

Audio-Visual, Visuo-Tactile and Audio-Tactile Correspondences in Preschoolers

No metrics data to plot.
The attempt to load metrics for this article has failed.
The attempt to plot a graph for these metrics has failed.
The full text of this article is not currently available.

Brill’s MyBook program is exclusively available on BrillOnline Books and Journals. Students and scholars affiliated with an institution that has purchased a Brill E-Book on the BrillOnline platform automatically have access to the MyBook option for the title(s) acquired by the Library. Brill MyBook is a print-on-demand paperback copy which is sold at a favorably uniform low price.

Access this article

+ Tax (if applicable)
Add to Favorites
You must be logged in to use this functionality

image of Multisensory Research
For more content, see Seeing and Perceiving and Spatial Vision.

Interest in crossmodal correspondences has recently seen a renaissance thanks to numerous studies in human adults. Yet, still very little is known about crossmodal correspondences in children, particularly in sensory pairings other than audition and vision. In the current study, we investigated whether 4–5-year-old children match auditory pitch to the spatial motion of visual objects (audio-visual condition). In addition, we investigated whether this correspondence extends to touch, i.e., whether children also match auditory pitch to the spatial motion of touch (audio-tactile condition) and the spatial motion of visual objects to touch (visuo-tactile condition). In two experiments, two different groups of children were asked to indicate which of two stimuli fitted best with a centrally located third stimulus (Experiment 1), or to report whether two presented stimuli fitted together well (Experiment 2). We found sensitivity to the congruency of all of the sensory pairings only in Experiment 2, suggesting that only under specific circumstances can these correspondences be observed. Our results suggest that pitch–height correspondences for audio-visual and audio-tactile combinations may still be weak in preschool children, and speculate that this could be due to immature linguistic and auditory cues that are still developing at age five.

Affiliations: 1: 2University of Padua, Via Venezia 8, 35131 Padua, Italy

Loading data from figshare Loading data from figshare
Loading

Full text loading...

/content/journals/10.1163/22134808-00002493
Loading

Data & Media loading...

1. Bahrick L. E. , Lickliter R. , Flom R. ( 2004). "Intersensory redundancy guides the development of selective attention, perception, and cognition in infancy", Curr. Dir. Psychol. Sci. Vol 13, 99102. http://dx.doi.org/10.1111/j.0963-7214.2004.00283.x
2. Chen Y.-C. , Spence C. ( 2010). "When hearing the bark helps to identify the dog: semantically-congruent sounds modulate the identification of masked pictures", Cognition Vol 114, 389404. http://dx.doi.org/10.1016/j.cognition.2009.10.012
3. Davidson M. C. , Amso D. , Anderson L. C. , Diamond A. ( 2006). "Development of cognitive control and executive functions from 4 to 13 years: evidence from manipulations of memory, inhibition, and task switching", Neuropsychologia Vol 44, 20372078. http://dx.doi.org/10.1016/j.neuropsychologia.2006.02.006
4. Demattè M. L. , Sanabria D. , Spence C. ( 2006). "Cross-modal associations between odors and colors", Chem. Senses Vol 31, 531538. http://dx.doi.org/10.1093/chemse/bjj057
5. Doehrmann O. , Naumer M. J. ( 2008). "Semantics and the multisensory brain: how meaning modulates processes of audio-visual integration", Brain Res. Vol 1242, 136150. http://dx.doi.org/10.1016/j.brainres.2008.03.071
6. Dolscheid S. , Hunnius S. , Casasanto D. , Majid A. ( 2014). "Prelinguistic infants are sensitive to space-pitch associations found across cultures", Psychol. Sci. Vol 25, 12561261. http://dx.doi.org/10.1177/0956797614528521
7. Ernst M. O. ( 2007). "Learning to integrate arbitrary signals from vision and touch", J. Vis. Vol 7, 114.
8. Evans K. K. , Treisman A. ( 2010). "Natural cross-modal mappings between visual and auditory features", J. Vis. Vol 10, 112.
9. Fels J. , Buthmann P. , Vorländer M. ( 2004). "Head-related transfer functions of children", Acta Acust. United Acust. Vol 90, 918927.
10. Gallace A. , Spence C. ( 2006). "Multisensory synesthetic interactions in the speeded classification of visual size", Percept. Psychophys. Vol 68, 11911203. http://dx.doi.org/10.3758/BF03193720
11. Gilbert A. N. , Martin R. , Kemp S. E. ( 1996). "Cross-modal correspondence between vision and olfaction: the color of smells", Am. J. Psychol. Vol 109, 335351. http://dx.doi.org/10.2307/1423010
12. Grassi M. ( 2005). "Do we hear size or sound? Balls dropped on plates", Percept. Psychophys. Vol 67, 274284. http://dx.doi.org/10.3758/BF03206491
13. Grassi M. , Soranzo A. ( 2009). "MLP: a MATLAB toolbox for rapid and reliable auditory threshold estimations", Behav. Res. Methods Vol 41, 2028. http://dx.doi.org/10.3758/BRM.41.1.20
14. Grassi M. , Pastore M. , Lemaitre G. ( 2013). "Looking at the world with your ears: how do we get the size of an object from its sound?" Acta Psychol. Vol 143, 96104. http://dx.doi.org/10.1016/j.actpsy.2013.02.005
15. Haryu E. , Kajikawa S. ( 2012). "Are higher-frequency sounds brighter in color and smaller in size? Auditory–visual correspondences in 10-month-old infants", Infant Behav. Dev. Vol 35, 727732. http://dx.doi.org/10.1016/j.infbeh.2012.07.015
16. Kleiner M. , Brainard D. , Pelli D. , Ingling A. , Murray R. , Broussard C. ( 2007). "What’s new in Psychtoolbox-3", Perception Vol 36, ECVP Abstract Suppl. 1.
17. Knöferle K. , Spence C. ( 2012). "Crossmodal correspondences between sounds and tastes", Psychon. B. Rev. Vol 19, 9921006. http://dx.doi.org/10.3758/s13423-012-0321-z
18. Koppen C. , Alsius A. , Spence C. ( 2008). "Semantic congruency and the Colavita visual dominance effect", Exp. Brain Res. Vol 184, 533546. http://dx.doi.org/10.1007/s00221-007-1120-z
19. Laurienti P. J. , Kraft R. A. , Maldjian J. A. , Burdette J. H. , Wallace M. T. ( 2004). "Semantic congruence is a critical factor in multisensory behavioral performance", Exp. Brain Res. Vol 158, 405414. http://dx.doi.org/10.1007/s00221-004-1913-2
20. Lewkowicz D. J. ( 2000). "The development of intersensory temporal perception: an epigenetic systems/limitations view", Psychol. Bull. Vol 126, 281308. http://dx.doi.org/10.1037/0033-2909.126.2.281
21. Lewkowicz D. J. , Minar N. J. ( 2014). "Infants are not sensitive to synesthetic cross-modality correspondences. A comment to Walker et al. (2010)", Psychol. Sci. Vol 25, 832834. http://dx.doi.org/10.1177/0956797613516011
22. Ludwig V. U. , Simner J. ( 2013). "What colour does that feel? Tactile–visual mapping and the development of cross-modality", Cortex Vol 49, 10891099. http://dx.doi.org/10.1016/j.cortex.2012.04.004
23. Marks L. E. , Hammeal R. , Bornstein M. ( 1987). "Perceiving similarity and comprehending metaphor", Monogr. Soc. Res. Child Dev. Vol 52, 1102. http://dx.doi.org/10.2307/1166084
24. Martino G. , Marks L. E. ( 2000). "Cross-modal interaction between vision and touch: the role of synesthetic correspondence", Perception Vol 29, 745754. http://dx.doi.org/10.1068/p2984
25. Maurer D. , Pathman T. , Mondloch C. J. ( 2006). "The shape of boubas: sound–shape correspondences in toddlers and adults", Dev. Sci. Vol 9, 316322. http://dx.doi.org/10.1111/j.1467-7687.2006.00495.x
26. Melara R. D. ( 1989). "Dimensional interaction between color and pitch", J. Exp. Psychol., Hum. Percept. Perform. Vol 15, 6979. http://dx.doi.org/10.1037/0096-1523.15.1.69
27. Melara R. D. , Marks L. E. ( 1990). "Processes underlying dimensional interactions: correspondences between linguistic and nonlinguistic dimensions", Mem. Cognit. Vol 18, 477495. http://dx.doi.org/10.3758/BF03198481
28. Mondloch C. J. , Maurer D. ( 2004). "Do small white balls squeak? Pitch-object correspondences in young children", Cogn. Affect. Behav. Neurosci. Vol 4, 133136. http://dx.doi.org/10.3758/CABN.4.2.133
29. Occelli V. , Spence C. , Zampini M. ( 2009). "Compatibility effects between sound frequency and tactile elevation", Neuroreport Vol 20, 793797. http://dx.doi.org/10.1097/WNR.0b013e32832b8069
30. Parise C. , Spence C. ( 2009). "‘When birds of a feather flock together’: synesthetic correspondences modulate audiovisual integration in non-synesthetes", PLoS One Vol 4, e5664. DOI: . http://dx.doi.org/10.1371/journal.pone.0005664
31. Parise C. V. , Spence C. ( 2013). "Audiovisual crossmodal correspondences", in: The Oxford Handbook of Synesthesia, Simner J. , Hubbard E. M. (Eds), pp.  790815. Oxford University Press, Oxford, UK.
32. Parise C. , Knorre K. , Ernst M. O. ( 2014). "Natural auditory scene statistics shapes human spatial hearing", Proc. Natl Acad. Sci. USA Vol 111, 61046108. http://dx.doi.org/10.1073/pnas.1322705111
33. Pratt C. C. ( 1930). "The spatial character of high and low tones", J. Exp. Psychol. Vol 13, 278. http://dx.doi.org/10.1037/h0072651
34. Rusconi E. , Kwan B. , Giordano B. L. , Umilta C. , Butterworth B. ( 2006). "Spatial representation of pitch height: the SMARC effect", Cognition Vol 99, 113129. http://dx.doi.org/10.1016/j.cognition.2005.01.004
35. Shepard R. N. ( 1964). "Circularity in judgments of relative pitch", J. Acoust. Soc. Am. Vol 36, 23462353. http://dx.doi.org/10.1121/1.1919362
36. Slobodenyuk N. , Jraissati Y. , Kanso A. , Ghanem L. , Elhajj I. ( in press). "Cross-modal associations between color and haptics", Atten. Percept. Psychophys., DOI: .
37. Smith L. B. , Sera M. D. ( 1992). "A developmental analysis of the polar structure of dimensions", Cogni. Psychol. Vol 24, 99142. http://dx.doi.org/10.1016/0010-0285(92)90004-L
38. Spence C. ( 2011). "Crossmodal correspondences: a tutorial review", Atten. Percept. Psychophys. Vol 73, 971995. http://dx.doi.org/10.3758/s13414-010-0073-7
39. Stein B. E. (Ed.) ( 2012). The New Handbook of Multisensory Processing. MIT Press, Cambridge, MA, USA.
40. Stein B. E. , Huneycutt S. W. , Meredith A. ( 1988). "Neurons and behavior: the same rules of multisensory integration apply", Brain Res. Vol 448, 355358. http://dx.doi.org/10.1016/0006-8993(88)91276-0
41. Walker P. , Bremner J. G. , Mason U. , Spring J. , Mattock K. , Slater A. , Johnson S. P. ( 2010). "Preverbal infants’ sensitivity to synaesthetic cross-modality correspondences", Psychol. Sci. Vol 21, 2125. http://dx.doi.org/10.1177/0956797609354734
42. Walker P. , Bremner J. G. , Mason U. , Spring J. , Mattock K. , Slater A. , Johnson S. P. ( 2014). "Preverbal infants are sensitive to crossmodal correspondences. Much ado about the null results of Lewkowicz and Minar (2014)", Psychol. Sci. Vol 25, 835836. http://dx.doi.org/10.1177/0956797613520170
http://brill.metastore.ingenta.com/content/journals/10.1163/22134808-00002493
Loading

Article metrics loading...

/content/journals/10.1163/22134808-00002493
2016-01-01
2018-07-21

Sign-in

Can't access your account?
  • Tools

  • Add to Favorites
  • Printable version
  • Email this page
  • Subscribe to ToC alert
  • Get permissions
  • Recommend to your library

    You must fill out fields marked with: *

    Librarian details
    Your details
    Why are you recommending this title?
    Select reason:
     
    Multisensory Research — Recommend this title to your library
  • Export citations
  • Key

  • Full access
  • Open Access
  • Partial/No accessInformation