Cookies Policy

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies.

I accept this policy

Find out more here

Semantically Congruent Visual Information Can Improve Auditory Recognition Memory in Older Adults

No metrics data to plot.
The attempt to load metrics for this article has failed.
The attempt to plot a graph for these metrics has failed.
The full text of this article is not currently available.

Brill’s MyBook program is exclusively available on BrillOnline Books and Journals. Students and scholars affiliated with an institution that has purchased a Brill E-Book on the BrillOnline platform automatically have access to the MyBook option for the title(s) acquired by the Library. Brill MyBook is a print-on-demand paperback copy which is sold at a favorably uniform low price.

Access this article

+ Tax (if applicable)
Add to Favorites
You must be logged in to use this functionality

image of Multisensory Research
For more content, see Seeing and Perceiving and Spatial Vision.

In the course of normal aging, memory functions show signs of impairment. Studies of memory in the elderly have previously focused on a single sensory modality, although multisensory encoding has been shown to improve memory performance in children and young adults. In this study, we investigated how audiovisual encoding affects auditory recognition memory in older (mean age 71 years) and younger (mean age 23 years) adults. Participants memorized auditory stimuli (sounds, spoken words) presented either alone or with semantically congruent visual stimuli (pictures, text) during encoding. Subsequent recognition memory performance of auditory stimuli was better for stimuli initially presented together with visual stimuli than for auditory stimuli presented alone during encoding. This facilitation was observed both in older and younger participants, while the overall memory performance was poorer in older participants. However, the pattern of facilitation was influenced by age. When encoding spoken words, the gain was greater for older adults. When encoding sounds, the gain was greater for younger adults. These findings show that semantically congruent audiovisual encoding improves memory performance in late adulthood, particularly for auditory verbal material.

Affiliations: 1: 1Department of Psychology and Logopedics, Faculty of Medicine, P.O. Box 9, 00014 University of Helsinki, Finland ; 2: 2Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, Helsinki, Finland

*To whom correspondence should be addressed. E-mail:

Full text loading...


Data & Media loading...

1. Bopp K., Verhaeghen P. (2005). "Aging and verbal memory span: a meta-analysis", J. Gerontol. B Psychol. Sci. Soc. Sci. Vol 60, 223233. [Crossref]
2. Cienkowski K., Carney A. (2002). "Audio-visual speech perception and aging", Ear Hearing Vol 23, 439449. [Crossref]
3. Cohen M. A., Horowitz T. S., Wolfe J. M. (2009). "Auditory recognition memory is inferior to visual recognition memory", Proc. Natl Acad. Sci. USA Vol 106, 60086010. [Crossref]
4. Diaconescu A., Hasher L., McIntosh A. (2013). "Visual dominance and multisensory integration changes with age", NeuroImage Vol 65, 152166. [Crossref]
5. Diederich A., Colonius H., Schomburg A. (2008). "Assessing age-related multisensory enhancement with the time-window-of-integration model", Neuropsychologia Vol 46, 25562562. [Crossref]
6. Gordon M. S., Allen S. (2009). "Audiovisual speech in older and younger adults: integrating a distorted visual signal with speech in noise", Exp. Aging Res. Vol 35, 202219. [Crossref]
7. Grady C., McInthos A., Horwitz B., Maisog J., Ungerleider L., Mentis M., Pietrini P., Schapiro M., Haxby J. (1995). "Age-related reductions in human recognition memory due to impaired encoding", Science Vol 269(5221), 218221. [Crossref]
8. Green D. M., Swets J. (1966). Signal Detection Theory and Psychophysics. Wiley, New York, NY, USA.
9. Heikkilä J., Tiippana K. (2016). "School-aged children can benefit from audiovisual semantic congruency during memory encoding", Exp. Brain Res. Vol 234, 11991207. [Crossref]
10. Heikkilä J., Alho K., Hyvönen H., Tiippana K. (2015). "Audiovisual semantic congruency during encoding enhances memory performance", Exp. Psychol. Vol 62, 123130. [Crossref]
11. Heikkilä J., Alho K., Tiippana K. (in press a). "Semantically congruent visual stimuli can improve auditory memory", Multisens. Res.
12. Heikkilä J., Alho K., Tiippana K. (in press b). "Semantic congruency improves recognition memory performance for both audiovisual and visual stimuli", Multisens. Res.
13. Laurienti P. J., Burdette J. H., Maldjian J. A., Wallace M. T. (2006). "Enhanced multisensory integration in older adults", Neurobiol. Aging Vol 27, 11551163. [Crossref]
14. Lehmann S., Murray M. M. (2005). "The role of multisensory memories in unisensory object discrimination", Cogn. Brain Res. Vol 24, 326334. [Crossref]
15. Luo L., Hendriks T., Craik F. (2007). "Age differences in recollection: three patterns of enhanced encoding", Psychol. Aging Vol 22, 269280. [Crossref]
16. Macmillan N. A., Creelman C. D. (2005). Detection Theory: a User’s Guide. Lawrence Erlbaum Associates, New York, NY, USA.
17. Maguinness C., Setti A., Burke K., Kenny R. A., Newell F. (2011). "The effect of combined sensory and semantic components on audio-visual speech perception in older adults", Front. Aging Neurosci. Vol 3, 19. DOI:10.3389/fnagi.2011.00019. [Crossref]
18. Miller J. (1996). "The sampling distribution of d′", Perception and Psychophysics Vol 58, 6572. [Crossref]
19. Moran Z., Bachman P., Pham P., Cho S., Cannon T., Shams L. (2013). "Multisensory encoding improves auditory recognition", Multisens. Res. Vol 26, 581592. [Crossref]
20. Murdock B. B. (1982). "Recognition memory", in: Handbook of Research Methods in Human Memory and Cognition, Puff C. R. (Ed.), pp.  126. Academic Press Inc., London, UK.
21. Murray M. M., Michel C. M., Grave de Peralta R., Ortigue S., Brunet D., Gonzalez Andino S., Schnider A. (2004). "Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging", NeuroImage Vol 21, 125135. [Crossref]
22. Old S. R., Naveh-Benjamin M. (2008). "Age-related changes in memory", in: Handbook of Cognitive Aging, Hofer S. M., Alwin D. F. (Eds), pp.  151167. Sage Publications, Thousand Oaks, CA, USA.
23. Park D., Lautenschlager G., Hedden T., Davidson N., Smith A., Smith P. (2002). "Models of visuospatial and verbal memory across the adult life span", Psychol. Aging Vol 17, 826837. [Crossref]
24. Peiffer A., Mozolic J., Hugenschmidt C., Laurienti P. (2007). "Age-related multisensory enhancement in a simple audiovisual detection task", NeuroReport Vol 18, 10771081. [Crossref]
25. Rönnlund M., Nyberg L., Bäckman L., Nilsson L. (2005). "Stability, growth, and decline in adult life span development of declarative memory: cross-sectional and longitudinal data from a population-based study", Psychol. Aging Vol 20, 318. [Crossref]
26. Salthouse T. (1996). "The processing speed theory of adult age differences in cognition", Psychol. Rev. Vol 103, 403428. [Crossref]
27. Salthouse T. (2000). "Aging and measures of processing speed", Biol. Psychol. Vol 54, 3554. [Crossref]
28. Schneider T. R., Engel A. K., Debener S. (2008). "Multisensory identification of natural objects in a two-way crossmodal priming paradigm", Exp. Psychol. Vol 55, 121132. [Crossref]
29. Sekiyama K., Soshi T., Sakamoto S. (2014). "Enhanced audiovisual integration with aging in speech perception: a heightened McGurk effect in older adults", Front. Psychol. Vol 5, 323. DOI:10.3389/fpsyg.2014.00323. [Crossref]
30. Setti A., Burke K. E., Kenny R., Newell F. N. (2013). "Susceptibility to a multisensory speech illusion in older persons is driven by perceptual processes", Fron. Psychol. Vol 4, 575. DOI:10.3389/fpsyg.2013.00575.
31. Sommers M. S., Tye-Murray N., Spehar B. (2005). "Auditory-visual speech perception and auditory-visual enhancement in normal hearing younger and older adults", Ear Hearing Vol 26, 263275. [Crossref]
32. Spaniol J., Madden D., Voss A. (2006). "A diffusion model analysis of adult age differences in episodic and semantic long-term memory retrieval", J. Exp. Psychol. Learn. Mem. Cogn. Vol 32, 101117. [Crossref]
33. Stanislav H., Torodov N. (1999). "Calculating signal detection theory measures", Behav. Res. Meth. Instrum. Comput. Vol 31, 137149. [Crossref]
34. Stevenson R. A., Nelms C. E., Baum S. H., Zurkovsky L., Barense M. D., Newhouse P. A., Wallace M. T. (2015). "Deficits in audiovisual speech perception in normal aging emerge at the level of whole-word recognition", Neurobiol. Aging Vol 36, 283291. [Crossref]
35. Talsma D., Senkowski D., Soto-Faraco S., Woldorff M. G. (2010). "The multifaceted interplay between attention and multisensory integration", Trends Cogn. Sci. Vol 14, 400410. [Crossref]
36. Thelen A., Talsma D., Murray M. (2015). "Single-trial multisensory memories affect later auditory and visual object discrimination", Cognition Vol 138, 148160. [Crossref]
37. Tye-Murray N., Sommers M., Spehar B., Myerson J., Hale S., Rose N. S. (2008). "Auditory-visual discourse comprehension by older and young adults in favorable and unfavorable conditions", Int. J. Audiol. Vol 47(Suppl. 2), S31S37. [Crossref]
38. Ueno D., Masumoto K., Sutani K., Iwaki S. (2015). "Latency of modality-specific reactivation of auditory and visual information during episodic memory retrieval", NeuroReport Vol 26, 302308. [Crossref]
39. Van Gerven P. W., Guerreiro M. J. (2016). "Selective attention and sensory modality in aging: curses and blessings", Front. Hum. Neurosci. Vol 10, 147. DOI:10.3389/fnhum.2016.00147. [Crossref]
40. Winneke A. H., Phillips N. A. (2011). "Does audiovisual speech offer a fountain of youth for old ears? An event-related brain potential study of age differences in audiovisual speech perception", Psychol. Aging Vol 26, 427438. [Crossref]
41. Yuval-Greenberg S., Deouell L. Y. (2009). "The dog’s meow: asymmetrical interaction in cross-modal object recognition", Exp. Brain Res. Vol 193, 603614. [Crossref]

Article metrics loading...



Can't access your account?
  • Tools

  • Add to Favorites
  • Printable version
  • Email this page
  • Subscribe to ToC alert
  • Get permissions
  • Recommend to your library

    You must fill out fields marked with: *

    Librarian details
    Your details
    Why are you recommending this title?
    Select reason:
    Multisensory Research — Recommend this title to your library
  • Export citations
  • Key

  • Full access
  • Open Access
  • Partial/No accessInformation