Cookies Policy

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies.

I accept this policy

Find out more here

Exploration of Trans-Sensory Mappings

No metrics data to plot.
The attempt to load metrics for this article has failed.
The attempt to plot a graph for these metrics has failed.
The full text of this article is not currently available.

Brill’s MyBook program is exclusively available on BrillOnline Books and Journals. Students and scholars affiliated with an institution that has purchased a Brill E-Book on the BrillOnline platform automatically have access to the MyBook option for the title(s) acquired by the Library. Brill MyBook is a print-on-demand paperback copy which is sold at a favorably uniform low price.

Access this article

+ Tax (if applicable)
Add to Favorites
You must be logged in to use this functionality

image of Art & Perception

This paper explores the way music can be translated into a sequence of images. A general approach is described that associates various structures captured by different sense modalities. This approach is illustrated by examples from vision and audition. Music and sets of images are digitalized and represented as forms in multidimensional spaces. A mapping, which preserves the dissimilarities in each space, is then defined and an algorithm that can approximate the optimal fit is proposed. An example that maps a set of photos of different versions of the wire chair on various Mozart variations is given.

Affiliations: 1: University of Liège, 18 Chemin de la Rentertkapell, B6700 Arlon, Belgium


Full text loading...


Data & Media loading...

1. Ayme A. (1984). N + 1 Variations sur une Empreinte de Viallat . Edition Traversière, Paris, France.
2. Berenzweig A.,, Ellis D., and Lawrence S. (s.a.). Anchor Space for Classification and Similarity Measurement of Music . Available from.
3. Bosseur J.-Y. (2006). Musique et Arts Plastiques, Interactions au XXe Siècle . Minerve, Paris, France.
4. Defays D. (2015). "Exploration on audio-visual mapping". Presented at the Workshop on Symbolic Data Analysis , Orléans, France, November 2015. .
5. Defays D. (in press). "Appariement de matrices de dissimilarités". Modulad.
6. Diday E., and Noirhomme-Fraiture M. (Eds) (2008). Symbolic Data Analysis and the SODAS Software . Wiley, Chichester, UK.
7. Hofstadter D. (1979). Gödel, Escher, Bach: An Eternal Golden Braid . Basic Books, New York, NY, USA.
8. Hofstadter, D., and the Fluid Analogies Research Group (1995). Fluid Concepts and Creative Analogies. Computer Models of the Fundamental Mechanisms of Thought . Basic Books, New York, NY, USA.
9. Hofstadter D.,, and Sander E. (2013). Surfaces and Essences. Analogy as the Fuel and Fire of Thinking . Basic Books, New York, NY, USA.
10. Kim R.,, Peters M.,, and Shams L. (2012). "0 + 1 > 1: How adding noninformative sound improves performance on a visual task". Psychol. Sci. , 23, 612.
11. Logan B. (s.a.) Mel Frequency Cepstral Coefficients for Music Modelling. Available from.
12. Mareschal D., and French R. (2016). "TRACX2: A connectionist autoencoder using graded chunks to model infant visual statistical learning". Philos. Trans. R. Soc. B Biol. Sci ., 372 (1711).
13. Michalski R.,, Carbonell J., and Mitchell M. (1986). Machine Learning. An Artificial Intelligence Approach. Volume II . Morgan Kaufmann Publishers, Los Altos, CA, USA.
14. Newton I. (1671–1672). "Letter to Henry Oldenburg", in: Philos. Trans. , 80, 30753087.
15. Ox J., and Britton D. (2000). "The 21st century virtual reality color organ", IEEE Multimedia , 7, 69.
16. Pham N.-K.,, Morin A., and Gros P. (2008). "CAViz, an interactive graphical tool for image mining", J. Comput. Inform. Technol. , 16, 295 302.
17. Pham N.-K.,, Morin A.,, Gros P., and Le Q.-T. (2009). "Utilisation de l’analyse factorielle des correspondances pour la recherche d’images à grande échelle", in: Actes d'EGC, RNTI-E-15, Revue des Nouvelles Technologies de l'Information - Série Extraction et Gestion des Connaissances , pp. 283294, Cépaduès Editions, Toulouse, France.
18. Sacks O. (2007). Musicophilia, Tales of Music and the Brain . Knopf, New York, NY, USA.
19. Thomson W. (2015). Music, Thought, and Feeling. Understanding the Psychology of Music , Oxford University Press, New York, NY, USA.
20. Widmer G. S.,, Dixon W.,, Goebl E.,, Pampalk A., and Tobudic A. (2003). "In search of the Horowitz factor". AI Mag. , 24, 111130.

Article metrics loading...



Can't access your account?
  • Tools

  • Add to Favorites
  • Printable version
  • Email this page
  • Subscribe to ToC alert
  • Get permissions
  • Recommend to your library

    You must fill out fields marked with: *

    Librarian details
    Your details
    Why are you recommending this title?
    Select reason:
    Art & Perception — Recommend this title to your library
  • Export citations
  • Key

  • Full access
  • Open Access
  • Partial/No accessInformation