Cookies Policy

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies.

I accept this policy

Find out more here

The Skin as a Medium for Sensory Substitution

No metrics data to plot.
The attempt to load metrics for this article has failed.
The attempt to plot a graph for these metrics has failed.
The full text of this article is not currently available.

Brill’s MyBook program is exclusively available on BrillOnline Books and Journals. Students and scholars affiliated with an institution that has purchased a Brill E-Book on the BrillOnline platform automatically have access to the MyBook option for the title(s) acquired by the Library. Brill MyBook is a print-on-demand paperback copy which is sold at a favorably uniform low price.

Access this article

+ Tax (if applicable)
Add to Favorites
You must be logged in to use this functionality

image of Multisensory Research
For more content, see Seeing and Perceiving and Spatial Vision.

The last 50 years or so has seen great optimism concerning the potential of sensory substitution and augmentation devices to enhance the lives of those with (or even those without) some form of sensory loss (in practice, this has typically meant those who are blind or suffering from low vision). One commonly discussed solution for those individuals who are blind has been to use one of a range of tactile–visual sensory substitution systems that represent objects captured by a camera as outline images on the skin surface in real-time (what Loomis, Klatzky and Giudice, 2012, term general-purpose sensory substitution devices). However, despite the fact that touch, like vision, initially codes information spatiotopically, I would like to argue that a number of fundamental perceptual, attentional, and cognitive limitations constraining the processing of tactile information mean that the skin surface is unlikely ever to provide such general-purpose sensory substitution capabilities. At present, there is little evidence to suggest that the extensive cortical plasticity that has been demonstrated in those who have lost (or never had) a sense can do much to overcome the limitations associated with trying to perceive high rates of spatiotemporally varying information presented via the skin surface (no matter whether that surface be the back, stomach, forehead, or tongue). Instead, the use of the skin will likely be restricted to various special-purpose devices that enable specific activities such as navigation, the control of locomotion, pattern perception, etc.

Affiliations: 1: Crossmodal Research Laboratory, Department of Experimental Psychology, University of Oxford, South Parks Road, Oxford, OX1 3UD, UK


Full text loading...


Data & Media loading...

1. Abrams M. , Winters D. ( 2003). Can you see with your tongue? The brain is so adaptable, some researchers now think, that any of the five senses can be rewired, Discover6th Jan., available from ( accessed 27 June 2014).
2. Aitkin L. M. ( 1976). "Tonotopic organisation at higher levels of the auditory pathway", in: International Reviews of Physiology, Neurophysiology, III, Vol Vol. 10, Porter R. (Ed.), pp.  249279. University Park Press, Baltimore, MD, USA.
3. Alliusi E. A. ( 1960). On optimizing cutaneous communication: a respectful supplement to some adventures in tactile literacy, in: Symposium on Cutaneous Sensitivity, G. R. Hawkes (Ed.), pp. 39–45. U.S. Army Med. Res. Lab. Rep., No. 424.
4. Alsmith A. J. T. , Longo M. R. ( 2014). "Where exactly am I? Self-location judgements distribute between head and torso", Conscious. Cogn. Vol 24, 7074.
5. Arnold G. , Spence C. , Auvray M. (submitted). "Which perspective is adopted when interpreting tactile stimuli? A review of the tactile symbol recognition paradigm", Psychol. Bull.
6. Auvray M. , Gallace A. , Hartcher-O’Brien J. , Tan H. Z. , Spence C. ( 2008). "Tactile and visual distractors induce change blindness for tactile stimuli presented on the fingertips", Brain Res. Vol 1213, 111119.
7. Bach-y-Rita P. ( 1972). Brain Mechanisms in Sensory Substitution. Academic Press, New York, NY, USA.
8. Bach-y-Rita P. ( 2002). "Sensory substitution and qualia", in: Vision and Mind, Noë A. , Thompson E. (Eds), pp.  497514. MIT Press, Cambridge, MA, USA.
9. Bach-y-Rita P. , Collins C. C. , Saunders F. A. , White B. , Scadden L. ( 1969). "Vision substitution by tactile image projection", Nature Vol 221, 963964.
10. Bach-y-Rita P. , Kercel S. W. ( 2003). "Sensory substitution and the human machine interface", Trends Cogn. Sci. Vol 7, 541546.
11. Bertossa F. , Besa M. , Ferrari R. , Ferri F. ( 2008). "Point zero: a phenomenological inquiry into the seat of consciousness", Percept. Mot. Skills Vol 107, 323335.
12. Biever C. ( 2005). The touchy-feely side of telecoms, New Scientist27th Feb., available from ( accessed 27 June 2014).
13. Cholewiak R. W. , Craig J. C. ( 1984). "Vibrotactile pattern recognition and discrimination at several body sites", Percept. Psychophys. Vol 35, 503514.
14. Cohen L. G. , Celnik P. , Pascual-Leone A. , Corwell B. , Faiz L. , Dambrosia J. , Honda M. , Sadato N. , Gerloff C. , Catala M. D. , Hallett M. ( 1997). "Functional relevance of cross-modal plasticity in blind humans", Nature Vol 389, 180183.
15. Collins C. C. ( 1970). "Tactile television-mechanical and electrical image projection", IEEE Trans. Hum. Mach. Syst. Vol MMS-11, 6571.
16. Collins C. C. ( 1985). "On mobility aids for the blind", in: Electronic Spatial Sensing for the Blind, Warren D. H. , Stelow E. R. (Eds), pp.  3564. Martinus Nijhof, Boston, MA, USA.
17. Corcoran D. W. J. ( 1977). "The phenomena of the disembodied eye or is it a matter of personal geography?" Perception Vol 6, 247253.
18. Craig J. C. ( 1974). Pictorial and abstract cutaneous displays, in: Conference on Cutaneous Communication Systems and Devices, F. A. Geldard (Ed.), pp. 78–83. Psychonomic Society, Austin, TX, USA.
19. Craig J. C. ( 1977). "Vibrotactile pattern perception: extraordinary observers", Science Vol 196, 450452.
20. Craig J. C. , Evans P. M. ( 1987). "Vibrotactile masking and the persistence of tactual features", Percept. Psychophys. Vol 42, 309317.
21. Craig J. C. , Sherrick C. E. ( 1982). "Dynamic tactile displays", in: Tactile Perception: A Sourcebook, Schiff W. , Foulke E. (Eds), pp.  209233. Cambridge University Press, Cambridge, UK.
22. Diaz A. , Barrientos A. , Jacobs D. M. , Travieso D. ( 2012). "Action contingent vibrotactile flow facilitates the detection of ground level obstacles with a partly virtual sensory substitution device", Hum. Mov. Sci. Vol 31, 15711584.
23. Felleman D. J. , Van Essen D. C. ( 1991). "Distributed hierarchical processing in primate cerebral cortex", Cereb. Cortex Vol 1, 147.
24. Frings C. , Ammendt A. , Spence C. ( 2011). "When seeing doesn’t matter: tactile negative priming is equally strong in the blind and the sighted", J. Exp. Psychol. Hum. Percept. Perform. Vol 37, 11741181.
25. Galinsky A. D. , Magee J. C. , Inesi M. E. , Gruenfeld D. H. ( 2006). "Power and perspectives not taken", Psychol. Sci. Vol 17, 10681074.
26. Gallace A. , Ngo M. K. , Sulaitis J. , Spence C. ( 2012). "Multisensory presence in virtual reality: possibilities and limitations", in: Multiple Sensorial Media Advances and Applications: New Developments in MulSeMedia, Ghinea G. , Andres F. , Gulliver S. (Eds), pp.  140. IGI Global, Hershey, PA, USA.
27. Gallace A. , Spence C. ( 2011). "To what extent do Gestalt grouping principles influence tactile perception?" Psychol. Bull. Vol 137, 538561.
28. Gallace A. , Spence C. ( 2014). In Touch with the Future: The Sense of Touch from Cognitive Neuroscience to Virtual Reality. Oxford University Press, Oxford, UK.
29. Gallace A. , Tan H. Z. , Spence C. ( 2006a). "The failure to detect tactile change: a tactile analog of visual change blindness", Psychonom. Bull. Rev. Vol 13, 300303.
30. Gallace A. , Tan H. Z. , Spence C. ( 2006b). "Numerosity judgments for tactile stimuli distributed over the body surface", Perception Vol 35, 247266.
31. Gallace A. , Tan H. Z. , Spence C. ( 2007). "The body surface as a communication system: the state of the art after 50 years", Presence (Camb.) Vol 16, 655676.
32. Gallace A. , Tan H. Z. , Spence C. ( 2008). "Can tactile stimuli be subitised? An unresolved controversy within the literature on numerosity judgments", Perception Vol 37, 782800.
33. Gallace A. , Zeeden S. , Röder B. , Spence C. ( 2010). "Lost in the move? Secondary task performance impairs the detection of tactile change on the body surface", Conscious. Cogn. Vol 19, 215229.
34. Geldard F. A. ( 1960). "Some neglected possibilities of communication", Science Vol 131, 15831588.
35. Geldard F. A. (Ed.) ( 1974). Cutaneous Communication Systems and Devices. Psychonomic Society, Austin, TX, USA.
36. Gould W. R. , Vierck C. J. , Luck M. M. ( 1979). "Cues supporting recognition of the orientation or direction of movement of tactile stimuli", in: Sensory Functions of the Skin of Humans, Kenshalo D. R. (Ed.), pp.  6378. Plenum Press, New York, NY, USA.
37. Gregg L. W. ( 1960). "Some coding problems in the design of a cutaneous communication channel", U.S. Army Medical Research Reports Vol 424, 85102.
38. Guarniero G. ( 1974). "Experience of tactile vision", Perception Vol 3, 101104.
39. Guarniero G. ( 1977). "Tactile vision: a personal view", Journal of Visual Impairment and Blindness Vol 71, 125130.
40. Hawkes G. R. (Ed.) ( 1960). Symposium on Cutaneous Sensitivity, Rep. U.S. Army Med. Res. Lab. 424, 1–165.
41. Hennessy J. R. ( 1966). "Cutaneous sensitivity communications", Hum. Fact. Vol 8, 463469.
42. Hill J. W. ( 1971). "Processing of tactual and visual point stimuli sequentially presented at high rates", J. Exp. Psychol. Vol 88, 340348.
43. Hill J. W. , Bliss J. C. ( 1968). "Perception of sequentially presented tactile point stimuli", Percept. Psychophys. Vol 4, 289295.
44. Ho C. , Spence C. ( 2008). The Multisensory Driver: Implications for Ergonomic Car Interface Design. Ashgate Publishing, Aldershot, UK.
45. Honig Z. ( 2013). Triposo Travel Belt vibrates to help you locate attractions (video), available from ( accessed 13 September 2013).
46. Hoover R. E. ( 1950). "The cane as a travel aid", in: Blindness, Zahl P. A. (Ed.), pp.  353365. Princeton University Press, Princeton, MA, USA.
47. Hötting K. , Röder B. ( 2004). "Hearing cheats touch, but less in congenitally blind than in sighted individuals", Psychol. Sci. Vol 15, 6064.
48. Humphries C. , Liebenthal E. , Binder J. R. ( 2010). "Tonotopic organization of human auditory cortex", NeuroImage Vol 50, 12021211.
49. Juravle G. , Deubel H. , Spence C. ( 2011). "Attention and suppression affect tactile perception in reach-to-grasp movements", Acta Psychol. Vol 138, 302310.
50. Juravle G. , Deubel H. , Tan H. Z. , Spence C. ( 2010). "Changes in tactile sensitivity over the timecourse of a goal-directed movement", Behav. Brain Res. Vol 208, 391401.
51. Juravle G. , Spence C. ( 2011). "Juggling reveals a decisional component to tactile suppression", Exp. Brain Res. Vol 213, 8799.
52. Kaczmarek K. A. , Bach-y-Rita P. ( 1995). "Tactile displays", in: Virtual Environments and Advanced Interface Design, Barfield W. , Furness T. A. (Eds), pp.  349414. Oxford University Press, New York, NY, USA.
53. Kajimoto H. , Kanno Y. , Tachi S. ( 2006). Forehead electro-tactile display for vision substitution, Proc. Eurohaptics, 1–6.
54. Kotovsky K. , Bliss J. C. ( 1963). "Tactual representation of visual information", IEEE Trans Mil. Electron. Vol MIL-7, 108113.
55. Krech D. , Crutchfield R. S. ( 1958). Elements of Psychology. A. A. Knopf, New York, NY, USA.
56. Kupers R. , Ptito M. ( 2004). "Seeing’ through the tongue: cross-modal plasticity in the congenitally blind", Int. Congr. Ser. Vol 1270, 7984.
57. Lakatos S. , Shepard R. N. ( 1997). "Time-distance relations in shifting attention between locations on one’s body", Percept. Psychophys. Vol 59, 557566.
58. Lavie N. ( 2005). "Distracted and confused?: selective attention under load", Trends Cogn. Sci. Vol 9, 7582.
59. Lee J.-H. , Spence C. ( 2008). "Feeling what you hear: task-irrelevant sounds modulates tactile perception delivered via a touch screen", J. Multisens. User Interfaces Vol 2, 145156.
60. Legge G. E. , Madison C. , Vaughn B. N. , Cheong A. M. Y. , Miller J. C. ( 2008). "Retention of high tactile acuity thoughout the lifspan in blindness", Atten. Percept. Psychophys. Vol 70, 14711488.
61. Limanowski J. , Hecht H. ( 2011). "Where do we stand on locating the self?" Psychology Vol 2, 312317.
62. Linvill J. G. , Bliss J. C. ( 1966). "A direct translation reading aid for the blind", Proc. IEEE Vol 54, 4051.
63. Löken L. S. , Wessberg J. , Morrison I. , McGlone F. , Olausson H. ( 2009). "Coding of pleasant touch by unmyelinated afferents in humans", Nat. Neurosci. Vol 12, 547548.
64. Loomis J. M. ( 1992). "Distal attribution and presence", Presence (Camb.) Vol 1, 113119.
65. Loomis J. M. , Klatzky R. L. , Giudice N. A. ( 2012). "Sensory substitution of vision: importance of perceptual and cognitive processing", in: Assistive Technology for Blindness and Low Vision, Manduchi R. , Kurniawan S. (Eds), pp.  162191. CRC Press, Boca Raton, FL, USA.
66. Luk J. , Pasquero J. , Little S. , MacLean K. , Lévesque V. , Hayward V. ( 2006). A role for haptics in mobile interaction: initial design using a handheld tactile display prototype, in: Proc. ACM Conf. Hum. Fact. Comput. Syst. (CHI ’06), CHI Lett. 8, no. 1, Montreal, Canada, pp. 171–180.
67. Marks P. ( 2006). "Gadgets get the feel of the tactile world", New Sci. Vol 2560, 27.
68. Martin M. G. F. ( 1995). "Bodily awareness: a sense of ownership", in: The Body and the Self, Bermudez J. L. , Marcel A. , Eilan N. (Eds), pp.  267289. MIT Press, Cambridge, MA, USA.
69. McGlone F. P. , Spence C. ( 2010). "Editorial: the cutaneous senses: touch, temperature, pain/itch, and pleasure", Neurosci. Biobehav. Rev. Vol 34, 145147.
70. Meijer P. B. L. ( 1993). "An experimental system for auditory image representations", IEEE Trans. Biomed. Eng. Vol 39, 112121.
71. Montagu A. ( 1971). Touching: The Human Significance of the Skin. Columbia University Press, New York, NY, USA.
72. Morioka M. , Maeda S. ( 1998). "Measurement of hand-transmitted vibration of tapping the long cane for visually handicapped people in Japan", Ind. Health Vol 36, 179190.
73. Nagel S. K. , Carl C. , Kringe T. , Märtin R. , König P. ( 2005). "Beyond sensory substitution-learning the sixth sense", J. Neural Eng. Vol 2, R13R26.
74. Natsoulas T. ( 1966). "Locus and orientation of the perceiver (ego) under variable, constant, and no perspective instructions", J. Personal. Soc. Psychol. Vol 3, 190196.
75. Natsoulas T. , Dubanoski R. A. ( 1964). "Inferring the locus and orientation of the perceiver from responses to stimulation of the skin", Am. J. Psychol. Vol 77, 281285.
76. Occelli V. , Spence C. , Zampini M. ( 2013). "Auditoy, tactile, and audiotactile information processing following visual depravation", Psychol. Bull. Vol 139, 189212.
77. Parsons L. M. , Shimojo S. ( 1987). "Perceived spatial organization of cutaneous patterns on surfaces of the human body in various positions", J. Exp. Psychol. Hum. Percept. Perform. Vol 13, 488505.
78. Pascual-Leone A. , Torres F. ( 1993). "Plasticity of the sensorimotor cortex representation of the reading finger in Braille readers", Brain Vol 116, 3952.
79. Ptito M. , Moesgaard S. M. , Gjedde A. , Kupers R. ( 2005). "Cross-modal plasticity revealed by electrotactile stimulation of the tongue in the congenitally blind", Brain Vol 128, 606614.
80. Putzar L. , Goerendt I. , Lange K. , Rösler F. , Röder B. ( 2007). "Early visual deprivation impairs multisensory interactions in humans", Nat. Neurosci. Vol 10, 12431245.
81. Rauschecker J. P. ( 1995). "Compensatory plasticity and sensory substitution in the cerebral cortex", Trends Neurosci. Vol 18, 3643.
82. Révész G. ( 1950). The Psychology and Art of the Blind. Longmans Green, London, UK.
83. Röder B. , Rösler F. ( 2004). "Compensatory plasticity as a consequence of sensory loss", in: The Handbook of Multisensory Processes, Calvert G. A. , Spence C. , Stein B. E. (Eds), pp.  719747. MIT Press, Cambridge, MA, USA.
84. Rönnberg J. ( 1995). "Perceptual compensation in the deaf and blind: myth or reality?", in: Compensating for Psychological Deficits and Declines: Managing Losses and Promoting Gains, Dixon R. A. , Bäckman L. (Eds), pp.  251274. Lawrence Erlbaum, Mahwah, NJ, USA.
85. Sadato N. , Pascual-Leone A. , Grafman J. , Ibañez V. , Deiber M.-P. , Dold G. , Hallett M. ( 1996). "Activation of the primary visual cortex by Braille reading in blind subjects", Nature Vol 380, 526528.
86. Saito D. N. , Okada T. , Honda M. , Yonekura Y. , Sadato N. ( 2007). "Practice makes perfect: the neural substrates of tactile discrimination by Mah-Jong experts include the primary visual cortex", BMC Neurosci. Vol 7, 79.
87. Sampaio E. , Maris S. , Bach-y-Rita P. ( 2001). "Brain plasticity: “Visual” acuity of blind persons via the tongue", Brain Res. Vol 908, 204207.
88. Scadden L. ( 1969). "A tactual substitute for sight", New Sci. Vol 41, 677678.
89. Schenkman B. N. ( 1986). "Identification of ground materials with the aid of tapping sounds and vibrations of long canes for the blind", Ergonomics Vol 29, 985998.
90. Schneider S. L. , Hughes B. , Epstein W. , Bach-y-Rita P. ( 1986). "The detection of length and orientation changes in dynamic vibrotactile patterns", Percept. Psychophys. Vol 40, 290300.
91. Scholtz D. A. ( 1957). "Fundamental principles of form perception in touch", Acta Psychol. Vol 13, 299333.
92. Sereno M. I. , Dale A. M. , Reppas J. B. , Kwong K. K. , Belliveau J. W. , Brady T. J. , Rosen B. R. , Tootell R. B. H. ( 1995). "Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging", Science Vol 268, 889893.
93. Shiffrin R. M. , Craig J. C. , Cohen E. ( 1973). "On the degree of attention and capacity limitation in tactile processing", Percept. Psychophys. Vol 13, 328336.
94. Shimizu Y. ( 1982). "Temporal effect of tactile letter recognition by a tracing mode", Percept. Mot. Skills Vol 55, 343349.
95. Shimizu Y. ( 1995). "Temporal effect in vibrotactile letter reading", Percept. Mot. Skills Vol 80, 10691070.
96. Siegle J. H. , Warren W. H. ( 2010). "Distal attribution and distance perception in sensory substitution", Perception Vol 39, 208223.
97. Soto-Faraco S. , Spence C. , Fairbank K. , Kingstone A. , Hillstrom A. P. , Shapiro K. ( 2002). "A crossmodal attentional blink between vision and touch", Psychonom. Bull. Rev. Vol 9, 731738.
98. Soto-Faraco S. , Spence C. , Lloyd D. , Kingstone A. ( 2004). "Moving multisensory research along: motion perception across sensory modalities", Curr. Dir. Psychol. Sci. Vol 13, 2932.
99. Spence C. ( 2010). "Crossmodal spatial attention", Ann. N. Y. Acad. Sci. Vol 1191, 182200.
100. Spence C. , Nicholls M. E. R. , Driver J. ( 2001). "The cost of expecting events in the wrong sensory modality", Percept. Psychophys. Vol 63, 330336.
101. Spence C. , Parise C. , Chen Y.-C. ( 2011). "The Colavita visual dominance effect", in: Frontiers in the Neural Bases of Multisensory Processes, Murray M. M. , Wallace M. (Eds), pp.  523550. CRC Press, Boca Raton, FL, USA.
102. Striem-Amit E. , Bubic A. , Amedi A. ( 2011). "Neurophysiological mechanisms underlying plastic changes and rehabilitation following sensory loss in blindness and deafness", in: Frontiers in the Neural Bases of Multisensory Processes, Murray M. M. , Wallace M. (Eds), pp.  395422. CRC Press, Boca Raton, FL, USA.
103. Van Hulle L. , Juravle G. , Spence C. , Crombez G. , Van Damme S. ( 2013). "Attention modulates sensory suppression during back movements", Conscious. Cogn. Vol 22, 420429.
104. Von Haller Gilmer B. ( 1961). "Toward cutaneous electro-pulse communication", J. Psychol. Vol 52, 211222.
105. Von Haller Gilmer B. ( 1966). Problems in Cutaneous Communication from Psychophysics to Information Processing. The American Foundation for the Blind, New York, NY, USA.
106. Walker P. , Moylan K. ( 1994). "The enhanced representation of surface texture consequent on the loss of sight", Neuropsychologia Vol 32, 289297.
107. Weinstein S. ( 1968). "Intensive and extensive aspects of tactile sensitivity as a function of body part, sex, and laterality", in: The Skin Senses, Kenshalo D. R. (Ed.), pp.  195222. Thomas, Springfield, IL, USA.
108. White B. W. ( 1970). "Perceptual findings with the vision-substitution system", IEEE Trans. Man–Machine Syst. Vol MMS-11, 5458.
109. Williams M. , Ray C. , Griffith J. , De l’Aune W. ( 2011). "The use of tactile vision sensory substitution as an augmentative tool for individuals with visual impairment", J. Vis. Impair. Blind. Vol 105, 4550.
110. Wright T. , Ward J. ( 2013). "The evolution of a visual-to-auditory sensory substitution device using interactive genetic algorithms", Q. J. Exp. Psychol. Vol 66, 16201638.
111. Yanagida Y. , Kakita M. , Lindeman R. W. , Kume Y. , Tetsutani N. ( 2004). Vibrotactile letter reading using a low-resolution tactor array, in: Proc. 12th Int. Symp. Haptic Interfacs Virt. Env. Teleoperator Syst., Chicago, IL, USA, pp. 400–406.

Article metrics loading...



Can't access your account?
  • Tools

  • Add to Favorites
  • Printable version
  • Email this page
  • Subscribe to ToC alert
  • Get permissions
  • Recommend to your library

    You must fill out fields marked with: *

    Librarian details
    Your details
    Why are you recommending this title?
    Select reason:
    Multisensory Research — Recommend this title to your library
  • Export citations
  • Key

  • Full access
  • Open Access
  • Partial/No accessInformation