How sound alters sense of touch

New research suggests our brains process different sensory inputs more like a symphony, combining and harmonising information rather than processing separately

By Dr Luca Godenzini and Associate Professor Lucy Palmer, Florey Institute of Neuroscience and Mental Health, and University of Melbourne

Associate Professor Lucy Palmer

Published 20 October 2021

Processing information from our senses is crucial to survival. Seeing a red light tells you to stop at an intersection, while the sound of a pedestrian button informs you that it’s safe to cross the road.

Of course, the interactions we have with the world are rarely through a single sense, and our ability to combine different sensory signals is extremely useful.

For example, we make roads safer to drive on by installing small bumps along lane markers (called audio tactile lines) so that when you drive on them the combination of vibration and sound helps to immediately warn you that you are drifting dangerously out of your lane.

The effectiveness of lane markings is enhanced by triggering multiple senses. Picture: Getty Images

We don’t know a lot about how our brains combine information from different senses though we do know that there are discrete primary processing sites in the brain for each sense.

But our latest research suggests that these processing sites aren’t as specialised as we may have thought and instead take in and process information from other senses as well.

It means that in processing sensory information our brains may work less like a computer and more like an orchestra harmonising different signals.

Now published in Nature Communications, our research investigated how information from different senses interact with each other and where in the brain this occurs.

Specifically, we looked at how sound can alter how the sense of touch and how that is processed in the brain.

To study sensory processing we measured the activity of neurons in mice brains by marking the neurons with a harmless fluorescent protein that lights up when they activate.

Combined with a special two photon microscope, it gives us a ‘window’ over the brain through which we can ‘see’ neurons in action and monitor their responses to sound and touch.

We looked inside the primary somatosensory cortex – the part of the brain that is activated by touch. Here, we found that sound enhances the processing of the sense of touch.

There are connections between where the brain processes sound and touch. Picture: Shutterstock

When sound and touch were presented together, neurons in the somatosensory cortex increased their activity. This led to faster behavioural responses when we tested the ability of the mice to detect a vibration.

In other words, having more information from multiple senses can improve the response time to sensory signals.

Think, for example, at how vibration and sounds on your phone help you realise that you have received a new notification or a phone call. How many times have you missed a call because your phone was muted, even if on vibration?

The finding suggests that primary sensory areas can also integrate information from multiple senses.

We found that this integration was possible thanks to connections between the somatosensory cortex and the part of the brain that processes sound – the auditory cortex.

These connections provide information about sound to a specific portion of the neuron called dendrites, leading to an increase in their activity. Dendrites, which are a neuron’s ‘antenna’ as they receive and integrate thousands of sensory signals, play an important role in integrating sound and touch information.

The combination of processing sound and touch leads to faster reaction times. Picture: 3D rendered image of Neuron cell/Getty Images

Indeed, when we ‘silenced’ auditory information to the dendrites by blocking the activity of projections from the auditory cortex using optogenetics – a harmless technique in which light is used to manipulate neuron activity – mice became slower at detecting vibrating stimuli.

This shows that the benefit of integrating sound and touch can occur thanks to communications between parts of the brain that are allocated to different sensory modalities.

This challenges the notion that the brain works as modules – processing discrete sensory information, in parallel but separately from each other. Instead, these cortical regions work together to create the complex patterns of brain activity that allow us to perceive (and respond to) the world.

Better understanding how this works could potentially tell us more about conditions like schizophrenia, autism and anxiety – all which are marked by impaired sensory processing.

But for now, the next time you drive over lane markings or catch a phone call, you can thank the unique neuron symphony going on in your head.

Banner: Getty Images

Find out more about research in this faculty

Medicine, Dentistry and Health

Content Card Slider


Content Card Slider


Subscribe for your weekly email digest

By subscribing, you agree to our

Acknowledgement of country

We acknowledge Aboriginal and Torres Strait Islander people as the Traditional Owners of the unceded lands on which we work, learn and live. We pay respect to Elders past, present and future, and acknowledge the importance of Indigenous knowledge in the Academy.

Read about our Indigenous priorities
Phone: 13 MELB (13 6352) | International: +61 3 9035 5511The University of Melbourne ABN: 84 002 705 224CRICOS Provider Code: 00116K (visa information)