Multisensory perception: How sight, sound and touch shape what we taste, with Charles Spence, PhD

Speaking of Psychology41mJune 17, 2026
AI-Generated Summary

Why does a potato chip taste better when you hear it crunch? According to Dr. Charles Spence, a leading expert in multisensory perception, the answer lies in the hidden power of sound, color, texture, and environment to shape our experience of food—often without us even realizing it. His groundbreaking research shows that enhancing the crunch of a chip by 15% through audio manipulation can make it taste fresher and more enjoyable, proving that 'sonic seasoning' is a real flavor ingredient. But the most astonishing revelation comes from a dish at the world’s best restaurant: a rice pudding served with sub-audible vibrations, nostalgic sounds, and a ritualistic wafer-breaking moment that triggers tears in two-thirds of diners. This emotional response isn’t about taste—it’s about a full sensory journey that makes people feel deeply connected to the moment. Spence argues that our brains don’t just process taste in isolation; they integrate sight, sound, touch, and even memory into a unified experience. From Instagrammable Dubai chocolate to AI-generated food images that manipulate desire, he reveals how modern food trends are driven not by flavor alone, but by sensory storytelling. And he’s now exploring the radical idea of 'culinary counterpoint'—using music that contradicts the dish, much like in Tarantino films—to create new kinds of multisensory art that only make sense when all senses collide. The implications go far beyond the dining table.

Key Takeaways
1

Enhancing the crunch sound of a potato chip by 15% increases perceived freshness and liking, proving sound is a real flavor ingredient.

2

Two-thirds of diners cried at a rice pudding dish due to a combination of sub-audible vibrations, nostalgic sounds, and emotional timing—proving food can trigger deep emotional responses.

3

Eating in front of TV or mobile devices increases consumption by up to 30% because distraction blocks sensory feedback that signals fullness.

4

Dubai chocolate’s viral success comes not from taste but from its Instagrammable green-and-brown color, proving visual distinctiveness drives food trends.

5

AI can generate compelling food visuals but can’t taste or smell—real chefs must sense-check AI ideas to ensure they work in practice.

…and 3 more takeaways available in PodZeus

Chapters
0:01
2 min

The Hidden Senses Behind Taste

The episode begins by challenging the idea that taste is only about sugar, salt, and fat. Instead, Dr. Spence explains how sight, sound, touch, and environment all contribute to flavor perception, setting the stage for a deep dive into multisensory psychology.

2:13
3 min

Cross-Modal vs. Multi-Sensory: The Science of Interaction

Spence distinguishes between cross-modal effects (like sound making lights seem brighter) and multi-sensory integration (like flavor being a blend of taste, smell, and texture), emphasizing how these interactions shape perception.

5:13
2 min

Sonic Seasoning: How Sound Makes Food Taste Better

We were able to show that we can enhance the crunchiness, the crispness and the freshness and hence the liking of those potato chips by about 15% simply by enhancing the sound of the crunch.

Highlight
7:34
4 min

The Emotional Power of Food: When Rice Pudding Makes People Cry

When we turn those bodily vibrations off the ultra-low frequency vibrations, then the rate of crying drops significantly, suggesting that's kind of a part.

Highlight
11:14
5 min

The Real Reason We Love Crunch: A Mystery of Evolution

Spence explores why we crave crunchy foods despite their lack of nutritional value, suggesting the sound of crunch signals freshness, fat content, or energy density—linking sound to survival instincts.

High-Impact Quotes
So could you have a culinary counterpoint? I don't think anyone has tried that yet, having music that deliberately goes against something in the dish.
Dr. Charles Spence36:36
And the real concern for me is that maybe they will be generated to be ultimately appealing to our brain because, you know, the AI will realize that if it's the image of the food should be from a first person perspective.
Dr. Charles Spence34:12
And we're able to show that we can enhance the crunchiness, the crispness and the freshness and hence the liking of those potato chips by about 15 simply by enhancing the sound of the crunch.
Dr. Charles Spence5:56
Speakers

Host

Kim Mills

Guest

Dr. Charles Spence
Topics Discussed
multisensory perception95%sonic seasoning90%food and emotion88%sensory marketing87%distracted eating85%culinary counterpoint84%AI in food design82%food trends80%
People & Brands

Dr. Charles Spence

person

12xPositive

AI

other

6xNeutral

Pringles

product

4xNeutral

Dubai chocolate

product

4xNeutral

University of Oxford

organization

4xNeutral

Speaking of Psychology

media

3xNeutral

Heston Blumenthal

person

3xPositive

Cross-Modal Research Laboratory

organization

3xNeutral

Federico

person

3xNeutral

American Psychological Association

organization

2xNeutral

Start discovering podcast insights today

Start with a 7-day trial and explore a growing catalog of popular podcasts. No credit card required.

No credit card required • 7-day trial • Cancel anytime