Skip to main content
Cross-sectional images (shown in different colors) of a spider web were combined into this 3D image and translated into music. Isabelle Su and Markus Buehler

We may one day be able to communicate with spiders in “language” of web vibrations.

Now you can walk through a virtual spider web, using VR headset and controllers to interact with a web sonification model.

A spider weaving its intricate web is a bit like a person composing a song, at least in the eyes of MIT materials engineer Markus Buehler, whose research involves translating web structure into musical melodies. Together with his collaborators, he has devised a way for humans to “enter” a 3D spider web and explore its structure both visually and aurally via a virtual reality setup. Buehler described the ongoing project during a talk at the (virtual) meeting of the American Chemical Society (ACS) this week.

The work may one day lead to a means of rudimentary communication with spiders in their own “language” of web vibrations, such as when they stretch a strand of silk while building a web or when the strands vibrate in response to a gust of wind or to the presence of trapped prey. “The spider lives in an environment of vibrating strings,” Buehler said during an online press conference. “They don’t see very well, so they sense their world through vibrations, which have different frequencies.”

As we’ve reported previously, several years ago, Buehler led a team of MIT scientists that mapped the molecular structure of proteins in spider silk threads onto musical theory to produce the “sound” of silk in hopes of establishing a radical new way to create designer proteins. The hierarchical elements of music composition (pitch, range, dynamics, tempo) are analogous to the hierarchical elements of a protein structure. Much like how music has a limited number of notes and chords and uses different combinations to compose music, proteins have a limited number of building blocks (20 amino acids) that can combine in any number of ways to create novel protein structures with unique properties.

That work inspired a sonification art exhibit, “Spider’s Canvas,” in Paris in 2018. Artist Tomas Saraceno worked with MIT engineers to create an interactive harp-like instrument inspired by the web of a Cyrtophora citricola spider, with each strand in the “web” tuned to a different note. To create the harp, the team scanned a spider web with a laser to capture the 2D cross-sections and then reconstructed that 3D network with computer algorithms. Next they assigned specific frequencies to the web strands to serve as musical notes. Combine those notes in various patterns in the web’s 3D structure and you can generate melodies.

“The sounds are very complex, and they don’t sound like conventionally tuned instruments, because of course a spider does not use the same tuning system we do in musical creation,” said Buehler. “Rather, the spider has tuned the web to their own idea of how the web should be tuned as the optimal sensor, an optimal prey-catching apparatus. It’s quite haunting in its sounds—unusual, but quite beautiful.”

In 2019, Buehler’s team subsequently developed an even more advanced system of making music out of a protein structure—and then converting it back to create novel proteins never before seen in nature. They assigned each amino acid a tone based on its natural resonant frequency—actually more akin to a chord, since amino acids vibrate at several overlapping frequencies. The different 3D structures of the molecules determined the duration of each tone.

Since there are 20 amino acids, this produced a 20-tone scale. The team also developed a free Android app, called the Amino Acid Synthesizer, so users can create their own protein “compositions” from the sounds of amino acids. And last year, Buehler’s lab applied the same approach to model the vibrational properties of the spike protein responsible for the high contagion rate of the novel coronavirus SARS-CoV-2.

Buehler’s presentation at the ACS meeting focused primarily on the virtual reality environment that allows the user to enter a virtual spider web and wander through its structure The idea is that one might be able to pick up more interesting structural features by combining both vision and hearing, since it gives the user a much richer sensory experience of the spider web.

While most people are familiar with two-dimensional spider webs, according to Buehler, most spiders actually build three-dimensional cobwebs, and it was those structures he was most interested in exploring through sound. He thinks of spiders as “autonomous 3D printers,” constructing their webs without any supportive scaffolding, unlike manmade 3D printing processes. “So we have a material that is created or spun by the spider in real time with a very low energy consumption, creating these very complex structures in three-dimensional space,” Buehler said.

Some of the MIT experiments involved scanning a spider web as it was being constructed, translating each stage into music so the team could study the process in audible form. “We can create a harp for each construction state, so you can begin to see how the spider harp actually changes during the construction, almost like a living musical instrument,” said Buehler. The researchers were also able to virtually study how the web’s sound changes in response to different mechanical forces, such as stretching a particular strand and increasing the tension until the strand breaks, producing a snapping sound.

The ultimate aim is to learn to create similar synthetic spiderwebs and other structures that mimic the spider’s process. “We’re interested in changing the overall paradigm of how we think about materials,” said Buehler. “A spider is able to sense the integrity of the web through the vibrations. If it’s damaged, they can repair it. They have a whole different relationship to the structure they built; they are actually a part of it.” He imagines future manmade structures, such as bridges, designed with a similar built-in repair mechanism. “You wouldn’t build something and wait for it to break, but continuously repair it,” he said. “It would become a living organism.”

Spiders use their webs to catch prey, but they also use them to collect sensory information via the vibrations of the various strand and as a means of communication, tapping the web to produce vibrational patterns. In other experiments, Buehler et al. recorded the various web vibrations as the spiders went about different activities: constructing their webs or sending courtship signals, for example. They designed a special machine-learning algorithm to distinguish between the various sounds, since the frequencies pretty much all sound alike to human ears.

“Now we’re trying to generate synthetic signals to basically speak the language of the spider,” Buehler said. “If we expose them to certain patterns of rhythms or vibrations, can we affect what they do, and can we begin to communicate with them? Those are really exciting ideas.”

Spider web sonification during construction, first premiered at Saraceno’s OnAir exhibition, Paris, 2018.

Listing image by Isabelle Su and Markus Buehler

Source: MIT scientists study spider web structure by translating it into music | Ars Technica

Ogre-faced spiders have great hearing—without ears

EmotionsPheromonesSmell
12/01/2024

Humans can ‘smell’ each other’s emotions | Livescience

This article discusses the profound importance of the sense of smell in human relationships and social interactions. Chrissi Kelly, who lost her sense of smell after a viral infection, founded…
MemorySmell
18/04/2023

Why Do Smells Trigger Such Powerful Memories? | Discover Magazine

(Credit: Nestor Rizhniak/Shutterstock) More and more, scientists are picking at the connection between smell, emotion and memory. Here's why the brain's unique architecture enables odors to evoke powerful recollections. Whenever…
EmotionsMemorySmell
17/04/2023

Get a Whiff of That! There’s Nothing Like the Smell of the Farm | Farm and Rural Family Life | lancasterfarming.com

BackyardProduction We’ve all had it happen. We’re walking along when a smell strikes, and seemingly out of nowhere, we have an intense memory flash — a memory associated with that…
CommunicationInterestingSmell
17/04/2023

Male Bees Have Incredible Passion for Collecting Scents, Creating Own Fragrances | Nature World News

(Photo : John Wiesenfeld/Unsplash) Male bees have an unusual desire to collect scents: they deposit scents from various sources in special pockets on their hind legs, thereby creating their own…
EmotionsSmell
05/04/2023

The Best Gourmand Scents to Make Your Home Smell Delicious | Times Lifestyle

Are you always looking for ways to make your home smell delicious? Then you must give Gourmand scents a try! An inviting scent can make all the difference, and your…
FlavourSmellTaste
05/04/2023

The Connection Between Saliva And Flavour Perception? | Slurp

Image credits: Food | Image Credit: Freepik.com Research findings indicate that individuals with varying salivary flow rates or saliva composition, especially mucin proteins, can have markedly different flavor experiences while consuming…
Smell
04/04/2023

How a quest to sharpen my sense of smell made me a more grateful cook | Salon.com

Portrait of a young woman smelling and about to taste a pizza slice. (Getty Images/Studio4) On particularly cold days in Chicago, there are brief moments when it's like the city has…
MemorySmell
04/04/2023

Can the Smell of Coffee Make You More Productive? | LifeSavvy

Antonio Guillem/Shutterstock.com Some people can’t start their day without a cup or two of coffee. Others need it as a pick-me-up in the afternoon. But, could just the smell of coffee be…
HealthNeuroscienceSmell
04/04/2023

Sense of smell linked to speed of brain loss and cognitive decline | National Institute on Aging

Having a good sense of smell is associated with slower loss of brain volume and cognitive decline in older adults, and the link between sense of smell and brain and…
HealthInterestingSound
02/04/2023

Stressed plants ‘cry’ — and some animals can probably hear them | Nature

Research showing water-stressed or injured plants emitting high-pitched sounds could have implications for horticultural monitoring.credit: Lilach Hadany Microphones capture ultrasonic crackles from plants that are water-deprived or injured. Plants do…
MultisensorySmell
30/03/2023

How Smell—the Most Underrated Sense—Was Overpowered By Our Other Senses | Lithub

VIA BASIC BOOKS Ashley Ward on the Oft-Ignored and Much-Maligned Olfactory Sense Despite the wonderful contributions that smell makes to our lives, it’s undervalued in modern Western societies. Polls conducted…
Augmented + virtual realityEntertainmentVisual
30/03/2023

Could the metaverse help predict and produce movie blockbusters? | World Economic Forum

James Cameron, promoting his new Avatar film, which used metaverse-comparable methods during shooting. Image: Reuters/Toby Melville The metaverse is expected to open a $10 billion opportunity in Indian media and…
ArtEmotionsNeuroscience
29/03/2023

The healing powers of a brain on art | Hub

Ivy Ross and Susan Magsamen In their new book, authors Susan Magsamen, founder and director of the International Arts + Mind Lab, and Ivy Ross contend that making and experiencing…
NeuroscienceSound
28/03/2023

Your native language may shape the wiring of your brain | Live Science

A new study of structural brain scans suggests that your brain wiring is strongly shaped by your native language. (Image credit: © MPI CBS) The connections between different regions of the…
ArtCustomized Multi-Sensory CompositionsMultisensorySmellSoundVisual
28/03/2023

Scent adds more dimension to exhibits and stories & enhance perception and interaction | Denver Art Museum

Dana El Masri is a perfumer, interdisciplinary artist, lecturer, writer, and storyteller who is inspired by the scents and sounds of contemporary landscapes, as well as by her deeply rooted Egyptian…
NeuroscienceUncategorized
27/03/2023

Why Things Can Smell Wrong in Schizophrenia | Psychology Today

KEY POINTS Studies show that some people with schizophrenia have problems with smell. There are six common signs, including not being able to correctly identify odours. Research suggests that there…
EmotionsMemoryPheromonesSmell
27/03/2023

Sniffing body odour is tested as an anxiety therapy | BBC News

IMAGE SOURCE,GETTY IMAGES Sniffing other people's body odour might be useful in therapy for social anxiety, say Swedish researchers who have started tests with volunteers. The scientists have been using…
SmellTaste
27/03/2023

Understanding flavor through a pet’s eyes, nose and mouth | Pet Food Processing

Source: ©CHALABALA – STOCK.ADOBE.COM This is the first in a series of two articles covering a presentation by Nancy Rawson, Ph.D., on “The Flavor World of Companion Animals.” Get the…
HealthSound
27/03/2023

Don’t Got Rhythm? What It Means to Be Beat Deaf | Psychology Today

Source: Anna Shvets/Pexels KEY POINTS Beat deafness is the inability to identify or move your body in time with rhythm in music. The disorder occurs in only about 3 percent…
Augmented + virtual realityMultisensorySmellSoundTechnologyVisual
27/03/2023

Immersive Seeds: What We Can Learn From a Sensory Journey as a Rainforest Tree | KCET

The "Tree" VR experience allows viewers to embody a kapok tree, which is considered sacred among indigenous peoples in Peru and other areas in and around the Amazon rainforest. |…
CommunicationSmell
24/03/2023

How Smell Holds Ant Societies Together | Discover Magazine

ShutterStock/lirtlon Ants can be found in nearly every location on Earth, with rough estimates suggesting there are over 10 quadrillion individuals – that is a 1 followed by 16 zeroes, or about 1…
Augmented + virtual realityBrandingMarketingMultisensory
22/03/2023

Why Clinique’s Next Move In The Metaverse Is A Winning Formula For Web3 Retail | Forbes

Skin diagnostics get virtual at Clinique Lab new digital retail experience in the metaverse. CLINIQUE Clinique is launching digital laboratory Clinique Lab, an all-immersive, multi-sensory gamified experience that combines retail…
EntertainmentMultisensory
21/03/2023

The Eatrenalin is a fine dining and theme park experience | Charlotte Observer

Eatrenalin is part of Europa-Park, a theme park in Rust, Germany. The restaurant offers guests a multi-sensory, fine-dining experience. WIRESTOCK CREATORS Shutterstock Have you ever imagined what you would get…
Smell
21/03/2023

We know what causes the scent of spring, but what’s it actually for? | Yahoo

We know what causes the scent of spring, but what's it actually for? Spring is in the air – specifically, that long-awaited, earthy scent that comes from soil that's been…
MemorySmellSound
21/03/2023

The Lasting Power of Good Memories | Nautilus

Lead image: Dubova / Shutterstock Three years ago almost to the day, my 7-year-old hugged his teacher goodbye, we walked home together, and then we pretty much remained there for…
EntertainmentMultisensorySoundVisual
21/03/2023

Multi-Sensory Visual Wonderland of Senza Fine | EDM.com

The third edition of Senza Fine featured performances from Seth Troxler, Carlita and HVOB, alongside spectacular visuals by Ben Heim. Michael Poselski/offbrandproject Senza Fine’s third edition was a multi-sensory exploration…
BrandingMarketingMultisensory
21/03/2023

How to Use the 5 Senses — Plus a Secret 6th One — to Catapult Your Brand Experience | MarketBeat

Brand experience is a cornerstone of business, especially for those with a brick-and-mortar presence. Without a strong and consistent brand experience, it would be difficult to attract customers. So what…
ScientificSmell
20/03/2023

How do we smell? First 3D structure of human odour receptor offers clues | Nature

The OR51E2 receptor is activated by propionate, which has a cheesy odour.CREDIT: Antonio Nardelli/ EyeEm/ Getty Images Finding could advance our understanding of how human olfactory proteins recognize specific scents,…
Augmented + virtual realityHapticTouch/Feel/Texture
20/03/2023

Tactile tattoos to make virtual worlds tangib | EurekAlert!

Virtual and augmented reality (VR and AR), often combined under the term 'extended reality (XR)', are increasingly losing their niche status and entering the mass market. Think of the metaverse,…
MultisensoryTasteVisual
20/03/2023

Tetley to Launch Immersive Pop-Up Experience for their new line “Tetley Live Teas” | Newswire

Canada's #1 tea brand encourages shoppers to "Live in the Moment" by inviting them to an immersive, multi-sensory experience on Feb 16-19 at CF Sherway Gardens Mall Tetley is launching "Live in the…