Skip to main content
Cross-sectional images (shown in different colors) of a spider web were combined into this 3D image and translated into music. Isabelle Su and Markus Buehler

We may one day be able to communicate with spiders in “language” of web vibrations.

Now you can walk through a virtual spider web, using VR headset and controllers to interact with a web sonification model.

A spider weaving its intricate web is a bit like a person composing a song, at least in the eyes of MIT materials engineer Markus Buehler, whose research involves translating web structure into musical melodies. Together with his collaborators, he has devised a way for humans to “enter” a 3D spider web and explore its structure both visually and aurally via a virtual reality setup. Buehler described the ongoing project during a talk at the (virtual) meeting of the American Chemical Society (ACS) this week.

The work may one day lead to a means of rudimentary communication with spiders in their own “language” of web vibrations, such as when they stretch a strand of silk while building a web or when the strands vibrate in response to a gust of wind or to the presence of trapped prey. “The spider lives in an environment of vibrating strings,” Buehler said during an online press conference. “They don’t see very well, so they sense their world through vibrations, which have different frequencies.”

As we’ve reported previously, several years ago, Buehler led a team of MIT scientists that mapped the molecular structure of proteins in spider silk threads onto musical theory to produce the “sound” of silk in hopes of establishing a radical new way to create designer proteins. The hierarchical elements of music composition (pitch, range, dynamics, tempo) are analogous to the hierarchical elements of a protein structure. Much like how music has a limited number of notes and chords and uses different combinations to compose music, proteins have a limited number of building blocks (20 amino acids) that can combine in any number of ways to create novel protein structures with unique properties.

That work inspired a sonification art exhibit, “Spider’s Canvas,” in Paris in 2018. Artist Tomas Saraceno worked with MIT engineers to create an interactive harp-like instrument inspired by the web of a Cyrtophora citricola spider, with each strand in the “web” tuned to a different note. To create the harp, the team scanned a spider web with a laser to capture the 2D cross-sections and then reconstructed that 3D network with computer algorithms. Next they assigned specific frequencies to the web strands to serve as musical notes. Combine those notes in various patterns in the web’s 3D structure and you can generate melodies.

“The sounds are very complex, and they don’t sound like conventionally tuned instruments, because of course a spider does not use the same tuning system we do in musical creation,” said Buehler. “Rather, the spider has tuned the web to their own idea of how the web should be tuned as the optimal sensor, an optimal prey-catching apparatus. It’s quite haunting in its sounds—unusual, but quite beautiful.”

In 2019, Buehler’s team subsequently developed an even more advanced system of making music out of a protein structure—and then converting it back to create novel proteins never before seen in nature. They assigned each amino acid a tone based on its natural resonant frequency—actually more akin to a chord, since amino acids vibrate at several overlapping frequencies. The different 3D structures of the molecules determined the duration of each tone.

Since there are 20 amino acids, this produced a 20-tone scale. The team also developed a free Android app, called the Amino Acid Synthesizer, so users can create their own protein “compositions” from the sounds of amino acids. And last year, Buehler’s lab applied the same approach to model the vibrational properties of the spike protein responsible for the high contagion rate of the novel coronavirus SARS-CoV-2.

Buehler’s presentation at the ACS meeting focused primarily on the virtual reality environment that allows the user to enter a virtual spider web and wander through its structure The idea is that one might be able to pick up more interesting structural features by combining both vision and hearing, since it gives the user a much richer sensory experience of the spider web.

While most people are familiar with two-dimensional spider webs, according to Buehler, most spiders actually build three-dimensional cobwebs, and it was those structures he was most interested in exploring through sound. He thinks of spiders as “autonomous 3D printers,” constructing their webs without any supportive scaffolding, unlike manmade 3D printing processes. “So we have a material that is created or spun by the spider in real time with a very low energy consumption, creating these very complex structures in three-dimensional space,” Buehler said.

Some of the MIT experiments involved scanning a spider web as it was being constructed, translating each stage into music so the team could study the process in audible form. “We can create a harp for each construction state, so you can begin to see how the spider harp actually changes during the construction, almost like a living musical instrument,” said Buehler. The researchers were also able to virtually study how the web’s sound changes in response to different mechanical forces, such as stretching a particular strand and increasing the tension until the strand breaks, producing a snapping sound.

The ultimate aim is to learn to create similar synthetic spiderwebs and other structures that mimic the spider’s process. “We’re interested in changing the overall paradigm of how we think about materials,” said Buehler. “A spider is able to sense the integrity of the web through the vibrations. If it’s damaged, they can repair it. They have a whole different relationship to the structure they built; they are actually a part of it.” He imagines future manmade structures, such as bridges, designed with a similar built-in repair mechanism. “You wouldn’t build something and wait for it to break, but continuously repair it,” he said. “It would become a living organism.”

Spiders use their webs to catch prey, but they also use them to collect sensory information via the vibrations of the various strand and as a means of communication, tapping the web to produce vibrational patterns. In other experiments, Buehler et al. recorded the various web vibrations as the spiders went about different activities: constructing their webs or sending courtship signals, for example. They designed a special machine-learning algorithm to distinguish between the various sounds, since the frequencies pretty much all sound alike to human ears.

“Now we’re trying to generate synthetic signals to basically speak the language of the spider,” Buehler said. “If we expose them to certain patterns of rhythms or vibrations, can we affect what they do, and can we begin to communicate with them? Those are really exciting ideas.”

Spider web sonification during construction, first premiered at Saraceno’s OnAir exhibition, Paris, 2018.

Listing image by Isabelle Su and Markus Buehler

Source: MIT scientists study spider web structure by translating it into music | Ars Technica

Ogre-faced spiders have great hearing—without ears

ArtMultisensorySmellVisual
04/10/2022

Spiders, Sperm, and Calvin Klein Obsession Co-exist in MIT Show ‘Symbionts’ | Ocula News

Gilberto Esparza, Plantas autofotosinthéticas  (2013–14) (detail). Polycarbonate, silicon, stainless steel, graphite, electronic circuits, local wastewater, natural pond water with micro algae and microorganisms, plants, shrimp, fish, sound. 400 × 400…
HealthMultisensoryNeuroscience
04/10/2022

The big idea: do we all experience the world in the same way? | The Guardian

Illustration: Elia Barbieri/the Guardian Every human brain is different – it’s time to embrace the diversity of our experiences Imagine you and I are walking together along Brighton seafront on…
EmotionsPheromonesSmell
30/09/2022

Dogs can smell when humans are stressed, study suggests | CTV News

Undated photo of a dog smelling. (Blue Bird/Pexels) Megan Marple There's now scientific evidence shedding more light on one of Barkley's impressive skills in a long list of endearing traits:…
FlavourMultisensorySmell
29/09/2022

Hefty announces pumpkin spice-scented garbage bags

Cinnamon Pumpkin Spice Ultra Strong™ Trash Bags. (Reynolds Consumer Products) Hefty wants to make sure that not only are your lattes pumpkin spiced but your garbage is as well. That’s right,…
ArtMultisensory
29/09/2022

Sensoria: The Art and Science of Our Senses | Excalibur

Courtesy of York University Sept. 26th – Oct. 14th, Sensorium: Centre for Digital Arts and Technology at York University is teaming up with LAZNIA Centre for Contemporary Art in Gdansk,…
BrandingMarketingMultisensorySoundVisual
27/09/2022

Cadbury now has a sonic logo – and it’s kinda perfect | Creative Bloq

(Image credit: Cadbury) Why rely on visual marketing when you could play with sound as well? That's the feeling behind the new sonic logo composed for Cadbury by a prominent…
Augmented + virtual realityEntertainmentMultisensorySmellSoundTechnologyTouch/Feel/TextureVisual
27/09/2022

Meet the woman shaping post-pandemic cybersex | BusinessWorld Online

THE FOUNDER of Raspberry Dream Labs, Angelina Aleksandrovich, poses for a photograph with a VR headset she gives volunteers for her cybersex experience using XR, a combination of virtual and…
EmotionsNeuroscience
27/09/2022

Scientists May Have Identified The Neurons That Give Birth to Fear | ScienceAlert

(Anderson Rian/Unsplash) It's sometimes said that you can smell fear, when, in fact, the signals that generate fear are often multi-sensory. A fire, for instance, has heat, smoke, and smell…
FlavourInteresting
27/09/2022

Genes responsible for flavor compounds in strawberries found | Charlotte County Florida Weekly

Vance Whitaker studies strawberries. COURTESY PHOTOS In their quest to improve strawberry flavor, University of Florida scientists have found the genes behind aromatic chemicals that enhance the fruit’s taste. These…
ArtSmell
27/09/2022

Scents Of Wood Travels To The Metaverse With First Fragrance NFT | Forbes

Scents of Wood is launching its first NFT. COURTESY OF SCENTS OF WOOD The Scents of Wood Company is launching the world’s first fragrance subscription available exclusively through the purchase…
HealthScientificSmell
27/09/2022

How COVID-19 stole our sense of smell | CEN.ACS

SARS-CoV-2 has left thousands with a distorted or lost sense of smell. This population is helping researchers identify what happens when smell goes wrong and what might help It’s been…
PheromonesSmell
26/09/2022

Body odor sniffing linked to higher sex drive: study | Vigour Times

Sex smells! Enjoying the stench of body odor might not just be a bizarre fetish: Those who like whiffing other people’s natural aroma may have a higher appetite for sex…
ArtSynaesthesia
26/09/2022

Artist with synaesthesia puts Greta Thunberg’s Davos speech on canvas | Painting | The Guardian

Jack Coulter’s Future Generations artwork is estimated to fetch up to £20,000 at Sotheby's Contemporary Curated auction. Photograph: Sotheby'sNorthern Irish painter Jack Coulter used the climate activist’s words and music…
EducationMultisensory
26/09/2022

Innovation And Technology: The Province Will Have A Sensory Museum | World nation News

In its last session, the House of Representatives approved the creation of a space within the Knowledge Park where visitors can have a significant sensory experience through the implementation of…
HealthMultisensory
26/09/2022

Seahawks unveil ‘sensory’ room at Lumen Field for fans overwhelmed by crowd noise | My Northwest

The Seahawks have introduced an updated 'sensory' room for those overwhelmed by crowd noise at Lumen Field. (Courtesy of the Seattle Seahawks) Every NFL team knows that Seahawks games are…
ArtSmell
23/09/2022

Art class stinks! Learn with smell in art class using this olfactory display | Blogdot.tv

- Werbung - By Maria Nikoli, Interaction Designer, MSc., Malmö University Smelling is crucial to our everyday living. But how well do we really understand the role that smells play in our…
InterestingSmellTaste
23/09/2022

Study Finds Babies React to Taste, Smell in Womb | Newsmax.com

(Dreamstime) At the kitchen table, babies trying different foods might look eager or offended, depending on the flavor of what they are asked to eat. It turns out infants may…
EntertainmentMultisensoryNeuroscience
22/09/2022

David Byrne’s Mind-Bending, Multi-Sensory Theater of the Mind Is Open in Denver | Westword

David Byrne's Theater of the Mind will finally open Wednesday, August 31. Denver Center for the Performing Arts What is reality? Can you really trust what you see, hear, taste, touch, feel? These…
Smell
22/09/2022

Your Home Could Smell Like Texas Roadhouse’s Butter With New Candle | News Radio 1200 WOAI

Photo: Getty Images This isn't an April Fools' joke! Texas Roadhouse is bringing its signature Honey Cinnamon Butter into your home... but not in the way you might expect. The popular chain…
ArtMultisensorySmell
22/09/2022

How Do You Smell? | Smithsonian Magazine

A sculpture by artist Arlene Love and a tray of bottled scents in Joel Mainland’s office at the Monell Chemical Senses Center in Philadelphia. Caroline Tompkins By Abigail Tucker Photographs by Caroline…
Augmented + virtual realityEducation
21/09/2022

Augmented reality project based in Sudbury aims to make mining safer | Sudbury Star

Benjamin Ratala of NSS Canada demonstrates the HoloLens Augmented Reality headset, which is attached to his hardhat using a harness specifically designed for use underground. Mia Jensen Historically, miners must…
HealthMultisensory
21/09/2022

Etihad Stadium sensory suite receives Puma makeover | Mancity

Fans in the stands for City’s home fixtures against Crystal Palace and Nottingham Forrest might have noticed something different at the Etihad Stadium this season. That is because the Club’s…
Augmented + virtual realityHealth
21/09/2022

VR-Assisted Healing | Diverse: Issues In Higher Education

Virtual Reality (VR) technology is now playing an important role in helping military servicemembers recover from post-traumatic stress disorder, or PTSD.Virtual reality software and equipment are helping Operation Iraqi Freedom…
EntertainmentMultisensorySoundTasteVisual
21/09/2022

An Ultra-Nostalgic Cocktail Experience Is Coming To London | Secret London

Look, we don’t want to sound like our parents, but today’s music really is just samples of iconic tunes from the past few decades at the moment, isn’t it? If…
Uncategorized
21/09/2022

We have a new weapon against memory loss: an external “hard drive” in the form of a brain prosthesis | Voonze

we have a new weapon against memory loss: an external We often see technology as a threat to cognitive processes like our memory. But perhaps it is also through technology…
ExperientialInterestingMarketingMultisensory
21/09/2022

Scoot Has A New Pokémon-Themed Plane With Pikachu’s Face All Over | The Smart Local

Image credit: Scoot What child of the ’90s doesn’t know Pikachu and gang? You probably woke up early on Saturday mornings to catch Ash, Brock, and Misty disrupting Team Rocket’s…
ExperientialMarketingMultisensory
21/09/2022

Fun and effective – say hello to experiential marketing | iTMunch

Have you ever taken a car for a test drive? Why do you think automotive companies allow you to take the car for a spin? The answer is experience. Similarly,…
HealthSmell
20/09/2022

Why your sense of smell is more important than you think

A global surge in search engine requests for “loss of smell”, combined with social media discussion, prompted an unprecedented global collaboration to unlock the mysteries of the fifth sense. CREDIT:STOCKSY…
BrandingMarketingMultisensorySmellTaste
20/09/2022

Magnolia Bakery x TULA collab on new banana pudding-inspired skincare | Guilty Eats

A ton of food brands have been getting into the merchandise game, but while most have done makeup, apparel, or even scented candles, the famous Magnolia Bakery is going a different route.…
EntertainmentMultisensorySmellTasteTrendyVisual
20/09/2022

Regent Hotels & Resorts debuts Regent Taste Studio – a multisensory dining experience blending culinary talent with artists across creative disciplines | IHGPLC

Regent Taste Studio - Global Pop-Up Launch in Singapore The global brand premiere of Regent Taste Studio was staged in Singapore, featuring Regent Phu Quoc chefs in collaboration with world-renowned visual artist…