Skip to main content
Cross-sectional images (shown in different colors) of a spider web were combined into this 3D image and translated into music. Isabelle Su and Markus Buehler

We may one day be able to communicate with spiders in “language” of web vibrations.

Now you can walk through a virtual spider web, using VR headset and controllers to interact with a web sonification model.

A spider weaving its intricate web is a bit like a person composing a song, at least in the eyes of MIT materials engineer Markus Buehler, whose research involves translating web structure into musical melodies. Together with his collaborators, he has devised a way for humans to “enter” a 3D spider web and explore its structure both visually and aurally via a virtual reality setup. Buehler described the ongoing project during a talk at the (virtual) meeting of the American Chemical Society (ACS) this week.

The work may one day lead to a means of rudimentary communication with spiders in their own “language” of web vibrations, such as when they stretch a strand of silk while building a web or when the strands vibrate in response to a gust of wind or to the presence of trapped prey. “The spider lives in an environment of vibrating strings,” Buehler said during an online press conference. “They don’t see very well, so they sense their world through vibrations, which have different frequencies.”

As we’ve reported previously, several years ago, Buehler led a team of MIT scientists that mapped the molecular structure of proteins in spider silk threads onto musical theory to produce the “sound” of silk in hopes of establishing a radical new way to create designer proteins. The hierarchical elements of music composition (pitch, range, dynamics, tempo) are analogous to the hierarchical elements of a protein structure. Much like how music has a limited number of notes and chords and uses different combinations to compose music, proteins have a limited number of building blocks (20 amino acids) that can combine in any number of ways to create novel protein structures with unique properties.

That work inspired a sonification art exhibit, “Spider’s Canvas,” in Paris in 2018. Artist Tomas Saraceno worked with MIT engineers to create an interactive harp-like instrument inspired by the web of a Cyrtophora citricola spider, with each strand in the “web” tuned to a different note. To create the harp, the team scanned a spider web with a laser to capture the 2D cross-sections and then reconstructed that 3D network with computer algorithms. Next they assigned specific frequencies to the web strands to serve as musical notes. Combine those notes in various patterns in the web’s 3D structure and you can generate melodies.

“The sounds are very complex, and they don’t sound like conventionally tuned instruments, because of course a spider does not use the same tuning system we do in musical creation,” said Buehler. “Rather, the spider has tuned the web to their own idea of how the web should be tuned as the optimal sensor, an optimal prey-catching apparatus. It’s quite haunting in its sounds—unusual, but quite beautiful.”

In 2019, Buehler’s team subsequently developed an even more advanced system of making music out of a protein structure—and then converting it back to create novel proteins never before seen in nature. They assigned each amino acid a tone based on its natural resonant frequency—actually more akin to a chord, since amino acids vibrate at several overlapping frequencies. The different 3D structures of the molecules determined the duration of each tone.

Since there are 20 amino acids, this produced a 20-tone scale. The team also developed a free Android app, called the Amino Acid Synthesizer, so users can create their own protein “compositions” from the sounds of amino acids. And last year, Buehler’s lab applied the same approach to model the vibrational properties of the spike protein responsible for the high contagion rate of the novel coronavirus SARS-CoV-2.

Buehler’s presentation at the ACS meeting focused primarily on the virtual reality environment that allows the user to enter a virtual spider web and wander through its structure The idea is that one might be able to pick up more interesting structural features by combining both vision and hearing, since it gives the user a much richer sensory experience of the spider web.

While most people are familiar with two-dimensional spider webs, according to Buehler, most spiders actually build three-dimensional cobwebs, and it was those structures he was most interested in exploring through sound. He thinks of spiders as “autonomous 3D printers,” constructing their webs without any supportive scaffolding, unlike manmade 3D printing processes. “So we have a material that is created or spun by the spider in real time with a very low energy consumption, creating these very complex structures in three-dimensional space,” Buehler said.

Some of the MIT experiments involved scanning a spider web as it was being constructed, translating each stage into music so the team could study the process in audible form. “We can create a harp for each construction state, so you can begin to see how the spider harp actually changes during the construction, almost like a living musical instrument,” said Buehler. The researchers were also able to virtually study how the web’s sound changes in response to different mechanical forces, such as stretching a particular strand and increasing the tension until the strand breaks, producing a snapping sound.

The ultimate aim is to learn to create similar synthetic spiderwebs and other structures that mimic the spider’s process. “We’re interested in changing the overall paradigm of how we think about materials,” said Buehler. “A spider is able to sense the integrity of the web through the vibrations. If it’s damaged, they can repair it. They have a whole different relationship to the structure they built; they are actually a part of it.” He imagines future manmade structures, such as bridges, designed with a similar built-in repair mechanism. “You wouldn’t build something and wait for it to break, but continuously repair it,” he said. “It would become a living organism.”

Spiders use their webs to catch prey, but they also use them to collect sensory information via the vibrations of the various strand and as a means of communication, tapping the web to produce vibrational patterns. In other experiments, Buehler et al. recorded the various web vibrations as the spiders went about different activities: constructing their webs or sending courtship signals, for example. They designed a special machine-learning algorithm to distinguish between the various sounds, since the frequencies pretty much all sound alike to human ears.

“Now we’re trying to generate synthetic signals to basically speak the language of the spider,” Buehler said. “If we expose them to certain patterns of rhythms or vibrations, can we affect what they do, and can we begin to communicate with them? Those are really exciting ideas.”

Spider web sonification during construction, first premiered at Saraceno’s OnAir exhibition, Paris, 2018.

Listing image by Isabelle Su and Markus Buehler

Source: MIT scientists study spider web structure by translating it into music | Ars Technica

Ogre-faced spiders have great hearing—without ears

SmellTaste
07/05/2021

The link between our sense of smell and creativity | Quartz at Work

REUTERS/ALBERTO LOWE. Nose training. It’s taken a deadly respiratory virus to teach us to value of our sense of smell. With anosmia being a common symptom of Covid-19, more people…
EducationHealthMemoryVisual
06/05/2021

Eye movements of those with dyslexia reveal laborious and inefficient reading strategies, according to Concordia study | Concordia

Researchers find that people with the learning disorder sample visual material slower and with more difficulty Researchers have long noted that readers with dyslexia employ eye movements that are significantly…
EmotionsEntertainmentMemoryMultisensory
06/05/2021

The Sights, Sounds, and Scents of Disney; What Takes You Back? | WDW Info

It's no secret that I am missing my happy place right now. Considering this is the longest I have gone without visiting Disney in some shape or form since I started…
CommunicationSmell
06/05/2021

Fox scents are so potent they can force a building evacuation. Understanding them may save our wildlife | The conversation

Foxes, like other animals, use scent to communicate and survive. They urinate to leave their mark, depositing a complex mix of chemicals to send messages to other foxes. Research by myself and colleagues has uncovered…
HealthScientificSmell
05/05/2021

New, Easier Smell Test May Better Detect Parkinson’s at Early Stages | Parkinsons New Today

A rapid, inexpensive, and easy-to-use test can help to assess a loss of smell, and with greater accuracy than current “scratch and sniff” tests, allowing neurological disorders like Parkinson’s disease to…
EntertainmentMultisensorySmellSoundTechnologyVisual
04/05/2021

This Brand New Las Vegas Attraction Flies To Grand Canyon Without Leaving The Strip | Forbes

FlyOver in Las Vegas by Pursuit FLYOVER IN LAS VEGAS BY PURSUIT No longer will travelers have to leave the Las Vegas Strip in order to experience the natural wonders…
MarketingSmellTechnology
04/05/2021

Business Scents: The Rise of Digital Olfaction | MIT Sloan Management Review

Two emerging branches of digital olfaction technology have the potential to revolutionize a range of industries. The aroma of freshly baked bread wafting through supermarket aisles. The percolating pot of…
InterestingScientificSmell
04/05/2021

New research shows how one sniff separates trillions of molecules into smells | Massive Sci

Photo by Cristian Newman on Unsplash When we first learn about our senses, it all may seem pretty straightforward: our eyes, ears, noses, mouths, and hands are each responsible for capturing some aspect…
MultisensorySmellTouch/Feel/TextureVisual
27/04/2021

Scratch and sniff | Quartz

In 2020, high-end French fashion brand Lanvin caused a stir after releasing $590 t-shirts that smelled of cherry, blackberry, or strawberry (though, the scent reportedly vanishes after one wash). Besides children’s books…
MemoryNeuroscienceSmell
27/04/2021

Study reveals why smell memories are stronger than other sense memories | New Atlas

The neuroimaging study found our olfactory sense has a unique direct connection to the hippocampus, unlike all other senses nejron/Depositphotos New research from an international team of scientists has demonstrated…
Augmented + virtual realityEntertainmentHapticMultisensorySmellVisual
27/04/2021

PlayStation Patent Filed For Scents In Video Games | Screen Rant

Sony recently filed a patent that indicates the use of scents in upcoming PlayStation games. The use of scents in entertainment has been around since the 1960s and has intrigued movie-goers…
MemoryMultisensoryScientific
27/04/2021

Brain Rotates Sensory Information to Prevent Overwriting Short-Term Memory | Science Times

(Photo : Pixabay) Brain Rotates Sensory Information to Prevent Overwriting Short-Term Memory Memories underlie so much of the rich life of humans as it helps people learn, tell stories, and…
BrandingMultisensorySoundVisual
26/04/2021

Why sonic branding can be a lethal weapon for brands | shots

Sound is immensely powerful. It has the ability to transport you back to a certain moment in time or take you somewhere you never knew existed. It can make you…
ArtMultisensorySmellSoundTouch/Feel/TextureVisual
26/04/2021

This electric guitar is made out of 5,000 coffee beans (And it smells like coffee too) | Yanko Design

Bold, strong, intense. You could use those words to describe coffee… you could also use it to describe this electric guitar built by YouTuber and guitar aficionado, Burls Art. Designed…
MarketingNeuroscience
26/04/2021

This is how brands use neuromarketing | Explica .co

Why do we buy a certain brand of detergent or any other product? Supermarkets are full of brands that struggle to attract our attention as a consumer, a consumer saturated with…
MarketingSmell
26/04/2021

How fragrances develop customer loyalty in hotels | HOTELIER MIDDLE EAST

The smell of fresh coffee, the salty scent of a sea breeze or the aroma of freshly baked cinnamon rolls all rank among people's most favourite scents, according to scientists.…
Artificial IntelligenceAugmented + virtual reality
22/04/2021

Artificial Intelligence, Virtual Reality and the Future of Storytelling | CXO Today

The great poet, Maya Angelou once famously said, “I’ve learned that people will forget what you said, people will forget what you did, but people will never forget how you…
ArtExperientialMultisensory
22/04/2021

Is immersive art a forgery or the real thing? | blooloop

Eddie Sotto explores the concept of immersive art and discusses why it is a rising trend in the attractions industry When I get asked where the location-based entertainment or FEC industry is heading,…
ArtCommunicationInterestingMultisensorySoundVisual
21/04/2021

MIT scientists study spider web structure by translating it into music | Ars Technica

Cross-sectional images (shown in different colors) of a spider web were combined into this 3D image and translated into music. Isabelle Su and Markus Buehler We may one day be…
MarketingMultisensory
21/04/2021

Hospitality Is The Kingdom Of Sensory Marketing | Hospitality Net

Azia Resort & SPA Sensory marketing is an essential tool to increase the profitability of the international hospitality industry. To understand why, you have to look at the process through…
Augmented + virtual realityMultisensory
21/04/2021

Is There VR for Senses Other Than Sight? | Gizmodo

Illustration: Benjamin Currie/Gizmodo In an ideal world, virtual reality would be just like regular reality, except without regular reality’s annoying restrictions on human flight, teleportation, endless/consequence-free consumption, etc. As it is…
ArtMultisensoryVisual
21/04/2021

Yoga and art combine in Dubai’s newest immersive fitness class | Whats ON AE

Get ready to lose yourself in the world of digital art… In Dubai, fitness fans are treated to an abundance of unique and interesting fitness classes, especially when it comes to…
Multisensory
20/04/2021

New Army Training Doc Outlines Ways To Give Soldiers Superhuman-Like Sensory Perception | The Drive

U.S. SPECIAL OPERATIONS COMMAND—PUBLIC DOMAIN New Army Training Doc Outlines Ways To Give Soldiers Superhuman-Like Sensory Perception The Advanced Situational Awareness concept aims to give soldiers an unconscious "human edge"…
FlavourMultisensory
20/04/2021

The Absolute Best Way to Eat An Oreo, According to Science | Popular Mechanics

TREVOR RAAB The Absolute Best Way to Eat An Oreo, According to Science Calling all twisters, lickers, and dunkers: This is your moment. You could be a dunker, a twister,…
ArtInterestingMultisensoryTouch/Feel/TextureVisual
16/04/2021

Chemist shop stocked with 15,000 items made entirely from felt | Evening Standard

Gallery assistant Scarlett Taulbut behind the counter of artist Lucy Sparrow’s NHS themed felt chemist art installation / PA Wire Artist Lucy Sparrow has created the Bourdon Street Chemist in Mayfair, where…
EmotionsHealthMemorySmell
15/04/2021

“Imprinting” Certain Smells During Infancy Change Adult Behavior | Technology Networks

Imprinting is a popularly known phenomenon, wherein certain animals and birds become fixated on sights and smells they see immediately after being born. In ducklings, this can be the first…
MultisensorySmellTasteVisual
15/04/2021

New study explains why you should look at your food before casting judgment | EurekAlert! Science News

The order in which your senses interact with food has a tremendous impact on how much you like it. That's the premise of a new study led by the University…
InterestingMultisensory
13/04/2021

Finding the ‘sense’ on a monotonous Monday | Epigram.org

The Croft // Through creative exploration of the senses, we can expand our world vision and experience the present in a new and invigorating light. Emelye Goult discusses the 'Collecting…
HealthMultisensory
13/04/2021

Sensory‌ ‌Defensiveness‌ ‌in‌ ‌Autism‌ | Autism Parenting Magazine

Imagine you walk into a dodgy diner…the sulphurous smell of onions hits you as you open the door, you start sweating because there is no air conditioning, and the more…
MemorySmell
12/04/2021

Smells form stronger connection to your memories | Big Think

Credit: myboys.me / Adobe Stock Smells connect to memories more than other senses "The smell of fresh chopped parsley may evoke a grandmother's cooking, or a whiff of a cigar may…
Close Menu

Random sensory quotes

Everybody has a right to like or dislike anything or anyone. From a flower to a flavor to a book or a composition but it is very sad that in our country we actually fight over such things in an unseemly manner.

— Ravi Shankar