Seeing sounds

March 27, 2026 - 03:45

A groundbreaking project at the intersection of art and technology is giving sound a new visual dimension. Carlos Mariano Salcedo, a graduate student in the MIT Music Technology and Computation program, is pioneering the development of artificial intelligence systems designed to visualize music and auditory experiences.

Moving beyond traditional waveforms or simple frequency graphs, Salcedo's work focuses on creating rich, dynamic, and aesthetically compelling visual representations. His AI interprets the complex layers of a musical piece—its melody, harmony, rhythm, and timbre—and generates corresponding visual art in real time. This process could translate the soaring crescendo of an orchestra into a burst of color and shape or map the intricate rhythm of a drum pattern onto a evolving digital tapestry.

The implications of this technology are vast, offering new tools for artists, educators, and the entertainment industry. It promises to create immersive multimedia performances and provides a novel way to analyze and understand the structure of sound. For individuals who are deaf or hard of hearing, it could open up a profound new method for experiencing music through sight. Salcedo's research highlights the expanding role of AI as a creative partner, pushing the boundaries of how we perceive and interact with the art that surrounds us.