TOP >  WORKS > RESONANT INSCAPES

An audiovisual system to enjoy music visually through scenes evoked by sound.

RESONANT INSCAPES

Music evokes blurry images that trigger fragments of memories and scenes from the past. This project transforms that synesthetic experience between music and memory into visuals with AI.

By extracting sound features, the system infers scenes where these sounds could exist as part of an environment, then generates visual representations in real time using AI.

An experimental project ensuring accessibility for the Deaf at live music events, RESONANT INSCAPES began with conversations with Deaf individuals about sound.

One of them shared his personal way of perceiving music — such as hearing a piano note as the sound of water from a faucet.

Resonating with his sensations of layering music with visual memories, I began researching ways to visualize them.

 

 

Credit

Creative Director: Tomoya Morohoshi (Dentsu Lab Tokyo) | Creative Technologist: Dai Takanashi (Dentsu Lab Tokyo) | Designer: Naoki Iwata