Sonic Apparitions is an interactive experience for cinema in which the audience’s physiological signals “contaminate” a film by influencing a generative score, thereby augmenting the mood of the film in real time. Inevitably, this process creates a unique sensorial feedback loop between the audience and the fılm’s evolving soundscape.
The project is based on a generative audio system that uses physiological signals from the audience in tandem with sounds sampled from the film itself. The changing bodily states of the audience essentially determine the fılm’s score, and the resulting output is played back on a multi-output sound system, creating an impactful real-time reflection of the audience’s perception of the film. We capture the audience’s physiological signals using individual on-skin sensors, which in turn influence various parameters inside of the system.
Using data collected from the audience, our generative score system transforms the raw audio sampled from the documentary into an unexpectedly haunting score, resulting in the amplification of the sensorial relation between narrative content and film format.
