BEETHOVEN – 5TH SYMPHONY

8′ 3D VR experience with generative graphic
Insula Orchestra / ARTE

Conductor : Laurence Equilbey
VFX supervisor : Benjamin Petit / LTBL
Video post-production : Alexandre Regeffe / RSHIFT
Spatial audio mix : Thomas Dappelo

Screenshot from the final video. The animations are mixed live with the 3D VR filmed image. 

A musical and technological journey

As part of the celebrations for the 250th anniversary of Beethoven’s birth, we wanted to think, with Insula Orchestra and its conductor Laurence Equilbey, about an immersive journey around the 5th symphony.
Quite immediately, I was very interested by research around the graphic scores of the first part of the 20th century, in particular that of Oskar Fischinger, Haubenstock and Boris Bilinsky.
For me, this is about « leaving the hand » to the computer code to create synthetic images. Once developed, we fed our specially built software with a set of data related to the original score. And then, go beyond the limited fields of sound and image alone, to generate a new immersive score.

Merging filmed images and digital animations perfectly synchronised with the music, the experience immerses us in the heart of this new score reacting to the slightest variation in the orchestra, building a dramatic dimension of the work.

A musical and technological journey

As part of the celebrations for the 250th anniversary of Beethoven’s birth, we wanted to think, with Insula Orchestra and its conductor Laurence Equilbey, about an immersive journey around the 5th symphony.
Quite immediately, I was very interested by research around the graphic scores of the first part of the 20th century, in particular that of Oskar Fischinger, Haubenstock and Boris Bilinsky.
For me, this is about « leaving the hand » to the computer code to create synthetic images. Once developed, we fed our specially built software with a set of data related to the original score. And then, go beyond the limited fields of sound and image alone, to generate a new immersive score.

Merging filmed images and digital animations perfectly synchronised with the music, the experience immerses us in the heart of this new score reacting to the slightest variation in the orchestra, building a dramatic dimension of the work.

Unity based development. Preliminary build of the virtual auditorium before mapping of the real image.

Unity based development. Virtual world integration.

Unity graphic generator. Development of a generative graphics engine.

Depth-maps integration. Development of an assimilation workflow of data filmed.