大象传媒

Nothing to be Written: WW1 in an Immersive VR Soundscape

Creating a VR soundtrack from a traditional classical concert recording, into a musical experience that fully surrounds the listener.

Published: 8 November 2018
  • Tom Parnell BMus (Hons)

    Tom Parnell BMus (Hons)

    Technical Producer
  • Jack Reynolds

    Jack Reynolds

    R&D Development Producer

Most virtual reality audio is a combination of created atmospheres, in-scene sounds, dialogue, and computer-generated music. But the 大象传媒 VR Hub鈥檚 Nothing to be Written, like before it, takes sound as the basis of its conception.

and 大象传媒 Research & Development created the magical visual world of The Turning Forest out of the S3A project鈥檚 specially-written spatial audio drama. And in Nothing to be Written, have crafted a moving montage of First World War imagery, to accompany new music by . Commissioned by the 大象传媒 Proms, , and , Meredith鈥檚 piece, Five Telegrams, is written for orchestra, choir, and several offstage instrumental ensembles. The immersive VR experience takes the second movement, Field Postcards, as its basis, setting to music the chillingly generic messages available to troops to send home from the battlefield; the choir opens the piece with the words 鈥淚 am quite well鈥.

The cutting-edge spatial soundtrack for Nothing to be Written was recorded live at the 2018 Proms performances. For each Proms season, over one hundred microphones are rigged at the Royal Albert Hall in London to create 大象传媒 Radio 3鈥檚 stereo mixes and 大象传媒 Television鈥檚 surround sound mixes. For Five Telegrams, further mixes were created for live PA reproduction at the Proms Curtain Raiser event, and for an immersive installation in Edinburgh. But the aesthetics of a VR soundtrack are very different from a broadcast mix or an ambient installation, so Field Postcards needed careful remixing to transform the live recording, made in a traditional classical concert setting, into a musical experience that fully surrounds the listener.

Anna Meredith: Five Telegrams - Sender & Receiver

大象传媒 Research & Development engineers used the Reaper digital audio workstation and audio plug-ins from Blue Ripple Sound to pan the microphones in three dimensions, and to produce a 鈥榯hird-order ambisonics鈥 mix - a high quality spatial audio format suited to VR production. This encapsulates the entire spherical 鈥榮oundfield鈥 in 16 channels of audio, which was imported into the Unity game engine using Blue Ripple Sound鈥檚 Rapture3D audio SDK. The project served as a useful opportunity to evaluate a growing number of ambisonics panning, rendering and reverberation plug-ins for use in future VR productions.

The immersive soundscape changes and responds instantly to your movements in VR. This tracked audio experience means that as you look around the VR environment, the audio will render in real-time in order for sound sources to appear static within the scene, despite constant re-orientation by the viewer. Although the music is not anchored to any visual element in Nothing to be Written, the dynamic audio experience really heightens the musical emotion and the visual narrative of the work.

Similar technology from 大象传媒 Research & Development was used this summer to help the Radio 3 sound engineers create binaural sound mixes of some other 大象传媒 Proms concerts. This is an immersive audio experience, without the tracked VR experience, but which you can listen to on normal headphones, and sounds much like being at the hall in person.

Sound is such an enriching and inspirational element of virtual reality, we鈥檙e already on the look-out for our next audio-led VR production.

  • Immersive and Interactive Content section

    IIC section is a group of around 25 researchers, investigating ways of capturing and creating new kinds of audio-visual content, with a particular focus on immersion and interactivity.

Rebuild Page

The page will automatically reload. You may need to reload again if the build takes longer than expected.

Useful links

Theme toggler

Select a theme and theme mode and click "Load theme" to load in your theme combination.

Theme:
Theme Mode: