Most virtual reality audio is a combination of created atmospheres, in-scene sounds, dialogue, and computer-generated music. But the 大象传媒 VR Hub鈥檚 Nothing to be Written, like before it, takes sound as the basis of its conception.
and 大象传媒 Research & Development created the magical visual world of The Turning Forest out of the S3A project鈥檚 specially-written spatial audio drama. And in Nothing to be Written, have crafted a moving montage of First World War imagery, to accompany new music by . Commissioned by the 大象传媒 Proms, , and , Meredith鈥檚 piece, Five Telegrams, is written for orchestra, choir, and several offstage instrumental ensembles. The immersive VR experience takes the second movement, Field Postcards, as its basis, setting to music the chillingly generic messages available to troops to send home from the battlefield; the choir opens the piece with the words 鈥淚 am quite well鈥.
- Or experience it at one of the 大象传媒 orchestras鈥 Armistice Day events:
- St David鈥檚 Hall, Cardiff
- Barbican Centre, London
- Or at libraries around the country this weekend:
- Sailsbury, Chorley, Oldham, Taunton, Ripon, Plympton, and Oxford.
The cutting-edge spatial soundtrack for Nothing to be Written was recorded live at the 2018 Proms performances. For each Proms season, over one hundred microphones are rigged at the Royal Albert Hall in London to create 大象传媒 Radio 3鈥檚 stereo mixes and 大象传媒 Television鈥檚 surround sound mixes. For Five Telegrams, further mixes were created for live PA reproduction at the Proms Curtain Raiser event, and for an immersive installation in Edinburgh. But the aesthetics of a VR soundtrack are very different from a broadcast mix or an ambient installation, so Field Postcards needed careful remixing to transform the live recording, made in a traditional classical concert setting, into a musical experience that fully surrounds the listener.
大象传媒 Research & Development engineers used the Reaper digital audio workstation and audio plug-ins from Blue Ripple Sound to pan the microphones in three dimensions, and to produce a 鈥榯hird-order ambisonics鈥 mix - a high quality spatial audio format suited to VR production. This encapsulates the entire spherical 鈥榮oundfield鈥 in 16 channels of audio, which was imported into the Unity game engine using Blue Ripple Sound鈥檚 Rapture3D audio SDK. The project served as a useful opportunity to evaluate a growing number of ambisonics panning, rendering and reverberation plug-ins for use in future VR productions.
The immersive soundscape changes and responds instantly to your movements in VR. This tracked audio experience means that as you look around the VR environment, the audio will render in real-time in order for sound sources to appear static within the scene, despite constant re-orientation by the viewer. Although the music is not anchored to any visual element in Nothing to be Written, the dynamic audio experience really heightens the musical emotion and the visual narrative of the work.
Similar technology from 大象传媒 Research & Development was used this summer to help the Radio 3 sound engineers create binaural sound mixes of some other 大象传媒 Proms concerts. This is an immersive audio experience, without the tracked VR experience, but which you can listen to on normal headphones, and sounds much like being at the hall in person.
Sound is such an enriching and inspirational element of virtual reality, we鈥檙e already on the look-out for our next audio-led VR production.
- -
- 大象传媒 R&D - An Introduction to 大象传媒 Reality Labs
- 大象传媒 R&D - Virtual Reality Sound in The Turning Forest
- from day
- 大象传媒 R&D - 360 Video & Virtual Reality
- More on Virtual Reality and 360 Video from the 大象传媒 Academy including:
- The making of 'Damming the Nile' in 360
- Factual storytelling in virtual reality
-
Immersive and Interactive Content section
IIC section is a group of around 25 researchers, investigating ways of capturing and creating new kinds of audio-visual content, with a particular focus on immersion and interactivity.