This week, we launched our third pilot in a series of immersive audio trials on 大象传媒 Taster. Monster is an audio drama produced in collaboration with 大象传媒 Writersroom, Wales. Designed to be experienced in the dark, Monster is a powerful tale of loss and guilt in the horror genre, telling the chilling tale of a mother and daughter caught in the midst of a frightening paranormal event. With Hallowe'en looking different this year and everyone staying home more this winter, we hope our audiences find Monster is a great way to spend an evening.
Monster follows on from 1927's Decameron Nights and Pick A Part with the 大象传媒 Philharmonic, using our audio device orchestration technology. Unlike many immersive audio dramas, no headphones are required for this experience. Instead, elements of the audio scene are dispersed physically around the listener's space, making use of the everyday devices they already own鈥攖urning phones, tablets and laptops into connected loudspeakers. To unlock the 30-minute experience, listeners are required to connect at least two devices and are given instructions on where to position them. The experience adapts to the number of available devices and tailors the audio routing to suit the listener's particular configuration. Although it works with at least two devices (which should ideally be positioned to the side of and behind the listener), the more devices connected, the more immersive the experience will be.
Developing the story
Monster was written by , an award-winning Welsh playwright transferring his talents in writing for theatre to his first commission for the 大象传媒. Brad worked closely with development producer Helen Perry from 大象传媒 Writersroom, refining the script and finding the right voice actors to bring it to life.
During the scriptwriting, the 大象传媒 Research & Development team and the production team in Cardiff collaborated closely. We had many calls as well as a (pre-lockdown) day in Cardiff workshopping ideas, trying to work out how the available technology could best support the story, and how to write a story that made most use of the technology.
In early 2020, the plan was for this piece to be an in situ installation in the new 大象传媒 Cardiff Central Square building. Small groups of visitors would book time slots and experience the drama in a space where we had very careful control of all elements - including loudspeaker positioning and the look and feel of the space. We were in the process of designing how we would use participants' own devices in the orchestrated experience when the UK was plunged into lockdown. We realised quickly that the installation wasn't going to be possible, and decided to pivot to online delivery. This presented an interesting new challenge: could we use our technology to bring an immersive experience that normally would exist in a specific location, into someone's living room?
Of course, this also made the production process challenging, as we had to adapt to making complex creative decisions whilst working remotely. We were no longer able to get together around a whiteboard to work things out.
Brad Birch writes:
"Horror is a whole-body experience. It is the perfect genre for pushing the boundaries of what is possible in an audio experience. Thanks to this brilliant technology, the audience exists alongside the characters within the story. So when the world turns upside down for the characters, it happens for the audience too.
As a scriptwriter, it's a rare experience to be learning the technical capabilities of a medium while writing for it. I knew I had to be adaptable. I had to be prepared to be told that some things wouldn't be possible and have to scale back. But in actual fact, I found that the majority of the conversations were about pushing further, adding more, testing limits. I think we're at a really exciting moment for audio drama. There were things that were possible but we decided against using on this project, so I look forward to whatever comes out next."
Audio production and sound design
Experienced sound designer and technical producer Catherine Robinson was another integral part of the production team. The Audio Team have worked with Cathy on several immersive audio productions, and she was involved in the hack week where we first investigated the audio device orchestration concept, so she was ideally placed to bring her creative vision to the sound design for Monster. With production taking place while social distancing measures were in effect, Cathy employed a series of remote recording sessions with the voice actors and produced the audio with a similar workflow to her usual radio drama projects.
Taking an object-based approach, Cathy exported the individual audio stems from her digital audio workstation and imported them into our Audio Orchestrator production tool, setting up behaviours for the individual audio objects that determine which device(s) they are routed to.
Cathy talked about Monster in her presentation at the recent Sounds Amazing conference.
Building the experience
As mentioned above, Cathy used Audio Orchestrator to build the core experience for Monster. The next step was for Audio Team developers Kristian Hentschel and Danial Haddadi to add extra features to enhance the specific experience. Changes included:
- timed images (which were extended from those used in Decameron Nights) augmented by customisable lighting effects;
- a new process for listeners to connect devices in, with the story progressing when the minimum number of devices were added; and
- changes in the look and feel of the experience, like the ability to go fullscreen for a more immersive experience.
One notable difference between Monster and our previous trials - including The Vostok-K Incident back in 2018 - is that this is the first time we've required extra devices to be connected before continuing to access the stories. Previous productions were designed to work in stereo that could be augmented by adding extra devices, whereas for Monster we considered the extra devices to be integral to the experience.
That was taken into account throughout the creative process - in the writing, design, production, and delivery. We're interested to learn more about the trade-offs here - we expect that the increased barrier to entry might reduce the number of listeners, but those who do connect will get a more complete immersive experience. We hope that Monster is an experience where people can take some time out to fully engage - turn down the lights, connect up some devices, and prepare to be spooked.
What's next?
It's been a really busy summer and autumn for us with the release of Audio Orchestrator followed by three trial productions in quick succession. So we need to take a step back to evaluate the tool and the technology. We'd like to learn from Audio Orchestrator users about how they found it, what other features they'd like, and what kind of productions they'd like to make with it. This will help to inform the direction that we take the tool in.
Part of this will include engaging with the community of users through the . For the pilots, we'll have a look at the feedback we get from the 大象传媒 Taster questionnaire, as well as designing more detailed experiments. We're particularly interested in looking at how audio orchestration can allow listeners to fulfil some of the core human values that have been empirically determined in other R&D work.
- - Share on Facebook
- 大象传媒 MakerBox - Audio Orchestrator
- 大象传媒 R&D - Vostok K Incident - Immersive Spatial Sound Using Personal Audio Devices
- 大象传媒 R&D - Vostok-K Incident: Immersive Audio Drama on Personal Devices
- 大象传媒 R&D - Evaluation of an immersive audio experience
- 大象传媒 R&D - Exploring audio device orchestration with audio professionals
- 大象传媒 R&D - Framework for web delivery of immersive audio experiences using device orchestration
- 大象传媒 R&D - The Mermaid's Tears
-
Immersive and Interactive Content section
IIC section is a group of around 25 researchers, investigating ways of capturing and creating new kinds of audio-visual content, with a particular focus on immersion and interactivity.