´óÏó´«Ã½

« Previous | Main | Next »

The ´óÏó´«Ã½ Philharmonic Maestro

Post categories: ,Ìý,Ìý,Ìý

Anthony Churnside Anthony Churnside | 12:12 UK time, Monday, 16 April 2012

We are very excited to find out that The ´óÏó´«Ã½ Philharmonic Maestro has been nominated for a and a award.

The ´óÏó´«Ã½ Philharmonic Maestro is an interactive virtual orchestra that allows a user to step up to the conductor's podium. Using intuitive and natural gestures, the user can conduct a performance of the ´óÏó´«Ã½ Philharmonic Orchestra as if they were a real conductor.

The user's view of the ´óÏó´«Ã½ Philharmonic

The user's view of the ´óÏó´«Ã½ Philharmonic

WeÌýcaptured a performance of the William Tell Overture using a 3D audio technology called ambisonics and high resolution video. A 4K video was captured with the camera positioned where the conductor would normally stand. The camera was equiped with a very wide angle lens so we could capture the conductor'sÌýwhole field of view. This gave the conductor an unusual challenge because he had to conduct around our rig.

Conducting around our recording equipment

Conducting around our recording equipment

The interface uses a Microsoft Kinect to track the positions of the user's left and right arms with skeletal tracking. Microsoft have released an SDK which allows anyone to work with their skeletal tracking algorithms which is available . The positions of the left and right arms are then converted into a beats per minute tempo (based on their lateral movement) and a left hand and right hand volume (based in the height of each hand).

Depth image and control data from the Kinect

Depth image and control data from the Kinect

An application was then built to control the audio and video playback. The application recieved the control data (tempo and volumes) from the Kinect and played back the recording of the orchestra's performance, altering the tempo and volume while keeping the audio and video in sync and maintaining the correct pitch.

The ´óÏó´«Ã½ Philharmonic Maestro was created with the help of ÌýandÌýitÌýhas been presented at two international conferences ( and ) and has been featured at two international arts festivals ( and ), not to mention the Webby and Design Week award nominations.

Getting the chance to conduct the ´óÏó´«Ã½ Philharmonic

Getting the chance to conduct the ´óÏó´«Ã½ Philharmonic

We're up against some pretty touch competition for the Webby, but if you like the idea of the Maestro you are able to vote for itÌý.

Comments

Be the first to comment

More from this blog...

´óÏó´«Ã½ iD

´óÏó´«Ã½ navigation

´óÏó´«Ã½ © 2014 The ´óÏó´«Ã½ is not responsible for the content of external sites. Read more.

This page is best viewed in an up-to-date web browser with style sheets (CSS) enabled. While you will be able to view the content of this page in your current browser, you will not be able to get the full visual experience. Please consider upgrading your browser software or enabling style sheets (CSS) if you are able to do so.