XR Stage for WILL.I.AM's Studio

Build a live system to shoot music videos that tracks the performer and the camera operator and generates real-time, music-synced visuals across a multi-screen XR stage.

Built in TouchDesigner and evolved over three iterations: a Kinect face-tracking prototype; a version built with three walls and a ceiling and Vive-joystick camera tracking; and the LA finale — a multi-screen stage with a floor screen and a high-accuracy MoSys tracker for a cameraman, Orbbec tracking for an artist, filmed on RED cameras.

Live show with GUNNA with audio-reactive and interactive effects.