After seeing Johnny Chung Lee’s wildly popular Wii head tracking video we were highly motivated to add this technology to our iRT ray tracer so colleague Joaquin Madruga quickly coded this function and we hit the road for GDC 2008.

Left to Right, Joaquin Madruga (IBM), Johnny Chung Lee (CM), Barry Minor (IBM) 

At the show we demonstrated two infrared (IR) LED tracked displays. The first was a target scene, similar to Johnny’s, that we created in 3dsMax and the second was a 7 million triangle China town scene created in Maya by our partners at Threshold Studios (Thanks Threshold!!). The target scene was easily ray traced on a single Linux Playstation3 but the China town scene required some real horsepower so we deployed six QS21 Cell blades and rendered it remotely using a GigE connected blade center.

Head tracking produces a very unique virtual window effect where the monitor appears to be a portal into a virtual world. The user wears a pair of IR LED equipped safety glasses which are tracked using an IR camera attached to the Playstation3. As the user moves, the view relative to the screen is computed and ray traced in real-time producing a strong motion parallax 3D effect. The next step for this technology will be passive head tracking using face tracking technology like that demonstrated by Richard Marks in the Sony booth at GDC 2008. What we need now is a passively head tracked 150” plasma with ray traced visuals at 120 frames/sec!!

iRT Head Tracking Video (YouTube)

iRT Head Tracking Video (Quicktime 28MB)