Intelligent Performance Space
The general notion here is to augment the interactions of a performance space, such as but not limited to a concert hall, with live performers. The performance space, in a sense, will become an extension of the computer and new ways to interface to it will be required.

Gesture Tracking and Analysis
Develop and improve techniques for tracking human motion, analyzing it, and translating the motion into computer responses. This includes using both large area sensors, such as UbiSense, and precision sensors such as MotionStar and Motes. The analysis includes both positional analysis, gesture recognition, and environment sensing.

Real-time Control of Audio, Video, Lighting, and Scenery
The analyzed motions can be used to control aspects of staging or performance, from lighting to audio-processing and spatialization, and many other things. This includes designing innovative interfaces that will enable non-technical users to exercise control over the processes. The video aspect will contain a sub-project in global lighting control running in a real-time performing environment.