G. Cooper Jones performs with his new gestural interaction system, LeapMax, which utilizes the Leap Motion controller and Max MSP to extract complex and accurate skeletal hand tracking data from a performer in a global 3-D context.
The goal of this project was to develop a simple and efficient architecture for designing dynamic and compelling digital gestural interfaces. At the core of this project is a Max MSP external object for extracting data from the Leap Motion service. From that data, a library for extracting more complex gesture and posture information was generated and refined.
To demonstrate the use of this system in a performance context, an experimental musical instrument was designed in which the Leap is combined with an absolute orientation sensor and mounted on the head of a performer.