Reactions. reimagines mixed reality in space. Using depth sensors and projection mapping, Reactions. explores the way physical surfaces react to our touch. A floating canvas is hanged from the ceiling. From above, a Kinect sensor is detecting the user’s touch of the surface. A rear projection of a grid lets the participants interact with the physical surface by creating ripples and making music.
The research and development for this project involved different methods for tracking movement such as computer vision and RGB cameras, depth cameras and IR cameras.