Archive for the ‘Research’ Category


IllumiRoom: Peripheral Projected Illusions for Interactive Experiences

January 15, 2013

Hi Internet,

Here is a more ‘researchy’ projection mapping project done by myself, Brett Jones (1/2 of Augmented Engineering).

This proof-of-concept prototype uses a lot of the ideas that we’ve seen in projection mapping. However, it dynamically adapts to the appearance and geometry of the room (captured by Kinect). While the video has a “Hollywood” touch, it shows the actual real-time prototype (no special effects added in post-production).

I can’t go into details yet (more to come at CHI in April).

Here is the official article.


High Performance Touch

September 25, 2012

This one is near and dear to us. If you ask anyone who has ever projected on moving objects, one of the biggest problems is latency. For example, if you project on a moving person, you will see a very noticeable and distracting lag. This problem isn’t just limited to projection, but it’s in many of our everyday electronics, including our mobile phones, cameras and even our beefy desk top computers (ask any experienced gamer if they notice when their weapons are slow to respond to mouse clicks in a first person shooter).

Researchers over in applied sciences at Microsoft used a low latency projector and a series of infrared sensors to simulate highly responsive touch input. If you look carefully, they are actually projecting over head instead of behind the touch screen. The results shown in the video are pretty awesome. I can’t help but imagine a projected digital tattoo that wont go away no matter how fast your move your arm. Look out for more details at the upcoming 2012 UIST conference in October.


Kinect + Data Visualization = Cool

June 8, 2012


May 18, 2012

Magnetic Levitation for Interaction (from MIT)


LightGuide: Using On-Body Projection to Guide 3D Movement

May 6, 2012

This is some fun work out of Microsoft Research that looks at using projection on your body to guide your movement in 3D space. If you want to figure out how to play sports, an instrument, exercise, or anything else that requires movement, they show that projecting visual hints directly on your body can help! They use a single overhead projector and Kinect to project hints on your hand. Their results show that when users tried their hints, they performed movements more accurately than by just using video.


Update on the Wedge Display @ MSR

February 28, 2012

Steven Bathiche presents a cool update on the wedge display. The wedge display can simultaneously display content and capture camera images of items in front of the display. This really cool technology enables interaction in the air in front of displays.

This is a similar concept to the Bidi screen.


Kinect Fusion

January 19, 2012

An awesome project from the Microsoft Cambridge group looking at creating nice high resolution models of a user’s environment by simply waving the Kinect around the scene.