Re-implementation of Projector Calibration with Embedded Light Sensors

February 26, 2009

Using projectors as light sources we can transform the surface properties of arbitrarily complex objects. The color of a surface is normally defined by the amount of light reflected/absorbed by the particular pigment/material of the object. In spatial augmented reality we lift the properties of the surface into the light source. I.e. instead of illuminating a red object with white light, we can illuminate a white object with red light.

We are in the process of developing a toolkit for the development of projection mapping/spatial augmented reality applications. Our focus is on projection mapping for theater and new media installation pieces using tracking with embedded light sensors.

Currently, we are researching human computer interaction issues with spatial augmented content authoring. We are focusing on improving the content pipeline (which is largely non-existent). Traditional video editing and computer graphics workflows are not designed for animated texturing and easily matching physical and digital models.

In this video we are calibrating a digital model of the box to the physical box using embedded light sensors. We re-implemented projector calibration with embedded light sensors by Johnny Chung Lee. Essentially, the projector displays a pattern which photosensors embedded into the box recieve and decode. With this information, we can determine the positions of the sensors in the projectors frame of reference. With enough sensors (at least six) we can determine the parameters of the projector (the lens etc.) along with the rotation and orientation of the box. Then using a game engine, we render a 3D model of the box from the projectors frame of reference. Finally, applying an animated texture to the 3D model of the box, yeilds the demonstration above. This technique is explained extensively by Johnny Chung Lee.



  1. After exploring a few of the articles on your web page, I seriously like your technique of blogging.

    I book-marked it to my bookmark webpage list and
    will be checking back in the near future. Please visit my web site too and tell me how
    you feel.

  2. […] in Energy saving helps lower Energy costs. LAN Exhibit Bargains a cost-effective resolution for projector implementation administration the use of a single LAN cable to Control and Show. This Selection additionally […]

  3. I’ve been exploring for a little bit for any high
    quality articles or blog posts in this kind of space .
    Exploring in Yahoo I finally stumbled upon this web site. Studying this information So i’m glad to show that I have an incredibly good uncanny feeling
    I came upon exactly what I needed. I most undoubtedly will make certain to don?t forget this web site and give it a look regularly.

  4. With havin so much content do you ever run into any problems of plagorism or copyright violation?
    My website has a lot of unique content I’ve either authored myself or outsourced but it seems a lot of it is popping it up all over the web without my permission. Do you know any ways to help reduce content from being stolen? I’d
    really appreciate it.

  5. I have been following this for years as well. As a visual artist, I know that this would take my works to a whole new level. I understand the process, but would certainly love to get access to the software that’s running this. If this does ever come to a beta testing stage, or released to the public, I would love to help test, or help to bring this to the public.

  6. I believe that avoiding ready-made foods is a first step to
    lose weight. They could taste very good, but processed foods include very little nutritional value,
    making you consume more simply to have enough vitality to get throughout
    the day. For anyone who is constantly feeding on these foods,
    transitioning to cereals and other complex carbohydrates will aid you to
    have more power while having less. Thanks alot : ) for your blog post.

    • What does this have to do with projectors and embedded light sensors? Weird bit of spam…….

  7. I absolutely love the potential of the project! How accessible is the framework for inputs of other type of positional data? ie motion controlled physical objects and inherently know spacial coodinates…

    Great Work!


  8. I would certainly like to know more about it. Have been following Johnny’s work for a couple of years now, and just haven’t had the gumption to ask more about it. I am pretty interested in not only the board for the sensors, but the software that is running it. Please keep us up to date IF this goes public, or if there is a place to take a look at how to build the board, and integrate the software. Is definitely something that is much needed, especially in places that I have to do events. Keep up the great work!!!!!

  9. […] Link to blog […]

  10. Sorry for this but I took the liberty of translating part of your introduction for this proyect to Spanish. The article is here: http://pinkpunkpop.wordpress.com/2009/03/06/toolkit-de-rvproyeccion-regulada-espacialmente-trabajo-en-proceso/
    … and of course if you have any problems with this fact, just tell me and I will take it away immediately.
    Congrats! it’s such an interesting work 🙂

  11. i would love it if someone could keep me posted/updated when this IS available for public, or beta testing 🙂

  12. Very cool demo. This might be a silly question, but would it be possible to calibrate the shapes with a camera close to the projector instead of embedded light sensors?

  13. […] Spatially Augmented Reality Toolkit (Work in progress videos) Projection Mapping Demo […]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s

%d bloggers like this: