đźš§ This website is currently under construction. Some information may be incomplete. Please refer to my LinkedIn for up-to-date details.
YJ.
Magic Table
2017 University of Michigan

Magic Table

Research & Interaction Design

Magic Table is aiming for creating an easy-to-use prototype platform for tabletop interaction. It can sense multiple touch inputs as well as fiducial markers for object tracking. The user can also use speech command to interact with it.

Multi-touch Table Computer Vision OpenFrameworks Projection Mapping

Interact with the digital world using everyday objects

Magic Table is aiming for creating an easy-to-use prototype platform for tabletop interaction. It can sense multiple touch inputs as well as fiducial markers for object tracking. The user can also use speech command to interact with it. The method I chose here is called Diffused Surface Illumination (DSI). It puts the infrared(IR) LED strip on the side of the acrylic to illuminate the whole surface; therefore, the IR camera underneath can see the surface clearly without being affect by the projection on the surface.

Applications using Magic Table

Material and Equipments

The material and equipments I used for the table contains:

All of the wood boards are just for making the structure of the table, it can be replaced with any other material. ACRYLITE LED acrylic sheet lets the IR LED’s light diffused nicely across the whole surface. ACRYLITE Satinice acrylic sheet is a frosted surface for projection, it can be replaced with any similar material. Kinect in this project is just serving as an IR camera, and it would be a lot easier if just using a normal IR camera than Kinect. ST200 is a short throw pico projector, it can project a 30” screen size (diagonal) in around 30” distance. If the projector has smaller throw rate, you can use a mirror to increase the projector distance without increases the table size, which I did after I replace the projector to P700. The ST200 has only 150 lumens, so the projection is pretty dim and requires a dark room to see the projection clearly. P700 does not have the problem.

ST200 (150 lumens) in bright environment
ST200 (150 lumens) in dark environment

Testing IR edge lit and projection

We use Kinect as an IR camera here. Kinect itself has an IR LED array that projects IR point clouds, which will interfere with the nicely diffused IR light comes out from the IR LED strips, so we need to block that LED array. The image bellow shows the Kinect with LED array blocked, and the Kinect’s views with LED blocked and unblocked.

Blocks the Kinect IR array to get a nicely diffused IR light surface.
When the IR array is unblocked, the result has a lot of noise points and a huge blobs in the center.
When the IR array is blocked. It shows a nicely distributed light surface.

The video below shows what the IR Camera sees

Making of the Table

Models the table using SolidWorks

CNC Routes the sides

Assembling

Laser Cuts the cover

Tracking Fingers and Objects

All of the code can be found on Github. I use openFrameworks with some other add-ons, including ofxFiducialTracker. The video shows the tracking result. For the fiducial tracker, the program can get the marker size and the orientation information as well.