[ame="http://www.youtube.com/watch?v=R8tiHXDiqsw&feature=player_detailpage"]YouTube - Augmented Reality 3d Video on iPad with Kinect[/ame]
Engadget has a really cool video today from LAAN Labs, which shows them using a Microsoft Kinect device, an iPad, and the String Augmented Reality SDK to turn 3D data into an augmented reality image that can be played on the iPad. As it shows in the video, the team used Libfreenect from Open Kinect to record the data from the Kinect. LAAN Labs explained on their blog how they created a textured mesh from the calibrated depth+rgb data for every frame and played it back in real time. A depth cutoff enabled them to isolate the person that was filmed for the video from the walls and any other objects. They then used the String SDK to project the video back onto a printed image marker in the real world, and they also experimented with removing the image marker from the picture with camera data from the area around the marker. Check it out!
Source: Kinect / iPad hack should help you get Obi-Wan's attention (video) -- Engadget, 3d Video from Kinect on the iPad | the labs @ laan