Talk about augmenting reality – take a look at this proof of concept video showcasing Microsoft’s IllumiRoom.
IllumiRoom is a wide-angle projector that’s (ideally) situated on your coffee table, pointed at your big-screen TV. The current prototype has a Kinect strapped to the projector, but the final version will have a Kinect sensor built in. The built-in Kinect uses an automatic calibration process to captures the color and geometry (shape, depth) of the wall behind and furniture around your TV. Then you hook the IllumiRoom up to your next-generation Xbox (wirelessly), and watch in awe as peripheral projection takes you to new levels of game immersion. – ExtremeTech