Version 3 of the AR HMD is now equipped with two integrated USB2 auto focus cameras with a maximum resolution of 1280x1024.
The software system is based on COVISE and AR-Toolkit or ALVAR. OpenCV is used to capture two sets of video streams for the left and right eye. It further recognizes different markers and computes its relative position compared to the cameras. Virtual objects which have been visualized using COVISE can then be displayed on top of the video image at the correct position relative to the marker and with the correct perspective.
Our test case is a white cardboard box. On the left picture you can see the box with a marker. The right picture is the same box as seen through the HMD a virtual blue box, a creature (floops) and a red and a green sphere are added to the scene. The spheres are partially occluded by the real box.