Augmented Reality

In augmented reality (AR) virtual content is superimposed on locations or products in the real world. This approach enables the development of hybrid prototypes and experiments that integrate both visible and ordinarily invisible features of physical environments simultaneously.

Augmented reality view of city with smiley faces indicating urban emotions.

Augmented reality tools

HLRS has expertise in realizing AR applications and tangible user interfaces using the visualization software COVISE. AR functionality is provided by a plugin interface that can be customized based on the user's needs and interests.

COVISE supports the optical infrared tracking systems DTrack by A.R.T., VICON MX, and the marker-based tracking system ARToolKit. Furthermore, it supports the electromagnetic tracking systems Flock of Birds and MotionStar, as well as the mechanical tracking system FaroArm. 

Increased availability of commodity AR headsets means that we now also support AR Headsets such as the Microsoft Hololens and HTC Vive Pro.

Head-mounted display

Version 1

The hardware consists of an HMD, a stereo version of the Daeyang Cy-Visor and two pairs of PAL color cameras mounted on top of the HMD. It is connected to a Pentium IV PC with two video capture cards and a GeForce 4 Ti Graphics card running RedHat Linux.

Version 2

Version 2 of the AR HMD is now equipped with two PointGrey DragonFly Firewire cameras with 1024x768 resolution and CS-Mount lenses. The computer was upgraded to a 3GHz Xeon system also running RedHat Linux.

Version 3

Version 3 of the AR HMD is now equipped with two integrated USB2 auto focus cameras with a maximum resolution of 1280x1024.

Augmented reality software system

The software system is based on COVISE and AR-Toolkit or ALVAR. OpenCV is used to capture two sets of video streams for the left and right eye. It further recognizes markers and computes their relative position compared to the cameras. Virtual objects that have been visualized using COVISE can then be displayed on top of the video image at the correct position relative to the marker and with the correct perspective.