handheld augmented reality

Augmented Reality Anywhere and Anytime   


   Social Augmented Reality

   Information Presentation

   Real-Time Self Localization

   AR Graphics

   AR Navigation

   Augmented Reality Games

   Past Projects



   Hybrid SLAM

   Panorama SLAM

   Planar SLAM

   Model-Based Tracking

   Marker-Based Tracking


Software Libraries

   Studierstube ES

   Studierstube Tracker










   Student projects


   Site map


The Handheld Augmented Reality
Project is supported by the
following institutions:



Christian Doppler Forschungsgesellschaft


Graz University of Technology




Come to ISMAR 2011



Enhancing Navigation Systems with Augmented Reality

The goal of this project is to design, implement and evaluate novel techniques for enhancing handheld navigation systems with AR. We address the problem of integrating AR into handheld navigation systems. We design and implement novel techniques to support this integration, and we conduct evaluations to validate such techniques.

We base our designs on transitional interfaces to support moving between AR-based representations and other representations. Users are thus free to access different representations of the information for solving different tasks.


Augmented Reality is constrained to the camera's fixed field of view and restricted to first-person views. This can limit the amount of overview that users can gain. Typical solutions in AR Browsers are overlays (e.g., radars) that are not always sufficiently informative, in particular on small screens. We present two zooming interfaces that compensate for these constraints by enabling users to smoothly zoom between the Augmented Reality view and (1) an egocentric panoramic view at 360 degrees, and (2) an exocentric top-down view. All interfaces run interactively on common smartphones.

Publication: Mulloni, A., Duenser, A., Schmalstieg, D. Zooming Interfaces for Augmented Reality Browsers. Proceedings of MobileHCI 2010, September 2010, Lisbon, Portugal. [PAPER]


MapLens is an Augmented Reality application for Nokia camera phones (Symbian OS S60) with GPS. The phone camera and display are used as a viewer in combination with a paper map, which is augmented with location-based data. When a paper map is viewed through the camera the system analyses the video frame and determines the GPS coordinates of the visible portion of the map. MapLens is then able to accurately overlay location-based media on the paper map. The paper maps used with MapLens are unmodified images from Google Maps.

Publication: Morrison, A., Mulloni, A., Lemmelä, S., Oulasvirta, A., Jacucci, G., Peltonen, P., Schmalstieg, D., Regenbrecht, H. Collaborative use of mobile augmented reality with paper maps. Computer & Graphics, Special Issue on Mobile Augmented Reality. Elsevier, 2011. [PAPER]


We compare three techniques for browsing video feeds from cameras that are located around the user in an unstructured manner. Our techniques allow mobile users to gain extra information about the surroundings, the objects and the actors in the environment by observing a site from different perspectives. Their common goal is to enhance spatial awareness of the user, without relying on a model or previous knowledge of the environment.

Publication: Veas, E., Mulloni, A., Kruijff, E., Regenbrecht, H. & Schmalstieg, D. Techniques for View Transition in Multi-Camera Outdoor Environments. Graphics Interface 2010 - 36th Graphics Interface conference, May 2010, Ottawa, Ontario/Canada. [PAPER]


We conducted a study to assess whether the effort of outfitting the environment with fiduciary markers pays off in terms of improvements in user navigation. We compared marker-based sparse localization with two conditions that represent the extremes of the localization continuum: no localization and continuous real-time localization. Our results show that marker-based sparse localization is a good solution for navigation when no GPS positioning is available, as it improves user confidence and it is subjectively preferred to a static map with no localization.

Publication: Mulloni, A., Wagner, D., Barakonyi, I., Schmalstieg, D., Indoor Positioning and Navigation with Camera Phones. In IEEE Pervasive Computing (Special Issue on Smarter Phones), Apr-Jun, 2009. [PAPER]

For further information, please also check the personal home page of Alessandro Mulloni


website maintained by Tobias Langlotz
last updated on 2011-08-02

copyright (c) 2011 Graz University of Technology