period of projectstarted in October 2009

involved peopleDipl.-Ing. Sophie Stellmach and
Prof. Dr.-Ing. Raimund Dachselt

type of advancementfunded by the BMBF

Natural Interaction Techniques for 3D Virtual Environments

Description

The simple and efficient handling of more and more complex digital systems is a central question in human-computer-interaction. Three-dimensional (3D) virtual environments (VEs) have gained importance over the last decade, for example in virtual interactive training, computer-aided design and entertainment. The development of appropriate interaction techniques (in terms of instinctiveness and efficiency) for such working environments is, however, slowly progressing. While a trend can be noticed from common desktop screens to large displays and multitouch devices, natural techniques for handling them are often missing. In this context, considering a user's visual perception shows high potential for improving interaction since the system may adapt information based on a user's visual attention. In combination with other modalities this may provide valuable context-information for optimizing 3D interactions. Arising challenges include collecting and using eye tracking data for interaction purposes, and determining suitable combinations of input- and output modalities for a comfortable handling.

Master and Diploma Theses within this Project

  • Michael Kaestner
    Interaction with 3D Computer-Aided Design Data via Mobile DevicesMaster Thesis

    Michael Kaestner

    since May 6th, 2011

     

  • Thomas Matzdorf
    Gaze and Body Gesture Interaction with Distant DisplaysMaster Thesis

    Thomas Matzdorf

    May 23rd - November 2nd, 2011

     

  • Thomas Seidl
    Gesture-based Interaction in Immersive Everyday ScenariosDiploma Thesis

    Thomas Seidl

    August 16th, 2010 - April 21st, 2011

     

  • Thomas Brücher
    Intuitive, Pen-based Interaction in VR scenariosDiploma Thesis

    Thomas Brücher

    27th August 2009 - 8th April 2010

     

Related publications

  • Vorschaubild
    Honorable Mention

    Honorable Mention

    Stellmach, S., Dachselt, R.:

    Look & Touch: Gaze-supported Target Acquisition

    To appear in Proceedings of the Conference on Human Factors in Computing Systems (CHI 2012) Austin, TX, USA, May 5-10, 2012.

  • Vorschaubild

    Stellmach, S., Dachselt, R.:

    Investigating Gaze-supported Multimodal Pan and Zoom

    Proceedings of the 2012 ACM Symposium on Eye-Tracking Research and Applications (ETRA 2012) (Santa Barbara, CA, USA, March 28-30, 2012).

    ETRA 2012, ACM, ISBN 978-1-4503-1221-9, pp. 357-360.

    Downloads: Short paper (914KB), Poster (4095KB), Video (28123KB)

  • Vorschaubild

    Stellmach, S., Dachselt, R.:

    Designing Gaze-based User Interfaces for Steering in Virtual Environments

    Proceedings of the 2012 ACM Symposium on Eye-Tracking Research and Applications (ETRA 2012) (Santa Barbara, CA, USA, March 28-30, 2012).

    ETRA 2012, ACM, ISBN 978-1-4503-1221-9, pp. 131-138.

    Downloads: Full paper (1185KB), Video (25619KB)

  • Vorschaubild
    Best Paper

    Best Paper

    Stellmach, S., Stober, S., Nürnberger, A., Dachselt, R.:

    Designing Gaze-supported Multimodal Interactions for the Exploration of Large Image Collections

    Proceedings of the 1st ACM Conference on Novel Gaze-Controlled Applications (NGCA 2011) Karlskrona, Sweden, May 26-27, 2011, pp. 1-8.

    Links: Free ACM Download, and Statistics

  • Vorschaubild

    Franke, R., Koch, M., Stellmach, S., Dachselt, R.:

    Intuitives zweihändiges Arbeiten in der virtuellen Realität

    Tagungsband: Virtuelle und erweiterte Realität, 7. Workshop der GI-Fachgruppe VR/AR Roland Blach, Christian-A. Bohn (Hg.) (Stuttgart-Fellbach, Germany, September 27-28, 2010).

    GI VR/AR Workshop 2010, Shaker Verlag, Aachen 2010, ISBN 978-3-8322-9468-7, ISSN 0945-0807, pp. 107 - 118 .

  • Vorschaubild

    Jacobs, J., Stengel, M., Dachselt, R.:

    Entwicklung einer Benutzungsschnittstelle für das virtuelle Erleben von Fahrzeugeigenschaften

    Tagungsband: Virtuelle und erweiterte Realität, 7. Workshop der GI-Fachgruppe VR/AR Roland Blach, Christian-A. Bohn (Hg.) (Stuttgart-Fellbach, Germany, September 27-28, 2010).

    GI VR/AR Workshop 2010, Shaker Verlag, Aachen 2010, ISBN 978-3-8322-9468-7, ISSN 0945-0807, pp. 133 - 144.

  • Vorschaubild

    Nacke, L., Stellmach, S., Sasse, D., Niesenhaus, J., Dachselt, R.:

    LAIF: A Logging and Interaction Framework for Gaze-Based Interfaces in Virtual Entertainment Environments

    Electronic Proceedings of the Interactive Cultures Conference 2010 (Duisburg, Germany, September 12-15, 2010).

    Interactive Cultures 2010, Oldenbourg Publishing, Munich, pp. 19 - 29.

    Downloads: Paper (1405KB)

  • Vorschaubild

    Stellmach, S., Brücher, T., Franke, R., Dachselt, R.:

    Digitale Stift- und Papierinteraktion in Virtuellen Umgebungen

    Proceedings of Mensch und Computer 2010 (Duisburg, Germany, September 12-15, 2010).

    Mensch und Computer 2010, Oldenbourg Publishing, Munich pp. 7 - 16.

    Downloads: Paper (1002KB)