Abstract

For a desktop computer, we investigate how to enhance conventional mouse and keyboard interaction by combining the input modalities gaze and foot. This multimodal approach offers the potential for fluently performing both manual input (e.g., for precise object selection) and gaze-supported foot input (for pan and zoom) in zoomable information spaces in quick succession or even in parallel. For this, we take advantage of fast gaze input to implicitly indicate where to navigate to and additional explicit foot input for speed control while leaving the hands free for further manual input. This allows for taking advantage of gaze input in a subtle and unobtrusive way. We have carefully elaborated and investigated three variants of foot controls incorporating one-, two- and multidirectional foot pedals in combination with gaze. These were evaluated and compared to mouse-only input in a user study using Google Earth as a geographic information system. The results suggest that gaze-supported foot input is feasible for convenient, user-friendly navigation and comparable to mouse input and encourage further investigations of gaze-supported foot controls.

Related Publications

Look & Pedal: Hands-free Navigation in Zoomable Information Spaces through Gaze-supported Foot Input
Konstantin Klamka, Andreas Siegel, Stefan Vogt, Fabian Göbel, Sophie Stellmach, Raimund Dachselt
In Proceedings of the 17th International Conference on Multimodal Interaction. ICMI ’15, Seattle, USA. ACM 123-130, 2015.
Publisher Video Research Website
Gaze-supported Foot Interaction in Zoomable Information Spaces (Interactivity)
Fabian Göbel, Konstantin Klamka, Andreas Siegel, Stefan Vogt, Sophie Stellmach, Raimund Dachselt
In Proceedings of the Conference on Human Factors in Computing Systems - Extended Abstracts. CHI ’13, Paris, France. ACM, 3059-3062, 2013.
Publisher Video Research Website
Gaze-supported Foot Interaction in Zoomable Information Spaces (Workshop)
Fabian Göbel, Konstantin Klamka, Andreas Siegel, Stefan Vogt, Sophie Stellmach, Raimund Dachselt
In CHI 2013 Workshop on Gaze Interaction in the Post-WIMP World. CHI ’13, Paris, France. 2013.
Workshop Website Research Website

Look & Pedal:
Hands-free Navigation in Zoomable Information Spaces through Gaze-supported Foot Input

Category Multi-Modal Interaction
Project date 2013-2015
Project URL imld.de/gaze-foot/
Collaborators Andreas Siegel,
Stefan Vogt,
Dr. Fabian Göbel,
Dr. Sophie Stellmach,
Prof. Raimund Dachselt
Video Watch on YouTube
Technologies
and Methods		 Windows Forms C# Direct Input Google Earth API Tobii Eyetracking SDK Rapid Prototyping Wood Working Mechanical Engineering Resistive Sensing
Presentation at ACM CHI 2013
in Paris, France.
The image shows the crowded demo booth at CHI (left) and the overall setup of interactivity (right).
Further presentations
Paper presentation at ACM ICMI '15
Interactivity at Uni-Day '14
Interactivity at Long Night of Science '13
Interactivity at Output.DD '13
Press Coverage
• MIT Technology Review
"Wie von Zauberhand - Forscher tüfteln an immer verrückteren Eingabetechniken für Computer. Sie werden unseren Alltag um verblüffende Magie berreichern."
Magazine Article 03/2014
• Dresdner Neueste Nachrichten (DNN)
"Die Welt mit den Augen steuern - Junge Informatiker zeigen ihre Erfindungen"
Newspaper Article 05.07.2013