The recent trend of emerging high-quality Augmented Reality (AR) glasses offered the possibility for visually exciting application scenarios. However, the interaction with these devices is often challenging since current input methods most of the time lack haptic feedback and are limited in their user interface controls. With this work, we introduce CHARM, a combination of a belt-worn interaction device, utilizing a retractable cord, and a set of interaction techniques to enhance AR input capabilities with physical controls and spatial constraints. Building on our previous research, we created a fully-functional prototype to investigate how body-worn string devices can be used to support generic AR tasks. We contribute a radial widget menu for system control as well as transformation techniques for 3D object manipulation. To validate our interaction concepts for system control, we implemented a mid-air gesture interface as a baseline and evaluated our prototype in two formative user studies. Our results show that our approach provides flexibility regarding possible interaction mappings and was preferred for manipulation tasks compared to mid-air gesture input.

Related Publications

CHARM: Cord-based Haptic Augmented Reality Manipulation
Konstantin Klamka, Patrick Reipschläger, Raimund Dachselt
In 21st International Conference on Human-Computer Interaction - Virtual, Augmented and Mixed Reality. Multimodal Interaction. HCII ’19, Orlando, Florida, USA. Springer International Publishing, 96-114, 2019.
Publisher Research Website

Cord-based Haptic Augmented Reality Manipulation

Category Mixed Rality
Project date 2019
Project URL imld.de/charm/
Collaborators Patrick Reipschläger,
Prof. Raimund Dachselt
and Methods
Unity HoloLens C# Arduino C Bluetooth Rapid Prototyping 3D-Printing Soldering Mechanical Engineering