On Your Feet!: Enhancing Vection in Leaning-Based Interfaces through Multisensory Stimuli
- When navigating larger virtual environments and computer games, natural walking is often unfeasible. Here, we investigate how alternatives such as joystick- or leaning-based locomotion interfaces ("human joystick") can be enhanced by adding walking-related cues following a sensory substitution approach. Using a custom-designed foot haptics system and evaluating it in a multi-part study, we show that adding walking related auditory cues (footstep sounds), visual cues (simulating bobbing head-motions from walking), and vibrotactile cues (via vibrotactile transducers and bass-shakers under participants' feet) could all enhance participants' sensation of self-motion (vection) and involement/presence. These benefits occurred similarly for seated joystick and standing leaning locomotion. Footstep sounds and vibrotactile cues also enhanced participants' self-reported ability to judge self-motion velocities and distances traveled. Compared to seated joystick control, standing leaning enhanced self-motion sensations. Combining standing leaning with a minimal walking-in-place procedure showed no benefits and reduced usability, though. Together, results highlight the potential of incorporating walking-related auditory, visual, and vibrotactile cues for improving user experience and self-motion perception in applications such as virtual reality, gaming, and tele-presence.
Document Type: | Conference Object |
---|---|
Language: | English |
Author: | Ernst Kruijff, Alexander Marquardt, Christina Trepkowski, Robert W. Lindeman, Andre Hinkenjann, Jens Maiero, Bernhard E. Riecke |
Parent Title (English): | Proceedings of the 2016 Symposium on Spatial User Interfaces (SUI '16). October 15-16, 2016, Tokyo, Japan |
First Page: | 149 |
Last Page: | 158 |
ISBN: | 978-1-4503-4068-7 |
DOI: | https://doi.org/10.1145/2983310.2985759 |
Publisher: | ACM Press |
Date of first publication: | 2016/10/15 |
Award: | Honorable Mention Paper Award |
Keyword: | 3D user interface; Navigation interface; VR; bass-shaker; gaming; leaning; surface textures; vibration; whole-body interface |
Departments, institutes and facilities: | Fachbereich Informatik |
Institute of Visual Computing (IVC) | |
Dewey Decimal Classification (DDC): | 0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik |
Entry in this database: | 2016/10/31 |