Search publications

Reset filters Search by keyword

No publications found.

 

Before hands disappear: Effect of early warning visual feedback method for hand tracking failures in virtual reality

Authors: Gemici MPhadnis VBatmaz AU


Affiliations

1 Department of Computer Science & Software Engineering, Concordia University, Montreal, Quebec, Canada.
2 Google, Mountain View, California, United States of America.

Description

Virtual hand representation in Head-Mounted Displays (HMDs) offers immersive and intuitive interactions in Virtual Reality (VR). However, current hand tracking algorithms are prone to errors, which can disrupt the user experience and hinder task performance. This paper presents a novel method for providing users with visual feedback when the quality of hand tracking decreases. Our approach employs a notification modal that warns users of potential failures. We identified three common hand tracking failure scenarios and evaluated the effectiveness of our method in two distinct VR tasks: object manipulation and complex assembly tasks. Results show that our early warning system reduces task completion time, lowers hand-tracking failures by up to 83%, decreases errors, improves system usability, and reduces cognitive load. This work contributes to the development of more robust and user-friendly VR HMD applications by enhancing hand tracking reliability, usability, and workload.


Links

PubMed: https://pubmed.ncbi.nlm.nih.gov/40493551/

DOI: 10.1371/journal.pone.0323796