Exploring Pseudo Hand-Eye Interaction on the Head-Mounted Display

Virtual and augmented reality devices and applications have enabled users to experience a variety of simulated real-life experiences through first-person visual, auditory, and haptic feedback. However, among the numerous everyday interactions that have been emulated, the familiar interaction of touching or rubbing the eyes is yet to be explored and remains to be understood. In this paper, we aim to understand the components of natural hand-eye interaction, propose an interaction technique through a proof-of-concept prototype head-mounted display, and evaluate the user experience of the prototype through a user study. In addition, we share insights that emerged from the studies with suggestions for further development of interaction techniques based on combinations of hardware and software.

@inproceedings{10.1145/3458709.3458960,
  author = {Kim, Myung Jin and Bianchi, Andrea},
  title = {Exploring Pseudo Hand-Eye Interaction on the Head-Mounted Display},
  year = {2021},
  isbn = {9781450384285},
  publisher = {Association for Computing Machinery},
  address = {New York, NY, USA},
  url = {https://doi.org/10.1145/3458709.3458960},
  doi = {10.1145/3458709.3458960},
  booktitle = {Proceedings of the Augmented Humans International Conference 2021},
  pages = {251–258},
  numpages = {8},
  keywords = {visual effects, touch input, pseudo hand-eye interaction, interaction technique, head-mounted display, first-person view},
  location = {Rovaniemi, Finland},
  series = {AHs '21}
}