SpinOcchio: Understanding Haptic-Visual Congruency of Skin-Slip in VR with a Dynamic Grip Controller (2022)

This paper’s goal is to understand the haptic-visual congruency perception of skin-slip on the fingertips given visual cues in Virtual Reality (VR). We developed SpinOcchio (Spin for the spinning mechanism used, Occhio for the Italian word “eye”), a handheld haptic controller capable of rendering the thickness and slipping of a virtual object pinched between two fingers. This is achieved using a mechanism with spinning and pivoting disks that apply a tangential skin-slip movement to the fingertips. With SpinOcchio, we determined the baseline haptic discrimination threshold for skin-slip, and, using these results, we tested how haptic realism of motion and thickness is perceived with varying visual cues in VR. Surprisingly, the results show that in all cases, visual cues dominate over haptic perception. Based on these results, we suggest applications that leverage skin-slip and grip interaction, contributing further to realistic experiences in VR.


Myung Jin Kim, Neung Ryu, Wooje Chang, Michel Pahud, Mike Sinclair, and Andrea Bianchi. 2022. SpinOcchio: Understanding Haptic-Visual Congruency of Skin-Slip in VR with a Dynamic Grip Controller. In CHI Conference on Human Factors in Computing Systems (CHI ‘22). Association for Computing Machinery, New York, NY, USA, Article 433, 1–14. DOI: https://doi.org/10.1145/3491102.3517724

paper    doi

Media Coverage

This Controller Lets You Feel VR Objects Slip Between Your Fingers, and the Possibilities Are Endless on GIZMODO.

Mind-blowing metaverse controller lets you TOUCH objects in virtual reality and ‘feel them slip through your fingers’ on The Sun.

움직이는 가상물체 현실처럼 쥔다 on 전자신문 2022.5.13.

Interview with Myung Jin Kim: 결국 1위는 또 애플… 전공자가 말하는 메타버스 시장의 미래 (with 카이스트) on YouTube 2022.7.15.

Back to projects