Comparing gaze-supported modalities with empathic mixed reality interfaces in remote collaboration

A Jing, K Gupta, J McDade, GA Lee… - … Symposium on Mixed …, 2022 - ieeexplore.ieee.org
2022 IEEE International Symposium on Mixed and Augmented Reality …, 2022ieeexplore.ieee.org
In this paper, we share real-time collaborative gaze behaviours, hand pointing, gesturing,
and heart rate visualisations between remote collaborators using a live 360° panoramic-
video based Mixed Reality (MR) system. We first ran a pilot study to explore visual designs
to combine communication cues with biofeedback (heart rate), aiming to understand user
perceptions of empathic collaboration. We then conducted a formal study to investigate the
effect of modality (Gaze+ Hand, Hand-only) and interface (Near-Gaze, Embodied). The …
In this paper, we share real-time collaborative gaze behaviours, hand pointing, gesturing, and heart rate visualisations between remote collaborators using a live 360 ° panoramic-video based Mixed Reality (MR) system. We first ran a pilot study to explore visual designs to combine communication cues with biofeedback (heart rate), aiming to understand user perceptions of empathic collaboration. We then conducted a formal study to investigate the effect of modality (Gaze+Hand, Hand-only) and interface (Near-Gaze, Embodied). The results show that the Gaze+Hand modality in a Near-Gaze interface is significantly better at reducing task load, improving co-presence, enhancing understanding and tightening collaborative behaviours compared to the conventional Embodied hand-only experience. Ranked as the most preferred condition, the Gaze+Hand in Near-Gaze condition is perceived to reduce the need for dividing attention to the collaborator’s physical location, although it feels slightly less natural compared to the embodied visualisations. In addition, the Gaze+Hand conditions also led to more joint attention and less hand pointing to align mutual understanding. Lastly, we provide a design guideline to summarize what we have learned from the studies on the representation between modality, interface, and biofeedback.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果