A hand-based collaboration framework in egocentric coexistence reality

Abstract

This paper presents a hand-based collaboration framework in egocentric coexistence reality (CR), which enables a local user to collaborate with multiple users in the distance. To develop the remote collaboration system, we integrate the following core technologies: i) hand-augmented object interaction method in CR environment by tracking the bare hands or hands with grasping real-world objects in egocentric view, ii) a remote user's hand-body information fusion method for enhancing spatial co-presence in CR environment. According to preliminary experimental results, we confirm the feasibility as a future remote collaboration platform in egocentric CR.