Real-time robust body part tracking for augmented reality interface

Abstract

We proposed real-time robust body part tracking for augmented reality interface that does not limit the user's freedom. The generality of the system was upgraded relative to body part tracking by establishing an ability to recognize details, such as, whether the user wears long sleeves or short sleeves. For precise body part tracking, we obtained images of hands, head, and feet separately via a single camera, and when detecting each body part, we separately chose appropriate features for specific parts. Using a calibrated camera, we transferred 2D detected body parts into an approximate 3D posture. In experiments conducted to evaluate the body part tracking module, the application with the proposed interface showed advanced hand tracking performance in real time(43.5fps).