Document Type

Journal Article

Department/Unit

Department of Computer Science

Title

Real-time posture reconstruction for microsoft kinect

Language

English

Abstract

The recent advancement of motion recognition using Microsoft Kinect stimulates many new ideas in motion capture and virtual reality applications. Utilizing a pattern recognition algorithm, Kinect can determine the positions of different body parts from the user. However, due to the use of a single-depth camera, recognition accuracy drops significantly when the parts are occluded. This hugely limits the usability of applications that involve interaction with external objects, such as sport training or exercising systems. The problem becomes more critical when Kinect incorrectly perceives body parts. This is because applications have limited information about the recognition correctness, and using those parts to synthesize body postures would result in serious visual artifacts. In this paper, we propose a new method to reconstruct valid movement from incomplete and noisy postures captured by Kinect. We first design a set of measurements that objectively evaluates the degree of reliability on each tracked body part. By incorporating the reliability estimation into a motion database query during run time, we obtain a set of similar postures that are kinematically valid. These postures are used to construct a latent space, which is known as the natural posture space in our system, with local principle component analysis. We finally apply frame-based optimization in the space to synthesize a new posture that closely resembles the true user posture while satisfying kinematic constraints. Experimental results show that our method can significantly improve the quality of the recognized posture under severely occluded environments, such as a person exercising with a basketball or moving in a small room. © 2013 IEEE.

Keywords

Human-computer interaction, Kinect, Local principal component analysis, Posture reconstruction

Publication Date

2013

Source Publication Title

IEEE Transactions on Cybernetics

Volume

43

Issue

5

Start Page

1357

End Page

1369

Publisher

Institute of Electrical and Electronics Engineers

DOI

10.1109/TCYB.2013.2275945

Link to Publisher's Edition

http://dx.doi.org/10.1109/TCYB.2013.2275945

ISSN (print)

21682267

This document is currently not available here.

Share

COinS