References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Learning Pose Grammar to Encode Human Body Configuration for 3D Pose Estimation
(Submitted on 17 Oct 2017 (v1), last revised 4 Jan 2018 (this version, v6))
Abstract: In this paper, we propose a pose grammar to tackle the problem of 3D human pose estimation. Our model directly takes 2D pose as input and learns a generalized 2D-3D mapping function. The proposed model consists of a base network which efficiently captures pose-aligned features and a hierarchy of Bi-directional RNNs (BRNN) on the top to explicitly incorporate a set of knowledge regarding human body configuration (i.e., kinematics, symmetry, motor coordination). The proposed model thus enforces high-level constraints over human poses. In learning, we develop a pose sample simulator to augment training samples in virtual camera views, which further improves our model generalizability. We validate our method on public 3D human pose benchmarks and propose a new evaluation protocol working on cross-view setting to verify the generalization capability of different methods. We empirically observe that most state-of-the-art methods encounter difficulty under such setting while our method can well handle such challenges.
Submission history
From: Yuanlu Xu [view email][v1] Tue, 17 Oct 2017 22:05:19 GMT (3411kb,D)
[v2] Mon, 23 Oct 2017 10:27:33 GMT (1862kb,D)
[v3] Tue, 21 Nov 2017 22:56:40 GMT (1910kb,D)
[v4] Tue, 5 Dec 2017 08:49:06 GMT (1910kb,D)
[v5] Tue, 12 Dec 2017 21:37:59 GMT (1910kb,D)
[v6] Thu, 4 Jan 2018 22:50:45 GMT (1910kb,D)
Link back to: arXiv, form interface, contact.