References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: NeMF: Neural Motion Fields for Kinematic Animation
(Submitted on 4 Jun 2022 (v1), last revised 9 Oct 2022 (this version, v3))
Abstract: We present an implicit neural representation to learn the spatio-temporal space of kinematic motions. Unlike previous work that represents motion as discrete sequential samples, we propose to express the vast motion space as a continuous function over time, hence the name Neural Motion Fields (NeMF). Specifically, we use a neural network to learn this function for miscellaneous sets of motions, which is designed to be a generative model conditioned on a temporal coordinate $t$ and a random vector $z$ for controlling the style. The model is then trained as a Variational Autoencoder (VAE) with motion encoders to sample the latent space. We train our model with a diverse human motion dataset and quadruped dataset to prove its versatility, and finally deploy it as a generic motion prior to solve task-agnostic problems and show its superiority in different motion generation and editing applications, such as motion interpolation, in-betweening, and re-navigating. More details can be found on our project page: this https URL
Submission history
From: Chengan He [view email][v1] Sat, 4 Jun 2022 05:53:27 GMT (47234kb,D)
[v2] Tue, 14 Jun 2022 13:25:40 GMT (47821kb,D)
[v3] Sun, 9 Oct 2022 08:20:44 GMT (24250kb,D)
Link back to: arXiv, form interface, contact.