We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computer Vision and Pattern Recognition

Title: NeMF: Neural Motion Fields for Kinematic Animation

Abstract: We present an implicit neural representation to learn the spatio-temporal space of kinematic motions. Unlike previous work that represents motion as discrete sequential samples, we propose to express the vast motion space as a continuous function over time, hence the name Neural Motion Fields (NeMF). Specifically, we use a neural network to learn this function for miscellaneous sets of motions, which is designed to be a generative model conditioned on a temporal coordinate $t$ and a random vector $z$ for controlling the style. The model is then trained as a Variational Autoencoder (VAE) with motion encoders to sample the latent space. We train our model with a diverse human motion dataset and quadruped dataset to prove its versatility, and finally deploy it as a generic motion prior to solve task-agnostic problems and show its superiority in different motion generation and editing applications, such as motion interpolation, in-betweening, and re-navigating. More details can be found on our project page: this https URL
Comments: Accepted to NeurIPS 2022. Project page: this https URL
Subjects: Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
Cite as: arXiv:2206.03287 [cs.CV]
  (or arXiv:2206.03287v3 [cs.CV] for this version)

Submission history

From: Chengan He [view email]
[v1] Sat, 4 Jun 2022 05:53:27 GMT (47234kb,D)
[v2] Tue, 14 Jun 2022 13:25:40 GMT (47821kb,D)
[v3] Sun, 9 Oct 2022 08:20:44 GMT (24250kb,D)

Link back to: arXiv, form interface, contact.