We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On

Abstract: We propose a new generative model for 3D garment deformations that enables us to learn, for the first time, a data-driven method for virtual try-on that effectively addresses garment-body collisions. In contrast to existing methods that require an undesirable postprocessing step to fix garment-body interpenetrations at test time, our approach directly outputs 3D garment configurations that do not collide with the underlying body. Key to our success is a new canonical space for garments that removes pose-and-shape deformations already captured by a new diffused human body model, which extrapolates body surface properties such as skinning weights and blendshapes to any 3D point. We leverage this representation to train a generative model with a novel self-supervised collision term that learns to reliably solve garment-body interpenetrations. We extensively evaluate and compare our results with recently proposed data-driven methods, and show that our method is the first to successfully address garment-body contact in unseen body shapes and motions, without compromising realism and detail.
Comments: Accepted to CVPR 2021. Project website this http URL
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2105.06462 [cs.CV]
  (or arXiv:2105.06462v1 [cs.CV] for this version)

Submission history

From: Dan Casas [view email]
[v1] Thu, 13 May 2021 17:58:20 GMT (8895kb,D)

Link back to: arXiv, form interface, contact.