We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computer Vision and Pattern Recognition

Title: Real-Time Monocular 4D Face Reconstruction using the LSFM models

Abstract: 4D face reconstruction from a single camera is a challenging task, especially when it is required to be performed in real time. We demonstrate a system of our own implementation that solves this task accurately and runs in real time on a commodity laptop, using a webcam as the only input. Our system is interactive, allowing the user to freely move their head and show various expressions while standing in front of the camera. As a result, the put forward system both reconstructs and visualises the identity of the subject in the correct pose along with the acted facial expressions in real-time. The 4D reconstruction in our framework is based on the recently-released Large-Scale Facial Models (LSFM) \cite{LSFM1, LSFM2}, which are the largest-scale 3D Morphable Models of facial shapes ever constructed, based on a dataset of more than 10,000 facial identities from a wide range of gender, age and ethnicity combinations. This is the first real-time demo that gives users the opportunity to test in practice the capabilities of the recently-released Large-Scale Facial Models (LSFM)
Comments: Published in Proceedings of the 15th ACM SIGGRAPH European Conference on Visual Media Production
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2006.10499 [cs.CV]
  (or arXiv:2006.10499v1 [cs.CV] for this version)

Submission history

From: Mohammad Rami Koujan [view email]
[v1] Fri, 22 May 2020 02:14:45 GMT (4014kb,D)

Link back to: arXiv, form interface, contact.