We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.GR

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Graphics

Title: Semantically Supervised Appearance Decomposition for Virtual Staging from a Single Panorama

Abstract: We describe a novel approach to decompose a single panorama of an empty indoor environment into four appearance components: specular, direct sunlight, diffuse and diffuse ambient without direct sunlight. Our system is weakly supervised by automatically generated semantic maps (with floor, wall, ceiling, lamp, window and door labels) that have shown success on perspective views and are trained for panoramas using transfer learning without any further annotations. A GAN-based approach supervised by coarse information obtained from the semantic map extracts specular reflection and direct sunlight regions on the floor and walls. These lighting effects are removed via a similar GAN-based approach and a semantic-aware inpainting step. The appearance decomposition enables multiple applications including sun direction estimation, virtual furniture insertion, floor material replacement, and sun direction change, providing an effective tool for virtual home staging. We demonstrate the effectiveness of our approach on a large and recently released dataset of panoramas of empty homes.
Comments: To appear in SIGGRAPH 2022
Subjects: Graphics (cs.GR)
Cite as: arXiv:2205.13150 [cs.GR]
  (or arXiv:2205.13150v1 [cs.GR] for this version)

Submission history

From: Tiancheng Zhi [view email]
[v1] Thu, 26 May 2022 04:49:48 GMT (134142kb,D)

Link back to: arXiv, form interface, contact.