We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.GR

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Graphics

Title: CLIP-based Neural Neighbor Style Transfer for 3D Assets

Abstract: We present a method for transferring the style from a set of images to a 3D object. The texture appearance of an asset is optimized with a differentiable renderer in a pipeline based on losses using pretrained deep neural networks. More specifically,
we utilize a nearest-neighbor feature matching loss with CLIP-ResNet50 to extract the style from images. We show that a CLIP- based style loss provides a different appearance over a VGG-based loss by focusing more on texture over geometric shapes.
Additionally, we extend the loss to support multiple images and enable loss-based control over the color palette combined with automatic color palette extraction from style images.
Subjects: Graphics (cs.GR)
Cite as: arXiv:2208.04370 [cs.GR]
  (or arXiv:2208.04370v1 [cs.GR] for this version)

Submission history

From: Jonathan Granskog [view email]
[v1] Mon, 8 Aug 2022 19:11:36 GMT (29503kb,D)

Link back to: arXiv, form interface, contact.