We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: CLIPstyler: Image Style Transfer with a Single Text Condition

Abstract: Existing neural style transfer methods require reference style images to transfer texture information of style images to content images. However, in many practical situations, users may not have reference style images but still be interested in transferring styles by just imagining them. In order to deal with such applications, we propose a new framework that enables a style transfer `without' a style image, but only with a text description of the desired style. Using the pre-trained text-image embedding model of CLIP, we demonstrate the modulation of the style of content images only with a single text condition. Specifically, we propose a patch-wise text-image matching loss with multiview augmentations for realistic texture transfer. Extensive experimental results confirmed the successful image style transfer with realistic textures that reflect semantic query texts.
Comments: CVPR 2022 camera ready
Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Image and Video Processing (eess.IV)
Cite as: arXiv:2112.00374 [cs.CV]
  (or arXiv:2112.00374v3 [cs.CV] for this version)

Submission history

From: Jong Chul Ye [view email]
[v1] Wed, 1 Dec 2021 09:48:53 GMT (17814kb,D)
[v2] Fri, 4 Mar 2022 01:26:24 GMT (17814kb,D)
[v3] Sat, 19 Mar 2022 11:35:18 GMT (23229kb,D)

Link back to: arXiv, form interface, contact.