We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Electrical Engineering and Systems Science > Image and Video Processing

Title: Learning Sparse Masks for Diffusion-based Image Inpainting

Abstract: Diffusion-based inpainting is a powerful tool for the reconstruction of images from sparse data. Its quality strongly depends on the choice of known data. Optimising their spatial location -- the inpainting mask -- is challenging. A commonly used tool for this task are stochastic optimisation strategies. However, they are slow as they compute multiple inpainting results. We provide a remedy in terms of a learned mask generation model. By emulating the complete inpainting pipeline with two networks for mask generation and neural surrogate inpainting, we obtain a model for highly efficient adaptive mask generation. Experiments indicate that our model can achieve competitive quality with an acceleration by as much as four orders of magnitude. Our findings serve as a basis for making diffusion-based inpainting more attractive for applications such as image compression, where fast encoding is highly desirable.
Comments: To appear in A. J. Pinho, P. Georgieva, L. F. Teixeira, J. A. S\'anchez (Eds.): Pattern Recognition and Image Analysis. Lecture Notes in Computer Science, Springer, Cham, 2022
Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as: arXiv:2110.02636 [eess.IV]
  (or arXiv:2110.02636v3 [eess.IV] for this version)

Submission history

From: Tobias Alt [view email]
[v1] Wed, 6 Oct 2021 10:20:59 GMT (476kb,D)
[v2] Wed, 26 Jan 2022 16:22:15 GMT (489kb,D)
[v3] Mon, 14 Mar 2022 08:27:39 GMT (490kb,D)

Link back to: arXiv, form interface, contact.