Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: The Image Local Autoregressive Transformer
(Submitted on 4 Jun 2021 (v1), last revised 18 Oct 2021 (this version, v2))
Abstract: Recently, AutoRegressive (AR) models for the whole image generation empowered by transformers have achieved comparable or even better performance to Generative Adversarial Networks (GANs). Unfortunately, directly applying such AR models to edit/change local image regions, may suffer from the problems of missing global information, slow inference speed, and information leakage of local guidance. To address these limitations, we propose a novel model -- image Local Autoregressive Transformer (iLAT), to better facilitate the locally guided image synthesis. Our iLAT learns the novel local discrete representations, by the newly proposed local autoregressive (LA) transformer of the attention mask and convolution mechanism. Thus iLAT can efficiently synthesize the local image regions by key guidance information. Our iLAT is evaluated on various locally guided image syntheses, such as pose-guided person image synthesis and face editing. Both the quantitative and qualitative results show the efficacy of our model.
Submission history
From: Chenjie Cao [view email][v1] Fri, 4 Jun 2021 14:33:25 GMT (23656kb,D)
[v2] Mon, 18 Oct 2021 10:34:26 GMT (30792kb,D)
Link back to: arXiv, form interface, contact.