References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Unsupervised Image Decomposition with Phase-Correlation Networks
(Submitted on 7 Oct 2021 (v1), last revised 10 Jan 2022 (this version, v3))
Abstract: The ability to decompose scenes into their object components is a desired property for autonomous agents, allowing them to reason and act in their surroundings. Recently, different methods have been proposed to learn object-centric representations from data in an unsupervised manner. These methods often rely on latent representations learned by deep neural networks, hence requiring high computational costs and large amounts of curated data. Such models are also difficult to interpret. To address these challenges, we propose the Phase-Correlation Decomposition Network (PCDNet), a novel model that decomposes a scene into its object components, which are represented as transformed versions of a set of learned object prototypes. The core building block in PCDNet is the Phase-Correlation Cell (PC Cell), which exploits the frequency-domain representation of the images in order to estimate the transformation between an object prototype and its transformed version in the image. In our experiments, we show how PCDNet outperforms state-of-the-art methods for unsupervised object discovery and segmentation on simple benchmark datasets and on more challenging data, while using a small number of learnable parameters and being fully interpretable.
Submission history
From: Angel Villar-Corrales [view email][v1] Thu, 7 Oct 2021 13:57:33 GMT (3741kb,D)
[v2] Fri, 8 Oct 2021 08:33:30 GMT (3745kb,D)
[v3] Mon, 10 Jan 2022 10:23:55 GMT (9041kb,D)
Link back to: arXiv, form interface, contact.