We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computer Vision and Pattern Recognition

Title: Landmarks Augmentation with Manifold-Barycentric Oversampling

Abstract: The training of Generative Adversarial Networks (GANs) requires a large amount of data, stimulating the development of new augmentation methods to alleviate the challenge. Oftentimes, these methods either fail to produce enough new data or expand the dataset beyond the original manifold. In this paper, we propose a new augmentation method that guarantees to keep the new data within the original data manifold thanks to the optimal transport theory. The proposed algorithm finds cliques in the nearest-neighbors graph and, at each sampling iteration, randomly draws one clique to compute the Wasserstein barycenter with random uniform weights. These barycenters then become the new natural-looking elements that one could add to the dataset. We apply this approach to the problem of landmarks detection and augment the available annotation in both unpaired and in semi-supervised scenarios. Additionally, the idea is validated on cardiac data for the task of medical segmentation. Our approach reduces the overfitting and improves the quality metrics beyond the original data outcome and beyond the result obtained with popular modern augmentation methods.
Comments: 11 pages, 4 figures, 3 tables. I.B. and N.B. contributed equally. D.V.D. is the corresponding author
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Journal reference: IEEE Access 2022
DOI: 10.1109/ACCESS.2022.3219934
Cite as: arXiv:2104.00925 [cs.CV]
  (or arXiv:2104.00925v2 [cs.CV] for this version)

Submission history

From: Dmitry V. Dylov [view email]
[v1] Fri, 2 Apr 2021 08:07:21 GMT (3346kb,D)
[v2] Mon, 20 Dec 2021 14:03:35 GMT (2920kb,D)

Link back to: arXiv, form interface, contact.