We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

eess.IV

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Electrical Engineering and Systems Science > Image and Video Processing

Title: Learning the geometry of wave-based imaging

Abstract: We propose a general physics-based deep learning architecture for wave-based imaging problems. A key difficulty in imaging problems with a varying background wave speed is that the medium "bends" the waves differently depending on their position and direction. This space-bending geometry makes the equivariance to translations of convolutional networks an undesired inductive bias. We build an interpretable neural architecture inspired by Fourier integral operators (FIOs) which approximate the wave physics. FIOs model a wide range of imaging modalities, from seismology and radar to Doppler and ultrasound. We focus on learning the geometry of wave propagation captured by FIOs, which is implicit in the data, via a loss based on optimal transport. The proposed FIONet performs significantly better than the usual baselines on a number of imaging inverse problems, especially in out-of-distribution tests.
Comments: Accepted as spotlight presentation to NeurIPS '20
Subjects: Image and Video Processing (eess.IV); Machine Learning (cs.LG)
Cite as: arXiv:2006.05854 [eess.IV]
  (or arXiv:2006.05854v3 [eess.IV] for this version)

Submission history

From: Konik Kothari [view email]
[v1] Wed, 10 Jun 2020 14:29:54 GMT (22701kb,D)
[v2] Thu, 11 Jun 2020 09:36:49 GMT (22701kb,D)
[v3] Tue, 10 Nov 2020 06:34:40 GMT (22701kb,D)

Link back to: arXiv, form interface, contact.