We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

eess.IV

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Electrical Engineering and Systems Science > Image and Video Processing

Title: Learning a Probabilistic Strategy for Computational Imaging Sensor Selection

Abstract: Optimized sensing is important for computational imaging in low-resource environments, when images must be recovered from severely limited measurements. In this paper, we propose a physics-constrained, fully differentiable, autoencoder that learns a probabilistic sensor-sampling strategy for optimized sensor design. The proposed method learns a system's preferred sampling distribution that characterizes the correlations between different sensor selections as a binary, fully-connected Ising model. The learned probabilistic model is achieved by using a Gibbs sampling inspired network architecture, and is trained end-to-end with a reconstruction network for efficient co-design. The proposed framework is applicable to sensor selection problems in a variety of computational imaging applications. In this paper, we demonstrate the approach in the context of a very-long-baseline-interferometry (VLBI) array design task, where sensor correlations and atmospheric noise present unique challenges. We demonstrate results broadly consistent with expectation, and draw attention to particular structures preferred in the telescope array geometry that can be leveraged to plan future observations and design array expansions.
Comments: This paper has been accepted to the IEEE International Conference on Computational Photography (ICCP) 2020. Keywords: Computational Imaging, Optimized Sensing, Ising Model, Deep Learning, VLBI, Interferometry
Subjects: Image and Video Processing (eess.IV); Instrumentation and Methods for Astrophysics (astro-ph.IM); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Signal Processing (eess.SP)
Cite as: arXiv:2003.10424 [eess.IV]
  (or arXiv:2003.10424v1 [eess.IV] for this version)

Submission history

From: He Sun [view email]
[v1] Mon, 23 Mar 2020 17:52:17 GMT (8159kb,D)

Link back to: arXiv, form interface, contact.