We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Electrical Engineering and Systems Science > Image and Video Processing

Title: Dynamic imaging using a deep generative SToRM (Gen-SToRM) model

Abstract: We introduce a generative smoothness regularization on manifolds (SToRM) model for the recovery of dynamic image data from highly undersampled measurements. The model assumes that the images in the dataset are non-linear mappings of low-dimensional latent vectors. We use the deep convolutional neural network (CNN) to represent the non-linear transformation. The parameters of the generator as well as the low-dimensional latent vectors are jointly estimated only from the undersampled measurements. This approach is different from traditional CNN approaches that require extensive fully sampled training data. We penalize the norm of the gradients of the non-linear mapping to constrain the manifold to be smooth, while temporal gradients of the latent vectors are penalized to obtain a smoothly varying time-series. The proposed scheme brings in the spatial regularization provided by the convolutional network. The main benefit of the proposed scheme is the improvement in image quality and the orders-of-magnitude reduction in memory demand compared to traditional manifold models. To minimize the computational complexity of the algorithm, we introduce an efficient progressive training-in-time approach and an approximate cost function. These approaches speed up the image reconstructions and offers better reconstruction performance.
Subjects: Image and Video Processing (eess.IV)
Cite as: arXiv:2102.00034 [eess.IV]
  (or arXiv:2102.00034v3 [eess.IV] for this version)

Submission history

From: Qing Zou [view email]
[v1] Fri, 29 Jan 2021 19:32:24 GMT (2751kb,D)
[v2] Thu, 11 Feb 2021 16:11:35 GMT (2775kb,D)
[v3] Thu, 11 Mar 2021 03:44:58 GMT (2776kb,D)

Link back to: arXiv, form interface, contact.