Current browse context:
eess.IV
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Image and Video Processing
Title: A Learnable Variational Model for Joint Multimodal MRI Reconstruction and Synthesis
(Submitted on 8 Apr 2022 (v1), last revised 28 Jun 2022 (this version, v2))
Abstract: Generating multi-contrasts/modal MRI of the same anatomy enriches diagnostic information but is limited in practice due to excessive data acquisition time. In this paper, we propose a novel deep-learning model for joint reconstruction and synthesis of multi-modal MRI using incomplete k-space data of several source modalities as inputs. The output of our model includes reconstructed images of the source modalities and high-quality image synthesized in the target modality. Our proposed model is formulated as a variational problem that leverages several learnable modality-specific feature extractors and a multimodal synthesis module. We propose a learnable optimization algorithm to solve this model, which induces a multi-phase network whose parameters can be trained using multi-modal MRI data. Moreover, a bilevel-optimization framework is employed for robust parameter training. We demonstrate the effectiveness of our approach using extensive numerical experiments.
Submission history
From: Wanyu Bian [view email][v1] Fri, 8 Apr 2022 01:35:19 GMT (9513kb,D)
[v2] Tue, 28 Jun 2022 23:41:08 GMT (9562kb,D)
Link back to: arXiv, form interface, contact.