We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Cramér-Rao bound-informed training of neural networks for quantitative MRI

Abstract: Neural networks are increasingly used to estimate parameters in quantitative MRI, in particular in magnetic resonance fingerprinting. Their advantages over the gold standard non-linear least square fitting are their superior speed and their immunity to the non-convexity of many fitting problems. We find, however, that in heterogeneous parameter spaces, i.e. in spaces in which the variance of the estimated parameters varies considerably, good performance is hard to achieve and requires arduous tweaking of the loss function, hyper parameters, and the distribution of the training data in parameter space. Here, we address these issues with a theoretically well-founded loss function: the Cram\'er-Rao bound (CRB) provides a theoretical lower bound for the variance of an unbiased estimator and we propose to normalize the squared error with respective CRB. With this normalization, we balance the contributions of hard-to-estimate and not-so-hard-to-estimate parameters and areas in parameter space, and avoid a dominance of the former in the overall training loss. Further, the CRB-based loss function equals one for a maximally-efficient unbiased estimator, which we consider the ideal estimator. Hence, the proposed CRB-based loss function provides an absolute evaluation metric. We compare a network trained with the CRB-based loss with a network trained with the commonly used means squared error loss and demonstrate the advantages of the former in numerical, phantom, and in vivo experiments.
Comments: Xiaoxia Zhang, Quentin Duchemin, and Kangning Liu contributed equally to this work
Subjects: Machine Learning (cs.LG); Image and Video Processing (eess.IV); Medical Physics (physics.med-ph)
MSC classes: 92B20(Primary) 68T07, 92C55(Secondary)
Cite as: arXiv:2109.10535 [cs.LG]
  (or arXiv:2109.10535v2 [cs.LG] for this version)

Submission history

From: Quentin Duchemin [view email]
[v1] Wed, 22 Sep 2021 06:38:03 GMT (4169kb,D)
[v2] Tue, 5 Oct 2021 12:58:01 GMT (4169kb,D)

Link back to: arXiv, form interface, contact.