We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computer Vision and Pattern Recognition

Title: Unsupervised-learning-based method for chest MRI-CT transformation using structure constrained unsupervised generative attention networks

Authors: Hidetoshi Matsuo (1), Mizuho Nishio (1), Munenobu Nogami (1), Feibi Zeng (1), Takako Kurimoto (2), Sandeep Kaushik (3), Florian Wiesinger (3), Atsushi K Kono (1), Takamichi Murakami (1) ((1) Department of Radiology, Kobe University Graduate School of Medicine, Kobe, Japan, (2) GE Healthcare, Hino, Japan and (3) GE Healthcare, Munich, Germany)
Abstract: The integrated positron emission tomography/magnetic resonance imaging (PET/MRI) scanner facilitates the simultaneous acquisition of metabolic information via PET and morphological information with high soft-tissue contrast using MRI. Although PET/MRI facilitates the capture of high-accuracy fusion images, its major drawback can be attributed to the difficulty encountered when performing attenuation correction, which is necessary for quantitative PET evaluation. The combined PET/MRI scanning requires the generation of attenuation-correction maps from MRI owing to no direct relationship between the gamma-ray attenuation information and MRIs. While MRI-based bone-tissue segmentation can be readily performed for the head and pelvis regions, the realization of accurate bone segmentation via chest CT generation remains a challenging task. This can be attributed to the respiratory and cardiac motions occurring in the chest as well as its anatomically complicated structure and relatively thin bone cortex. This paper presents a means to minimise the anatomical structural changes without human annotation by adding structural constraints using a modality-independent neighbourhood descriptor (MIND) to a generative adversarial network (GAN) that can transform unpaired images. The results obtained in this study revealed the proposed U-GAT-IT + MIND approach to outperform all other competing approaches. The findings of this study hint towards possibility of synthesising clinically acceptable CT images from chest MRI without human annotation, thereby minimising the changes in the anatomical structure.
Comments: 27 pages, 12 figures
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Journal reference: Sci Rep 12, 11090 (2022)
DOI: 10.1038/s41598-022-14677-x
Cite as: arXiv:2106.08557 [cs.CV]
  (or arXiv:2106.08557v2 [cs.CV] for this version)

Submission history

From: Hidetoshi Matsuo [view email]
[v1] Wed, 16 Jun 2021 05:22:27 GMT (1384kb)
[v2] Fri, 5 Aug 2022 01:29:25 GMT (5190kb)

Link back to: arXiv, form interface, contact.