Current browse context:
eess.IV
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Image and Video Processing
Title: TransMorph: Transformer for unsupervised medical image registration
(Submitted on 19 Nov 2021 (v1), last revised 15 Oct 2022 (this version, v6))
Abstract: In the last decade, convolutional neural networks (ConvNets) have been a major focus of research in medical image analysis. However, the performances of ConvNets may be limited by a lack of explicit consideration of the long-range spatial relationships in an image. Recently Vision Transformer architectures have been proposed to address the shortcomings of ConvNets and have produced state-of-the-art performances in many medical imaging applications. Transformers may be a strong candidate for image registration because their substantially larger receptive field enables a more precise comprehension of the spatial correspondence between moving and fixed images. Here, we present TransMorph, a hybrid Transformer-ConvNet model for volumetric medical image registration. This paper also presents diffeomorphic and Bayesian variants of TransMorph: the diffeomorphic variants ensure the topology-preserving deformations, and the Bayesian variant produces a well-calibrated registration uncertainty estimate. We extensively validated the proposed models using 3D medical images from three applications: inter-patient and atlas-to-patient brain MRI registration and phantom-to-CT registration. The proposed models are evaluated in comparison to a variety of existing registration methods and Transformer architectures. Qualitative and quantitative results demonstrate that the proposed Transformer-based model leads to a substantial performance improvement over the baseline methods, confirming the effectiveness of Transformers for medical image registration.
Submission history
From: Junyu Chen [view email][v1] Fri, 19 Nov 2021 23:37:39 GMT (27545kb,D)
[v2] Tue, 23 Nov 2021 02:56:26 GMT (27545kb,D)
[v3] Tue, 28 Dec 2021 23:17:55 GMT (37443kb,D)
[v4] Sun, 23 Jan 2022 22:42:21 GMT (30668kb,D)
[v5] Mon, 5 Sep 2022 02:21:56 GMT (28500kb,D)
[v6] Sat, 15 Oct 2022 22:03:43 GMT (28500kb,D)
Link back to: arXiv, form interface, contact.