Current browse context:
eess.IV
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Image and Video Processing
Title: A Data-scalable Transformer for Medical Image Segmentation: Architecture, Model Efficiency, and Benchmark
(Submitted on 28 Feb 2022 (v1), last revised 5 Apr 2023 (this version, v5))
Abstract: Transformers have demonstrated remarkable performance in natural language processing and computer vision. However, existing vision Transformers struggle to learn from limited medical data and are unable to generalize on diverse medical image tasks. To tackle these challenges, we present MedFormer, a data-scalable Transformer designed for generalizable 3D medical image segmentation. Our approach incorporates three key elements: a desirable inductive bias, hierarchical modeling with linear-complexity attention, and multi-scale feature fusion that integrates spatial and semantic information globally. MedFormer can learn across tiny- to large-scale data without pre-training. Comprehensive experiments demonstrate MedFormer's potential as a versatile segmentation backbone, outperforming CNNs and vision Transformers on seven public datasets covering multiple modalities (e.g., CT and MRI) and various medical targets (e.g., healthy organs, diseased tissues, and tumors). We provide public access to our models and evaluation pipeline, offering solid baselines and unbiased comparisons to advance a wide range of downstream clinical applications.
Submission history
From: Yunhe Gao [view email][v1] Mon, 28 Feb 2022 22:59:42 GMT (686kb,D)
[v2] Thu, 3 Mar 2022 03:22:10 GMT (686kb,D)
[v3] Fri, 20 May 2022 05:02:32 GMT (29107kb,D)
[v4] Sun, 26 Jun 2022 17:28:50 GMT (22610kb,D)
[v5] Wed, 5 Apr 2023 01:56:21 GMT (30864kb,D)
Link back to: arXiv, form interface, contact.