1
|
Zeng X, Huang R, Zhong Y, Xu Z, Liu Z, Wang Y. A reciprocal learning strategy for semisupervised medical image segmentation. Med Phys 2023; 50:163-177. [PMID: 35950367 DOI: 10.1002/mp.15923] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Revised: 08/02/2022] [Accepted: 08/04/2022] [Indexed: 01/25/2023] Open
Abstract
BACKGROUND Semisupervised strategy has been utilized to alleviate issues from segmentation applications due to challenges in collecting abundant annotated segmentation masks, which is an essential prerequisite for training high-performance 3D convolutional neural networks (CNNs) . PURPOSE Existing semisupervised segmentation methods are mainly concerned with how to generate the pseudo labels with regularization but not evaluate the quality of the pseudo labels explicitly. To alleviate this problem, we offer a simple yet effective reciprocal learning strategy for semisupervised volumetric medical image segmentation, which generates more reliable pseudo labels for the unannotated data. METHODS Our proposed reciprocal learning is achieved through a pair of networks, one as a teacher network and the other as a student network. The student network learns from pseudo labels generated by the teacher network. In addition, the teacher network autonomously optimizes its parameters based on the reciprocal feedback signals from the student's performance on the annotated images. The efficacy of the proposed method is evaluated on three medical image data sets, including 82 pancreas computed tomography (CT) scans (training/testing: 62/20), 100 left atrium gadolinium-enhanced magnetic resonance (MR) scans (training/testing: 80/20), and 200 breast cancer MR scans (training/testing: 68/132). The comparison methods include mean teacher (MT) model, uncertainty-aware MT (UA-MT) model, shape-aware adversarial network (SASSNet), and transformation-consistent self-ensembling model (TCSM). The evaluation metrics are Dice similarity coefficient (Dice), Jaccard index (Jaccard), 95% Hausdorff distance (95HD), and average surface distance (ASD). The Wilcoxon signed-rank test is used to conduct the statistical analyses. RESULTS By utilizing 20% labeled data and 80% unlabeled data for training, our proposed method achieves an average Dice of 84.77%/90.46%/78.53%, Jaccard of 73.71%/82.67%/69.00%, ASD of 1.58/1.90/0.57, and 95HD of 6.24/5.97/4.34 on pancreas/left atrium/breast data sets, respectively. These results outperform several cutting-edge semisupervised approaches, showing the feasibility of our method for the challenging semisupervised segmentation applications. CONCLUSIONS The proposed reciprocal learning strategy is a general semisupervised solution and has the potential to be applied for other 3D segmentation tasks.
Collapse
Affiliation(s)
- Xiangyun Zeng
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China.,Smart Medical Imaging, Learning and Engineering (SMILE) Lab, Shenzhen University, Shenzhen, China.,Medical UltraSound Image Computing (MUSIC) Lab, Shenzhen University, Shenzhen, China
| | - Rian Huang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China.,Smart Medical Imaging, Learning and Engineering (SMILE) Lab, Shenzhen University, Shenzhen, China.,Medical UltraSound Image Computing (MUSIC) Lab, Shenzhen University, Shenzhen, China
| | - Yuming Zhong
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China.,Smart Medical Imaging, Learning and Engineering (SMILE) Lab, Shenzhen University, Shenzhen, China.,Medical UltraSound Image Computing (MUSIC) Lab, Shenzhen University, Shenzhen, China
| | - Zeyan Xu
- Department of Radiology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangzhou, China.,Guangdong Provincial Key Laboratory of Artificial Intelligence in Medical Image Analysis and Application, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangzhou, China
| | - Zaiyi Liu
- Department of Radiology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangzhou, China.,Guangdong Provincial Key Laboratory of Artificial Intelligence in Medical Image Analysis and Application, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangzhou, China
| | - Yi Wang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China.,Smart Medical Imaging, Learning and Engineering (SMILE) Lab, Shenzhen University, Shenzhen, China.,Medical UltraSound Image Computing (MUSIC) Lab, Shenzhen University, Shenzhen, China.,Marshall Laboratory of Biomedical Engineering, Shenzhen University, Shenzhen, China
| |
Collapse
|