1
|
Yan L, Li Q, Fu K, Zhou X, Zhang K. Progress in the Application of Artificial Intelligence in Ultrasound-Assisted Medical Diagnosis. Bioengineering (Basel) 2025; 12:288. [PMID: 40150752 PMCID: PMC11939760 DOI: 10.3390/bioengineering12030288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2025] [Revised: 03/07/2025] [Accepted: 03/12/2025] [Indexed: 03/29/2025] Open
Abstract
The integration of artificial intelligence (AI) into ultrasound medicine has revolutionized medical imaging, enhancing diagnostic accuracy and clinical workflows. This review focuses on the applications, challenges, and future directions of AI technologies, particularly machine learning (ML) and its subset, deep learning (DL), in ultrasound diagnostics. By leveraging advanced algorithms such as convolutional neural networks (CNNs), AI has significantly improved image acquisition, quality assessment, and objective disease diagnosis. AI-driven solutions now facilitate automated image analysis, intelligent diagnostic assistance, and medical education, enabling precise lesion detection across various organs while reducing physician workload. AI's error detection capabilities further enhance diagnostic accuracy. Looking ahead, the integration of AI with ultrasound is expected to deepen, promoting trends in standardization, personalized treatment, and intelligent healthcare, particularly in underserved areas. Despite its potential, comprehensive assessments of AI's diagnostic accuracy and ethical implications remain limited, necessitating rigorous evaluations to ensure effectiveness in clinical practice. This review provides a systematic evaluation of AI technologies in ultrasound medicine, highlighting their transformative potential to improve global healthcare outcomes.
Collapse
Affiliation(s)
- Li Yan
- Institute of Medical Research, Northwestern Polytechnical University, Xi’an 710072, China; (L.Y.); (K.F.)
| | - Qing Li
- Ultrasound Diagnosis & Treatment Center, Xi’an International Medical Center Hospital, Xi’an 710100, China
| | - Kang Fu
- Institute of Medical Research, Northwestern Polytechnical University, Xi’an 710072, China; (L.Y.); (K.F.)
| | - Xiaodong Zhou
- Ultrasound Diagnosis & Treatment Center, Xi’an International Medical Center Hospital, Xi’an 710100, China
| | - Kai Zhang
- Department of Dermatology and Aesthetic Plastic Surgery, Xi’an No. 3 Hospital, The Affiliated Hospital of Northwest University, Xi’an 718000, China
| |
Collapse
|
2
|
Chen B, Yi Y, Zhang C, Yan Y, Wang X, Shui W, Zhou M, Yang G, Ying T. Automatic anal sphincter integrity detection from ultrasound images via convolutional neural networks. Technol Health Care 2025; 33:103-114. [PMID: 39213111 DOI: 10.3233/thc-240569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/04/2024]
Abstract
BACKGROUND The anal sphincter complex comprises the anal sphincter and the U-shaped deep and superficial puborectalis muscle. As an important supporting structure of the posterior pelvic floor, together with its surrounding tissues and muscles, the anal sphincter complex maintains the normal physiological functions of defecation and continence. OBJECTIVE The plane required for diagnosing anal sphincter injury and the diagnosis of anal sphincter integrity through pelvic floor ultrasound are highly dependent on sonographers' experience. We developed a deep learning (DL) tool for the automatic diagnosis of anal sphincter integrity via pelvic floor ultrasound. METHODS A 2D detection network was trained to detect the bounding box of the anal sphincter. The pelvic floor ultrasound image and its corresponding oval mask were input into a 2D classification network to determine the integrity of the anal sphincter. The average precision (AP) and intersection over union (IoU) were used to evaluate the performance of anal sphincter detection. Receiver operating characteristic (ROC) analysis was used to evaluate the performance of the classification model. RESULTS The Pearson correlation coefficients (r values) of the topmost and bottommost layers detected by the CNN and sonographers were 0.932 and 0.978, respectively. The best DL model yielded the highest area under the curve (AUC) of 0.808 (95% CI: 0.698-0.921) in the test cohort. The results from the CNN agreed well with the diagnostic results of experienced sonographers. CONCLUSIONS We proposed, for the first time, a CNN to obtain the plane required for diagnosing anal sphincter injury on the basis of pelvic floor ultrasound and for preliminarily diagnosing anal sphincter injury.
Collapse
Affiliation(s)
- Bin Chen
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Shanghai Institute of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Yinqiao Yi
- Shanghai Key Laboratory of Magnetic Resonance, School of Physics and Electronic Science, East China Normal University, Shanghai, China
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Chengxiu Zhang
- Shanghai Key Laboratory of Magnetic Resonance, School of Physics and Electronic Science, East China Normal University, Shanghai, China
| | - Yulin Yan
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Shanghai Institute of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Xia Wang
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Shanghai Institute of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Wen Shui
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Shanghai Institute of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Minzhi Zhou
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Shanghai Institute of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Guang Yang
- Shanghai Key Laboratory of Magnetic Resonance, School of Physics and Electronic Science, East China Normal University, Shanghai, China
| | - Tao Ying
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Shanghai Institute of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| |
Collapse
|
3
|
Guo Z, Lu X, Yao J, Zhou Y, Chen C, Chen J, Yang D, Cao Y, Zheng W, Yang X, Ni D. Fully Automated Localization and Measurement of Levator Hiatus Dimensions Using 3-D Pelvic Floor Ultrasound. ULTRASOUND IN MEDICINE & BIOLOGY 2024; 50:1329-1338. [PMID: 38845332 DOI: 10.1016/j.ultrasmedbio.2024.05.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Revised: 04/26/2024] [Accepted: 05/05/2024] [Indexed: 08/06/2024]
Abstract
OBJECTIVE To develop an algorithm for the automated localization and measurement of levator hiatus (LH) dimensions (AI-LH) using 3-D pelvic floor ultrasound. METHODS The AI-LH included a 3-D plane regression model and a 2-D segmentation model, which first achieved automated localization of the minimal LH dimension plane (C-plane) and measurement of the hiatal area (HA) on maximum Valsalva on the rendered LH images, but not on the C-plane. The dataset included 600 volumetric data. We compared AI-LH with sonographer difference (ASD) as well as the inter-sonographer differences (IESD) in the testing dataset (n = 240). The assessment encompassed the mean absolute error (MAE) for the angle and center point distance of the C-plane, along with the Dice coefficient, MAE, and intra-class correlation coefficient (ICC) for HA, and included the time consumption. RESULTS The MAE of the C-plane of ASD was 4.81 ± 2.47° with 1.92 ± 1.54 mm. AI-LH achieved a mean Dice coefficient of 0.93 for LH segmentation. The MAE on HA of ASD (1.44 ± 1.12 mm²) was lower than that of IESD (1.63 ± 1.58 mm²). The ICC on HA of ASD (0.964) was higher than that of IESD (0.949). The average time costs of AI-LH and manual measurement were 2.00 ± 0.22 s and 59.60 ± 2.63 s (t = 18.87, p < 0.01), respectively. CONCLUSION AI-LH is accurate, reliable, and robust in the localization and measurement of LH dimensions, which can shorten the time cost, simplify the operation process, and have good value in clinical applications.
Collapse
Affiliation(s)
- Zhijie Guo
- Department of Ultrasound, Shenzhen Bao'an Chinese Medicine Hospital, Guangzhou University of Chinese Medicine, Shenzhen, China
| | - Xiduo Lu
- Shenzhen RayShape Medical Technology Co., Ltd, Shenzhen, China
| | - Jiezhi Yao
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China; Marshall Laboratory of Biomedical Engineering, Shenzhen University, Shenzhen, China; Medical UltraSound Image Computing (MUSIC) Lab, Shenzhen, China
| | - Yongsong Zhou
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China; Marshall Laboratory of Biomedical Engineering, Shenzhen University, Shenzhen, China; Medical UltraSound Image Computing (MUSIC) Lab, Shenzhen, China
| | - Chaoyu Chen
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China; Marshall Laboratory of Biomedical Engineering, Shenzhen University, Shenzhen, China; Medical UltraSound Image Computing (MUSIC) Lab, Shenzhen, China
| | - Jiongquan Chen
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China; Marshall Laboratory of Biomedical Engineering, Shenzhen University, Shenzhen, China; Medical UltraSound Image Computing (MUSIC) Lab, Shenzhen, China
| | - Danling Yang
- Department of Ultrasound, Shenzhen Bao'an Chinese Medicine Hospital, Guangzhou University of Chinese Medicine, Shenzhen, China
| | - Yan Cao
- Shenzhen RayShape Medical Technology Co., Ltd, Shenzhen, China
| | - Wei Zheng
- Department of Ultrasound, Shenzhen Bao'an Chinese Medicine Hospital, Guangzhou University of Chinese Medicine, Shenzhen, China
| | - Xin Yang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China; Marshall Laboratory of Biomedical Engineering, Shenzhen University, Shenzhen, China; Medical UltraSound Image Computing (MUSIC) Lab, Shenzhen, China
| | - Dong Ni
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China; Marshall Laboratory of Biomedical Engineering, Shenzhen University, Shenzhen, China; Medical UltraSound Image Computing (MUSIC) Lab, Shenzhen, China.
| |
Collapse
|
4
|
Resta S, De Vito M, Patelli C, Lu JLA, Gabrielli G, Chiodo E, Mappa I, Rizzo G. Validation of an automated software (Smartpelvic™) in assessing hiatal area from three dimensional transperineal pelvic volumes of pregnant women: comparison with manual analysis. J Perinat Med 2024; 52:165-170. [PMID: 37938105 DOI: 10.1515/jpm-2023-0323] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Accepted: 10/02/2023] [Indexed: 11/09/2023]
Abstract
OBJECTIVES The aim of this investigation was to evaluate the agreement between a manual and an automatic technique in assessing levator hiatus area (LHA) during pregnancy from three-dimensional (3D) pelvic floor volumes obtained by trans-perineal ultrasound (TPUS). METHODS 3D volumes were acquired during rest, maximum pelvic floor contraction and Valsalva maneuver from 66 pregnant women. Manual selection of LHA and automatic software (Smart Pelvic™) were applied on TPUS volume starting from a C-plane view. To evaluate intra- and inter-observer variability measurements of LHA were performed twice by the same operator and once by a second sonographer. Reference hiatal contours obtained manually by the first operator were compared with the automated ones. Reproducibility was evaluated by intraclass correlation coefficients (ICC) and Bland-Altman plots. RESULTS LHA measurement, using automatic software, achieved excellent intra-observer and inter-observer reproducibility in pregnant women both at rest and after dynamic analysis (ICC>0.9). Further, an excellent agreement resulted between manual selection of the LHA and automatic imaging (ICC>0.9). The average time taken to obtain LHA manually was significantly longer when compared to the automatic analysis (p≤0.0001). CONCLUSIONS Smart pelvic software resulted from a reliable method for automatically measuring the LHA, showing high reproducibility and accuracy.
Collapse
Affiliation(s)
- Serena Resta
- Department of Obstetrics and Gynecology, Università di Roma Tor Vergata, Rome, Italy
| | - Marika De Vito
- Department of Obstetrics and Gynecology, Università di Roma Tor Vergata, Rome, Italy
| | - Chiara Patelli
- Department of Obstetrics and Gynecology, Università di Verona, Verona Italy
| | - Jia Li Angela Lu
- Department of Obstetrics and Gynecology, Università di Roma Tor Vergata, Rome, Italy
| | - Gianluca Gabrielli
- Department of Obstetrics and Gynecology, Università di Roma Tor Vergata, Rome, Italy
| | - Erika Chiodo
- Department of Obstetrics and Gynecology, Università di Roma Tor Vergata, Rome, Italy
| | - Ilenia Mappa
- Department of Obstetrics and Gynecology, Università di Roma Tor Vergata, Rome, Italy
| | - Giuseppe Rizzo
- Department of Obstetrics and Gynecology, Università di Roma Tor Vergata, Rome, Italy
| |
Collapse
|
5
|
Jost E, Kosian P, Jimenez Cruz J, Albarqouni S, Gembruch U, Strizek B, Recker F. Evolving the Era of 5D Ultrasound? A Systematic Literature Review on the Applications for Artificial Intelligence Ultrasound Imaging in Obstetrics and Gynecology. J Clin Med 2023; 12:6833. [PMID: 37959298 PMCID: PMC10649694 DOI: 10.3390/jcm12216833] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Revised: 10/17/2023] [Accepted: 10/25/2023] [Indexed: 11/15/2023] Open
Abstract
Artificial intelligence (AI) has gained prominence in medical imaging, particularly in obstetrics and gynecology (OB/GYN), where ultrasound (US) is the preferred method. It is considered cost effective and easily accessible but is time consuming and hindered by the need for specialized training. To overcome these limitations, AI models have been proposed for automated plane acquisition, anatomical measurements, and pathology detection. This study aims to overview recent literature on AI applications in OB/GYN US imaging, highlighting their benefits and limitations. For the methodology, a systematic literature search was performed in the PubMed and Cochrane Library databases. Matching abstracts were screened based on the PICOS (Participants, Intervention or Exposure, Comparison, Outcome, Study type) scheme. Articles with full text copies were distributed to the sections of OB/GYN and their research topics. As a result, this review includes 189 articles published from 1994 to 2023. Among these, 148 focus on obstetrics and 41 on gynecology. AI-assisted US applications span fetal biometry, echocardiography, or neurosonography, as well as the identification of adnexal and breast masses, and assessment of the endometrium and pelvic floor. To conclude, the applications for AI-assisted US in OB/GYN are abundant, especially in the subspecialty of obstetrics. However, while most studies focus on common application fields such as fetal biometry, this review outlines emerging and still experimental fields to promote further research.
Collapse
Affiliation(s)
- Elena Jost
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Philipp Kosian
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Jorge Jimenez Cruz
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Shadi Albarqouni
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
- Helmholtz AI, Helmholtz Munich, Ingolstädter Landstraße 1, 85764 Neuherberg, Germany
| | - Ulrich Gembruch
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Brigitte Strizek
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Florian Recker
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| |
Collapse
|
6
|
van den Noort F, Manzini C, van der Vaart CH, van Limbeek MAJ, Slump CH, Grob ATM. Reply. ULTRASOUND IN OBSTETRICS & GYNECOLOGY : THE OFFICIAL JOURNAL OF THE INTERNATIONAL SOCIETY OF ULTRASOUND IN OBSTETRICS AND GYNECOLOGY 2022; 60:589-590. [PMID: 36183346 DOI: 10.1002/uog.26056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Affiliation(s)
- F van den Noort
- Robotics and Mechatronics, Faculty of Electrical Engineering Mathematics and Computer Science, Technical Medical Centre, University of Twente, Enschede, The Netherlands
| | - C Manzini
- Department of Obstetrics and Gynecology, University Medical Centre Utrecht, Utrecht, The Netherlands
| | - C H van der Vaart
- Department of Obstetrics and Gynecology, University Medical Centre Utrecht, Utrecht, The Netherlands
| | - M A J van Limbeek
- Dynamics of Complex Fluids, Max Planck Institute for Dynamics and Self-Organization, Göttingen, Germany
| | - C H Slump
- Robotics and Mechatronics, Faculty of Electrical Engineering Mathematics and Computer Science, Technical Medical Centre, University of Twente, Enschede, The Netherlands
| | - A T M Grob
- Multi-Modality Medical Imaging, Faculty of Science and Technology, Technical Medical Centre, University of Twente, Enschede, The Netherlands
| |
Collapse
|
7
|
Huang Z, Qu E, Meng Y, Zhang M, Wei Q, Bai X, Zhang X. Deep learning-based pelvic levator hiatus segmentation from ultrasound images. Eur J Radiol Open 2022; 9:100412. [PMID: 35345817 PMCID: PMC8956942 DOI: 10.1016/j.ejro.2022.100412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2022] [Revised: 02/27/2022] [Accepted: 03/09/2022] [Indexed: 11/29/2022] Open
Abstract
Purpose To automatically segment and measure the levator hiatus with a deep learning approach and evaluate the performance between algorithms, sonographers, and different devices. Methods Three deep learning models (UNet-ResNet34, HR-Net, and SegNet) were trained with 360 images and validated with 42 images. The trained models were tested with two test sets. The first set included 138 images to evaluate the performance between the algorithms and sonographers. An independent dataset including 679 images assessed the performances of algorithms between different ultrasound devices. Four metrics were used for evaluation: DSC, HDD, the relative error of segmentation area, and the absolute error of segmentation area. Results The UNet model outperformed HR-Net and SegNet. It could achieve a mean DSC of 0.964 for the first test set and 0.952 for the independent test set. UNet was creditable compared with three senior sonographers with a noninferiority test in the first test set and equivalent in the two test sets collected by different devices. On average, it took two seconds to process one case with a GPU and 2.4 s with a CPU. Conclusions The deep learning approach has good performance for levator hiatus segmentation and good generalization ability on independent test sets. This automatic levator hiatus segmentation approach could help shorten the clinical examination time and improve consistency.
Collapse
Affiliation(s)
- Zeping Huang
- Department of Ultrasound, the Third Affiliated Hospital of Sun Yat-sen University, 600 Tianhe Road, Guangzhou 510630, China
| | - Enze Qu
- Department of Ultrasound, the Third Affiliated Hospital of Sun Yat-sen University, 600 Tianhe Road, Guangzhou 510630, China
| | - Yishuang Meng
- Philips (China) Investment Co. Ltd, 6F, Building A2, 718 Lingshi Road, Shanghai 200072, China
| | - Man Zhang
- Department of Ultrasound, the Third Affiliated Hospital of Sun Yat-sen University, 600 Tianhe Road, Guangzhou 510630, China
| | - Qiuwen Wei
- Philips (China) Investment Co. Ltd, 6F, Building A2, 718 Lingshi Road, Shanghai 200072, China
| | - Xianghui Bai
- Philips (China) Investment Co. Ltd, 6F, Building A2, 718 Lingshi Road, Shanghai 200072, China
| | - Xinling Zhang
- Department of Ultrasound, the Third Affiliated Hospital of Sun Yat-sen University, 600 Tianhe Road, Guangzhou 510630, China
| |
Collapse
|