1
|
Yang X, Geng H, Wang X, Li L, An X, Cong Z. Identification of lesion location and discrimination between benign and malignant findings in thyroid ultrasound imaging. Sci Rep 2024; 14:32118. [PMID: 39738724 PMCID: PMC11685495 DOI: 10.1038/s41598-024-83888-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2024] [Accepted: 12/18/2024] [Indexed: 01/02/2025] Open
Abstract
Thyroid nodules are a common thyroid disorder, and ultrasound imaging, as the primary diagnostic tool, is susceptible to variations based on the physician's experience, leading to misdiagnosis. This paper constructs an end-to-end thyroid nodule detection framework based on YOLOv8, enabling automatic detection and classification of nodules by extracting grayscale and elastic features from ultrasound images. First, an attention-weighted DCN is introduced to enhance superficial feature extraction and capture local information. Next, the CPCA mechanism is employed to reduce the interference of redundant information. Finally, a feature fusion network based on an aggregation-distribution mechanism is utilized to improve the learning capability of fine-grained features, enhancing the performance of early nodule detection. Experimental results demonstrate that our method is accurate and effective for thyroid nodule detection, achieving diagnostic rates of 89.3% for benign and 90.4% for malignant nodules based on tests conducted on 611 clinical ultrasound images, with a mean Average Precision at IoU = 0.5 (mAP@50) of 95.5%, representing a 6.6% improvement over baseline models.
Collapse
Affiliation(s)
- Xu Yang
- School of Electronic Information Engineering, Changchun University of Science and Technology, Changchun, 130022, China
| | - Hongliang Geng
- School of Electronic Information Engineering, Changchun University of Science and Technology, Changchun, 130022, China
| | - Xue Wang
- Department of Electrodiagnosis, The Affiliated Hospital to Changchun University of Traditional Chinese Medicine, Changchun, 130021, China
| | - Lingxiao Li
- Human Resources Department, The Third Affiliated Hospital of C.C.U.C.M, Changchun, 130117, China
| | - Xiaofeng An
- Education Quality Monitoring Center, Jilin Engineering Normal University, Changchun, 130052, China.
| | - Zhibin Cong
- Department of Electrodiagnosis, The Affiliated Hospital to Changchun University of Traditional Chinese Medicine, Changchun, 130021, China.
| |
Collapse
|
2
|
Chen G, Tan G, Duan M, Pu B, Luo H, Li S, Li K. MLMSeg: A multi-view learning model for ultrasound thyroid nodule segmentation. Comput Biol Med 2024; 169:107898. [PMID: 38176210 DOI: 10.1016/j.compbiomed.2023.107898] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 11/26/2023] [Accepted: 12/23/2023] [Indexed: 01/06/2024]
Abstract
Accurate segmentation of the thyroid gland in ultrasound images is an essential initial step in distinguishing between benign and malignant nodules, thus facilitating early diagnosis. Most existing deep learning-based methods to segment thyroid nodules are learned from only a single view or two views, which limits the performance of segmenting nodules at different scales in complex ultrasound scanning environments. To address this limitation, this study proposes a multi-view learning model, abbreviated as MLMSeg. First, a deep convolutional neural network is introduced to encode the features of the local view. Second, a multi-channel transformer module is designed to capture long-range dependency correlations of global view between different nodules. Third, there are semantic relationships of structural view between features of different layers. For example, low-level features and high-level features are endowed with hidden relationships in the feature space. To this end, a cross-layer graph convolutional module is proposed to adaptively learn the correlations of high-level and low-level features by constructing graphs across different layers. In addition, in the view fusion, a channel-aware graph attention block is devised to fuse the features from the aforementioned views for accurate segmentation of thyroid nodules. To demonstrate the effectiveness of the proposed method, extensive comparative experiments were conducted with 14 baseline methods. MLMSeg achieved higher Dice coefficients (92.10% and 83.84%) and Intersection over Union scores (86.60% and 73.52%) on two different thyroid datasets. The exceptional segmentation capability of MLMSeg for thyroid nodules can greatly assist in localizing thyroid nodules and facilitating more precise measurements of their transverse and longitudinal diameters, which is of significant clinical relevance for the diagnosis of thyroid nodules.
Collapse
Affiliation(s)
- Guanyuan Chen
- College of Computer Science and Electronic Engineering, Hunan University, Changsha 410000, China
| | - Guanghua Tan
- College of Computer Science and Electronic Engineering, Hunan University, Changsha 410000, China.
| | - Mingxing Duan
- College of Computer Science and Electronic Engineering, Hunan University, Changsha 410000, China
| | - Bin Pu
- Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong
| | - Hongxia Luo
- Department of Ultrasonic Diagnosis, Second Affiliated Hospital and Yuying Children's Hospital of Wenzhou Medical University, Zhejiang, China
| | - Shengli Li
- Department of Ultrasound, Shenzhen Maternal and Child Health Hospital, Southern Medical University, Shenzhen, China
| | - Kenli Li
- College of Computer Science and Electronic Engineering, Hunan University, Changsha 410000, China
| |
Collapse
|
3
|
Nugroho A, Hidayat R, Nugroho HA, Debayle J. Combinatorial active contour bilateral filter for ultrasound image segmentation. J Med Imaging (Bellingham) 2020; 7:057003. [PMID: 33344671 PMCID: PMC7746853 DOI: 10.1117/1.jmi.7.5.057003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2019] [Accepted: 10/07/2020] [Indexed: 11/14/2022] Open
Abstract
Purpose: Utilization of computer-aided diagnosis (CAD) on radiological ultrasound (US) imaging has increased tremendously. The prominent CAD applications are found in breast and thyroid cancer investigation. To make appropriate clinical recommendations, it is important to accurately segment the cancerous object called a lesion. Segmentation is a crucial step but undoubtedly a challenging problem due to various perturbations, e.g., speckle noise, intensity inhomogeneity, and low contrast. Approach: We present a combinatorial framework for US image segmentation using a bilateral filter (BF) and hybrid region-edge-based active contour (AC) model. The BF is adopted to smooth images while preserving edges. Then the hybrid model of region and edge-based AC is applied along the scales in a global-to-local manner to capture the lesion areas. The framework was tested in segmenting 258 US images of breast and thyroid, which were validated by manual ground truths. Results: The proposed framework is accessed quantitatively based on the overlapping values of the Dice coefficient, which reaches 90.05±5.81%. The evaluation with and without the BF shows that the enhancement procedure improves the framework well. Conclusions: The high performance of the proposed method in our experimental results indicates its potential for practical implementations in CAD radiological US systems.
Collapse
Affiliation(s)
- Anan Nugroho
- Universitas Gadjah Mada, Department of Electrical and Information Engineering, Yogyakarta, Indonesia.,Universitas Negeri Semarang, Department of Electrical Engineering, Semarang, Indonesia
| | - Risanuri Hidayat
- Universitas Gadjah Mada, Department of Electrical and Information Engineering, Yogyakarta, Indonesia
| | - Hanung A Nugroho
- Universitas Gadjah Mada, Department of Electrical and Information Engineering, Yogyakarta, Indonesia
| | - Johan Debayle
- MINES Saint-Étienne, SPIN/LGF CNRS UMR 5307, Saint-Étienne Cedex 2, France
| |
Collapse
|
4
|
Kosik I, Brackstone M, Kornecki A, Chamson-Reig A, Wong P, Carson JJ. Lipid-weighted intraoperative photoacoustic tomography of breast tumors: Volumetric comparison to preoperative MRI. PHOTOACOUSTICS 2020; 18:100165. [PMID: 32426228 PMCID: PMC7226881 DOI: 10.1016/j.pacs.2020.100165] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/11/2019] [Revised: 01/07/2020] [Accepted: 01/29/2020] [Indexed: 06/01/2023]
Abstract
With a lifetime risk of 1 in 8, breast cancer continues to be a major concern for women and their physicians. The optimal treatment of the disease depends on the stage of the cancer at diagnosis, which is typically assessed using medical imaging. However, currently employed imaging systems for breast tumor measurement rarely agree perfectly. Our group developed an Intraoperative Photoacoustic Screening (iPAS) soft tissue scanner featuring high bulk tissue sensitivity, a clinically compatible scan-time of 6 min, imaging depths greater than 2 cm and the capability to visualize whole breast tumors based on their lipid, rather than hemoglobin, profile. Here, we report on the first clinical experience with breast cancer patients by comparing tumor-measurement using iPAS, preoperative dynamic contrast enhanced magnetic resonance imaging (DCE-MRI) and gold-standard pathology. Tumor size was measured volumetrically for iPAS and DCE-MRI, and separately using maximum diameters for pathology, DCE-MRI and iPAS. Comparisons were performed using Pearson's correlation coefficients, and the non-parametric Wilcoxon signed-rank test. Twelve consecutive patients were included in the study, contingent on pathologically documented invasive carcinoma. iPAS volumetric tumor size was positively correlated to DCE-MRI (Pearson's r = 0.78, p = 0.003) and not significantly different (Wilcoxon, p = 0.97). In comparison to pathology, tumor diameters given by iPAS were positively correlated (Pearson's r = 0.87, p = 0.0002) and significantly different (Wilcoxon, p = 0.0015). The results indicated that volumetric-measurement of invasive breast tumors with iPAS is similar to that of DCE-MRI. On the other hand, tumor diameter measurements were less reliable. Beyond enhancing surgical specimen examination, an extension of this technology to diagnostic imaging promises a new perspective on tumor assessment, potentially improving our current understanding and treatment of breast cancer.
Collapse
Affiliation(s)
- Ivan Kosik
- Imaging Program, Lawson Health Research Institute, London, Ontario, Canada
- Department of Medical Biophysics, Schulich School of Medicine and Dentistry, The University of Western Ontario, London, Ontario, Canada
| | - Muriel Brackstone
- Department of Oncology, Schulich School of Medicine & Dentistry, The University of Western Ontario, London, Ontario, Canada
- Department of Surgery, Schulich School of Medicine & Dentistry, The University of Western Ontario, London, Ontario, Canada
| | - Anat Kornecki
- Imaging Program, Lawson Health Research Institute, London, Ontario, Canada
- Department of Medical Imaging, Schulich School of Medicine and Dentistry, The University of Western Ontario, London, Ontario, Canada
| | | | - Philip Wong
- Imaging Program, Lawson Health Research Institute, London, Ontario, Canada
- Department of Medical Biophysics, Schulich School of Medicine and Dentistry, The University of Western Ontario, London, Ontario, Canada
| | - Jeffrey J.L. Carson
- Imaging Program, Lawson Health Research Institute, London, Ontario, Canada
- Department of Medical Biophysics, Schulich School of Medicine and Dentistry, The University of Western Ontario, London, Ontario, Canada
- Department of Surgery, Schulich School of Medicine & Dentistry, The University of Western Ontario, London, Ontario, Canada
- Department of Physics and Astronomy, Schulich School of Medicine and Dentistry, The University of Western Ontario, London, Ontario, Canada
| |
Collapse
|
5
|
Lee C, Zhou C, Hyde B, Song P, Hangiandreou N. Techniques for Improving Ultrasound Visualization of Biopsy Markers in Axillary Lymph Nodes. J Clin Imaging Sci 2020; 10:21. [PMID: 32363083 PMCID: PMC7193150 DOI: 10.25259/jcis_9_2020] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2020] [Accepted: 04/03/2020] [Indexed: 02/05/2023] Open
Abstract
Objective: Biopsy markers are often placed into biopsy-proven metastatic axillary lymph nodes to ensure later accurate node excision. Ultrasound is the preferred imaging modality in the axilla. However, sonographic identification of biopsy markers after neoadjuvant therapy can be challenging. This is due to poor conspicuity relative to surrounding parenchymal interfaces, treatment-related alteration of malignant morphology during neoadjuvant chemotherapy, or extrusion of the marker from the target. To the authors’ knowledge, the literature provides no recommendations for ultrasound scanning parameters that improve the detection of biopsy markers. The purpose of this manuscript is 3-fold: (1) To determine scanning parameters that improve sonographic conspicuity of biopsy markers in a phantom and cadaver model; (2) to implement these scanning parameters in the clinical setting; and (3) to provide strategies that might increase the likelihood of successful ultrasound detection of biopsy markers in breast imaging practices. Materials and Methods: An ex vivo study was performed using a phantom designed to simulate the heterogeneity of normal mammary or axillary soft tissues. A selection of available biopsy markers was deployed into this phantom and ultrasound (GE LOGIQ E9) was performed. Scanning parameters were adjusted to optimize marker conspicuity. For the cadaver study, the biopsy markers were deployed using ultrasound guidance into axillary lymph nodes of a female cadaver. Adjustments in transducer frequency, dynamic range, cross-beam (spatial compound imaging), beam steering, speckle reduction imaging, harmonic imaging, colorization, and speed of sound were evaluated. Settings that improved marker detection were used clinically for a year. Results: Sonographic scanning settings that improved biopsy marker conspicuity included increasing transducer frequency, decreasing dynamic range, setting cross-beam to medium hybrid, turning on beam steering, and setting speckle reduction imaging in the mid-range. There was no appreciable improvement with harmonic imaging, colorization, or speed of sound. Conclusion: On a currently available clinical ultrasound scanning system, ultrasound scanning parameters can be adjusted to improve the conspicuity of biopsy markers. Overall, optimization requires a balance between techniques that clinically increase contrast (dynamic range, harmonic imaging, and steering) and those that minimize graininess (spatial compound imaging, speckle reduction imaging, and steering). Additional scanning and procedural strategies have been provided to improve the confidence of sonographic detection of biopsy markers closely associated with the intended target.
Collapse
Affiliation(s)
- Christine Lee
- Department of Radiology, Division of Breast Imaging and Intervention, Mayo Clinic, Rochester, China
| | - Chenyun Zhou
- Department of Ultrasound, West China Hospital of Sichuan University, Chengdu, Sichuan, China
| | - Brenda Hyde
- Consulting Radiologists Ltd., Edina, MN, China
| | - Pengfei Song
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL
| | | |
Collapse
|
6
|
Compensated Row-Column Ultrasound Imaging System Using Multilayered Edge Guided Stochastically Fully Connected Random Fields. Sci Rep 2017; 7:10644. [PMID: 28878344 PMCID: PMC5587655 DOI: 10.1038/s41598-017-09534-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2016] [Accepted: 07/12/2017] [Indexed: 11/08/2022] Open
Abstract
The row-column method received a lot of attention for 3-D ultrasound imaging. By reducing the number of connections required to address the 2-D array and therefore reducing the amount of data to handle, this addressing method allows for real time 3-D imaging. Row-column still has its limitations: the issues of sparsity, speckle noise inherent to ultrasound, the spatially varying point spread function, and the ghosting artifacts inherent to the row-column method must all be taken into account when building a reconstruction framework. In this research, we build on a previously published system and propose an edge-guided, compensated row-column ultrasound imaging system that incorporates multilayered edge-guided stochastically fully connected conditional random fields to address the limitations of the row-column method. Tests carried out on simulated and real row-column ultrasound images show the effectiveness of our proposed system over other published systems. Visual assessment show our proposed system's potential at preserving edges and reducing speckle. Quantitative analysis shows that our proposed system outperforms previously published systems when evaluated with metrics such as Peak Signal-to-Noise Ratio, Coefficient of Correlation, and Effective Number of Looks. These results show the potential of our proposed system as an effective tool for enhancing 3-D row-column imaging.
Collapse
|
7
|
Ben Daya I, Chen AIH, Shafiee MJ, Wong A, Yeow JTW. Compensated Row-Column Ultrasound Imaging System Using Fisher Tippett Multilayered Conditional Random Field Model. PLoS One 2015; 10:e0142817. [PMID: 26658577 PMCID: PMC4676696 DOI: 10.1371/journal.pone.0142817] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2015] [Accepted: 10/27/2015] [Indexed: 11/19/2022] Open
Abstract
3-D ultrasound imaging offers unique opportunities in the field of non destructive testing that cannot be easily found in A-mode and B-mode images. To acquire a 3-D ultrasound image without a mechanically moving transducer, a 2-D array can be used. The row column technique is preferred over a fully addressed 2-D array as it requires a significantly lower number of interconnections. Recent advances in 3-D row-column ultrasound imaging systems were largely focused on sensor design. However, these imaging systems face three intrinsic challenges that cannot be addressed by improving sensor design alone: speckle noise, sparsity of data in the imaged volume, and the spatially dependent point spread function of the imaging system. In this paper, we propose a compensated row-column ultrasound image reconstruction system using Fisher-Tippett multilayered conditional random field model. Tests carried out on both simulated and real row-column ultrasound images show the effectiveness of our proposed system as opposed to other published systems. Visual assessment of the results show our proposed system's potential at preserving detail and reducing speckle. Quantitative analysis shows that our proposed system outperforms previously published systems when evaluated with metrics such as Peak Signal to Noise Ratio, Coefficient of Correlation, and Effective Number of Looks. These results show the potential of our proposed system as an effective tool for enhancing 3-D row-column imaging.
Collapse
Affiliation(s)
- Ibrahim Ben Daya
- Department of Systems Design Engineering, University of Waterloo, Ontario, Canada
| | - Albert I. H. Chen
- Department of Systems Design Engineering, University of Waterloo, Ontario, Canada
| | | | - Alexander Wong
- Department of Systems Design Engineering, University of Waterloo, Ontario, Canada
| | - John T. W. Yeow
- Department of Systems Design Engineering, University of Waterloo, Ontario, Canada
- * E-mail:
| |
Collapse
|