1
|
Bransby KM, Bajaj R, Ramasamy A, Çap M, Yap N, Slabaugh G, Bourantas C, Zhang Q. POLYCORE: Polygon-based contour refinement for improved Intravascular Ultrasound Segmentation. Comput Biol Med 2024; 182:109162. [PMID: 39305731 DOI: 10.1016/j.compbiomed.2024.109162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2024] [Revised: 09/14/2024] [Accepted: 09/16/2024] [Indexed: 11/14/2024]
Abstract
Segmentation of the coronary vessel wall in intravascular ultrasound is a fundamental step in guiding coronary intervention. However, it is an challenging task, even for highly skilled cardiologists, due to image artefacts and shadowed regions caused by calcified plaque, guide wires and vessel side branches. Recently, dense-based neural networks have been applied to this task, however, they often fail to predict anatomically plausible contours in these low-signal areas. We propose a novel methodology called Polygon-based Contour Refiner (POLYCORE) that addresses topological error in dense-based segmentation networks using a relational inductive bias through higher-order connections between vertices to learn anatomically rational contours. Our approach remedies the over-smoothing phenomena common in polygon networks by introducing a new vector field refinement module which enables pixel-level detail to be added in an iterative process. POLYCORE is enhanced with augmented polygon aggregation which we show is more effective than typical dense-based test-time augmentation strategies. We achieve state-of-the-art results on two diverse datasets, observing particular improvements when segmenting the lumen structure and in topologically-challenging regions containing shadow artefacts. Our source code is available here: https://github.com/kitbransby/POLYCORE.
Collapse
Affiliation(s)
- Kit Mills Bransby
- School of Electronic Engineering and Computer Science, Queen Mary University of London, UK; Digital Environment Research Institute, Queen Mary University of London, UK
| | - Retesh Bajaj
- Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK; Department of Cardiology, Barts Health NHS Trust, London, UK
| | - Anantharaman Ramasamy
- Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK; Department of Cardiology, Barts Health NHS Trust, London, UK
| | - Murat Çap
- Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK; Department of Cardiology, Barts Health NHS Trust, London, UK
| | - Nathan Yap
- Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK; Department of Cardiology, Barts Health NHS Trust, London, UK
| | - Gregory Slabaugh
- School of Electronic Engineering and Computer Science, Queen Mary University of London, UK; Digital Environment Research Institute, Queen Mary University of London, UK
| | - Christos Bourantas
- Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK; Department of Cardiology, Barts Health NHS Trust, London, UK
| | - Qianni Zhang
- School of Electronic Engineering and Computer Science, Queen Mary University of London, UK; Digital Environment Research Institute, Queen Mary University of London, UK.
| |
Collapse
|
2
|
Arora P, Singh P, Girdhar A, Vijayvergiya R. A State-Of-The-Art Review on Coronary Artery Border Segmentation Algorithms for Intravascular Ultrasound (IVUS) Images. Cardiovasc Eng Technol 2023; 14:264-295. [PMID: 36650320 DOI: 10.1007/s13239-023-00654-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Revised: 11/28/2022] [Accepted: 01/02/2023] [Indexed: 01/19/2023]
Abstract
Intravascular Ultrasound images (IVUS) is a useful guide for medical practitioners to identify the vascular status of coronary arteries in human beings. IVUS is a unique intracoronary imaging modality that is used as an adjunct to angioplasty to view vessel structures using a catheter with high resolutions. Segmentation of IVUS images has always remained a challenging task due to various impediments, for example, similar tissue components, vessel structures, and artifacts imposed during the acquisition process. Many researchers have applied various techniques to develop standard methods of image interpretation, however, the ultimate goal is still elusive to most researchers. This challenge was presented at the MICCAI- Computing and Visualization for (Intra)Vascular Imaging (CVII) workshop in 2011. This paper presents a major review of recently reported work in the field, with a detailed analysis of various segmentation techniques applied in IVUS, and highlights the directions for future research. The findings recommend a reference database with a larger number of samples acquired at varied transducer frequencies with special consideration towards complex lesions, suitable validation metrics, and ground-truth definition as a standard against which to compare new and current algorithms.
Collapse
Affiliation(s)
- Priyanka Arora
- Research Scholar, IKG Punjab Technical University, Punjab, India. .,Department of Computer Science and Engineering, Guru Nanak Dev Engineering College, Ludhiana, Punjab, India.
| | - Parminder Singh
- Department of Computer Science and Engineering, Guru Nanak Dev Engineering College, Ludhiana, Punjab, India
| | - Akshay Girdhar
- Department of Information Technology, Guru Nanak Dev Engineering College, Ludhiana, Punjab, India
| | - Rajesh Vijayvergiya
- Department of Cardiology, Advanced Cardiac Centre, Post Graduate Institute of Medical Education and Research (PGIMER), Chandigarh, India
| |
Collapse
|
3
|
Multilevel structure-preserved GAN for domain adaptation in intravascular ultrasound analysis. Med Image Anal 2022; 82:102614. [PMID: 36115099 DOI: 10.1016/j.media.2022.102614] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 07/17/2022] [Accepted: 09/02/2022] [Indexed: 11/21/2022]
Abstract
The poor generalizability of intravascular ultrasound (IVUS) analysis methods caused by the great diversity of IVUS datasets is hopefully addressed by the domain adaptation strategy. However, existing domain adaptation models underperform in intravascular structural preservation, because of the complex pathology and low contrast in IVUS images. Losing structural information during the domain adaptation would lead to inaccurate analyses of vascular states. In this paper, we propose a Multilevel Structure-Preserved Generative Adversarial Network (MSP-GAN) for transferring IVUS domains while maintaining intravascular structures. On the generator-discriminator baseline, the MSP-GAN integrates the transformer, contrastive restraint, and self-ensembling strategy, for effectively preserving structures in multi-levels, including global, local, and fine levels. For the global-level pathology maintenance, the generator explores long-range dependencies in IVUS images via an incorporated vision transformer. For the local-level anatomy consistency, a region-to-region correspondence is forced between the translated and source images via a superpixel-wise multiscale contrastive (SMC) constraint. For reducing distortions of fine-level structures, a self-ensembling mean teacher generates the pixel-wise pseudo-label and restricts the translated image via an uncertainty-aware teacher-student consistency (TSC) constraint. Experiments were conducted on 20 MHz and 40 MHz IVUS datasets from different medical centers. Ablation studies illustrate that each innovation contributes to intravascular structural preservation. Comparisons with representative domain adaptation models illustrate the superiority of the MSP-GAN in the structural preservation. Further comparisons with the state-of-the-art IVUS analysis accuracy demonstrate that the MSP-GAN is effective in enlarging the generalizability of diverse IVUS analysis methods and promoting accurate vessel and lumen segmentation and stenosis-related parameter quantification.
Collapse
|
4
|
Su B, Wang Z, Gong Y, Li M, Teng Y, Yu S, Zong Y, Yao W, Wang J. Anal center detection and classification of perianal healthy condition. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103759] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
5
|
Detection of Healthy and Diseased Pylorus Natural Anatomical Center with Convolutional Neural Network Classification and Filters. J Med Biol Eng 2022. [DOI: 10.1007/s40846-022-00696-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
6
|
Zhang P, Zhang L, Zhao R. Application of MRI images based on Spatial Fuzzy Clustering Algorithm guided by Neuroendoscopy in the treatment of Tumors in the Saddle Region. Pak J Med Sci 2021; 37:1600-1604. [PMID: 34712290 PMCID: PMC8520360 DOI: 10.12669/pjms.37.6-wit.4850] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Revised: 06/12/2021] [Accepted: 07/18/2021] [Indexed: 01/02/2023] Open
Abstract
Objective: The paper applies spatial fuzzy clustering algorithm to explore the role and value of neuroendoscopic assisted technology in the operation of tumors in the saddle region, and analyze the MRI image characteristics of tumors in the saddle region. Methods: The clinical data of 63 patients from our hospital who underwent neuroendoscopic assisted microscopy to remove tumors in the saddle area from 2017 to 2019 (neuroendoscopy-assisted group) were collected. Seventy six patients who occupied the saddle area by microscopic resection only in the same period (Simple microscope group) clinical data. By comparing the patient’s tumor resection rate, postoperative complication rate and postoperative recurrence rate, the surgical effect was evaluated. Results: The total resection rates of the tumors in the neuroendoscopy-assisted group and the microscope-only group were 95.24% (60/63) and 80.26% (61/76). The incidence of postoperative vasospasm was 3.17% (2/63) and 13.16% (10/76), the incidence of nerve injury was 0 (0/63) and 6.58% (5/76), the difference was statistically significant (P <0.05). There was no significant difference in the incidence of postoperative infection, cerebrospinal fluid leakage and postoperative recurrence rate between the two groups (P> 0.05). Conclusion: Neuroendoscopy-assisted microscopy-based removal of the saddle area occupying space based on spatial fuzzy clustering algorithm can increase the total tumor resection rate and reduce the incidence of complications.
Collapse
Affiliation(s)
- Peng Zhang
- Peng Zhang, Attending Physician. Department of Neurosurgery, Chongqing Three Gorges Central Hospital, 165 Xincheng Road, Wanzhou District, Chongqing, 404100, China
| | - Lingdang Zhang
- Lingdang Zhang, Attending Physician. Department of Neurosurgery, Chongqing Three Gorges Central Hospital, 165 Xincheng Road, Wanzhou District, Chongqing, 404100, China
| | - Rui Zhao
- Rui Zhao, Associate Chief Physician. Department of Neurosurgery, Chongqing Three Gorges Central Hospital, 165 Xincheng Road, Wanzhou District, Chongqing, 404100, China
| |
Collapse
|
7
|
Bajaj R, Huang X, Kilic Y, Ramasamy A, Jain A, Ozkor M, Tufaro V, Safi H, Erdogan E, Serruys PW, Moon J, Pugliese F, Mathur A, Torii R, Baumbach A, Dijkstra J, Zhang Q, Bourantas CV. Advanced deep learning methodology for accurate, real-time segmentation of high-resolution intravascular ultrasound images. Int J Cardiol 2021; 339:185-191. [PMID: 34153412 DOI: 10.1016/j.ijcard.2021.06.030] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/30/2021] [Revised: 04/10/2021] [Accepted: 06/15/2021] [Indexed: 11/29/2022]
Abstract
AIMS The aim of this study is to develop and validate a deep learning (DL) methodology capable of automated and accurate segmentation of intravascular ultrasound (IVUS) image sequences in real-time. METHODS AND RESULTS IVUS segmentation was performed by two experts who manually annotated the external elastic membrane (EEM) and lumen borders in the end-diastolic frames of 197 IVUS sequences portraying the native coronary arteries of 65 patients. The IVUS sequences of 177 randomly-selected vessels were used to train and optimise a novel DL model for the segmentation of IVUS images. Validation of the developed methodology was performed in 20 vessels using the estimations of two expert analysts as the reference standard. The mean difference for the EEM, lumen and plaque area between the DL-methodology and the analysts was ≤0.23mm2 (standard deviation ≤0.85mm2), while the Hausdorff and mean distance differences for the EEM and lumen borders was ≤0.19 mm (standard deviation≤0.17 mm). The agreement between DL and experts was similar to experts' agreement (Williams Index ranges: 0.754-1.061) with similar results in frames portraying calcific plaques or side branches. CONCLUSIONS The developed DL-methodology appears accurate and capable of segmenting high-resolution real-world IVUS datasets. These features are expected to facilitate its broad adoption and enhance the applications of IVUS in clinical practice and research.
Collapse
Affiliation(s)
- Retesh Bajaj
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, London, UK; Cardiovascular Devices Hub, Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK
| | - Xingru Huang
- School of Electronic Engineering and Computer Science, Queen Mary University of London, UK
| | - Yakup Kilic
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, London, UK
| | - Anantharaman Ramasamy
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, London, UK; Cardiovascular Devices Hub, Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK
| | - Ajay Jain
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, London, UK
| | - Mick Ozkor
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, London, UK
| | - Vincenzo Tufaro
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, London, UK
| | - Hannah Safi
- Department of Mechanical Engineering, University College London, London, UK
| | - Emrah Erdogan
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, London, UK
| | - Patrick W Serruys
- Faculty of Medicine, National Heart & Lung Institute, Imperial College London, UK
| | - James Moon
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, London, UK; Institute of Cardiovascular Sciences, University College London, London, UK
| | - Francesca Pugliese
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, London, UK; Cardiovascular Devices Hub, Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK
| | - Anthony Mathur
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, London, UK; Cardiovascular Devices Hub, Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK
| | - Ryo Torii
- Department of Mechanical Engineering, University College London, London, UK
| | - Andreas Baumbach
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, London, UK; Cardiovascular Devices Hub, Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK
| | - Jouke Dijkstra
- Department of Radiology, Division of Image Processing, Leiden University Medical Center, Leiden, the Netherlands
| | - Qianni Zhang
- School of Electronic Engineering and Computer Science, Queen Mary University of London, UK
| | - Christos V Bourantas
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, London, UK; Cardiovascular Devices Hub, Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK; Institute of Cardiovascular Sciences, University College London, London, UK.
| |
Collapse
|
8
|
Chakraborty T, Banik SK, Bhadra AK, Nandi D. Dynamically learned PSO based neighborhood influenced fuzzy c-means for pre-treatment and post-treatment organ segmentation from CT images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 202:105971. [PMID: 33611030 DOI: 10.1016/j.cmpb.2021.105971] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Accepted: 02/01/2021] [Indexed: 06/12/2023]
Abstract
BACKGROUND AND OBJECTIVE The accurate segmentation of pre-treatment and post-treatment organs is always perceived as a challenging task in medical image analysis field. Especially, in those situations where the amount of data set is limited, the researchers are compelled to design unsupervised model for segmentation. In this paper, we propose a novel dynamically learned particle swarm optimization based neighborhood influenced fuzzy c-means (DLPSO-NIFCM) clustering (unsupervised learning model) for solving pre-treatment and post-treatment organs segmentation problems. The proposed segmentation technique has been successfully applied to segment the liver parts from the Computed Tomography (CT) images of abdomen and also the lung parenchyma from the lungs CT images. METHODOLOGY In the proposed method, we formulate a primary convex objective function by considering the membership value of a pixel as well as the membership of its other neighboring pixels. Then we apply a new algebraic transformation on the primary objective function to design a new and more suitable objective function without losing convexity of the primary objective function. This new objective function is compatible for hybridization with any heuristic search technique in true sense. In this work, we propose a dynamically learned PSO to obtain the initial cluster centroids from the final objective function. Finally, we use a graph-based isolation mechanism for refining the segmentation results. RESULTS AND CONCLUSION This hybrid method, along with the restructured single variable objective function of the distance, leads to accurate clustering results with relatively lesser converging time as compared to the state-of-the-art methods. The segmentation results, obtained through several experiments with real CT images, are encouraging. The numerical values of different performance metrics obtained over the same data set confirm that the proposed algorithm performs better with respect to the state-of-the-art methods. Hence, we may consider the proposed method as a promising tool for clustering and CT image segmentation in a Computer Aided Diagnostic (CAD) system.
Collapse
Affiliation(s)
- Tiyasa Chakraborty
- Department of Computer Science and Engineering, National Institute of Technology Durgapur, India.
| | - Samiran Kumar Banik
- Department of Computer Science and Engineering, National Institute of Technology Durgapur, India.
| | | | - Debashis Nandi
- Department of Computer Science and Engineering, National Institute of Technology Durgapur, India.
| |
Collapse
|