1
|
Zhong W, Zhang H, Gao Z, Hau WK, Yang G, Liu X, Xu L. Distraction-aware hierarchical learning for vascular structure segmentation in intravascular ultrasound images. Comput Med Imaging Graph 2024; 115:102381. [PMID: 38640620 DOI: 10.1016/j.compmedimag.2024.102381] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Revised: 02/19/2024] [Accepted: 04/09/2024] [Indexed: 04/21/2024]
Abstract
Vascular structure segmentation in intravascular ultrasound (IVUS) images plays an important role in pre-procedural evaluation of percutaneous coronary intervention (PCI). However, vascular structure segmentation in IVUS images has the challenge of structure-dependent distractions. Structure-dependent distractions are categorized into two cases, structural intrinsic distractions and inter-structural distractions. Traditional machine learning methods often rely solely on low-level features, overlooking high-level features. This way limits the generalization of these methods. The existing semantic segmentation methods integrate low-level and high-level features to enhance generalization performance. But these methods also introduce additional interference, which is harmful to solving structural intrinsic distractions. Distraction cue methods attempt to address structural intrinsic distractions by removing interference from the features through a unique decoder. However, they tend to overlook the problem of inter-structural distractions. In this paper, we propose distraction-aware hierarchical learning (DHL) for vascular structure segmentation in IVUS images. Inspired by distraction cue methods for removing interference in a decoder, the DHL is designed as a hierarchical decoder that gradually removes structure-dependent distractions. The DHL includes global perception process, distraction perception process and structural perception process. The global perception process and distraction perception process remove structural intrinsic distractions then the structural perception process removes inter-structural distractions. In the global perception process, the DHL searches for the coarse structural region of the vascular structures on the slice of IVUS sequence. In the distraction perception process, the DHL progressively refines the coarse structural region of the vascular structures to remove structural distractions. In the structural perception process, the DHL detects regions of inter-structural distractions in fused structure features then separates them. Extensive experiments on 361 subjects show that the DHL is effective (e.g., the average Dice is greater than 0.95), and superior to ten state-of-the-art IVUS vascular structure segmentation methods.
Collapse
Affiliation(s)
- Wenhao Zhong
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, 518055, Guangdong, China
| | - Heye Zhang
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, 518055, Guangdong, China
| | - Zhifan Gao
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, 518055, Guangdong, China
| | - William Kongto Hau
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong, China
| | - Guang Yang
- Bioengineering Department and Imperial-X, Imperial College London, W12 7SL London, UK; Cardiovascular Research Centre, Royal Brompton Hospital, SW3 6NP London, UK; National Heart and Lung Institute, Imperial College London, SW7 2AZ London, UK; School of Biomedical Engineering and Imaging Sciences, King's College London, WC2R 2LS London, UK
| | - Xiujian Liu
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, 518055, Guangdong, China.
| | - Lin Xu
- Department of Geriatric Cardiology, PLA General Hospital of the Southern Theatre Command, Guangzhou, China.
| |
Collapse
|
2
|
Yang Y, Yu W, Du H, Ling L, Feng Q, Tu S, Yang W. Coupled Contour Regression for Efficient Delineation of Lumen and External Elastic Lamina in Intravascular Ultrasound Images. IEEE J Biomed Health Inform 2023; 27:5883-5894. [PMID: 37792661 DOI: 10.1109/jbhi.2023.3321788] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/06/2023]
Abstract
Automatic delineation of the lumen and vessel contours in intravascular ultrasound (IVUS) images is crucial for the subsequent IVUS-based analysis. Existing methods usually address this task through mask-based segmentation, which cannot effectively handle the anatomical plausibility of the lumen and external elastic lamina (EEL) contours and thus limits their performance. In this article, we propose a contour encoding based method called coupled contour regression network (CCRNet) to directly predict the lumen and EEL contour pairs. The lumen and EEL contours are resampled, coupled, and embedded into a low-dimensional space to learn a compact contour representation. Then, we employ a convolutional network backbone to predict the coupled contour signatures and reconstruct the signatures to the object contours by a linear decoder. Assisted by the implicit anatomical prior of the paired lumen and EEL contours in the signature space and contour decoder, CCRNet has the potential to avoid producing unreasonable results. We evaluated our proposed method on a large IVUS dataset consisting of 7204 cross-sectional frames from 185 pullbacks. The CCRNet can rapidly extract the contours at 100 fps. Without any post-processing, all produced contours are anatomically reasonable in the test 19 pullbacks. The mean Dice similarity coefficients of our CCRNet for the lumen and EEL are 0.940 and 0.958, which are comparable to the mask-based models. In terms of the contour metric Hausdorff distance, our CCRNet achieves 0.258 mm for lumen and 0.268 mm for EEL, which outperforms the mask-based models.
Collapse
|
3
|
Arora P, Singh P, Girdhar A, Vijayvergiya R. A State-Of-The-Art Review on Coronary Artery Border Segmentation Algorithms for Intravascular Ultrasound (IVUS) Images. Cardiovasc Eng Technol 2023; 14:264-295. [PMID: 36650320 DOI: 10.1007/s13239-023-00654-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Revised: 11/28/2022] [Accepted: 01/02/2023] [Indexed: 01/19/2023]
Abstract
Intravascular Ultrasound images (IVUS) is a useful guide for medical practitioners to identify the vascular status of coronary arteries in human beings. IVUS is a unique intracoronary imaging modality that is used as an adjunct to angioplasty to view vessel structures using a catheter with high resolutions. Segmentation of IVUS images has always remained a challenging task due to various impediments, for example, similar tissue components, vessel structures, and artifacts imposed during the acquisition process. Many researchers have applied various techniques to develop standard methods of image interpretation, however, the ultimate goal is still elusive to most researchers. This challenge was presented at the MICCAI- Computing and Visualization for (Intra)Vascular Imaging (CVII) workshop in 2011. This paper presents a major review of recently reported work in the field, with a detailed analysis of various segmentation techniques applied in IVUS, and highlights the directions for future research. The findings recommend a reference database with a larger number of samples acquired at varied transducer frequencies with special consideration towards complex lesions, suitable validation metrics, and ground-truth definition as a standard against which to compare new and current algorithms.
Collapse
Affiliation(s)
- Priyanka Arora
- Research Scholar, IKG Punjab Technical University, Punjab, India. .,Department of Computer Science and Engineering, Guru Nanak Dev Engineering College, Ludhiana, Punjab, India.
| | - Parminder Singh
- Department of Computer Science and Engineering, Guru Nanak Dev Engineering College, Ludhiana, Punjab, India
| | - Akshay Girdhar
- Department of Information Technology, Guru Nanak Dev Engineering College, Ludhiana, Punjab, India
| | - Rajesh Vijayvergiya
- Department of Cardiology, Advanced Cardiac Centre, Post Graduate Institute of Medical Education and Research (PGIMER), Chandigarh, India
| |
Collapse
|
4
|
Lo Vercio L, Del Fresno M, Larrabide I. Lumen-intima and media-adventitia segmentation in IVUS images using supervised classifications of arterial layers and morphological structures. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2019; 177:113-121. [PMID: 31319939 DOI: 10.1016/j.cmpb.2019.05.021] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/20/2018] [Revised: 04/26/2019] [Accepted: 05/20/2019] [Indexed: 06/10/2023]
Abstract
BACKGROUND Intravascular ultrasound (IVUS) provides axial grey-scale images of blood vessels. The large number of images require automatic analysis, specifically to identify the lumen and outer vessel wall. However, the high amount of noise, the presence of artifacts and anatomical structures, such as bifurcations, calcifications and fibrotic plaques, usually hinder the proper automatic segmentation of the vessel wall. METHODS Lumen, media, adventitia and surrounding tissues are automatically detected using Support Vector Machines (SVMs). The classification performance of the SVMs vary according to the kind of structure present within each region of the image. Random Forest (RF) is used to detect different morphological structures and to modify the initial layer classification depending on the detected structure. The resulting classification maps are fed into a segmentation method based on deformable contours to detect lumen-intima (LI) and media-adventitia (MA) interfaces. RESULTS The modifications in the layer classifications according to the presence of structures proved to be effective improving LI and MA segmentations. The proposed method reaches a Jaccard Measure (JM) of 0.88 ± 0.08 for LI segmentation, compared with 0.88 ± 0.05 of a semiautomatic method. When looking at MA, our method reaches a JM of 0.84 ± 0.09, and outperforms previous automatic methods in terms of HD, with 0.51mm ± 0.30. CONCLUSIONS A simple modification to the arterial layer classification produces results that match and improve state-of-the-art fully-automatic segmentation methods for LI and MA in 20MHz IVUS images. For LI segmentation, the proposed automatic method performs accurately as semi-automatic methods. For MA segmentation, our method matched the quality of state-of-the-art automatic methods described in the literature. Furthermore, our implementation is modular and open-source, allowing for future extensions and improvements.
Collapse
Affiliation(s)
- Lucas Lo Vercio
- Pladema Institute, UNCPBA, Gral. Pinto 399, Tandil, Argentina; Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET), Argentina.
| | - Mariana Del Fresno
- Pladema Institute, UNCPBA, Gral. Pinto 399, Tandil, Argentina; Comisión de Investigaciones Científicas de la Provincia deBuenos Aires (CICPBA), Argentina
| | - Ignacio Larrabide
- Pladema Institute, UNCPBA, Gral. Pinto 399, Tandil, Argentina; Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET), Argentina
| |
Collapse
|
5
|
IVUS images segmentation using spatial fuzzy clustering and hierarchical level set evolution. Comput Biol Med 2019; 109:207-217. [DOI: 10.1016/j.compbiomed.2019.04.029] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2019] [Revised: 04/22/2019] [Accepted: 04/22/2019] [Indexed: 11/22/2022]
|
6
|
Yang X, Sun A, Ju BF, Xu S. A rotary scanning method to evaluate grooves and porosity for nerve guide conduits based on ultrasound microscopy. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2018; 89:073705. [PMID: 30068110 DOI: 10.1063/1.5004783] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/15/2017] [Accepted: 06/21/2018] [Indexed: 06/08/2023]
Abstract
Grooved nerve guide conduits (NGCs) have been effective in the clinical treatment of peripheral nerve injury. They are generally fabricated from a micro-structured spinneret using a spinning process, which easily can cause a variety of pores and morphological deviation. The topography of internal grooves as well as the porosity can greatly influence the therapeutic effect. Traditional optical or scanning electron microscopy (SEM) methods can be used to image the grooves; however, these methods are destructive and require slicing NGCs to prepare specimens suitable for imaging. Moreover, lengthy experiments and large batches of NGCs are required to ensure reliable results from both in vitro experiments and clinical studies. In this paper, a non-destructive method for evaluating the grooves and porosity of NGCs is proposed using ultrasonic imaging combined with rotary scanning and an image analysis algorithm. Two ultrasonic methods were used: a 25-MHz point-focus ultrasonic transducer applied to observe axial cross sections of the conduits and a 100-MHz point-focus ultrasonic transducer to detect large pores caused by defects. Furthermore, a theoretical algorithm for detecting the local porosity of a conduit based on density is proposed. Herein, the proposed acoustic method and traditional optical methods are evaluated and compared. A parameter representing the specific surface area of the internal grooves is introduced and computed for both the optical and acoustic methods, and the relative errors of the computed parameter values for three different NGCs were 7.0%, 7.9%, and 15.3%. The detected location and shape of pores were consistent between the acoustic and optical methods, and greater porosity was observed in the middle of the conduit wall. In this paper, the results of the acoustic and optical methods are presented and the errors relating to the acoustic factors, device characteristics, and image processing method are further analyzed.
Collapse
Affiliation(s)
- Xiaoyu Yang
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou 310027, People's Republic of China
| | - Anyu Sun
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou 310027, People's Republic of China
| | - Bing-Feng Ju
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou 310027, People's Republic of China
| | - Shaoning Xu
- Zhejiang Information Institute of Machinery Industry, Hangzhou 310027, People's Republic of China
| |
Collapse
|
7
|
Faraji M, Cheng I, Naudin I, Basu A. Segmentation of arterial walls in intravascular ultrasound cross-sectional images using extremal region selection. ULTRASONICS 2018; 84:356-365. [PMID: 29241056 DOI: 10.1016/j.ultras.2017.11.020] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/30/2017] [Revised: 11/30/2017] [Accepted: 11/30/2017] [Indexed: 06/07/2023]
Abstract
Intravascular Ultrasound (IVUS) is an intra-operative imaging modality that facilitates observing and appraising the vessel wall structure of the human coronary arteries. Segmentation of arterial wall boundaries from the IVUS images is not only crucial for quantitative analysis of the vessel walls and plaque characteristics, but is also necessary for generating 3D reconstructed models of the artery. The aim of this study is twofold. Firstly, we investigate the feasibility of using a recently proposed region detector, namely Extremal Region of Extremum Level (EREL) to delineate the luminal and media-adventitia borders in IVUS frames acquired by 20 MHz probes. Secondly, we propose a region selection strategy to label two ERELs as lumen and media based on the stability of their textural information. We extensively evaluated our selection strategy on the test set of a standard publicly available dataset containing 326 IVUS B-mode images. We showed that in the best case, the average Hausdorff Distances (HD) between the extracted ERELs and the actual lumen and media were 0.22 mm and 0.45 mm, respectively. The results of our experiments revealed that our selection strategy was able to segment the lumen with ⩽0.3 mm HD to the gold standard even though the images contained major artifacts such as bifurcations, shadows, and side branches. Moreover, when there was no artifact, our proposed method was able to delineate media-adventitia boundaries with 0.31 mm HD to the gold standard. Furthermore, our proposed segmentation method runs in time that is linear in the number of pixels in each frame. Based on the results of this work, by using a 20 MHz IVUS probe with controlled pullback, not only can we now analyze the internal structure of human arteries more accurately, but also segment each frame during the pullback procedure because of the low run time of our proposed segmentation method.
Collapse
Affiliation(s)
- Mehdi Faraji
- Department of Computing Science, University of Alberta, Canada.
| | - Irene Cheng
- Department of Computing Science, University of Alberta, Canada.
| | | | - Anup Basu
- Department of Computing Science, University of Alberta, Canada.
| |
Collapse
|