1
|
Bransby KM, Bajaj R, Ramasamy A, Çap M, Yap N, Slabaugh G, Bourantas C, Zhang Q. POLYCORE: Polygon-based contour refinement for improved Intravascular Ultrasound Segmentation. Comput Biol Med 2024; 182:109162. [PMID: 39305731 DOI: 10.1016/j.compbiomed.2024.109162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2024] [Revised: 09/14/2024] [Accepted: 09/16/2024] [Indexed: 11/14/2024]
Abstract
Segmentation of the coronary vessel wall in intravascular ultrasound is a fundamental step in guiding coronary intervention. However, it is an challenging task, even for highly skilled cardiologists, due to image artefacts and shadowed regions caused by calcified plaque, guide wires and vessel side branches. Recently, dense-based neural networks have been applied to this task, however, they often fail to predict anatomically plausible contours in these low-signal areas. We propose a novel methodology called Polygon-based Contour Refiner (POLYCORE) that addresses topological error in dense-based segmentation networks using a relational inductive bias through higher-order connections between vertices to learn anatomically rational contours. Our approach remedies the over-smoothing phenomena common in polygon networks by introducing a new vector field refinement module which enables pixel-level detail to be added in an iterative process. POLYCORE is enhanced with augmented polygon aggregation which we show is more effective than typical dense-based test-time augmentation strategies. We achieve state-of-the-art results on two diverse datasets, observing particular improvements when segmenting the lumen structure and in topologically-challenging regions containing shadow artefacts. Our source code is available here: https://github.com/kitbransby/POLYCORE.
Collapse
Affiliation(s)
- Kit Mills Bransby
- School of Electronic Engineering and Computer Science, Queen Mary University of London, UK; Digital Environment Research Institute, Queen Mary University of London, UK
| | - Retesh Bajaj
- Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK; Department of Cardiology, Barts Health NHS Trust, London, UK
| | - Anantharaman Ramasamy
- Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK; Department of Cardiology, Barts Health NHS Trust, London, UK
| | - Murat Çap
- Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK; Department of Cardiology, Barts Health NHS Trust, London, UK
| | - Nathan Yap
- Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK; Department of Cardiology, Barts Health NHS Trust, London, UK
| | - Gregory Slabaugh
- School of Electronic Engineering and Computer Science, Queen Mary University of London, UK; Digital Environment Research Institute, Queen Mary University of London, UK
| | - Christos Bourantas
- Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, UK; Department of Cardiology, Barts Health NHS Trust, London, UK
| | - Qianni Zhang
- School of Electronic Engineering and Computer Science, Queen Mary University of London, UK; Digital Environment Research Institute, Queen Mary University of London, UK.
| |
Collapse
|
2
|
Zhong W, Zhang H, Gao Z, Hau WK, Yang G, Liu X, Xu L. Distraction-aware hierarchical learning for vascular structure segmentation in intravascular ultrasound images. Comput Med Imaging Graph 2024; 115:102381. [PMID: 38640620 DOI: 10.1016/j.compmedimag.2024.102381] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Revised: 02/19/2024] [Accepted: 04/09/2024] [Indexed: 04/21/2024]
Abstract
Vascular structure segmentation in intravascular ultrasound (IVUS) images plays an important role in pre-procedural evaluation of percutaneous coronary intervention (PCI). However, vascular structure segmentation in IVUS images has the challenge of structure-dependent distractions. Structure-dependent distractions are categorized into two cases, structural intrinsic distractions and inter-structural distractions. Traditional machine learning methods often rely solely on low-level features, overlooking high-level features. This way limits the generalization of these methods. The existing semantic segmentation methods integrate low-level and high-level features to enhance generalization performance. But these methods also introduce additional interference, which is harmful to solving structural intrinsic distractions. Distraction cue methods attempt to address structural intrinsic distractions by removing interference from the features through a unique decoder. However, they tend to overlook the problem of inter-structural distractions. In this paper, we propose distraction-aware hierarchical learning (DHL) for vascular structure segmentation in IVUS images. Inspired by distraction cue methods for removing interference in a decoder, the DHL is designed as a hierarchical decoder that gradually removes structure-dependent distractions. The DHL includes global perception process, distraction perception process and structural perception process. The global perception process and distraction perception process remove structural intrinsic distractions then the structural perception process removes inter-structural distractions. In the global perception process, the DHL searches for the coarse structural region of the vascular structures on the slice of IVUS sequence. In the distraction perception process, the DHL progressively refines the coarse structural region of the vascular structures to remove structural distractions. In the structural perception process, the DHL detects regions of inter-structural distractions in fused structure features then separates them. Extensive experiments on 361 subjects show that the DHL is effective (e.g., the average Dice is greater than 0.95), and superior to ten state-of-the-art IVUS vascular structure segmentation methods.
Collapse
Affiliation(s)
- Wenhao Zhong
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, 518055, Guangdong, China
| | - Heye Zhang
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, 518055, Guangdong, China
| | - Zhifan Gao
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, 518055, Guangdong, China
| | - William Kongto Hau
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong, China
| | - Guang Yang
- Bioengineering Department and Imperial-X, Imperial College London, W12 7SL London, UK; Cardiovascular Research Centre, Royal Brompton Hospital, SW3 6NP London, UK; National Heart and Lung Institute, Imperial College London, SW7 2AZ London, UK; School of Biomedical Engineering and Imaging Sciences, King's College London, WC2R 2LS London, UK
| | - Xiujian Liu
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, 518055, Guangdong, China.
| | - Lin Xu
- Department of Geriatric Cardiology, PLA General Hospital of the Southern Theatre Command, Guangzhou, China.
| |
Collapse
|
3
|
Liu X, Feng T, Liu W, Song L, Yuan Y, Hau WK, Ser JD, Gao Z. Scale Mutualized Perception for Vessel Border Detection in Intravascular Ultrasound Images. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2024; 21:1060-1071. [PMID: 36441897 DOI: 10.1109/tcbb.2022.3224934] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Vessel border detection in IVUS images is essential for coronary disease diagnosis. It helps to obtain the clinical indices on the inner vessel morphology to indicate the stenosis. However, the existing methods suffer the challenge of scale-dependent interference. Early methods usually rely on the hand-crafted features, thus not robust to this interference. The existing deep learning methods are also ineffective to solve this challenge, because these methods aggregate multi-scale features in the top-down way. This aggregation may bring in interference from the non-adjacent scale. Besides, they only combine the features in all scales, and thus may weaken their complementary information. We propose the scale mutualized perception to solve this challenge by considering the adjacent scales mutually to preserve their complementary information. First, the adjacent small scales contain certain semantics to locate different vessel tissues. Then, they can also perceive the global context to assist the representation of the local context in the adjacent large scale, and vice versa. It helps to distinguish the objects with similar local features. Second, the adjacent large scales provide detailed information to refine the vessel boundaries. The experiments show the effectiveness of our method in 153 IVUS sequences, and its superiority to ten state-of-the-art methods.
Collapse
|
4
|
Arora P, Singh P, Girdhar A, Vijayvergiya R. A State-Of-The-Art Review on Coronary Artery Border Segmentation Algorithms for Intravascular Ultrasound (IVUS) Images. Cardiovasc Eng Technol 2023; 14:264-295. [PMID: 36650320 DOI: 10.1007/s13239-023-00654-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Revised: 11/28/2022] [Accepted: 01/02/2023] [Indexed: 01/19/2023]
Abstract
Intravascular Ultrasound images (IVUS) is a useful guide for medical practitioners to identify the vascular status of coronary arteries in human beings. IVUS is a unique intracoronary imaging modality that is used as an adjunct to angioplasty to view vessel structures using a catheter with high resolutions. Segmentation of IVUS images has always remained a challenging task due to various impediments, for example, similar tissue components, vessel structures, and artifacts imposed during the acquisition process. Many researchers have applied various techniques to develop standard methods of image interpretation, however, the ultimate goal is still elusive to most researchers. This challenge was presented at the MICCAI- Computing and Visualization for (Intra)Vascular Imaging (CVII) workshop in 2011. This paper presents a major review of recently reported work in the field, with a detailed analysis of various segmentation techniques applied in IVUS, and highlights the directions for future research. The findings recommend a reference database with a larger number of samples acquired at varied transducer frequencies with special consideration towards complex lesions, suitable validation metrics, and ground-truth definition as a standard against which to compare new and current algorithms.
Collapse
Affiliation(s)
- Priyanka Arora
- Research Scholar, IKG Punjab Technical University, Punjab, India. .,Department of Computer Science and Engineering, Guru Nanak Dev Engineering College, Ludhiana, Punjab, India.
| | - Parminder Singh
- Department of Computer Science and Engineering, Guru Nanak Dev Engineering College, Ludhiana, Punjab, India
| | - Akshay Girdhar
- Department of Information Technology, Guru Nanak Dev Engineering College, Ludhiana, Punjab, India
| | - Rajesh Vijayvergiya
- Department of Cardiology, Advanced Cardiac Centre, Post Graduate Institute of Medical Education and Research (PGIMER), Chandigarh, India
| |
Collapse
|
5
|
Su B, Wang Z, Gong Y, Li M, Teng Y, Yu S, Zong Y, Yao W, Wang J. Anal center detection and classification of perianal healthy condition. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103759] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
6
|
|
7
|
Du H, Ling L, Yu W, Wu P, Yang Y, Chu M, Yang J, Yang W, Tu S. Convolutional networks for the segmentation of intravascular ultrasound images: Evaluation on a multicenter dataset. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 215:106599. [PMID: 34974233 DOI: 10.1016/j.cmpb.2021.106599] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Revised: 11/21/2021] [Accepted: 12/20/2021] [Indexed: 06/14/2023]
Abstract
BACKGROUND AND OBJECTIVE The delineation of the lumen contour and external elastic lamina (EEL) in intravascular ultrasound (IVUS) images is crucial for the quantitative analysis of coronary atherosclerotic plaques. However, the presence of ultrasonic shadows and anatomical structures (such as bifurcations and calcified plaque) complicates the automatic delineation of the lumen contour and EEL. The purpose of this paper is to evaluate the IVUS segmentation performances of different convolutional networks and the impact factors on a large-scale multiple-center dataset. METHODS A total of 6516 cross-sectional images from 175 IVUS pullbacks acquired in different centers by different IVUS imaging catheters were screened from a corelab to evaluate the segmentation methods. The IVUS images included bifurcation, side branch ostia, and various image artifacts to reflect the general image characteristics in routine clinical acquisition. We compared three generic fully convolutional networks (FCNs) and two FCNs specifically designed for the segmentation of IVUS images and explored the factors impacting the segmentation performance, including the training images and the input of consecutive images to the models. The performance of the FCNs was evaluated by using the Dice similarity coefficient (DSC), the Jaccard index (JI), the Hausdorff distance (HD), linear regression and Bland-Altman analysis. RESULTS The 4-cascaded RefineNet and DeepLabv3+ outperformed U-net and IVUS-net in the segmentation of the lumen contour and EEL on IVUS images. DeepLabv3+ had the best segmentation performance, with DSCs of 0.927 and 0.944, JIs of 0.911 and 0.933, and HDs of 0.336 mm and 0.367 mm for delineation of the lumen and EEL, respectively. Excellent agreement between DeepLabv3+ and the manual delineation was found in the quantification of the coronary plaque area (r = 0.98). CONCLUSIONS The convolutional network architecture is effective in the automatic segmentation of IVUS images. It might contribute to the clinical application of quantitative IVUS analysis in real-world as well as the efficient assessment of coronary atherosclerosis.
Collapse
Affiliation(s)
- Haiyan Du
- School of Biomedical Engineering, Southern Medical University, 1023-1063 Shatai, South Road Baiyun District, Guangzhou, Guangdong 510515, China
| | - Li Ling
- Biomedical Instrument Institute, School of Biomedical Engineering, Shanghai Jiao Tong University, 1954 Hua Shan Road Xuhui District, Shanghai 200030, China
| | - Wei Yu
- Biomedical Instrument Institute, School of Biomedical Engineering, Shanghai Jiao Tong University, 1954 Hua Shan Road Xuhui District, Shanghai 200030, China
| | - Peng Wu
- Biomedical Instrument Institute, School of Biomedical Engineering, Shanghai Jiao Tong University, 1954 Hua Shan Road Xuhui District, Shanghai 200030, China
| | - Yuan Yang
- School of Biomedical Engineering, Southern Medical University, 1023-1063 Shatai, South Road Baiyun District, Guangzhou, Guangdong 510515, China
| | - Miao Chu
- Biomedical Instrument Institute, School of Biomedical Engineering, Shanghai Jiao Tong University, 1954 Hua Shan Road Xuhui District, Shanghai 200030, China
| | - Junqing Yang
- Department of Cardiology, Guangdong Provincial People's Hospital, Guangzhou, China
| | - Wei Yang
- School of Biomedical Engineering, Southern Medical University, 1023-1063 Shatai, South Road Baiyun District, Guangzhou, Guangdong 510515, China.
| | - Shengxian Tu
- Biomedical Instrument Institute, School of Biomedical Engineering, Shanghai Jiao Tong University, 1954 Hua Shan Road Xuhui District, Shanghai 200030, China.
| |
Collapse
|
8
|
Detection of Healthy and Diseased Pylorus Natural Anatomical Center with Convolutional Neural Network Classification and Filters. J Med Biol Eng 2022. [DOI: 10.1007/s40846-022-00696-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
9
|
Dhanalakshmi B, Shijith KP, Sharma P. A prospective interventional study to assess the advantage of premedication with sublingual nitroglycerin in evaluation of peripheral vascular disease with computed tomography peripheral angiography. MEDICAL JOURNAL OF DR. D.Y. PATIL VIDYAPEETH 2022. [DOI: 10.4103/mjdrdypu.mjdrdypu_527_20] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
|
10
|
Subramanian B, Palanisamy K, Prasath VBS. On a hybrid lossless compression technique for three-dimensional medical images. J Appl Clin Med Phys 2021; 22:191-203. [PMID: 33960632 PMCID: PMC8364287 DOI: 10.1002/acm2.12960] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2019] [Revised: 11/29/2019] [Accepted: 06/02/2020] [Indexed: 02/05/2023] Open
Abstract
In the last two decades, incredible progress in various medical imaging modalities and sensing techniques have been made, leading to the proliferation of three-dimensional (3D) imagery. Byproduct of such great progress is the production of huge volume of medical images and this big data place a burden on automatic image processing methods for diagnostic assistance processes. Moreover, large amount of medical imaging data needs to be transmitted with no loss of information for the purpose of telemedicine, remote diagnosis etc. In this work, we consider a hybrid lossless compression technique with object-based features for three-dimensional (3D) medical images. Our approach utilizes two phases as follows: first we determine the volume of interest (VOI) for a given 3D medical imagery using selective bounding volume (SBV) method, and second the obtained VOI is encoded using a hybrid lossless algorithm using Lembel-Ziv-Welch Coding (LZW) followed by arithmetic coding (L to A). Experimental results show that our proposed 3D medical image compression method is comparable with other existing standard lossless encoding methods such as Huffman Coding, Run Length Coding, LZW, and Arithmetic Coding and obtains superior results overall.
Collapse
Affiliation(s)
- Boopathiraja Subramanian
- Department of Computer Science and ApplicationsThe Gandhigram Rural InstituteGandhigramTamil NaduIndia
| | - Kalavathi Palanisamy
- Department of Computer Science and ApplicationsThe Gandhigram Rural InstituteGandhigramTamil NaduIndia
| | - V. B. Surya Prasath
- Division of Biomedical InformaticsCincinnati Children's Hospital Medical CenterCincinnatiOH45229USA
- Department of PediatricsUniversity of CincinnatiCincinnatiOHUSA
- Department of Biomedical InformaticsCollege of MedicineUniversity of CincinnatiCincinnatiOHUSA
- Department of Electrical Engineering and Computer ScienceUniversity of CincinnatiOH45221USA
| |
Collapse
|
11
|
Lv R, Maehara A, Matsumura M, Wang L, Wang Q, Zhang C, Guo X, Samady H, Giddens DP, Zheng J, Mintz GS, Tang D. Using optical coherence tomography and intravascular ultrasound imaging to quantify coronary plaque cap thickness and vulnerability: a pilot study. Biomed Eng Online 2020; 19:90. [PMID: 33256759 PMCID: PMC7706023 DOI: 10.1186/s12938-020-00832-w] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2020] [Accepted: 11/17/2020] [Indexed: 11/11/2022] Open
Abstract
Background Detecting coronary vulnerable plaques in vivo and assessing their vulnerability have been great challenges for clinicians and the research community. Intravascular ultrasound (IVUS) is commonly used in clinical practice for diagnosis and treatment decisions. However, due to IVUS limited resolution (about 150–200 µm), it is not sufficient to detect vulnerable plaques with a threshold cap thickness of 65 µm. Optical Coherence Tomography (OCT) has a resolution of 15–20 µm and can measure fibrous cap thickness more accurately. The aim of this study was to use OCT as the benchmark to obtain patient-specific coronary plaque cap thickness and evaluate the differences between OCT and IVUS fibrous cap quantifications. A cap index with integer values 0–4 was also introduced as a quantitative measure of plaque vulnerability to study plaque vulnerability. Methods Data from 10 patients (mean age: 70.4; m: 6; f: 4) with coronary heart disease who underwent IVUS, OCT, and angiography were collected at Cardiovascular Research Foundation (CRF) using approved protocol with informed consent obtained. 348 slices with lipid core and fibrous caps were selected for study. Convolutional Neural Network (CNN)-based and expert-based data segmentation were performed using established methods previously published. Cap thickness data were extracted to quantify differences between IVUS and OCT measurements. Results For the 348 slices analyzed, the mean value difference between OCT and IVUS cap thickness measurements was 1.83% (p = 0.031). However, mean value of point-to-point differences was 35.76%. Comparing minimum cap thickness for each plaque, the mean value of the 20 plaque IVUS-OCT differences was 44.46%, ranging from 2.36% to 91.15%. For cap index values assigned to the 348 slices, the disagreement between OCT and IVUS assignments was 25%. However, for the OCT cap index = 2 and 3 groups, the disagreement rates were 91% and 80%, respectively. Furthermore, the observation of cap index changes from baseline to follow-up indicated that IVUS results differed from OCT by 80%. Conclusions These preliminary results demonstrated that there were significant differences between IVUS and OCT plaque cap thickness measurements. Large-scale patient studies are needed to confirm our findings.
Collapse
Affiliation(s)
- Rui Lv
- School of Biological Science and Medical Engineering, Southeast University, #2 SiPailou, Nanjing, China
| | - Akiko Maehara
- The Cardiovascular Research Foundation, Columbia University, New York, USA
| | - Mitsuaki Matsumura
- The Cardiovascular Research Foundation, Columbia University, New York, USA
| | - Liang Wang
- School of Biological Science and Medical Engineering, Southeast University, #2 SiPailou, Nanjing, China
| | - Qingyu Wang
- School of Biological Science and Medical Engineering, Southeast University, #2 SiPailou, Nanjing, China
| | - Caining Zhang
- School of Biological Science and Medical Engineering, Southeast University, #2 SiPailou, Nanjing, China
| | - Xiaoya Guo
- School of Science, Nanjing University of Posts and Telecommunications, Nanjing, China
| | - Habib Samady
- Department of Medicine, Emory University School of Medicine, Atlanta, GA, USA
| | - Don P Giddens
- Department of Medicine, Emory University School of Medicine, Atlanta, GA, USA.,The Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA, USA
| | - Jie Zheng
- Mallinckrodt Institute of Radiology, Washington University, St. Louis, MO, USA
| | - Gary S Mintz
- The Cardiovascular Research Foundation, Columbia University, New York, USA
| | - Dalin Tang
- School of Biological Science and Medical Engineering, Southeast University, #2 SiPailou, Nanjing, China. .,Mathematical Sciences Department, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA, 01609, USA.
| |
Collapse
|
12
|
Gao Z, Chung J, Abdelrazek M, Leung S, Hau WK, Xian Z, Zhang H, Li S. Privileged Modality Distillation for Vessel Border Detection in Intracoronary Imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:1524-1534. [PMID: 31715563 DOI: 10.1109/tmi.2019.2952939] [Citation(s) in RCA: 42] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Intracoronary imaging is a crucial imaging technology in coronary disease diagnosis as it visualizes the internal tissue morphologies of coronary arteries. Vessel border detection in intracoronary images (VBDI) is desired because it can help the succeeding procedures of computer-aided disease diagnosis. However, existing VDBI methods suffer from the challenge of vessel-environment variability (i.e. high intra- and inter-subject diversity of vessels and their surrounding tissues appeared in images). This challenge leads to the ineffectiveness in the vessel region representation for hand-crafted features, in the receptive field extraction for deeply-represented features, as well as performance suppression derived from clinical data limitation. To solve this challenge, we propose a novel privileged modality distillation (PMD) framework for VBDI. PMD transforms the single-input-single-task (SIST) learning problem in the single-mode VBDI to a multiple-input-multiple-task (MIMT) problem by using the privileged image modality to help the learning model in the target modality. This learns the enriched high-level knowledge with similar semantics and generalizes PMD on diversity-increased low-level image features for improving the model adaptation to diverse vessel environments. Moreover, PMD refines MIMT to SIST by distilling the learned knowledge from multiple to one modality. This eliminates the reliance on privileged modality in the test phase, and thus enables the applicability to each of different intracoronary modalities. A structure-deformable neural network is proposed as an elaborately-designed implementation of PMD. It expands a conventional SIST network structure to the MIMT structure, and then recovers it to the final SIST structure. The PMD is validated on intravascular ultrasound imaging and optical coherence tomography imaging. One modality is the target, and the other one can be considered as the privileged modality owing to their semantic relatedness. The experiments show that our PMD is effective in VBDI (e.g. the Dice index is larger than 0.95), as well as superior to six state-of-the-art VBDI methods.
Collapse
|
13
|
Cao Y, Xiao X, Liu Z, Yang M, Sun D, Guo W, Cui L, Zhang P. Detecting vulnerable plaque with vulnerability index based on convolutional neural networks. Comput Med Imaging Graph 2020; 81:101711. [PMID: 32155412 DOI: 10.1016/j.compmedimag.2020.101711] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2019] [Revised: 01/29/2020] [Accepted: 02/16/2020] [Indexed: 10/25/2022]
Abstract
Plaque rupture and subsequent thrombosis are major processes of acute cardiovascular events. The Vulnerability Index is a very important indicator of whether a plaque is ruptured, and these easily ruptured or fragile plaques can be detected early. The higher the general vulnerability index, the higher the instability of the plaque. Therefore, determining a clear vulnerability index classification point can effectively reduce unnecessary interventional therapy. However, the current critical value of the vulnerability index has not been well defined. In this study, we proposed a neural network-based method to determine the critical point of vulnerability index that distinguishes vulnerable plaques from stable ones. Firstly, based on MatConvNet, the intravascular ultrasound images under different vulnerability index labels are classified. Different vulnerability indexes can obtain different accuracy rates for the demarcation points. The corresponding data points are fitted to find the existing relationship to judge the highest classification. In this way, the vulnerability index corresponding to the highest classification accuracy rate is judged. Then the article is based on the same experiment of different components of the aortic artery in the artificial neural network, and finally the vulnerability index corresponding to the highest classification accuracy can be obtained. The results show that the best vulnerability index point is 1.716 when the experiment is based on the intravascular ultrasound image, and the best vulnerability index point is 1.607 when the experiment is based on the aortic artery component data. Moreover, the vulnerability index and classification accuracy rate has a periodic relationship within a certain range, and finally the highest AUC is 0.7143 based on the obtained vulnerability index point on the verification set. In this paper, the convolution neural network is used to find the best vulnerability index classification points. The experimental results show that this method has the guiding significance for the classification and diagnosis of vulnerable plaques, further reduce interventional treatment of cardiovascular disease.
Collapse
Affiliation(s)
- Yankun Cao
- The Rsearch Center of Intelligent Medical Information Processing, School of Information Science and Engineering, Shandong University, Qingdao 266237, China; Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University, Jinan 250101, China
| | - Xiaoyan Xiao
- Department of Nephrology, Qilu Hospital of Shandong University, No.107 Wenhuaxi Road, Jinan 250012, China
| | - Zhi Liu
- The Rsearch Center of Intelligent Medical Information Processing, School of Information Science and Engineering, Shandong University, Qingdao 266237, China; Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University, Jinan 250101, China.
| | - Meijun Yang
- The Rsearch Center of Intelligent Medical Information Processing, School of Information Science and Engineering, Shandong University, Qingdao 266237, China
| | - Dianmin Sun
- Department of Thoracic Surgery, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan 250117, Shandong, China
| | - Wei Guo
- Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University, Jinan 250101, China
| | - Lizhen Cui
- Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University, Jinan 250101, China
| | - Pengfei Zhang
- Key Laboratory of Cardiovascular Remodeling and Function Research, Chinese Ministry of Education and Chinese National Health Commission, Department of Cardiology, Qilu Hospital of Shandong University. N0.107 Wenhuaxi Road, Jinan, Shanodng Province, China.
| |
Collapse
|
14
|
Gao Z, Wang X, Sun S, Wu D, Bai J, Yin Y, Liu X, Zhang H, de Albuquerque VHC. Learning physical properties in complex visual scenes: An intelligent machine for perceiving blood flow dynamics from static CT angiography imaging. Neural Netw 2020; 123:82-93. [DOI: 10.1016/j.neunet.2019.11.017] [Citation(s) in RCA: 47] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2019] [Revised: 10/22/2019] [Accepted: 11/19/2019] [Indexed: 02/06/2023]
|
15
|
KANSE SHILPASAMEER, YADAV DM. HG-SVNN: HARMONIC GENETIC-BASED SUPPORT VECTOR NEURAL NETWORK CLASSIFIER FOR THE GLAUCOMA DETECTION. J MECH MED BIOL 2020. [DOI: 10.1142/s0219519419500659] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2023]
Abstract
Glaucoma has emerged as the one of the leading causes of blindness. Even though the diagnosis of this disease has not yet been found, the early detection can cure the glaucoma disease. Various works presented for the glaucoma detection have many disadvantages such as increased run time, complex architecture, etc., during the real-time implementations. This work introduces the glaucoma detection system based on the proposed harmonic genetic-based support vector neural network (HG-SVNN) classifier. The proposed system detects glaucoma in the database through four major steps, (1) pre-processing, (2) proposed hybrid feature extraction, (3) segmentation and (4) classification through the proposed HG-SVNN classifier. The proposed model uses both the statistical and the vessel features from the segmented and the pre-processed images to construct the feature vector. The proposed HG-SVNN classifier uses both the harmonic operator and the genetic algorithm (GA) for the neural network training. From the simulation results, it is evident that the proposed glaucoma detection system has better performance than the existing works with the values of 0.945, 0.9, 0.9333 and 0.86667 for the segmentation accuracy, accuracy, sensitivity and specificity metric.
Collapse
Affiliation(s)
| | - D. M. YADAV
- Academic Dean G. H. Raisoni College of Engineering and Management, Wagholi, Pune, Maharashtra 412207, India
| |
Collapse
|
16
|
YANG LIJUN, LI SHUANG, ZHANG ZHI, YANG XIAOHUI. CLASSIFICATION OF PHONOCARDIOGRAM SIGNALS BASED ON ENVELOPE OPTIMIZATION MODEL AND SUPPORT VECTOR MACHINE. J MECH MED BIOL 2020. [DOI: 10.1142/s0219519419500623] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The prevention and diagnosis of cardiovascular diseases have become one of the primary problems in the medical community since the mortality of this kind of diseases accounts for 31% of global deaths in 2016. Heart sound, which is an important physiological signal of human body, mainly comes from the pulsing of cardiac structures and blood turbulence. The analysis of heart sounds plays an irreplaceable role in early diagnosis of heart disease since they contain a large amount of pathological information about each part of human heart. Heart sounds can be detected and recorded by Phonocardiogram (PCG). As a noninvasive method to detect and diagnose heart disease, PCG signals have been paid more and more attention by researchers. In this paper, a novel envelope extraction model is proposed and used to estimate the cardiac cycle of each PCG signal. We present a strategy combining empirical mode decomposition (EMD) technique and the proposed envelope model to extract the time-domain features. After applying EMD process to each PCG signal, the second intrinsic mode function is chosen for further analysis. Based on the proposed envelope model, the cardiac cycles of PCG signals can be estimated and then the time-domain features can be extracted. Combining with the frequency-domain features and wavelet-domain features, the feature vectors are obtained. Finally, the support vector machine (SVM) classifier is used to detect the normal and abnormal PCG signals. Two public datasets are used to test our framework in this paper. And classification accuracies of more than [Formula: see text] on both datasets show the effectiveness of the proposed model.
Collapse
Affiliation(s)
- LIJUN YANG
- School of Mathematics and Statistics, Henan University, Kaifeng 475004, P. R. China
| | - SHUANG LI
- School of Mathematics and Statistics, Henan University, Kaifeng 475004, P. R. China
| | - ZHI ZHANG
- Department of Computer Science, Georgia Institute of Technology, Atlanta, GA, 30332, USA
| | - XIAOHUI YANG
- School of Mathematics and Statistics, Henan University, Kaifeng 475004, P. R. China
| |
Collapse
|
17
|
Naveed S, Geetha G. Intelligent Diabetes Detection System based on Tongue Datasets. Curr Med Imaging 2019; 15:672-678. [DOI: 10.2174/1573405614666181009133414] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2018] [Revised: 09/14/2018] [Accepted: 09/19/2018] [Indexed: 11/22/2022]
Abstract
Background:
Scanning Electron Microscope (SEM) Camera Imaging shows and helps
analyze hidden organs in the human body. SEM image analysis provides in-depth and critical details of organ abnormalities. Similarly, the human tongue finds use in the detection of organ dysfunction with tongue reflexology.
Objective:
To detect diabetes at an early stage using a non-invasive method of diabetes detection
through tongue images and to utilize the reasonable cost of modality (SEM camera) for capturing
the tongue images instead of the existing and expensive imaging modalities like X-ray, Computed
Tomography, Magnetic Resonance Imaging, Positron Emission Tomography, Single-Photon Emission Computed Tomography etc.
Methods:
The tongue image is captured via SEM camera, it is preprocessed to remove noise and
resize the tongue such that it is suitable for segmentation. Greedy Snake Algorithm (GSA) is used
to segment the tongue image. The texture features of the tongue are analyzed and finally it is classified as diabetic or normal.
Results:
Failure of organs stomach, intestine, liver and pancreas results in change of the color of
the tongue, coating thickness and cracks on the tongue. Changes in pancreas proactive behavior also reflect on tongue coating. The tongue coating texture varies from white or vanilla to yellow also
the tongue coating thickness also increases.
Conclusion:
In this paper, the author proposes to diagnose Diabetes Type2 (DT2) at an early stage
from tongue digital image. The tongue image is acquired and processed with Greedy Snake Algorithm (GSA) to extract edge and texture features.
Collapse
Affiliation(s)
- Safia Naveed
- Department of Computer Science and Engineering, Jerusalem College of Engineering (Affiliated to Anna University), Pallikaranai, Chennai- 600100, Tamil Nadu, India
| | - Gurunathan Geetha
- Department of Computer Science and Engineering, Jerusalem College of Engineering (Affiliated to Anna University), Pallikaranai, Chennai- 600100, Tamil Nadu, India
| |
Collapse
|
18
|
Lo Vercio L, Del Fresno M, Larrabide I. Lumen-intima and media-adventitia segmentation in IVUS images using supervised classifications of arterial layers and morphological structures. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2019; 177:113-121. [PMID: 31319939 DOI: 10.1016/j.cmpb.2019.05.021] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/20/2018] [Revised: 04/26/2019] [Accepted: 05/20/2019] [Indexed: 06/10/2023]
Abstract
BACKGROUND Intravascular ultrasound (IVUS) provides axial grey-scale images of blood vessels. The large number of images require automatic analysis, specifically to identify the lumen and outer vessel wall. However, the high amount of noise, the presence of artifacts and anatomical structures, such as bifurcations, calcifications and fibrotic plaques, usually hinder the proper automatic segmentation of the vessel wall. METHODS Lumen, media, adventitia and surrounding tissues are automatically detected using Support Vector Machines (SVMs). The classification performance of the SVMs vary according to the kind of structure present within each region of the image. Random Forest (RF) is used to detect different morphological structures and to modify the initial layer classification depending on the detected structure. The resulting classification maps are fed into a segmentation method based on deformable contours to detect lumen-intima (LI) and media-adventitia (MA) interfaces. RESULTS The modifications in the layer classifications according to the presence of structures proved to be effective improving LI and MA segmentations. The proposed method reaches a Jaccard Measure (JM) of 0.88 ± 0.08 for LI segmentation, compared with 0.88 ± 0.05 of a semiautomatic method. When looking at MA, our method reaches a JM of 0.84 ± 0.09, and outperforms previous automatic methods in terms of HD, with 0.51mm ± 0.30. CONCLUSIONS A simple modification to the arterial layer classification produces results that match and improve state-of-the-art fully-automatic segmentation methods for LI and MA in 20MHz IVUS images. For LI segmentation, the proposed automatic method performs accurately as semi-automatic methods. For MA segmentation, our method matched the quality of state-of-the-art automatic methods described in the literature. Furthermore, our implementation is modular and open-source, allowing for future extensions and improvements.
Collapse
Affiliation(s)
- Lucas Lo Vercio
- Pladema Institute, UNCPBA, Gral. Pinto 399, Tandil, Argentina; Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET), Argentina.
| | - Mariana Del Fresno
- Pladema Institute, UNCPBA, Gral. Pinto 399, Tandil, Argentina; Comisión de Investigaciones Científicas de la Provincia deBuenos Aires (CICPBA), Argentina
| | - Ignacio Larrabide
- Pladema Institute, UNCPBA, Gral. Pinto 399, Tandil, Argentina; Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET), Argentina
| |
Collapse
|
19
|
IVUS images segmentation using spatial fuzzy clustering and hierarchical level set evolution. Comput Biol Med 2019; 109:207-217. [DOI: 10.1016/j.compbiomed.2019.04.029] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2019] [Revised: 04/22/2019] [Accepted: 04/22/2019] [Indexed: 11/22/2022]
|
20
|
Hammouche A, Cloutier G, Tardif JC, Hammouche K, Meunier J. Automatic IVUS lumen segmentation using a 3D adaptive helix model. Comput Biol Med 2019; 107:58-72. [DOI: 10.1016/j.compbiomed.2019.01.023] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2018] [Revised: 01/23/2019] [Accepted: 01/24/2019] [Indexed: 10/27/2022]
|
21
|
Yu S, Xu X, Pandey NR, Zhao Y, Jing J. A safe percutaneous technique for the reduction of irreducible femoral neck fractures using ultrasound localization of the femoral vascular and nervous structures at the hip. Medicine (Baltimore) 2019; 98:e15163. [PMID: 30985696 PMCID: PMC6485823 DOI: 10.1097/md.0000000000015163] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
We present a safe percutaneous technique for the placement of Kirschner wires into the femoral head to assist in the reduction of irreducible femoral neck fractures using ultrasound to identify the vascular and nervous structures about the hip.From January 2011 to June 2014, a total of 36 patients (25 males and 11 females) were enrolled in this study. Patients were placed on a fracture reduction table for limb traction. After 3 unsuccessful reductions with limb traction, ultrasound-guided localization of the patient's femoral artery, vein, and nerve at the hip was performed. These structures were marked on the overlying skin and then Kirschner wires were inserted into the femoral head avoiding these marked structures. After the surgery, the Kirschner wire insertions were routinely reviewed by ultrasound, the hip fracture reduction and the femoral nerve sensorimotor function were routinely examined as well.All 36 patients with an irreducible variant of a femoral neck fracture showed anatomic reduction under C-arm fluoroscopy using ultrasound to avoid K wire injury to the femoral vascular structures and nerve. No major vascular injury during operation. In post-surgical ultrasound examination, local hematoma formation was not evident. There was normal function of the femoral nerve. On follow-up, there were no infections, wound problems, recurrence of fracture displacement, laxity, or implant breakage.Preoperative ultrasonic localization of the femoral artery, vein, and femoral nerve safely allowed. Kirschner wire placement under C-arm fluoroscopy into the femoral head to assist in fracture reduction. This assisted reduction method for irreducible femoral neck fractures had a number of advantages, including closed anatomic reduction with minimal attempts, used simple equipment, and avoided further destruction of the blood supply to the femoral head.
Collapse
Affiliation(s)
- Shuisheng Yu
- Department of Orthopaedics, The Second Affiliated Hospital of Anhui Medical University, Hefei, Anhui, PR China
| | - Xinzhong Xu
- Department of Orthopaedics, The Second Affiliated Hospital of Anhui Medical University, Hefei, Anhui, PR China
| | - Nitesh Raj Pandey
- Department of Orthopaedics, B&B Hospital, Guwarko, Lalitpur, Kathmandu, Nepal
| | - Yao Zhao
- Department of Orthopaedics, The Second Affiliated Hospital of Anhui Medical University, Hefei, Anhui, PR China
| | - Juehua Jing
- Department of Orthopaedics, The Second Affiliated Hospital of Anhui Medical University, Hefei, Anhui, PR China
| |
Collapse
|
22
|
Kaur P, Singh G, Kaur P. An intelligent validation system for diagnostic and prognosis of ultrasound fetal growth analysis using Neuro-Fuzzy based on genetic algorithm. EGYPTIAN INFORMATICS JOURNAL 2019. [DOI: 10.1016/j.eij.2018.10.002] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
23
|
Shabani Varaki E, Gargiulo GD, Penkala S, Breen PP. Peripheral vascular disease assessment in the lower limb: a review of current and emerging non-invasive diagnostic methods. Biomed Eng Online 2018; 17:61. [PMID: 29751811 PMCID: PMC5948740 DOI: 10.1186/s12938-018-0494-4] [Citation(s) in RCA: 44] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2018] [Accepted: 05/02/2018] [Indexed: 12/27/2022] Open
Abstract
BACKGROUND Worldwide, at least 200 million people are affected by peripheral vascular diseases (PVDs), including peripheral arterial disease (PAD), chronic venous insufficiency (CVI) and deep vein thrombosis (DVT). The high prevalence and serious consequences of PVDs have led to the development of several diagnostic tools and clinical guidelines to assist timely diagnosis and patient management. Given the increasing number of diagnostic methods available, a comprehensive review of available technologies is timely in order to understand their limitations and direct future development effort. MAIN BODY This paper reviews the available diagnostic methods for PAD, CVI, and DVT with a focus on non-invasive modalities. Each method is critically evaluated in terms of sensitivity, specificity, accuracy, ease of use, procedure time duration, and training requirements where applicable. CONCLUSION This review emphasizes the limitations of existing methods, highlighting a latent need for the development of new non-invasive, efficient diagnostic methods. Some newly emerging technologies are identified, in particular wearable sensors, which demonstrate considerable potential to address the need for simple, cost-effective, accurate and timely diagnosis of PVDs.
Collapse
Affiliation(s)
- Elham Shabani Varaki
- The MARCS Institute for Brain, Behaviour & Development, Western Sydney University, Penrith, NSW, 2750, Australia.
| | - Gaetano D Gargiulo
- The MARCS Institute for Brain, Behaviour & Development, Western Sydney University, Penrith, NSW, 2750, Australia
| | - Stefania Penkala
- School of Science and Health, Western Sydney University, Penrith, NSW, 2750, Australia
| | - Paul P Breen
- The MARCS Institute for Brain, Behaviour & Development, Western Sydney University, Penrith, NSW, 2750, Australia.,Translational Health Research Institute, Western Sydney University, Penrith, NSW, 2750, Australia
| |
Collapse
|
24
|
Chen F, Ma R, Liu J, Zhu M, Liao H. Lumen and media-adventitia border detection in IVUS images using texture enhanced deformable model. Comput Med Imaging Graph 2018; 66:1-13. [PMID: 29481899 DOI: 10.1016/j.compmedimag.2018.02.003] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2017] [Revised: 01/30/2018] [Accepted: 02/12/2018] [Indexed: 10/18/2022]
Abstract
Lumen and media-adventitia (MA) borders in intravascular ultrasound (IVUS) images are critical for assessing the dimensions of vascular structures and providing plaque information in the diagnosis and navigation of vascular interventions. However, manual delineation of the lumen and MA borders is an intricate and time-consuming process. In this paper, a texture-enhanced deformable model (TEDM) is proposed to accurately detect these borders by incorporating texture information with the morphological factors of deformable model. An ensemble support vector machine classifier is used to classify IVUS pixels presented by texture features into different tissue types. The image regionalization maps of different tissue types are further used for texture enhancement modules in the TEDM. The proposed TEDM method has been tested on 1500 images from 15 clinical IVUS datasets by comparing with the manual delineations. Evaluation results demonstrate that our method can accurately detect lumen and MA surfaces with small surface distance errors of 0.17 and 0.19 mm, respectively. Accurate segmentation results provide 2D measurements of MA/lumen areas and 3D vessel visualizations for vascular interventions.
Collapse
Affiliation(s)
- Fang Chen
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, China
| | - Ruibin Ma
- Department of Electronic Engineering, Tsinghua University, Beijing, China
| | - Jia Liu
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, China
| | - Mingyu Zhu
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, China
| | - Hongen Liao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, China.
| |
Collapse
|
25
|
Zakeri FS, Setarehdan SK, Norouzi S. Automatic media-adventitia IVUS image segmentation based on sparse representation framework and dynamic directional active contour model. Comput Biol Med 2017; 89:561-572. [DOI: 10.1016/j.compbiomed.2017.03.022] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2016] [Revised: 03/22/2017] [Accepted: 03/23/2017] [Indexed: 10/19/2022]
|
26
|
Zahnd G, Hoogendoorn A, Combaret N, Karanasos A, Péry E, Sarry L, Motreff P, Niessen W, Regar E, van Soest G, Gijsen F, van Walsum T. Contour segmentation of the intima, media, and adventitia layers in intracoronary OCT images: application to fully automatic detection of healthy wall regions. Int J Comput Assist Radiol Surg 2017; 12:1923-1936. [PMID: 28801817 PMCID: PMC5656722 DOI: 10.1007/s11548-017-1657-7] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2017] [Accepted: 08/03/2017] [Indexed: 11/29/2022]
Abstract
PURPOSE Quantitative and automatic analysis of intracoronary optical coherence tomography images is useful and time-saving to assess cardiovascular risk in the clinical arena. METHODS First, the interfaces of the intima, media, and adventitia layers are segmented, by means of an original front propagation scheme, running in a 4D multi-parametric space, to simultaneously extract three non-crossing contours in the initial cross-sectional image. Second, information resulting from the tentative contours is exploited by a machine learning approach to identify healthy and diseased regions of the arterial wall. The framework is fully automatic. RESULTS The method was applied to 40 patients from two different medical centers. The framework was trained on 140 images and validated on 260 other images. For the contour segmentation method, the average segmentation errors were [Formula: see text] for the intima-media interface, [Formula: see text] for the media-adventitia interface, and [Formula: see text] for the adventitia-periadventitia interface. The classification method demonstrated a good accuracy, with a median Dice coefficient equal to 0.93 and an interquartile range of (0.78-0.98). CONCLUSION The proposed framework demonstrated promising offline performances and could potentially be translated into a reliable tool for various clinical applications, such as quantification of tissue layer thickness and global summarization of healthy regions in entire pullbacks.
Collapse
Affiliation(s)
- Guillaume Zahnd
- Biomedical Imaging Group Rotterdam, Department of Radiology & Nuclear Medicine and Department of Medical Informatics, Erasmus MC, Rotterdam, The Netherlands.
| | - Ayla Hoogendoorn
- Department of Biomedical Engineering, Thorax Center, Erasmus MC, Rotterdam, The Netherlands
| | - Nicolas Combaret
- Image Science for Interventional Techniques Laboratory, Université Clermont Auvergne, Université d'Auvergne, CNRS, UMR 6284, Clermont-Ferrand, France.,Department of Cardiology, Gabriel-Montpied Hospital, Clermont-Ferrand University Hospital, Clermont-Ferrand, France
| | - Antonios Karanasos
- Department of Interventional Cardiology, Thorax Center, Erasmus MC, Rotterdam, The Netherlands
| | - Emilie Péry
- Image Science for Interventional Techniques Laboratory, Université Clermont Auvergne, Université d'Auvergne, CNRS, UMR 6284, Clermont-Ferrand, France
| | - Laurent Sarry
- Image Science for Interventional Techniques Laboratory, Université Clermont Auvergne, Université d'Auvergne, CNRS, UMR 6284, Clermont-Ferrand, France
| | - Pascal Motreff
- Image Science for Interventional Techniques Laboratory, Université Clermont Auvergne, Université d'Auvergne, CNRS, UMR 6284, Clermont-Ferrand, France.,Department of Cardiology, Gabriel-Montpied Hospital, Clermont-Ferrand University Hospital, Clermont-Ferrand, France
| | - Wiro Niessen
- Biomedical Imaging Group Rotterdam, Department of Radiology & Nuclear Medicine and Department of Medical Informatics, Erasmus MC, Rotterdam, The Netherlands
| | - Evelyn Regar
- Department of Interventional Cardiology, Thorax Center, Erasmus MC, Rotterdam, The Netherlands
| | - Gijs van Soest
- Department of Biomedical Engineering, Thorax Center, Erasmus MC, Rotterdam, The Netherlands
| | - Frank Gijsen
- Department of Biomedical Engineering, Thorax Center, Erasmus MC, Rotterdam, The Netherlands
| | - Theo van Walsum
- Biomedical Imaging Group Rotterdam, Department of Radiology & Nuclear Medicine and Department of Medical Informatics, Erasmus MC, Rotterdam, The Netherlands
| |
Collapse
|
27
|
Jodas DS, Pereira AS, Tavares JMRS. Automatic segmentation of the lumen region in intravascular images of the coronary artery. Med Image Anal 2017. [PMID: 28624754 DOI: 10.1016/j.media.2017.06.006] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Image assessment of the arterial system plays an important role in the diagnosis of cardiovascular diseases. The segmentation of the lumen and media-adventitia in intravascular (IVUS) images of the coronary artery is the first step towards the evaluation of the morphology of the vessel under analysis and the identification of possible atherosclerotic lesions. In this study, a fully automatic method for the segmentation of the lumen in IVUS images of the coronary artery is presented. The proposed method relies on the K-means algorithm and the mean roundness to identify the region corresponding to the potential lumen. An approach to identify and eliminate side branches on bifurcations is also proposed to delimit the area with the potential lumen regions. Additionally, an active contour model is applied to refine the contour of the lumen region. In order to evaluate the segmentation accuracy, the results of the proposed method were compared against manual delineations made by two experts in 326 IVUS images of the coronary artery. The average values of the Jaccard measure, Hausdorff distance, percentage of area difference and Dice coefficient were 0.88 ± 0.06, 0.29 ± 0.17 mm, 0.09 ± 0.07 and 0.94 ± 0.04, respectively, in 324 IVUS images successfully segmented. Additionally, a comparison with the studies found in the literature showed that the proposed method is slight better than the majority of the related methods that have been proposed. Hence, the new automatic segmentation method is shown to be effective in detecting the lumen in IVUS images without using complex solutions and user interaction.
Collapse
Affiliation(s)
- Danilo Samuel Jodas
- CAPES Foundation, Ministry of Education of Brazil, Brasília - DF, 70040-020, Brazil; Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Faculdade de Engenharia, Universidade do Porto, Rua Dr. Roberto Frias, s/n, 4200-465, Porto, Portugal.
| | - Aledir Silveira Pereira
- Universidade Estadual Paulista "Júlio de Mesquita Filho", Rua Cristóvão Colombo, 2265, 15054-000, S. J. do Rio Preto, Brazil.
| | - João Manuel R S Tavares
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Faculdade de Engenharia, Universidade do Porto, Rua Dr. Roberto Frias, s/n, 4200-465, Porto, Portugal. http://www.fe.up.pt/~tavares
| |
Collapse
|
28
|
Jodas DS, Pereira AS, R.S. Tavares JM. Lumen segmentation in magnetic resonance images of the carotid artery. Comput Biol Med 2016; 79:233-242. [DOI: 10.1016/j.compbiomed.2016.10.021] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2016] [Revised: 10/24/2016] [Accepted: 10/24/2016] [Indexed: 11/15/2022]
|