Learning tree-structured representation for 3D coronary artery segmentation

SeqCorr-EUNet: A sequence correction dual-flow network for segmentation and quantification of anterior segment OCT image

The accurate segmentation of AS-OCT images is a prerequisite for the morphological details analysis of anterior segment structure and the extraction of clinical biological parameters, which play an essential role in the diagnosis, evaluation, and preoperative prognosis management of many ophthalmic diseases. Manually marking the boundaries of the anterior segment tissue is time-consuming and error-prone, with inherent speckle noise, various artifacts, and some low-quality scanned images further increasing the difficulty of the segmentation task. In this work, we propose a novel model called SeqCorr-EUNet with a dual-flow architecture based on convolutional gated recursive sequence correction for semantic segmentation and quantification of AS-OCT images. An EfficientNet encoder is employed to enhance the intra-slice features extraction ability of semantic segmentation flow. The sequence correction flow based on ConvGRU is introduced to extract inter-slice features from consecutive adjacent slices. Spatio-temporal information is fused to correct the morphological details of pre-segmentation results. And the channel attention gate is inserted into the skip-connection between encoder and decoder to enrich the contextual information and suppress the noise of irrelevant regions. Based on the segmentation results of the anterior segment structures, we achieved automatic extraction of essential clinical parameters, 3D reconstruction of the anterior chamber structure, and measurement of anterior chamber volume. The proposed SeqCorr-EUNet has been evaluated on the public AS-OCT dataset. The experimental results show that our method is competitive compared with the existing methods and significantly improves the segmentation and quantification performance of low-quality imaging structures in AS-OCT images.

AVDNet: Joint coronary artery and vein segmentation with topological consistency

Coronary CT angiography (CCTA) is an effective and non-invasive method for coronary artery disease diagnosis. Extracting an accurate coronary artery tree from CCTA image is essential for centerline extraction, plaque detection, and stenosis quantification. In practice, data quality varies. Sometimes, the arteries and veins have similar intensities and locate closely, which may confuse segmentation algorithms, even deep learning based ones, to obtain accurate arteries. However, it is not always feasible to re-scan the patient for better image quality. In this paper, we propose an artery and vein disentanglement network (AVDNet) for robust and accurate segmentation by incorporating the coronary vein into the segmentation task. This is the first work to segment coronary artery and vein at the same time. The AVDNet consists of an image based vessel recognition network (IVRN) and a topology based vessel refinement network (TVRN). IVRN learns to segment the arteries and veins, while TVRN learns to correct the segmentation errors based on topology consistency. We also design a novel inverse distance weighted dice (IDD) loss function to recover more thin vessel branches and preserve the vascular boundaries. Extensive experiments are conducted on a multi-center dataset of 700 patients. Quantitative and qualitative results demonstrate the effectiveness of the proposed method by comparing it with state-of-the-art methods and different variants. Prediction results of the AVDNet on the Automated Segmentation of Coronary Artery Challenge dataset are avaliabel at https://github.com/WennyJJ/Coronary-Artery-Vein-Segmentation for follow-up research.

Exhaustive matching of 3D/2D coronary artery structure based on imperfect segmentations

PURPOSE

The 3D/2D coronary artery registration technique has been developed for the guidance of the percutaneous coronary intervention. It introduces the absent 3D structural information by fusing the pre-operative computed tomography angiography (CTA) volume with the intra-operative X-ray coronary angiography (XCA) image. To conduct the registration, an accurate matching of the coronary artery structures extracted from the two imaging modalities is an essential step.

METHODS

In this study, we propose an exhaustive matching algorithm to solve this problem. First, by recognizing the fake bifurcations in the XCA image caused by projection and concatenating the fractured centerline fragments, the original XCA topological structure is restored. Then, the vessel segments in the two imaging modalities are removed orderly, which generates all the potential structures to simulate the imperfect segmentation results. Finally, the CTA and XCA structures are compared pairwise, and the matching result is obtained by searching for the structure pair with the minimum similarity score.

RESULTS

The experiments were conducted based on a clinical dataset collected from 46 patients and comprising of 240 CTA/XCA data pairs. And the results show that the proposed method is very effective, which achieves an accuracy of 0.960 for recognizing the fake bifurcations in the XCA image and an accuracy of 0.896 for matching the CTA/XCA vascular structures.

CONCLUSION

The proposed exhaustive structure matching algorithm is simple and straightforward without any impractical assumption or time-consuming computations. With this method, the influence of the imperfect segmentations is eliminated and the accurate matching could be achieved efficiently. This lays a good foundation for the subsequent 3D/2D coronary artery registration task.

Multi-site, Multi-domain Airway Tree Modeling

Open international challenges are becoming the de facto standard for assessing computer vision and image analysis algorithms. In recent years, new methods have extended the reach of pulmonary airway segmentation that is closer to the limit of image resolution. Since EXACT'09 pulmonary airway segmentation, limited effort has been directed to the quantitative comparison of newly emerged algorithms driven by the maturity of deep learning based approaches and extensive clinical efforts for resolving finer details of distal airways for early intervention of pulmonary diseases. Thus far, public annotated datasets are extremely limited, hindering the development of data-driven methods and detailed performance evaluation of new algorithms. To provide a benchmark for the medical imaging community, we organized the Multi-site, Multi-domain Airway Tree Modeling (ATM'22), which was held as an official challenge event during the MICCAI 2022 conference. ATM'22 provides large-scale CT scans with detailed pulmonary airway annotation, including 500 CT scans (300 for training, 50 for validation, and 150 for testing). The dataset was collected from different sites and it further included a portion of noisy COVID-19 CTs with ground-glass opacity and consolidation. Twenty-three teams participated in the entire phase of the challenge and the algorithms for the top ten teams are reviewed in this paper. Both quantitative and qualitative results revealed that deep learning models embedded with the topological continuity enhancement achieved superior performance in general. ATM'22 challenge holds as an open-call design, the training data and the gold standard evaluation are available upon successful registration via its homepage (https://atm22.grand-challenge.org/).

The Differences of Quantitative Flow Ratio in Coronary Artery Stenosis with or without Atrial Fibrillation

Quantitative flow ratio (QFR) is a new method for the assessment of the extent of coronary artery stenosis. But it may be obscured by the cardiac remodeling and abnormal blood flow of the coronary artery when encountering atrial fibrillation (AF). The present study aimed to examine the impact of these changed structures and blood flow of coronary arteries on QFR results in AF patients. Methods and Results. We evaluated QFR in 223 patients (112 patients with AF; 111 non-AF patients served as controls) who had undergone percutaneous coronary intervention (PCI) due to severe stenoses in coronary arteries. QFR of the target coronary was determined according to the flow rate of the contrast agent. Results showed that AF patients had significantly higher QFR values than control (0.792 ± 0.118 vs. 0.685 ± 0.167, p < 0.001). We further analyzed local QFR around the stenoses (0.858 ± 0.304 vs. 0.756 ± 0.146, p=0.002), residual QFR (0.958 ± 0.055 vs. 0.929 ± 0.093, p=0.005), and index QFR (0.807 ± 0.108 vs. 0.713 ± 0.152, p < 0.001) in these two groups of patients with and without AF. Further analysis revealed that QFR in AF patients was negatively correlated with coronary flow velocity (R = -0.22, p=0.02) and area of stenosis (R = -0.70, p < 0.001) but positively correlated with the minimum lumen area (MLA) (R = 0.47, p < 0.001). Conclusion. AF patients with coronary artery stenosis have higher QFR values, which are associated with decreased blood flow velocity, smaller stenosis, and larger MLA in AF patients upon cardiac remodeling.

ImageCAS: A large-scale dataset and benchmark for coronary artery segmentation based on computed tomography angiography images

Cardiovascular disease (CVD) accounts for about half of non-communicable diseases. Vessel stenosis in the coronary artery is considered to be the major risk of CVD. Computed tomography angiography (CTA) is one of the widely used noninvasive imaging modalities in coronary artery diagnosis due to its superior image resolution. Clinically, segmentation of coronary arteries is essential for the diagnosis and quantification of coronary artery disease. Recently, a variety of works have been proposed to address this problem. However, on one hand, most works rely on in-house datasets, and only a few works published their datasets to the public which only contain tens of images. On the other hand, their source code have not been published, and most follow-up works have not made comparison with existing works, which makes it difficult to judge the effectiveness of the methods and hinders the further exploration of this challenging yet critical problem in the community. In this paper, we propose a large-scale dataset for coronary artery segmentation on CTA images. In addition, we have implemented a benchmark in which we have tried our best to implement several typical existing methods. Furthermore, we propose a strong baseline method which combines multi-scale patch fusion and two-stage processing to extract the details of vessels. Comprehensive experiments show that the proposed method achieves better performance than existing works on the proposed large-scale dataset. The benchmark and the dataset are published at https://github.com/XiaoweiXu/ImageCAS-A-Large-Scale-Dataset-and-Benchmark-for-Coronary-Artery-Segmentation-based-on-CT.

Automatic coronary artery segmentation of CCTA images using UNet with a local contextual transformer

Coronary artery segmentation is an essential procedure in the computer-aided diagnosis of coronary artery disease. It aims to identify and segment the regions of interest in the coronary circulation for further processing and diagnosis. Currently, automatic segmentation of coronary arteries is often unreliable because of their small size and poor distribution of contrast medium, as well as the problems that lead to over-segmentation or omission. To improve the performance of convolutional-neural-network (CNN) based coronary artery segmentation, we propose a novel automatic method, DR-LCT-UNet, with two innovative components: the Dense Residual (DR) module and the Local Contextual Transformer (LCT) module. The DR module aims to preserve unobtrusive features through dense residual connections, while the LCT module is an improved Transformer that focuses on local contextual information, so that coronary artery-related information can be better exploited. The LCT and DR modules are effectively integrated into the skip connections and encoder-decoder of the 3D segmentation network, respectively. Experiments on our CorArtTS2020 dataset show that the dice similarity coefficient (DSC), Recall, and Precision of the proposed method reached 85.8%, 86.3% and 85.8%, respectively, outperforming 3D-UNet (taken as the reference among the 6 other chosen comparison methods), by 2.1%, 1.9%, and 2.1%.

Graph Convolution Based Cross-Network Multiscale Feature Fusion for Deep Vessel Segmentation

Vessel segmentation is widely used to help with vascular disease diagnosis. Vessels reconstructed using existing methods are often not sufficiently accurate to meet clinical use standards. This is because 3D vessel structures are highly complicated and exhibit unique characteristics, including sparsity and anisotropy. In this paper, we propose a novel hybrid deep neural network for vessel segmentation. Our network consists of two cascaded subnetworks performing initial and refined segmentation respectively. The second subnetwork further has two tightly coupled components, a traditional CNN-based U-Net and a graph U-Net. Cross-network multi-scale feature fusion is performed between these two U-shaped networks to effectively support high-quality vessel segmentation. The entire cascaded network can be trained from end to end. The graph in the second subnetwork is constructed according to a vessel probability map as well as appearance and semantic similarities in the original CT volume. To tackle the challenges caused by the sparsity and anisotropy of vessels, a higher percentage of graph nodes are distributed in areas that potentially contain vessels while a higher percentage of edges follow the orientation of potential nearby vessels. Extensive experiments demonstrate our deep network achieves state-of-the-art 3D vessel segmentation performance on multiple public and in-house datasets.

COVID-19 Detection: A Systematic Review of Machine and Deep Learning-Based Approaches Utilizing Chest X-Rays and CT Scans

This review study presents the state-of-the-art machine and deep learning-based COVID-19 detection approaches utilizing the chest X-rays or computed tomography (CT) scans. This study aims to systematically scrutinize as well as to discourse challenges and limitations of the existing state-of-the-art research published in this domain from March 2020 to August 2021. This study also presents a comparative analysis of the performance of four majorly used deep transfer learning (DTL) models like VGG16, VGG19, ResNet50, and DenseNet over the COVID-19 local CT scans dataset and global chest X-ray dataset. A brief illustration of the majorly used chest X-ray and CT scan datasets of COVID-19 patients utilized in state-of-the-art COVID-19 detection approaches are also presented for future research. The research databases like IEEE Xplore, PubMed, and Web of Science are searched exhaustively for carrying out this survey. For the comparison analysis, four deep transfer learning models like VGG16, VGG19, ResNet50, and DenseNet are initially fine-tuned and trained using the augmented local CT scans and global chest X-ray dataset in order to observe their performance. This review study summarizes major findings like AI technique employed, type of classification performed, used datasets, results in terms of accuracy, specificity, sensitivity, F1 score, etc., along with the limitations, and future work for COVID-19 detection in tabular manner for conciseness. The performance analysis of the four majorly used deep transfer learning models affirms that Visual Geometry Group 19 (VGG19) model delivered the best performance over both COVID-19 local CT scans dataset and global chest X-ray dataset.

Towards automated coronary artery segmentation: A systematic review

BACKGROUND AND OBJECTIVE

Vessel segmentation is the first processing stage of 3D medical images for both clinical and research use. Current segmentation methods are tedious and time consuming, requiring significant manual correction and hence are infeasible to use in large data sets.

METHODS

Here, we review and analyse available coronary artery segmentation methods, focusing on fully automated methods capable of handling the rapidly growing medical images available. All manuscripts published since 2010 are systematically reviewed, categorised into different groups based on the approach taken, and characteristics of the different approaches as well as trends over the past decade are explored.

RESULTS

The manuscripts were divided intro three broad categories, consisting of region growing, voxelwise prediction and partitioning approaches. The most common approach overall was region growing, particularly using active contour models, however these have had a sharp fall in popularity in recent years with convolutional neural networks becoming significantly more popular.

CONCLUSIONS

The systematic review of current coronary artery segmentation methods shows interesting trends, with rising popularity of machine learning methods, a focus on efficient methods, and falling popularity of computationally expensive processing steps such as vesselness and multiplanar reformation.

Deep learning-based approach for detecting COVID-19 in chest X-rays

Today, 2019 Coronavirus (COVID-19) infections are a major health concern worldwide. Therefore, detecting COVID-19 in X-ray images is crucial for diagnosis, evaluation, and treatment. Furthermore, expressing diagnostic uncertainty in a report is a challenging duty but unavoidable task for radiologists. This study proposes a novel CNN (Convolutional Neural Network) model for automatic COVID-19 identification utilizing chest X-ray images. The proposed CNN model is designed to be a reliable diagnostic tool for two-class categorization (COVID and Normal). In addition to the proposed model, different architectures, including the pre-trained MobileNetv2 and ResNet50 models, are evaluated for this COVID-19 dataset (13,824 X-ray images) and our suggested model is compared to these existing COVID-19 detection algorithms in terms of accuracy. Experimental results show that our proposed model identifies patients with COVID-19 disease with 96.71 percent accuracy, 91.89 percent F1-score. Our proposed approach CNN’s experimental results show that it outperforms the most advanced algorithms currently available. This model can assist clinicians in making informed judgments on how to diagnose COVID-19, as well as make test kits more accessible.

Artificial Intelligence in Coronary CT Angiography: Current Status and Future Prospects

Coronary heart disease (CHD) is the leading cause of mortality in the world. Early detection and treatment of CHD are crucial. Currently, coronary CT angiography (CCTA) has been the prior choice for CHD screening and diagnosis, but it cannot meet the clinical needs in terms of examination quality, the accuracy of reporting, and the accuracy of prognosis analysis. In recent years, artificial intelligence (AI) has developed rapidly in the field of medicine; it played a key role in auxiliary diagnosis, disease mechanism analysis, and prognosis assessment, including a series of studies related to CHD. In this article, the application and research status of AI in CCTA were summarized and the prospects of this field were also described.

Multi-constraints based deep learning model for automated segmentation and diagnosis of coronary artery disease in X-ray angiographic images

BACKGROUND

The detection of coronary artery disease (CAD) from the X-ray coronary angiography is a crucial process which is hindered by various issues such as presence of noise, insufficient contrast of the input images along with the uncertainties caused by the motion due to respiration and variation of angles of vessels.

METHODS

In this article, an Automated Segmentation and Diagnosis of Coronary Artery Disease (ASCARIS) model is proposed in order to overcome the prevailing challenges in detection of CAD from the X-ray images. Initially, the preprocessing of the input images was carried out by using the modified wiener filter for the removal of both internal and external noise pixels from the images. Then, the enhancement of contrast was carried out by utilizing the optimized maximum principal curvature to preserve the edge information thereby contributing to increasing the segmentation accuracy. Further, the binarization of enhanced images was executed by the means of OTSU thresholding. The segmentation of coronary arteries was performed by implementing the Attention-based Nested U-Net, in which the attention estimator was incorporated to overcome the difficulties caused by intersections and overlapped arteries. The increased segmentation accuracy was achieved by performing angle estimation. Finally, the VGG-16 based architecture was implemented to extract threefold features from the segmented image to perform classification of X-ray images into normal and abnormal classes.

RESULTS

The experimentation of the proposed ASCARIS model was carried out in the MATLAB R2020a simulation tool and the evaluation of the proposed model was compared with several existing approaches in terms of accuracy, sensitivity, specificity, revised contrast to noise ratio, mean square error, dice coefficient, Jaccard similarity, Hausdorff distance, Peak signal-to-noise ratio (PSNR), segmentation accuracy and ROC curve.

DISCUSSION

The results obtained conclude that the proposed model outperforms the existing approaches in all the evaluation metrics thereby achieving optimized classification of CAD. The proposed method removes the large number of background artifacts and obtains a better vascular structure.

Automated Multi-View Multi-Modal Assessment of COVID-19 Patients Using Reciprocal Attention and Biomedical Transform

Automated severity assessment of coronavirus disease 2019 (COVID-19) patients can help rationally allocate medical resources and improve patients' survival rates. The existing methods conduct severity assessment tasks mainly on a unitary modal and single view, which is appropriate to exclude potential interactive information. To tackle the problem, in this paper, we propose a multi-view multi-modal model to automatically assess the severity of COVID-19 patients based on deep learning. The proposed model receives multi-view ultrasound images and biomedical indices of patients and generates comprehensive features for assessment tasks. Also, we propose a reciprocal attention module to acquire the underlying interactions between multi-view ultrasound data. Moreover, we propose biomedical transform module to integrate biomedical data with ultrasound data to produce multi-modal features. The proposed model is trained and tested on compound datasets, and it yields 92.75% for accuracy and 80.95% for recall, which is the best performance compared to other state-of-the-art methods. Further ablation experiments and discussions conformably indicate the feasibility and advancement of the proposed model.

A Practical Deep Learning Model in Differentiating Pneumonia-Type Lung Carcinoma from Pneumonia on CT Images: ResNet Added with Attention Mechanism

Objective

We aim to develop a deep neural network model to differentiate pneumonia-type lung carcinoma from pneumonia based on chest CT scanning and evaluate its performance.

Materials and Methods

We retrospectively analyzed 131 patients diagnosed with pneumonia-type lung carcinoma and 171 patients with pneumonia treated in Beijing Hospital from October 2019 to February 2021. The average age was 68 (±15) years old, and the proportion of men (162/302) was slightly more than that of women (140/302). In this study, a deep learning based model UNet was applied to extract lesion areas from chest CT images. Lesion areas were extracted and classified by a designed spatial attention mechanism network. The model AUC and diagnostic accuracy were analyzed based on the results of the model. We analyzed the accuracy rate, sensitivity, and specificity and compared the results of the model to the junior and senior radiologists and radiologists based on the model.

Results

The model has a good efficiency in detecting pneumonia-like lesions (6.31 seconds/case). The model accuracy rate, sensitivity, and specificity were 74.20%, 60.37%, and 89.36%, respectively. The junior radiologist's accuracy rate, sensitivity, and specificity were 61.00%, 48.08%, and 75.00%, respectively. The senior radiologist's accuracy rate, sensitivity, and specificity were 65.00%, 51.92%, and 79.17%, respectively. The results of junior radiologists based on the model were improved (76.00% for accuracy rate, 62.75% for sensitivity, and 89.80% for specificity). The results of senior radiologists based on the model were also improved (78.00% for accuracy rate, 64.71% for sensitivity, and 91.84% for specificity) and the diagnostic accuracy of which was statistically higher than other groups (P < 0.05). Based on the lesion texture diversity and the lesion boundary ambiguity, the algorithm produced false-positive samples (13.51%).

Conclusion

This deep learning model could detect pneumonia-type lung carcinoma and differentiate it from pneumonia accurately and efficiently.

Robust Deep 3D Blood Vessel Segmentation Using Structural Priors

Deep learning has enabled significant improvements in the accuracy of 3D blood vessel segmentation. Open challenges remain in scenarios where labeled 3D segmentation maps for training are severely limited, as is often the case in practice, and in ensuring robustness to noise. Inspired by the observation that 3D vessel structures project onto 2D image slices with informative and unique edge profiles, we propose a novel deep 3D vessel segmentation network guided by edge profiles. Our network architecture comprises a shared encoder and two decoders that learn segmentation maps and edge profiles jointly. 3D context is mined in both the segmentation and edge prediction branches by employing bidirectional convolutional long-short term memory (BCLSTM) modules. 3D features from the two branches are concatenated to facilitate learning of the segmentation map. As a key contribution, we introduce new regularization terms that: a) capture the local homogeneity of 3D blood vessel volumes in the presence of biomarkers; and b) ensure performance robustness to domain-specific noise by suppressing false positive responses. Experiments on benchmark datasets with ground truth labels reveal that the proposed approach outperforms state-of-the-art techniques on standard measures such as DICE overlap and mean Intersection-over-Union. The performance gains of our method are even more pronounced when training is limited. Furthermore, the computational cost of our network inference is among the lowest compared with state-of-the-art.

A quantum-clustering optimization method for COVID-19 CT scan image segmentation

The World Health Organization (WHO) has declared Coronavirus Disease 2019 (COVID-19) as one of the highly contagious diseases and considered this epidemic as a global health emergency. Therefore, medical professionals urgently need an early diagnosis method for this new type of disease as soon as possible. In this research work, a new early screening method for the investigation of COVID-19 pneumonia using chest CT scan images has been introduced. For this purpose, a new image segmentation method based on K-means clustering algorithm (KMC) and novel fast forward quantum optimization algorithm (FFQOA) is proposed. The proposed method, called FFQOAK (FFQOA+KMC), initiates by clustering gray level values with the KMC algorithm and generating an optimal segmented image with the FFQOA. The main objective of the proposed FFQOAK is to segment the chest CT scan images so that infected regions can be accurately detected. The proposed method is verified and validated with different chest CT scan images of COVID-19 patients. The segmented images obtained using FFQOAK method are compared with various benchmark image segmentation methods. The proposed method achieves mean squared error, peak signal-to-noise ratio, Jaccard similarity coefficient and correlation coefficient of 712.30, 19.61, 0.90 and 0.91 in case of four experimental sets, namely Experimental_Set_1, Experimental_Set_2, Experimental_Set_3 and Experimental_Set_4, respectively. These four performance evaluation metrics show the effectiveness of FFQOAK method over these existing methods.

Calcium Scoring at Coronary CT Angiography Using Deep Learning

Background Separate noncontrast CT to quantify the coronary artery calcium (CAC) score often precedes coronary CT angiography (CTA). Quantifying CAC scores directly at CTA would eliminate the additional radiation produced at CT but remains challenging. Purpose To quantify CAC scores automatically from a single CTA scan. Materials and Methods In this retrospective study, a deep learning method to quantify CAC scores automatically from a single CTA scan was developed on training and validation sets of 292 patients and 73 patients collected from March 2019 to July 2020. Virtual noncontrast scans obtained with a spectral CT scanner were used to develop the algorithm to alleviate tedious manual annotation of calcium regions. The proposed method was validated on an independent test set of 240 CTA scans collected from three different CT scanners from August 2020 to November 2020 using the Pearson correlation coefficient, the coefficient of determination, or r², and the Bland-Altman plot against the semiautomatic Agatston score at noncontrast CT. The cardiovascular risk categorization performance was evaluated using weighted κ based on the Agatston score (CAC score risk categories: 0-10, 11-100, 101-400, and >400). Results Two hundred forty patients (mean age, 60 years ± 11 [standard deviation]; 146 men) were evaluated. The positive correlation between the automatic deep learning CTA and semiautomatic noncontrast CT CAC score was excellent (Pearson correlation = 0.96; r² = 0.92). The risk categorization agreement based on deep learning CTA and noncontrast CT CAC scores was excellent (weighted κ = 0.94 [95% CI: 0.91, 0.97]), with 223 of 240 scans (93%) categorized correctly. All patients who were miscategorized were in the direct neighboring risk groups. The proposed method's differences from the noncontrast CT CAC score were not statistically significant with regard to scanner (P = .15), sex (P = .051), and section thickness (P = .67). Conclusion A deep learning automatic calcium scoring method accurately quantified coronary artery calcium from CT angiography images and categorized risk. © RSNA, 2021 See also the editorial by Goldfarb and Cao et al in this issue.

Examinee-Examiner Network: Weakly Supervised Accurate Coronary Lumen Segmentation Using Centerline Constraint

Accurate coronary lumen segmentation on coronary-computed tomography angiography (CCTA) images is crucial for quantification of coronary stenosis and the subsequent computation of fractional flow reserve. Many factors including difficulty in labeling coronary lumens, various morphologies in stenotic lesions, thin structures and small volume ratio with respect to the imaging field complicate the task. In this work, we fused the continuity topological information of centerlines which are easily accessible, and proposed a novel weakly supervised model, Examinee-Examiner Network (EE-Net), to overcome the challenges in automatic coronary lumen segmentation. First, the EE-Net was proposed to address the fracture in segmentation caused by stenoses by combining the semantic features of lumens and the geometric constraints of continuous topology obtained from the centerlines. Then, a Centerline Gaussian Mask Module was proposed to deal with the insensitiveness of the network to the centerlines. Subsequently, a weakly supervised learning strategy, Examinee-Examiner Learning, was proposed to handle the weakly supervised situation with few lumen labels by using our EE-Net to guide and constrain the segmentation with customized prior conditions. Finally, a general network layer, Drop Output Layer, was proposed to adapt to the class imbalance by dropping well-segmented regions and weights the classes dynamically. Extensive experiments on two different data sets demonstrated that our EE-Net has good continuity and generalization ability on coronary lumen segmentation task compared with several widely used CNNs such as 3D-UNet. The results revealed our EE-Net with great potential for achieving accurate coronary lumen segmentation in patients with coronary artery disease. Code at http://github.com/qiyaolei/Examinee-Examiner-Network.

Fusing 2D and 3D convolutional neural networks for the segmentation of aorta and coronary arteries from CT images

Automated segmentation of three-dimensional medical images is of great importance for the detection and quantification of certain diseases such as stenosis in the coronary arteries. Many 2D and 3D deep learning models, especially deep convolutional neural networks (CNNs), have achieved state-of-the-art segmentation performance on 3D medical images. Yet, there is a trade-off between the field of view and the utilization of inter-slice information when using pure 2D or 3D CNNs for 3D segmentation, which compromises the segmentation accuracy. In this paper, we propose a two-stage strategy that retains the advantages of both 2D and 3D CNNs and apply the method for the segmentation of the human aorta and coronary arteries, with stenosis, from computed tomography (CT) images. In the first stage, a 2D CNN, which can extract large-field-of-view information, is used to segment the aorta and coronary arteries simultaneously in a slice-by-slice fashion. Then, in the second stage, a 3D CNN is applied to extract the inter-slice information to refine the segmentation of the coronary arteries in certain subregions not resolved well in the first stage. We show that the 3D network of the second stage can improve the continuity between slices and reduce the missed detection rate of the 2D CNN. Compared with directly using a 3D CNN, the two-stage approach can alleviate the class imbalance problem caused by the large non-coronary artery (aorta and background) and the small coronary artery and reduce the training time because the vast majority of negative voxels are excluded in the first stage. To validate the efficacy of our method, extensive experiments are carried out to compare with other approaches based on pure 2D or 3D CNNs and those based on hybrid 2D-3D CNNs.

Segmentation of Coronary Arteries Images Using Spatio-temporal Feature Fusion Network with Combo Loss

PURPOSE

Coronary heart disease is a serious disease that endangers human health and life. In recent years, the incidence and mortality of coronary heart disease have increased rapidly. The quantification of the coronary artery is critical in diagnosing coronary heart disease.

METHODS

In this paper, we improve the coronary arteries segmentation performance from two aspects of network model and algorithm. We proposed a U-shaped network based on spatio-temporal feature fusion structure to segment coronary arteries from 2D slices of computed tomography angiography (CTA) heart images. The spatio-temporal feature combines features of multiple levels and different receptive fields separately to get more precise boundaries. It is easy to cause over-segmented for the small proportion of coronary arteries in CTA images. For this reason, a combo loss function was designed to deal with the notorious imbalance between inputs and outputs that plague learning models. Input imbalance refers to the class imbalance in the input training samples. The output imbalance refers to the imbalance between the false positive and false negative of the inference model. The two imbalances in training and inference were divided and conquered with our combo loss function. Specifically, a gradient harmonizing mechanism (GHM) loss was employed to balance the gradient contribution of the input samples and at the same time punish false positives/negatives using another sensitivity-precision loss term to learn better model parameters gradually.

RESULTS

Compared with some existing methods, our proposed method improves the segmentation accuracy significantly, achieving the mean Dice coefficient of 0.87. In addition, accurate results can be obtained with little data using our method. Code is available at: https://github.com/Ariel97-star/FFNet-CoronaryArtery-Segmentation .

CONCLUSIONS

Our method can intelligently capture coronary artery structure and achieve accurate flow reserve fraction (FFR) analysis. Through a series of steps such as CPR curved reconstruction, the detection of coronary heart disease can be achieved without affecting the patient's body. In addition, our work can be used as an effective means to assist in the detection of stenosis. In the screening of coronary heart disease among high-risk cardiovascular factors, automatic detection of luminal stenosis can be performed based on the application of later algorithm transformation.

Deep Recursive Bayesian Tracking for Fully Automatic Centerline Extraction of Coronary Arteries in CT Images

Extraction of coronary arteries in coronary computed tomography (CT) angiography is a prerequisite for the quantification of coronary lesions. In this study, we propose a tracking method combining a deep convolutional neural network (DNN) and particle filtering method to identify the trajectories from the coronary ostium to each distal end from 3D CT images. The particle filter, as a non-linear approximator, is an appropriate tracking framework for such thin and elongated structures; however, the robust 'vesselness' measurement is essential for extracting coronary centerlines. Importantly, we employed the DNN to robustly measure the vesselness using patch images, and we integrated softmax values to the likelihood function in our particle filtering framework. Tangent patches represent cross-sections of coronary arteries of circular shapes. Thus, 2D tangent patches are assumed to include enough features of coronary arteries, and the use of 2D patches significantly reduces computational complexity. Because coronary vasculature has multiple bifurcations, we also modeled a method to detect branching sites by clustering the particle locations. The proposed method is compared with three commercial workstations and two conventional methods from the academic literature.

The human-AI scoring system: A new method for CT-based assessment of COVID-19 severity

BACKGROUND

Chest computed tomography (CT) plays an important role in the diagnosis and assessment of coronavirus disease 2019 (COVID-19).

OBJECTIVE

To evaluate the value of an artificial intelligence (AI) scoring system for radiologically assessing the severity of COVID-19.

MATERIALS AND METHODS

Chest CT images of 81 patients (61 of normal type and 20 of severe type) with confirmed COVID-19 were used. The test data were anonymized. The scores achieved by four methods (junior radiologists; AI scoring system; human-AI segmentation system; human-AI scoring system) were compared with that by two experienced radiologists (reference score). The mean absolute errors (MAEs) between the four methods and experienced radiologists were calculated separately. The Wilcoxon test is used to predict the significance of the severity of COVID-19. Then use Spearman correlation analysis ROC analysis was used to evaluate the performance of different scores.

RESULTS

The AI score had a relatively low MAE (1.67-2.21). Score of human-AI scoring system had the lowest MAE (1.67), a diagnostic value almost equal to reference score (r= 0.97), and a strongest correlation with clinical severity (r= 0.59, p< 0.001). The AUCs of reference score, score of junior radiologists, AI score, score of human-AI segmentation system, and score of human-AI scoring system were 0.874, 0.841, 0.852, 0.857 and 0.865, respectively.

CONCLUSION

The human-AI scoring system can help radiologists to improve the accuracy of COVID-19 severity assessment.

Machine Learning Models for Image-Based Diagnosis and Prognosis of COVID-19: Systematic Review

BACKGROUND

Accurate and timely diagnosis and effective prognosis of the disease is important to provide the best possible care for patients with COVID-19 and reduce the burden on the health care system. Machine learning methods can play a vital role in the diagnosis of COVID-19 by processing chest x-ray images.

OBJECTIVE

The aim of this study is to summarize information on the use of intelligent models for the diagnosis and prognosis of COVID-19 to help with early and timely diagnosis, minimize prolonged diagnosis, and improve overall health care.

METHODS

A systematic search of databases, including PubMed, Web of Science, IEEE, ProQuest, Scopus, bioRxiv, and medRxiv, was performed for COVID-19-related studies published up to May 24, 2020. This study was performed in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines. All original research articles describing the application of image processing for the prediction and diagnosis of COVID-19 were considered in the analysis. Two reviewers independently assessed the published papers to determine eligibility for inclusion in the analysis. Risk of bias was evaluated using the Prediction Model Risk of Bias Assessment Tool.

RESULTS

Of the 629 articles retrieved, 44 articles were included. We identified 4 prognosis models for calculating prediction of disease severity and estimation of confinement time for individual patients, and 40 diagnostic models for detecting COVID-19 from normal or other pneumonias. Most included studies used deep learning methods based on convolutional neural networks, which have been widely used as a classification algorithm. The most frequently reported predictors of prognosis in patients with COVID-19 included age, computed tomography data, gender, comorbidities, symptoms, and laboratory findings. Deep convolutional neural networks obtained better results compared with non-neural network-based methods. Moreover, all of the models were found to be at high risk of bias due to the lack of information about the study population, intended groups, and inappropriate reporting.

CONCLUSIONS

Machine learning models used for the diagnosis and prognosis of COVID-19 showed excellent discriminative performance. However, these models were at high risk of bias, because of various reasons such as inadequate information about study participants, randomization process, and the lack of external validation, which may have resulted in the optimistic reporting of these models. Hence, our findings do not recommend any of the current models to be used in practice for the diagnosis and prognosis of COVID-19.

Coronary Centerline Extraction from CCTA Using 3D-UNet

The mesh-type coronary model, obtained from three-dimensional reconstruction using the sequence of images produced by computed tomography (CT), can be used to obtain useful diagnostic information, such as extracting the projection of the lumen (planar development along an artery). In this paper, we have focused on automated coronary centerline extraction from cardiac computed tomography angiography (CCTA) proposing a 3D version of U-Net architecture, trained with a novel loss function and with augmented patches. We have obtained promising results for accuracy (between 90–95%) and overlap (between 90–94%) with various network training configurations on the data from the Rotterdam Coronary Artery Centerline Extraction benchmark. We have also demonstrated the ability of the proposed network to learn despite the huge class imbalance and sparse annotation present in the training data.

Role of Hybrid Deep Neural Networks (HDNNs), Computed Tomography, and Chest X-rays for the Detection of COVID-19

COVID-19 syndrome has extensively escalated worldwide with the induction of the year 2020 and has resulted in the illness of millions of people. COVID-19 patients bear an elevated risk once the symptoms deteriorate. Hence, early recognition of diseased patients can facilitate early intervention and avoid disease succession. This article intends to develop a hybrid deep neural networks (HDNNs), using computed tomography (CT) and X-ray imaging, to predict the risk of the onset of disease in patients suffering from COVID-19. To be precise, the subjects were classified into 3 categories namely normal, Pneumonia, and COVID-19. Initially, the CT and chest X-ray images, denoted as 'hybrid images' (with resolution 1080 × 1080) were collected from different sources, including GitHub, COVID-19 radiography database, Kaggle, COVID-19 image data collection, and Actual Med COVID-19 Chest X-ray Dataset, which are open source and publicly available data repositories. The 80% hybrid images were used to train the hybrid deep neural network model and the remaining 20% were used for the testing purpose. The capability and prediction accuracy of the HDNNs were calculated using the confusion matrix. The hybrid deep neural network showed a 99% classification accuracy on the test set data.

ADID-UNET-a segmentation model for COVID-19 infection from lung CT scans

Currently, the new coronavirus disease (COVID-19) is one of the biggest health crises threatening the world. Automatic detection from computed tomography (CT) scans is a classic method to detect lung infection, but it faces problems such as high variations in intensity, indistinct edges near lung infected region and noise due to data acquisition process. Therefore, this article proposes a new COVID-19 pulmonary infection segmentation depth network referred as the Attention Gate-Dense Network- Improved Dilation Convolution-UNET (ADID-UNET). The dense network replaces convolution and maximum pooling function to enhance feature propagation and solves gradient disappearance problem. An improved dilation convolution is used to increase the receptive field of the encoder output to further obtain more edge features from the small infected regions. The integration of attention gate into the model suppresses the background and improves prediction accuracy. The experimental results show that the ADID-UNET model can accurately segment COVID-19 lung infected areas, with performance measures greater than 80% for metrics like Accuracy, Specificity and Dice Coefficient (DC). Further when compared to other state-of-the-art architectures, the proposed model showed excellent segmentation effects with a high DC and F1 score of 0.8031 and 0.82 respectively.

Novel Deep Learning Technique Used in Management and Discharge of Hospitalized Patients with COVID-19 in China

Purpose

The low sensitivity and false-negative results of nucleic acid testing greatly affect its performance in diagnosing and discharging patients with coronavirus disease (COVID-19). Chest computed tomography (CT)-based evaluation of pneumonia may indicate a need for isolation. Therefore, this radiologic modality plays an important role in managing patients with suspected COVID-19. Meanwhile, deep learning (DL) technology has been successful in detecting various imaging features of chest CT. This study applied a novel DL technique to standardize the discharge criteria of COVID-19 patients with consecutive negative respiratory pathogen nucleic acid test results at a “square cabin” hospital.

Patients and Methods

DL was used to evaluate the chest CT scans of 270 hospitalized COVID-19 patients who had two consecutive negative nucleic acid tests (sampling interval >1 day). The CT scans evaluated were obtained after the patients’ second negative test result. The standard criterion determined by DL for patient discharge was a total volume ratio of lesion to lung <50%.

Results

The mean number of days between hospitalization and DL was 14.3 (± 2.4). The average intersection over union was 0.7894. Two hundred and thirteen (78.9%) patients exhibited pneumonia, of whom 54.0% (115/213) had mild interstitial fibrosis. Twenty-one, 33, and 4 cases exhibited vascular enlargement, pleural thickening, and mediastinal lymphadenopathy, respectively. Of the latter, 18.8% (40/213) had a total volume ratio of lesions to lung ≥50% according to our severity scale and were monitored continuously in the hospital. Three cases had a positive follow-up nucleic acid test during hospitalization. None of the 230 discharged cases later tested positive or exhibited pneumonia progression.

Conclusion

The novel DL enables the accurate management of hospitalized patients with COVID-19 and can help avoid cluster transmission or exacerbation in patients with false-negative acid test.

Using Artificial Intelligence to Detect COVID-19 and Community-acquired Pneumonia Based on Pulmonary CT: Evaluation of the Diagnostic Accuracy

Background Coronavirus disease 2019 (COVID-19) has widely spread all over the world since the beginning of 2020. It is desirable to develop automatic and accurate detection of COVID-19 using chest CT. Purpose To develop a fully automatic framework to detect COVID-19 using chest CT and evaluate its performance. Materials and Methods In this retrospective and multicenter study, a deep learning model, the COVID-19 detection neural network (COVNet), was developed to extract visual features from volumetric chest CT scans for the detection of COVID-19. CT scans of community-acquired pneumonia (CAP) and other non-pneumonia abnormalities were included to test the robustness of the model. The datasets were collected from six hospitals between August 2016 and February 2020. Diagnostic performance was assessed with the area under the receiver operating characteristic curve, sensitivity, and specificity. Results The collected dataset consisted of 4352 chest CT scans from 3322 patients. The average patient age (±standard deviation) was 49 years ± 15, and there were slightly more men than women (1838 vs 1484, respectively; P = .29). The per-scan sensitivity and specificity for detecting COVID-19 in the independent test set was 90% (95% confidence interval [CI]: 83%, 94%; 114 of 127 scans) and 96% (95% CI: 93%, 98%; 294 of 307 scans), respectively, with an area under the receiver operating characteristic curve of 0.96 (P < .001). The per-scan sensitivity and specificity for detecting CAP in the independent test set was 87% (152 of 175 scans) and 92% (239 of 259 scans), respectively, with an area under the receiver operating characteristic curve of 0.95 (95% CI: 0.93, 0.97). Conclusion A deep learning model can accurately detect coronavirus 2019 and differentiate it from community-acquired pneumonia and other lung conditions. © RSNA, 2020 Online supplemental material is available for this article.

Machine learning for diagnosis of coronary artery disease in computed tomography angiography: A survey

Coronary artery disease (CAD) has become a major illness endangering human health. It mainly manifests as atherosclerotic plaques, especially vulnerable plaques without obvious symptoms in the early stage. Once a rupture occurs, it will lead to severe coronary stenosis, which in turn may trigger a major adverse cardiovascular event. Computed tomography angiography (CTA) has become a standard diagnostic tool for early screening of coronary plaque and stenosis due to its advantages in high resolution, noninvasiveness, and three-dimensional imaging. However, manual examination of CTA images by radiologists has been proven to be tedious and time-consuming, which might also lead to intra- and interobserver errors. Nowadays, many machine learning algorithms have enabled the (semi-)automatic diagnosis of CAD by extracting quantitative features from CTA images. This paper provides a survey of these machine learning algorithms for the diagnosis of CAD in CTA images, including coronary artery extraction, coronary plaque detection, vulnerable plaque identification, and coronary stenosis assessment. Most included articles were published within this decade and are found in the Web of Science. We wish to give readers a glimpse of the current status, challenges, and perspectives of these machine learning-based analysis methods for automatic CAD diagnosis.