1
|
Lee YS, Chung HT, Lin JJ, Hwang MS, Liu HC, Hsu HM, Chang YT, Peng SJ. Prediction of significant congenital heart disease in infants and children using continuous wavelet transform and deep convolutional neural network with 12-lead electrocardiogram. BMC Pediatr 2025; 25:324. [PMID: 40275174 PMCID: PMC12020324 DOI: 10.1186/s12887-025-05628-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/21/2024] [Accepted: 03/24/2025] [Indexed: 04/26/2025] Open
Abstract
BACKGROUND Congenital heart disease (CHD) affects approximately 1% of newborns and is a leading cause of mortality in early childhood. Despite the importance of early detection, current screening methods, such as pulse oximetry and auscultation, have notable limitations, particularly in identifying non-cyanotic CHD. (AI)-assisted electrocardiography (ECG) analysis offers a cost-effective alternative to conventional CHD detection. However, most existing models have been trained on older children, limiting their generalizability to infants and young children. This study developed an AI model trained on real-world ECG data for the detection of hemodynamically significant CHD in children under five years of age. METHODS ECG data was retrospectively collected from 1,035 patients under five years old at Chang Gung Memorial Hospital, Taoyuan, Taiwan (2013-2020). Based on ECG findings, patients were categorized into the following groups: normal heart structure (NOR), non-significant right heart disease (RHA), significant right heart disease (RHB), non-significant left heart disease (LHA), and significant left heart disease (LHB). ECG signals underwent preprocessing using continuous wavelet transformation and segmentation into 2-s intervals for data augmentation. Transfer learning was applied using three pre-trained deep learning models: ResNet- 18, InceptionResNet-V2, and NasNetMobile. Model performance was evaluated in terms of accuracy, sensitivity, specificity, F1 score, and area under the receiver operating characteristic curve (AUC). RESULTS Among the tested models, the model based on ResNet-18 demonstrated the best overall performance in predicting clinically significant CHD, achieving accuracy of 73.9%, an F1 score of 75.8%, and an AUC of 81.0% in differentiating significant from non-significant CHD. InceptionResNet-V2 performed well in detecting left heart disease but was computationally intensive. The proposed AI model significantly outperformed conventional ECG interpretation by pediatric cardiologists (accuracy 67.1%, sensitivity 71.6%). CONCLUSIONS This study highlights the potential of AI-assisted ECG analysis for CHD screening in young children. The ResNet-18-based model outperformed conventional ECG evaluation, suggesting its feasibility as a supplementary tool for early CHD detection. Future studies should focus on multi-center validation, inclusion of more CHD subtypes, and integration with other screening modalities to improve diagnostic accuracy and clinical applicability.
Collapse
Affiliation(s)
- Yu-Shin Lee
- Division of Cardiology, Department of Pediatrics, Chang Gung Memoral Hospital Linkou Branch, Taoyuan, Taiwan
- In-Service Master Program in Artificial Intelligence in Medicine, College of Medicine, Taipei Medical University, No.250, Wuxing St., Xinyi Dist., Taipei City, 110, Taiwan
| | - Hung-Tao Chung
- Division of Cardiology, Department of Pediatrics, Chang Gung Memoral Hospital Linkou Branch, Taoyuan, Taiwan
| | - Jainn-Jim Lin
- Division of Pediatric Intensive Care, Department of Pediatrics, Chang Gung Memorial Hospital, Linkou Branch, Taoyuan, Taiwan
| | - Mao-Sheng Hwang
- Division of Cardiology, Department of Pediatrics, Chang Gung Memoral Hospital Linkou Branch, Taoyuan, Taiwan
| | - Hao-Chuan Liu
- Division of Cardiology, Department of Pediatrics, Chang Gung Memoral Hospital Linkou Branch, Taoyuan, Taiwan
| | - Hsin-Mao Hsu
- Division of Cardiology, Department of Pediatrics, Chang Gung Memoral Hospital Linkou Branch, Taoyuan, Taiwan
| | - Ya-Ting Chang
- Division of Cardiology, Department of Pediatrics, Chang Gung Memoral Hospital Linkou Branch, Taoyuan, Taiwan
| | - Syu-Jyun Peng
- In-Service Master Program in Artificial Intelligence in Medicine, College of Medicine, Taipei Medical University, No.250, Wuxing St., Xinyi Dist., Taipei City, 110, Taiwan.
- Clinical Big Data Research Center, Taipei Medical University Hospital, Taipei Medical University, Taipei, Taiwan.
| |
Collapse
|
2
|
Xu C, Li X, Zhang X, Wu R, Zhou Y, Zhao Q, Zhang Y, Geng S, Gu Y, Hong S. Cardiac murmur grading and risk analysis of cardiac diseases based on adaptable heterogeneous-modality multi-task learning. Health Inf Sci Syst 2024; 12:2. [PMID: 38045019 PMCID: PMC10692066 DOI: 10.1007/s13755-023-00249-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Accepted: 09/20/2023] [Indexed: 12/05/2023] Open
Abstract
Cardiovascular disease (CVDs) has become one of the leading causes of death, posing a significant threat to human life. The development of reliable Artificial Intelligence (AI) assisted diagnosis algorithms for cardiac sounds is of great significance for early detection and treatment of CVDs. However, there is scarce research in this field. Existing research mainly faces three major challenges: (1) They mainly limited to murmur classification and cannot achieve murmur grading, but attempting both classification and grading may lead to negative effects between different multi-tasks. (2) They mostly pay attention to unstructured cardiac sound modality and do not consider the structured demographic modality, as it is difficult to balance the influence of heterogeneous modalities. (3) Deep learning methods lack interpretability, which makes it challenging to apply them clinically. To tackle these challenges, we propose a method for cardiac murmur grading and cardiac risk analysis based on heterogeneous modality adaptive multi-task learning. Specifically, a Hierarchical Multi-Task learning-based cardiac murmur detection and grading method (HMT) is proposed to prevent negative interference between different tasks. In addition, a cardiac risk analysis method based on Heterogeneous Multi-modal feature impact Adaptation (HMA) is also proposed, which transforms unstructured modality into structured modality representation, and utilizes an adaptive mode weight learning mechanism to balance the impact between unstructured modality and structured modality, thus enhancing the performance of cardiac risk prediction. Finally, we propose a multi-task interpretability learning module that incorporates an important evaluation using random masks. This module utilizes SHAP graphs to visualize crucial murmur segments in cardiac sound and employs a multi-factor risk decoupling model based on nomograms. And then we gain insights into the cardiac disease risk in both pre-decoupled multi-modality and post-decoupled single-modality scenarios, thus providing a solid foundation for AI assisted cardiac murmur grading and risk analysis. Experimental results on a large real-world CirCor DigiScope PCG dataset demonstrate that the proposed method outperforms the state-of-the-art (SOTA) method in murmur detection, grading, and cardiac risk analysis, while also providing valuable diagnostic evidence.
Collapse
Affiliation(s)
- Chenyang Xu
- Department of Computer Science, Tianjin University of Technology, Tianjin, China
| | - Xin Li
- Department of Rehabilitation Medicine, Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University, Beijing, China
| | - Xinyue Zhang
- Department of Computer Science, Tianjin University of Technology, Tianjin, China
| | - Ruilin Wu
- Department of Computer Science, Tianjin University of Technology, Tianjin, China
| | - Yuxi Zhou
- Department of Computer Science, Tianjin University of Technology, Tianjin, China
- DCST, BNRist, RIIT, Institute of Internet Industry, Tsinghua University, Beijing, China
| | - Qinghao Zhao
- Department of Cardiology, Peking University People’s Hospital, Beijing, China
| | - Yong Zhang
- DCST, BNRist, RIIT, Institute of Internet Industry, Tsinghua University, Beijing, China
| | | | - Yue Gu
- Department of Computer Science, Tianjin University of Technology, Tianjin, China
| | - Shenda Hong
- National Institute of Health Data Science, Peking University, Beijing, China
- Institute of Medical Technology, Peking University, Beijing, China
| |
Collapse
|
3
|
Khan K, Ullah F, Syed I, Ali H. Accurately assessing congenital heart disease using artificial intelligence. PeerJ Comput Sci 2024; 10:e2535. [PMID: 39650370 PMCID: PMC11623015 DOI: 10.7717/peerj-cs.2535] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Accepted: 10/29/2024] [Indexed: 12/11/2024]
Abstract
Congenital heart disease (CHD) remains a significant global health challenge, particularly contributing to newborn mortality, with the highest rates observed in middle- and low-income countries due to limited healthcare resources. Machine learning (ML) presents a promising solution by developing predictive models that more accurately assess the risk of mortality associated with CHD. These ML-based models can help healthcare professionals identify high-risk infants and ensure timely and appropriate care. In addition, ML algorithms excel at detecting and analyzing complex patterns that can be overlooked by human clinicians, thereby enhancing diagnostic accuracy. Despite notable advancements, ongoing research continues to explore the full potential of ML in the identification of CHD. The proposed article provides a comprehensive analysis of the ML methods for the diagnosis of CHD in the last eight years. The study also describes different data sets available for CHD research, discussing their characteristics, collection methods, and relevance to ML applications. In addition, the article also evaluates the strengths and weaknesses of existing algorithms, offering a critical review of their performance and limitations. Finally, the article proposes several promising directions for future research, with the aim of further improving the efficacy of ML in the diagnosis and treatment of CHD.
Collapse
Affiliation(s)
- Khalil Khan
- Department of Computer Science, School of Engineering and Digital Sciences, Nazarbayev University, Astana, Kazakhstan
| | - Farhan Ullah
- College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, China
| | - Ikram Syed
- Dept of Information and Communication Engineering, Hankuk University of Foreign Studies, Yongin, Gyeonggy-do, Republic of South Korea
| | - Hashim Ali
- Department of Computer Science, School of Engineering and Digital Sciences, Nazarbayev University, Astana, Kazakhstan
| |
Collapse
|
4
|
Li F, Li P, Liu Z, Liu S, Zeng P, Song H, Liu P, Lyu G. Application of artificial intelligence in VSD prenatal diagnosis from fetal heart ultrasound images. BMC Pregnancy Childbirth 2024; 24:758. [PMID: 39550543 PMCID: PMC11568577 DOI: 10.1186/s12884-024-06916-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Accepted: 10/21/2024] [Indexed: 11/18/2024] Open
Abstract
BACKGROUND Developing a combined artificial intelligence (AI) and ultrasound imaging to provide an accurate, objective, and efficient adjunctive diagnostic approach for fetal heart ventricular septal defects (VSD). METHODS 1,451 fetal heart ultrasound images from 500 pregnant women were comprehensively analyzed between January 2016 and June 2022. The fetal heart region was manually labeled and the presence of VSD was discriminated by experts. The principle of five-fold cross-validation was followed in the training set to develop the AI model to assist in the diagnosis of VSD. The model was evaluated in the test set using metrics such as mAP@0.5, precision, recall, and F1 score. The diagnostic accuracy and inference time were also compared with junior doctors, intermediate doctors, and senior doctors. RESULTS The mAP@0.5, precision, recall, and F1 scores for the AI model diagnosis of VSD were 0.926, 0.879, 0.873, and 0.88, respectively. The accuracy of junior doctors and intermediate doctors improved by 6.7% and 2.8%, respectively, with the assistance of this system. CONCLUSIONS This study reports an AI-assisted diagnostic method for VSD that has a high agreement with manual recognition. It also has a low number of parameters and computational complexity, which can also improve the diagnostic accuracy and speed of some physicians for VSD.
Collapse
Affiliation(s)
- Furong Li
- School of Information Science & Engineering, Lanzhou University, Lanzhou, 730000, China
- College of Physics and Electronic Engineering, Northwest Normal University, Lanzhou, 730070, China
| | - Ping Li
- Department of Gynecology and Obstetrics, The First Hospital of Quanzhou Affiliated to Fujian Medical University, Quanzhou, China
| | - Zhonghua Liu
- Department of Ultrasound, The First Hospital of Quanzhou Affiliated to Fujian Medical University, Quanzhou, China
| | - Shunlan Liu
- Department of Ultrasound, The Second Hospital of Quanzhou Affiliated to Fujian Medical University, Quanzhou, China
| | - Pan Zeng
- College of Medicine, Huaqiao University, Quanzhou, 362021, China
| | - Haisheng Song
- College of Physics and Electronic Engineering, Northwest Normal University, Lanzhou, 730070, China
| | - Peizhong Liu
- College of Medicine, Huaqiao University, Quanzhou, 362021, China.
| | - Guorong Lyu
- Department of Ultrasound, The Second Hospital of Quanzhou Affiliated to Fujian Medical University, Quanzhou, China.
| |
Collapse
|
5
|
Partovi E, Babic A, Gharehbaghi A. A review on deep learning methods for heart sound signal analysis. Front Artif Intell 2024; 7:1434022. [PMID: 39605951 PMCID: PMC11599230 DOI: 10.3389/frai.2024.1434022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2024] [Accepted: 10/09/2024] [Indexed: 11/29/2024] Open
Abstract
Introduction Application of Deep Learning (DL) methods is being increasingly appreciated by researchers from the biomedical engineering domain in which heart sound analysis is an important topic of study. Diversity in methodology, results, and complexity causes uncertainties in obtaining a realistic picture of the methodological performance from the reported methods. Methods This survey paper provides the results of a broad retrospective study on the recent advances in heart sound analysis using DL methods. Representation of the results is performed according to both methodological and applicative taxonomies. The study method covers a wide span of related keywords using well-known search engines. Implementation of the observed methods along with the related results is pervasively represented and compared. Results and discussion It is observed that convolutional neural networks and recurrent neural networks are the most commonly used ones for discriminating abnormal heart sounds and localization of heart sounds with 67.97% and 33.33% of the related papers, respectively. The convolutional neural network and the autoencoder network show a perfect accuracy of 100% in the case studies on the classification of abnormal from normal heart sounds. Nevertheless, this superiority against other methods with lower accuracy is not conclusive due to the inconsistency in evaluation.
Collapse
Affiliation(s)
- Elaheh Partovi
- Department of Electrical Engineering, Amirkabir University of Technology, Tehran, Iran
| | - Ankica Babic
- Department of Biomedical Engineering, Linköping University, Linköping, Sweden
- Department of Information Science and Media Studies, University of Bergen, Bergen, Norway
| | - Arash Gharehbaghi
- Department of Biomedical Engineering, Linköping University, Linköping, Sweden
| |
Collapse
|
6
|
Jia H, Tang S, Guo W, Pan P, Qian Y, Hu D, Dai Y, Yang Y, Geng C, Lv H. Differential diagnosis of congenital ventricular septal defect and atrial septal defect in children using deep learning-based analysis of chest radiographs. BMC Pediatr 2024; 24:661. [PMID: 39407181 PMCID: PMC11476512 DOI: 10.1186/s12887-024-05141-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Accepted: 10/09/2024] [Indexed: 10/20/2024] Open
Abstract
BACKGROUND Children with atrial septal defect (ASD) and ventricular septal defect (VSD) are frequently examined for respiratory symptoms, even when the underlying disease is not found. Chest radiographs often serve as the primary imaging modality. It is crucial to differentiate between ASD and VSD due to their distinct treatment. PURPOSE To assess whether deep learning analysis of chest radiographs can more effectively differentiate between ASD and VSD in children. METHODS In this retrospective study, chest radiographs and corresponding radiology reports from 1,194 patients were analyzed. The cases were categorized into a training set and a validation set, comprising 480 cases of ASD and 480 cases of VSD, and a test set with 115 cases of ASD and 119 cases of VSD. Four deep learning network models-ResNet-CBAM, InceptionV3, EfficientNet, and ViT-were developed for training, and a fivefold cross-validation method was employed to optimize the models. Receiver operating characteristic (ROC) curve analyses were conducted to assess the performance of each model. The most effective algorithm was compared with the interpretations provided by two radiologists on 234 images from the test group. RESULTS The average accuracy, sensitivity, and specificity of the four deep learning models in the differential diagnosis of VSD and ASD were higher than 70%. The AUC values of ResNet-CBAM, IncepetionV3, EfficientNet, and ViT were 0.87, 0.91, 0.90, and 0.66, respectively. Statistical analysis showed that the differential diagnosis efficiency of InceptionV3 was the highest, reaching 87% classification accuracy. The accuracy of InceptionV3 in the differential diagnosis of VSD and ASD was higher than that of the radiologists. CONCLUSIONS Deep learning methods such as IncepetionV3 based on chest radiographs in the study showed good performance for differential diagnosis of congenital VSD and ASD, which may be able to assist radiologists in diagnosis, education, and training, and reduce missed diagnosis and misdiagnosis.
Collapse
Affiliation(s)
- Huihui Jia
- Department of Radiology, Children ' s Hospital of Soochow University, 215025, Suzhou, P. R. China
| | - Songqiao Tang
- School of Electronic & Information Engineering, Suzhou University of Science and Technology, 215009, Suzhou, China
| | - Wanliang Guo
- Department of Radiology, Children ' s Hospital of Soochow University, 215025, Suzhou, P. R. China
| | - Peng Pan
- Department of Radiology, Children ' s Hospital of Soochow University, 215025, Suzhou, P. R. China
| | - Yufeng Qian
- Department of Radiology, Children ' s Hospital of Soochow University, 215025, Suzhou, P. R. China
| | - Dongliang Hu
- Department of Radiology, Children ' s Hospital of Soochow University, 215025, Suzhou, P. R. China
| | - Yakang Dai
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, 215163, Suzhou, China
| | - Yang Yang
- Department of Radiology, Children ' s Hospital of Soochow University, 215025, Suzhou, P. R. China
| | - Chen Geng
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, 215163, Suzhou, China.
- Jinan Guoke Medical Technology Development Co., Ltd, 250102, Shandong, China.
| | - Haitao Lv
- Department of Pediatric Cardiology, Children ' s Hospital of Soochow University, 215025, Suzhou, P. R. China.
| |
Collapse
|
7
|
Zhao Q, Geng S, Wang B, Sun Y, Nie W, Bai B, Yu C, Zhang F, Tang G, Zhang D, Zhou Y, Liu J, Hong S. Deep Learning in Heart Sound Analysis: From Techniques to Clinical Applications. HEALTH DATA SCIENCE 2024; 4:0182. [PMID: 39387057 PMCID: PMC11461928 DOI: 10.34133/hds.0182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Revised: 08/09/2024] [Accepted: 08/13/2024] [Indexed: 10/12/2024]
Abstract
Importance: Heart sound auscultation is a routinely used physical examination in clinical practice to identify potential cardiac abnormalities. However, accurate interpretation of heart sounds requires specialized training and experience, which limits its generalizability. Deep learning, a subset of machine learning, involves training artificial neural networks to learn from large datasets and perform complex tasks with intricate patterns. Over the past decade, deep learning has been successfully applied to heart sound analysis, achieving remarkable results and accumulating substantial heart sound data for model training. Although several reviews have summarized deep learning algorithms for heart sound analysis, there is a lack of comprehensive summaries regarding the available heart sound data and the clinical applications. Highlights: This review will compile the commonly used heart sound datasets, introduce the fundamentals and state-of-the-art techniques in heart sound analysis and deep learning, and summarize the current applications of deep learning for heart sound analysis, along with their limitations and areas for future improvement. Conclusions: The integration of deep learning into heart sound analysis represents a significant advancement in clinical practice. The growing availability of heart sound datasets and the continuous development of deep learning techniques contribute to the improvement and broader clinical adoption of these models. However, ongoing research is needed to address existing challenges and refine these technologies for broader clinical use.
Collapse
Affiliation(s)
- Qinghao Zhao
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | | | - Boya Wang
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Gastrointestinal Oncology,
Peking University Cancer Hospital and Institute, Beijing, China
| | - Yutong Sun
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Wenchang Nie
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Baochen Bai
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Chao Yu
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Feng Zhang
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Gongzheng Tang
- National Institute of Health Data Science,
Peking University, Beijing, China
- Institute of Medical Technology,
Health Science Center of Peking University, Beijing, China
| | | | - Yuxi Zhou
- Department of Computer Science,
Tianjin University of Technology, Tianjin, China
- DCST, BNRist, RIIT, Institute of Internet Industry,
Tsinghua University, Beijing, China
| | - Jian Liu
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Shenda Hong
- National Institute of Health Data Science,
Peking University, Beijing, China
- Institute of Medical Technology,
Health Science Center of Peking University, Beijing, China
| |
Collapse
|
8
|
Chen SH, Weng KP, Hsieh KS, Chen YH, Shih JH, Li WR, Zhang RY, Chen YC, Tsai WR, Kao TY. Optimizing Object Detection Algorithms for Congenital Heart Diseases in Echocardiography: Exploring Bounding Box Sizes and Data Augmentation Techniques. Rev Cardiovasc Med 2024; 25:335. [PMID: 39355611 PMCID: PMC11440387 DOI: 10.31083/j.rcm2509335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2024] [Revised: 07/22/2024] [Accepted: 08/01/2024] [Indexed: 10/03/2024] Open
Abstract
Background Congenital heart diseases (CHDs), particularly atrial and ventricular septal defects, pose significant health risks and common challenges in detection via echocardiography. Doctors often employ the cardiac structural information during the diagnostic process. However, prior CHD research has not determined the influence of including cardiac structural information during the labeling process and the application of data augmentation techniques. Methods This study utilizes advanced artificial intelligence (AI)-driven object detection frameworks, specifically You Look Only Once (YOLO)v5, YOLOv7, and YOLOv9, to assess the impact of including cardiac structural information and data augmentation techniques on the identification of septal defects in echocardiographic images. Results The experimental results reveal that different labeling strategies substantially affect the performance of the detection models. Notably, adjustments in bounding box dimensions and the inclusion of cardiac structural details in the annotations are key factors influencing the accuracy of the model. The application of deep learning techniques in echocardiography enhances the precision of detecting septal heart defects. Conclusions This study confirms that careful annotation of imaging data is crucial for optimizing the performance of object detection algorithms in medical imaging. These findings suggest potential pathways for refining AI applications in diagnostic cardiology studies.
Collapse
Affiliation(s)
- Shih-Hsin Chen
- Department of Computer Science and Information Engineering, Tamkang University, 251301 New Taipei, Taiwan
| | - Ken-Pen Weng
- Congenital Structural Heart Disease Center, Department of Pediatrics, Kaohsiung Veterans General Hospital, 813414 Kaohsiung, Taiwan
| | - Kai-Sheng Hsieh
- Structural/Congenital Heart Disease and Ultrasound Center, Children's Hospital, China Medical University, 404 Taichung, Taiwan
| | - Yi-Hui Chen
- Department of Information Management, Chang Gung University, 333 Taoyuan, Taiwan
- Kawasaki Disease Center, Kaohsiung Chang Gung Memorial Hospital, 83301 Kaohsiung, Taiwan
| | - Jo-Hsin Shih
- Department of Information Management, Chang Gung University, 333 Taoyuan, Taiwan
| | - Wen-Ru Li
- Department of Information Management, Chang Gung University, 333 Taoyuan, Taiwan
| | - Ru-Yi Zhang
- Department of Information Management, Chang Gung University, 333 Taoyuan, Taiwan
| | - Yun-Chiao Chen
- Department of Information Management, Chang Gung University, 333 Taoyuan, Taiwan
| | - Wan-Ru Tsai
- Department of Information Management, Chang Gung University, 333 Taoyuan, Taiwan
| | - Ting-Yi Kao
- Department of Information Management, Chang Gung University, 333 Taoyuan, Taiwan
| |
Collapse
|
9
|
Dai Y, Liu P, Hou W, Kadier K, Mu Z, Lu Z, Chen P, Ma X, Dai J. Deep learning fusion framework for automated coronary artery disease detection using raw heart sound signals. Heliyon 2024; 10:e35631. [PMID: 39262986 PMCID: PMC11388508 DOI: 10.1016/j.heliyon.2024.e35631] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2024] [Revised: 06/21/2024] [Accepted: 08/01/2024] [Indexed: 09/11/2024] Open
Abstract
One of the most common cardiovascular diseases is coronary artery disease (CAD). Thus, it is crucial for early CAD diagnosis to control disease progression. Computer-aided CAD detection often converts heart sounds into graphics for analysis. However, this method relies heavily on the subjective experience of experts. Therefore, in this study, we proposed a method for CAD detection using raw heart sound signals by constructing a fusion framework with two CAD detection models: a multidomain feature model and a medical multidomain feature fusion model. We collected heart sound signal datasets from 400 participants, extracting 206 multidomain features and 126 medical multidomain features. The designed framework fused the same one-dimensional deep learning features with different multidomain features for CAD detection. The experimental results showed that the multidomain feature model and the medical multidomain feature fusion model achieved areas under the curve (AUC) of 94.7 % and 92.7 %, respectively, demonstrating the effectiveness of the fusion framework in integrating one-dimensional and cross-domain heart sound features through deep learning algorithms, providing an effective solution for noninvasive CAD detection.
Collapse
Affiliation(s)
- YunFei Dai
- College of Information Science and Technology, Shihezi University, Shihezi, Xinjiang, 832000, China
| | - PengFei Liu
- Department of Cardiology, First Affiliated Hospital of Xinjiang Medical University, Urumqi, Xinjiang, 830000, China
| | - WenQing Hou
- School of Information Network Security, Xinjiang University of Political Science and Law, Tumushuke, Xinjiang, 843900, China
| | - Kaisaierjiang Kadier
- Department of Cardiology, First Affiliated Hospital of Xinjiang Medical University, Urumqi, Xinjiang, 830000, China
| | - ZhengYang Mu
- College of Information Science and Technology, Shihezi University, Shihezi, Xinjiang, 832000, China
| | - Zang Lu
- College of Information Science and Technology, Shihezi University, Shihezi, Xinjiang, 832000, China
| | - PeiPei Chen
- College of Information Science and Technology, Shihezi University, Shihezi, Xinjiang, 832000, China
| | - Xiang Ma
- Department of Cardiology, First Affiliated Hospital of Xinjiang Medical University, Urumqi, Xinjiang, 830000, China
| | - JianGuo Dai
- College of Information Science and Technology, Shihezi University, Shihezi, Xinjiang, 832000, China
| |
Collapse
|
10
|
Zeng Y, Li M, He Z, Zhou L. Segmentation of Heart Sound Signal Based on Multi-Scale Feature Fusion and Multi-Classification of Congenital Heart Disease. Bioengineering (Basel) 2024; 11:876. [PMID: 39329618 PMCID: PMC11428210 DOI: 10.3390/bioengineering11090876] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2024] [Revised: 08/22/2024] [Accepted: 08/27/2024] [Indexed: 09/28/2024] Open
Abstract
Analyzing heart sound signals presents a novel approach for early diagnosis of pediatric congenital heart disease. The existing segmentation algorithms have limitations in accurately distinguishing the first (S1) and second (S2) heart sounds, limiting the diagnostic utility of cardiac cycle data for pediatric pathology assessment. This study proposes a time bidirectional long short-term memory network (TBLSTM) based on multi-scale analysis to segment pediatric heart sound signals according to different cardiac cycles. Mel frequency cepstral coefficients and dynamic characteristics of the heart sound fragments were extracted and input into random forest for multi-classification of congenital heart disease. The segmentation model achieved an overall F1 score of 94.15% on the verification set, with specific F1 scores of 90.25% for S1 and 86.04% for S2. In a situation where the number of cardiac cycles in the heart sound fragments was set to six, the results for multi-classification achieved stabilization. The performance metrics for this configuration were as follows: accuracy of 94.43%, sensitivity of 95.58%, and an F1 score of 94.51%. Furthermore, the segmentation model demonstrates robustness in accurately segmenting pediatric heart sound signals across different heart rates and in the presence of noise. Notably, the number of cardiac cycles in heart sound fragments directly impacts the multi-classification of these heart sound signals.
Collapse
Affiliation(s)
- Yuan Zeng
- Research Center of Fluid Machinery Engineering and Technology, Jiangsu University, Zhenjiang 212013, China; (Y.Z.); (M.L.); (Z.H.)
| | - Mingzhe Li
- Research Center of Fluid Machinery Engineering and Technology, Jiangsu University, Zhenjiang 212013, China; (Y.Z.); (M.L.); (Z.H.)
| | - Zhaoming He
- Research Center of Fluid Machinery Engineering and Technology, Jiangsu University, Zhenjiang 212013, China; (Y.Z.); (M.L.); (Z.H.)
- Department of Mechanical Engineering, Texas Tech University, Lubbock, TX 79411, USA
| | - Ling Zhou
- Research Center of Fluid Machinery Engineering and Technology, Jiangsu University, Zhenjiang 212013, China; (Y.Z.); (M.L.); (Z.H.)
| |
Collapse
|
11
|
Zhou G, Chien C, Chen J, Luan L, Chen Y, Carroll S, Dayton J, Thanjan M, Bayle K, Flynn P. Identifying pediatric heart murmurs and distinguishing innocent from pathologic using deep learning. Artif Intell Med 2024; 153:102867. [PMID: 38723434 DOI: 10.1016/j.artmed.2024.102867] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 04/02/2024] [Accepted: 04/03/2024] [Indexed: 06/11/2024]
Abstract
OBJECTIVE To develop a deep learning algorithm to perform multi-class classification of normal pediatric heart sounds, innocent murmurs, and pathologic murmurs. METHODS We prospectively enrolled children under age 18 being evaluated by the Division of Pediatric Cardiology. Parents provided consent for a deidentified recording of their child's heart sounds with a digital stethoscope. Innocent murmurs were validated by a pediatric cardiologist and pathologic murmurs were validated by echocardiogram. To augment our collection of normal heart sounds, we utilized a public database of pediatric heart sound recordings (Oliveira, 2022). We propose two novel approaches for this audio classification task. We train a vision transformer on either Markov transition field or Gramian angular field image representations of the frequency spectrum. We benchmark our results against a ResNet-50 CNN trained on spectrogram images. RESULTS Our final dataset consisted of 366 normal heart sounds, 175 innocent murmurs, and 216 pathologic murmurs. Innocent murmurs collected include Still's murmur, venous hum, and flow murmurs. Pathologic murmurs included ventricular septal defect, tetralogy of Fallot, aortic regurgitation, aortic stenosis, pulmonary stenosis, mitral regurgitation and stenosis, and tricuspid regurgitation. We find that the Vision Transformer consistently outperforms the ResNet-50 on all three image representations, and that the Gramian angular field is the superior image representation for pediatric heart sounds. We calculated a one-vs-rest multi-class ROC curve for each of the three classes. Our best model achieves an area under the curve (AUC) value of 0.92 ± 0.05, 0.83 ± 0.04, and 0.88 ± 0.04 for identifying normal heart sounds, innocent murmurs, and pathologic murmurs, respectively. CONCLUSION We present two novel methods for pediatric heart sound classification, which outperforms the current standard of using a convolutional neural network trained on spectrogram images. To our knowledge, we are the first to demonstrate multi-class classification of pediatric murmurs. Multiclass output affords a more explainable and interpretable model, which can facilitate further model improvement in the downstream model development cycle and enhance clinician trust and therefore adoption.
Collapse
Affiliation(s)
- George Zhou
- Weill Cornell Medicine, New York, NY 10021, USA.
| | - Candace Chien
- Children's Hospital Los Angeles, Los Angeles, CA 90027, USA
| | - Justin Chen
- Staten Island University Hospital, Northwell Health, Staten Island, NY 10305, USA
| | - Lucille Luan
- Teachers College, Columbia University, New York, NY 10027, USA
| | | | - Sheila Carroll
- Division of Pediatric Cardiology, NewYork-Presbyterian Hospital, New York, NY 10021, USA
| | - Jeffrey Dayton
- Division of Pediatric Cardiology, NewYork-Presbyterian Hospital, New York, NY 10021, USA
| | - Maria Thanjan
- Division of Pediatric Cardiology, NewYork-Presbyterian Hospital Queens, New York, NY 11355, USA
| | - Ken Bayle
- Division of Pediatric Cardiology, NewYork-Presbyterian Hospital Queens, New York, NY 11355, USA
| | - Patrick Flynn
- Division of Pediatric Cardiology, NewYork-Presbyterian Hospital, New York, NY 10021, USA
| |
Collapse
|
12
|
Arjoune Y, Nguyen TN, Doroshow RW, Shekhar R. A Noise-Robust Heart Sound Segmentation Algorithm Based on Shannon Energy. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2024; 12:7747-7761. [PMID: 39398361 PMCID: PMC11469632 DOI: 10.1109/access.2024.3351570] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 10/15/2024]
Abstract
Heart sound segmentation has been shown to improve the performance of artificial intelligence (AI)-based auscultation decision support systems increasingly viewed as a solution to compensate for eroding auscultatory skills and the associated subjectivity. Various segmentation approaches with demonstrated performance can be utilized for this task, but their robustness can suffer in the presence of noise. A noise-robust heart sound segmentation algorithm was developed and its accuracy was tested using two datasets: the CirCor DigiScope Phonocardiogram dataset and an in-house dataset - a heart murmur library collected at the Children's National Hospital (CNH). On the CirCor dataset, our segmentation algorithm marked the boundaries of the primary heart sounds S1 and S2 with an accuracy of 0.28 ms and 0.29 ms, respectively, and correctly identified the actual positive segments with a sensitivity of 97.44%. The algorithm also executed four times faster than a logistic regression hidden semi-Markov model. On the CNH dataset, the algorithm succeeded in 87.4% cases, achieving a 6% increase in segmentation success rate demonstrated by our original Shannon energy-based algorithm. Accurate heart sound segmentation is critical to supporting and accelerating AI research in cardiovascular diseases. The proposed algorithm increases the robustness of heart sound segmentation to noise and viability for clinical use.
Collapse
Affiliation(s)
- Youness Arjoune
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, DC 20010, USA
| | | | - Robin W Doroshow
- Department of Cardiology, Children's National Hospital, Washington, DC 20010, USA
| | - Raj Shekhar
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, DC 20010, USA
| |
Collapse
|
13
|
Kaur I, Ahmad T. A cluster-based ensemble approach for congenital heart disease prediction. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 243:107922. [PMID: 37984098 DOI: 10.1016/j.cmpb.2023.107922] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/15/2023] [Revised: 10/24/2023] [Accepted: 11/06/2023] [Indexed: 11/22/2023]
Abstract
BACKGROUND One of the most prevalent birth disorders is congenital heart diseases (CHD). Although CHD risk factors have been the subject of numerous studies, their propensity to cause CHD has not been tested. Particularly few research has attempted to forecast CHD risk using population-based cross-sectional data, which is inherently imbalanced. OBJECTIVE The main goals of this study are to create a reliable data analysis model that can help with (i) a better understanding of congenital heart disease prediction in the presence of missing and unbalanced data and (ii) creating cohorts of expectant mothers with similar lifestyle characteristics. METHODS Clusters of patient cohorts are produced using the unsupervised data mining technique density-based spatial clustering of applications with noise (DBSCAN). For more accurate CHD prediction, a random forest model was trained using these clusters and their corresponding patterns. This study uses a dataset of 33,831 expectant mothers to make its prediction. Missing data were handled using the k-NN imputation approach, while extremely unbalanced data were balanced using SMOTE. These techniques are all data-driven and need little to no user or expert involvement. RESULTS AND CONCLUSION Using DBSCAN, three cohorts were found. The cluster information enhanced the random forest-based CHD prediction and revealed intricate factors that influence prediction accuracy. The proposed approach gave the highest results with 99 % accuracy and 0.91 AUC and performed better than the state-of-the-art methodologies. Hence, the suggested method using unsupervised learning can provide intricate information to the classifier and further enhance the performance of the classification.
Collapse
Affiliation(s)
- Ishleen Kaur
- Sri Guru Tegh Bahadur Khalsa College, University of Delhi, Delhi, India.
| | - Tanvir Ahmad
- Department of Computer Engineering, Jamia Millia Islamia, New Delhi, India
| |
Collapse
|
14
|
Jacquemyn X, Kutty S, Manlhiot C. The Lifelong Impact of Artificial Intelligence and Clinical Prediction Models on Patients With Tetralogy of Fallot. CJC PEDIATRIC AND CONGENITAL HEART DISEASE 2023; 2:440-452. [PMID: 38161675 PMCID: PMC10755786 DOI: 10.1016/j.cjcpc.2023.08.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Accepted: 08/24/2023] [Indexed: 01/03/2024]
Abstract
Medical advancements in the diagnosis, surgical techniques, perioperative care, and continued care throughout childhood have transformed the outlook for individuals with tetralogy of Fallot (TOF), improving survival and shifting the perspective towards lifelong care. However, with a growing population of survivors, longstanding challenges have been accentuated, and new challenges have surfaced, necessitating a re-evaluation of TOF care. Availability of prenatal diagnostics, insufficient information from traditional imaging techniques, previously unforeseen medical complications, and debates surrounding optimal timing and indications for reintervention are among the emerging issues. To address these challenges, the integration of artificial intelligence and machine learning holds great promise as they have the potential to revolutionize patient management and positively impact lifelong outcomes for individuals with TOF. Innovative applications of artificial intelligence and machine learning have spanned across multiple domains of TOF care, including screening and diagnosis, automated image processing and interpretation, clinical risk stratification, and planning and performing cardiac interventions. By embracing these advancements and incorporating them into routine clinical practice, personalized medicine could be delivered, leading to the best possible outcomes for patients. In this review, we provide an overview of these evolving applications and emphasize the challenges, limitations, and future potential for integrating them into clinical care.
Collapse
Affiliation(s)
- Xander Jacquemyn
- Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
- Department of Cardiovascular Sciences, KU Leuven, Leuven, Belgium
| | - Shelby Kutty
- Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
| | - Cedric Manlhiot
- Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
| |
Collapse
|
15
|
Krittanawong C, Omar AMS, Narula S, Sengupta PP, Glicksberg BS, Narula J, Argulian E. Deep Learning for Echocardiography: Introduction for Clinicians and Future Vision: State-of-the-Art Review. Life (Basel) 2023; 13:1029. [PMID: 37109558 PMCID: PMC10145844 DOI: 10.3390/life13041029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Revised: 03/30/2023] [Accepted: 04/03/2023] [Indexed: 04/29/2023] Open
Abstract
Exponential growth in data storage and computational power is rapidly narrowing the gap between translating findings from advanced clinical informatics into cardiovascular clinical practice. Specifically, cardiovascular imaging has the distinct advantage in providing a great quantity of data for potentially rich insights, but nuanced interpretation requires a high-level skillset that few individuals possess. A subset of machine learning, deep learning (DL), is a modality that has shown promise, particularly in the areas of image recognition, computer vision, and video classification. Due to a low signal-to-noise ratio, echocardiographic data tend to be challenging to classify; however, utilization of robust DL architectures may help clinicians and researchers automate conventional human tasks and catalyze the extraction of clinically useful data from the petabytes of collected imaging data. The promise is extending far and beyond towards a contactless echocardiographic exam-a dream that is much needed in this time of uncertainty and social distancing brought on by a stunning pandemic culture. In the current review, we discuss state-of-the-art DL techniques and architectures that can be used for image and video classification, and future directions in echocardiographic research in the current era.
Collapse
Affiliation(s)
- Chayakrit Krittanawong
- Cardiology Division, NYU Langone Health, NYU School of Medicine, New York, NY 10016, USA
- Icahn School of Medicine at Mount Sinai, Mount Sinai Heart, New York, NY 10029, USA
| | - Alaa Mabrouk Salem Omar
- Icahn School of Medicine at Mount Sinai, Mount Sinai Heart, New York, NY 10029, USA
- Division of Cardiovascular Medicine, Icahn School of Medicine at Mount Sinai Morningside, Mount Sinai Heart, New York, NY 10029, USA
| | - Sukrit Narula
- Department of Medicine, Yale School of Medicine, New Haven, CT 06512, USA
| | - Partho P. Sengupta
- Robert Wood Johnson University Hospital, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ 08901, USA
| | - Benjamin S. Glicksberg
- Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Jagat Narula
- Icahn School of Medicine at Mount Sinai, Mount Sinai Heart, New York, NY 10029, USA
- Division of Cardiovascular Medicine, Icahn School of Medicine at Mount Sinai Morningside, Mount Sinai Heart, New York, NY 10029, USA
| | - Edgar Argulian
- Icahn School of Medicine at Mount Sinai, Mount Sinai Heart, New York, NY 10029, USA
- Division of Cardiovascular Medicine, Icahn School of Medicine at Mount Sinai Morningside, Mount Sinai Heart, New York, NY 10029, USA
| |
Collapse
|
16
|
Phonocardiogram transfer learning-based CatBoost model for diastolic dysfunction identification using multiple domain-specific deep feature fusion. Comput Biol Med 2023; 156:106707. [PMID: 36871337 DOI: 10.1016/j.compbiomed.2023.106707] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Revised: 02/11/2023] [Accepted: 02/19/2023] [Indexed: 02/22/2023]
Abstract
Left ventricular diastolic dyfunction detection is particularly important in cardiac function screening. This paper proposed a phonocardiogram (PCG) transfer learning-based CatBoost model to detect diastolic dysfunction noninvasively. The Short-Time Fourier Transform (STFT), Mel Frequency Cepstral Coefficients (MFCCs), S-transform and gammatonegram were utilized to perform four different representations of spectrograms for learning the representative patterns of PCG signals in two-dimensional image modality. Then, four pre-trained convolutional neural networks (CNNs) such as VGG16, Xception, ResNet50 and InceptionResNetv2 were employed to extract multiple domain-specific deep features from PCG spectrograms using transfer learning, respectively. Further, principal component analysis and linear discriminant analysis (LDA) were applied to different feature subsets, respectively, and then these different selected features are fused and fed into CatBoost for classification and performance comparison. Finally, three typical machine learning classifiers such as multilayer perceptron, support vector machine and random forest were employed to compared with CatBoost. The hyperparameter optimization of the investigated models was determined through grid search. The visualized result of the global feature importance showed that deep features extracted from gammatonegram by ResNet50 contributed most to classification. Overall, the proposed multiple domain-specific feature fusion based CatBoost model with LDA achieved the best performance with an area under the curve of 0.911, accuracy of 0.882, sensitivity of 0.821, specificity of 0.927, F1-score of 0.892 on the testing set. The PCG transfer learning-based model developed in this study could aid in diastolic dysfunction detection and could contribute to non-invasive evaluation of diastolic function.
Collapse
|
17
|
Arjoune Y, Nguyen TN, Doroshow RW, Shekhar R. Technical characterisation of digital stethoscopes: towards scalable artificial intelligence-based auscultation. J Med Eng Technol 2023; 47:165-178. [PMID: 36794318 PMCID: PMC10753976 DOI: 10.1080/03091902.2023.2174198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Revised: 01/25/2023] [Accepted: 01/25/2023] [Indexed: 02/17/2023]
Abstract
Digital stethoscopes can enable the development of integrated artificial intelligence (AI) systems that can remove the subjectivity of manual auscultation, improve diagnostic accuracy, and compensate for diminishing auscultatory skills. Developing scalable AI systems can be challenging, especially when acquisition devices differ and thus introduce sensor bias. To address this issue, a precise knowledge of these differences, i.e., frequency responses of these devices, is needed, but the manufacturers often do not provide complete device specifications. In this study, we reported an effective methodology for determining the frequency response of a digital stethoscope and used it to characterise three common digital stethoscopes: Littmann 3200, Eko Core, and Thinklabs One. Our results show significant inter-device variability in that the frequency responses of the three studied stethoscopes were distinctly different. A moderate intra-device variability was seen when comparing two separate units of Littmann 3200. The study highlights the need for normalisation across devices for developing successful AI-assisted auscultation and provides a technical characterisation approach as a first step to accomplish it.
Collapse
Affiliation(s)
- Youness Arjoune
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, DC, USA
| | - Trong N Nguyen
- Department of Research, AusculTech DX, Silver Spring, MD, USA
| | - Robin W Doroshow
- Department of Research, AusculTech DX, Silver Spring, MD, USA
- Department of Cardiology, Children's National Hospital, Washington, DC, USA
| | - Raj Shekhar
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, DC, USA
- Department of Research, AusculTech DX, Silver Spring, MD, USA
| |
Collapse
|
18
|
Seemann F, Chen MY. Identifying Takotsubo syndrome without contrast agents - Is machine learning-based diagnostics the way to go? Int J Cardiol 2023; 375:142-143. [PMID: 36584944 DOI: 10.1016/j.ijcard.2022.12.040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Accepted: 12/19/2022] [Indexed: 12/28/2022]
Affiliation(s)
- Felicia Seemann
- Cardiovascular Branch, Division of Intramural Research, National Heart, Lung, and Blood Institute, National Institutes of Health, Bethesda, MD 20892, USA.
| | - Marcus Y Chen
- Cardiovascular Branch, Division of Intramural Research, National Heart, Lung, and Blood Institute, National Institutes of Health, Bethesda, MD 20892, USA
| |
Collapse
|
19
|
Sethi Y, Patel N, Kaka N, Desai A, Kaiwan O, Sheth M, Sharma R, Huang H, Chopra H, Khandaker MU, Lashin MMA, Hamd ZY, Emran TB. Artificial Intelligence in Pediatric Cardiology: A Scoping Review. J Clin Med 2022; 11:7072. [PMID: 36498651 PMCID: PMC9738645 DOI: 10.3390/jcm11237072] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Revised: 11/22/2022] [Accepted: 11/26/2022] [Indexed: 12/05/2022] Open
Abstract
The evolution of AI and data science has aided in mechanizing several aspects of medical care requiring critical thinking: diagnosis, risk stratification, and management, thus mitigating the burden of physicians and reducing the likelihood of human error. AI modalities have expanded feet to the specialty of pediatric cardiology as well. We conducted a scoping review searching the Scopus, Embase, and PubMed databases covering the recent literature between 2002-2022. We found that the use of neural networks and machine learning has significantly improved the diagnostic value of cardiac magnetic resonance imaging, echocardiograms, computer tomography scans, and electrocardiographs, thus augmenting the clinicians' diagnostic accuracy of pediatric heart diseases. The use of AI-based prediction algorithms in pediatric cardiac surgeries improves postoperative outcomes and prognosis to a great extent. Risk stratification and the prediction of treatment outcomes are feasible using the key clinical findings of each CHD with appropriate computational algorithms. Notably, AI can revolutionize prenatal prediction as well as the diagnosis of CHD using the EMR (electronic medical records) data on maternal risk factors. The use of AI in the diagnostics, risk stratification, and management of CHD in the near future is a promising possibility with current advancements in machine learning and neural networks. However, the challenges posed by the dearth of appropriate algorithms and their nascent nature, limited physician training, fear of over-mechanization, and apprehension of missing the 'human touch' limit the acceptability. Still, AI proposes to aid the clinician tomorrow with precision cardiology, paving a way for extremely efficient human-error-free health care.
Collapse
Affiliation(s)
- Yashendra Sethi
- PearResearch, Dehradun 248001, India
- Department of Medicine, Government Doon Medical College, Dehradun 248001, India
| | - Neil Patel
- PearResearch, Dehradun 248001, India
- Department of Medicine, GMERS Medical College, Himmatnagar 383001, India
| | - Nirja Kaka
- PearResearch, Dehradun 248001, India
- Department of Medicine, GMERS Medical College, Himmatnagar 383001, India
| | - Ami Desai
- Department of Medicine, SMIMER Medical College, Surat 395010, India
| | - Oroshay Kaiwan
- PearResearch, Dehradun 248001, India
- Department of Medicine, Northeast Ohio Medical University, Rootstown, OH 44272, USA
| | - Mili Sheth
- Department of Medicine, GMERS Gandhinagar, Gandhinagar 382012, India
| | - Rupal Sharma
- Department of Medicine, Government Medical College, Nagpur 440003, India
| | - Helen Huang
- Faculty of Medicine and Health Science, Royal College of Surgeons in Ireland, D02 YN77 Dublin, Ireland
| | - Hitesh Chopra
- Chitkara College of Pharmacy, Chitkara University, Rajpura 140401, India
| | - Mayeen Uddin Khandaker
- Centre for Applied Physics and Radiation Technologies, School of Engineering and Technology, Sunway University, Bandar Sunway 47500, Malaysia
| | - Maha M. A. Lashin
- Department of Biomedical Engineering, College of Engineering, Princess Nourah bint Abdulrahman University, P.O. 84428, Riyadh 11671, Saudi Arabia
| | - Zuhal Y. Hamd
- Department of Radiological Sciences, College of Health and Rehabilitation Sciences, Princess Nourah bint Abdulrahman University, P.O. 84428, Riyadh 11671, Saudi Arabia
| | - Talha Bin Emran
- Department of Pharmacy, BGC Trust University Bangladesh, Chittagong 4381, Bangladesh
- Department of Pharmacy, Faculty of Allied Health Sciences, Daffodil International University, Dhaka 1207, Bangladesh
| |
Collapse
|
20
|
Song H, Zhao B, Hu J, Sun H, Zhou Z. Research on Improved DenseNets Pig Cough Sound Recognition Model Based on SENets. ELECTRONICS 2022; 11:3562. [DOI: 10.3390/electronics11213562] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2025]
Abstract
In order to real-time monitor the health status of pigs in the process of breeding and to achieve the purpose of early warning of swine respiratory diseases, the SE-DenseNet-121 recognition model was established to recognize pig cough sounds. The 13-dimensional MFCC, ΔMFCC and Δ2MFCC were transverse spliced to obtain six groups of parameters that could reflect the static, dynamic and mixed characteristics of pig sound signals respectively, and the DenseNet-121 recognition model was used to compare the performance of the six sets of parameters to obtain the optimal set of parameters. The DenseNet-121 recognition model was improved by using the SENets attention module to enhance the recognition model’s ability to extract effective features from the pig sound signals. The results showed that the optimal set of parameters was the 26-dimensional MFCC + ΔMFCC, and the rate of recognition accuracy, recall, precision and F1 score of the SE-DenseNet-121 recognition model for pig cough sounds were 93.8%, 98.6%, 97% and 97.8%, respectively. The above results can be used to develop a pig cough sound recognition system for early warning of pig respiratory diseases.
Collapse
Affiliation(s)
- Hang Song
- College of Engineering, Heilongjiang Bayi Agricultural University, Daqing 163319, China
| | - Bin Zhao
- College of Engineering, Heilongjiang Bayi Agricultural University, Daqing 163319, China
| | - Jun Hu
- College of Engineering, Heilongjiang Bayi Agricultural University, Daqing 163319, China
| | - Haonan Sun
- College of Engineering, Heilongjiang Bayi Agricultural University, Daqing 163319, China
| | - Zheng Zhou
- College of Engineering, Heilongjiang Bayi Agricultural University, Daqing 163319, China
| |
Collapse
|
21
|
Saikumar K, Rajesh V, Srivastava G, Lin JCW. Heart disease detection based on internet of things data using linear quadratic discriminant analysis and a deep graph convolutional neural network. Front Comput Neurosci 2022; 16:964686. [PMID: 36277609 PMCID: PMC9585537 DOI: 10.3389/fncom.2022.964686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2022] [Accepted: 09/09/2022] [Indexed: 11/15/2022] Open
Abstract
Heart disease is an emerging health issue in the medical field, according to WHO every year around 10 billion people are affected with heart abnormalities. Arteries in the heart generate oxygenated blood to all body parts, however sometimes blood vessels become clogged or restrained due to cardiac issues. Past heart diagnosis applications are outdated and suffer from poor performance. Therefore, an intelligent heart disease diagnosis application design is required. In this research work, internet of things (IoT) sensor data with a deep learning-based heart diagnosis application is designed. The heart disease IoT sensor data is collected from the University of California Irvine machine learning repository free open-source dataset which is useful for training the deep graph convolutional network (DG_ConvoNet) deep learning network. The testing data has been collected from the Cleveland Clinic Foundation; it is a collection of 350 real-time clinical instances from heart patients through IoT sensors. The K-means technique is employed to remove noise in sensor data and clustered the unstructured data. The features are extracted to employ Linear Quadratic Discriminant Analysis. DG_ConvoNet is a deep learning process to classify and predict heart diseases. The diagnostic application achieves an accuracy of 96%, sensitivity of 80%, specificity of 73%, precision of 90%, F-Score of 79%, and area under the ROC curve of 75% implementing the proposed model.
Collapse
Affiliation(s)
- K. Saikumar
- Department of ECE, Koneru Lakshmaiah Education Foundation, Green Fields, Vaddeswaram, Andhra Pradesh, India
| | - V. Rajesh
- Department of ECE, Koneru Lakshmaiah Education Foundation, Green Fields, Vaddeswaram, Andhra Pradesh, India
| | - Gautam Srivastava
- Department of Mathematics and Computer Science, Brandon University, Brandon, MB, Canada
- Research Centre for Interneural Computing, China Medical University, Taichung, Taiwan
- Department of Mathematics and Computer Science, Lebanese American University, Beirut, Lebanon
| | - Jerry Chun-Wei Lin
- Western Norway University of Applied Science, Bergen, Norway
- *Correspondence: Jerry Chun-Wei Lin,
| |
Collapse
|
22
|
Shekhar R, Vanama G, John T, Issac J, Arjoune Y, Doroshow RW. Automated identification of innocent Still's murmur using a convolutional neural network. Front Pediatr 2022; 10:923956. [PMID: 36210944 PMCID: PMC9533723 DOI: 10.3389/fped.2022.923956] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Accepted: 08/18/2022] [Indexed: 11/16/2022] Open
Abstract
Background Still's murmur is the most prevalent innocent heart murmur of childhood. Auscultation is the primary clinical tool to identify this murmur as innocent. Whereas pediatric cardiologists routinely perform this task, primary care providers are less successful in distinguishing Still's murmur from the murmurs of true heart disease. This results in a large number of children with a Still's murmur being referred to pediatric cardiologists. Objectives To develop a computer algorithm that can aid primary care providers to identify the innocent Still's murmur at the point of care, to substantially decrease over-referral. Methods The study included Still's murmurs, pathological murmurs, other innocent murmurs, and normal (i.e., non-murmur) heart sounds of 1,473 pediatric patients recorded using a commercial electronic stethoscope. The recordings with accompanying clinical diagnoses provided by a pediatric cardiologist were used to train and test the convolutional neural network-based algorithm. Results A comparative analysis showed that the algorithm using only the murmur sounds recorded at the lower left sternal border achieved the highest accuracy. The developed algorithm identified Still's murmur with 90.0% sensitivity and 98.3% specificity for the default decision threshold. The area under the receiver operating characteristic curve was 0.943. Conclusions Still's murmur can be identified with high accuracy with the algorithm we developed. Using this approach, the algorithm could help to reduce the rate of unnecessary pediatric cardiologist referrals and use of echocardiography for a common benign finding.
Collapse
Affiliation(s)
- Raj Shekhar
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, DC, United States
- AusculTech Dx, Silver Spring, MD, United States
| | | | - Titus John
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, DC, United States
- AusculTech Dx, Silver Spring, MD, United States
| | - James Issac
- AusculTech Dx, Silver Spring, MD, United States
| | - Youness Arjoune
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, DC, United States
| | - Robin W. Doroshow
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, DC, United States
- AusculTech Dx, Silver Spring, MD, United States
- Children's National Heart Institute, Children's National Hospital, Washington, DC, United States
| |
Collapse
|
23
|
Rezaee K, Khosravi MR, Jabari M, Hesari S, Anari MS, Aghaei F. Graph convolutional network‐based deep feature learning for cardiovascular disease recognition from heart sound signals. INT J INTELL SYST 2022. [DOI: 10.1002/int.23041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Khosro Rezaee
- Department of Biomedical Engineering Meybod University Meybod Iran
| | - Mohammad R. Khosravi
- Shandong Provincial University Laboratory for Protected Horticulture Weifang University of Science and Technology Weifang Shandong China
- Department of Computer Engineering Persian Gulf University Bushehr Iran
| | - Mohammad Jabari
- Faculty of Mechanical Engineering University of Tabriz Tabriz Iran
| | - Shabnam Hesari
- Department of Electrical and Computer Engineering Ferdows Branch Islamic Azad University Ferdows Iran
| | - Maryam Saberi Anari
- Department of Computer Engineering Technical and Vocational University (TVU) Tehran Iran
| | - Fahimeh Aghaei
- Department of Electrical and Electronics Engineering Ozyegin University Istanbul Turkey
| |
Collapse
|