1
|
Park S, Yi Y, Han SS, Kim TH, Kim SJ, Yoon YS, Kim S, Lee HJ, Heo Y. Development of an AI Model for Predicting Methacholine Bronchial Provocation Test Results Using Spirometry. Diagnostics (Basel) 2025; 15:449. [PMID: 40002600 PMCID: PMC11854253 DOI: 10.3390/diagnostics15040449] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2024] [Revised: 01/31/2025] [Accepted: 02/08/2025] [Indexed: 02/27/2025] Open
Abstract
Background/Objectives: The methacholine bronchial provocation test (MBPT) is a diagnostic test frequently used to evaluate airway hyper-reactivity. MBPT is essential for diagnosing asthma; however, it can be time-consuming and resource-intensive. This study aimed to develop an artificial intelligence (AI) model to predict the MBPT results using forced expiratory volume in one second (FEV1) and bronchodilator test measurements from spirometry. Methods: a dataset of spirometry measurements, including Pre- and Post-bronchodilator FEV1, was used to train and validate the model. Results: Among the evaluated models, the multilayer perceptron (MLP) achieved the highest area under the curve (AUC) of 0.701 (95% CI: 0.676-0.725), accuracy of 0.758, and an F1-score of 0.853. Logistic regression (LR) and a support vector machine (SVM) demonstrated comparable performance with AUC values of 0.688, while random forest (RF) and extreme gradient boost (XGBoost) achieved slightly lower AUC values of 0.669 and 0.672, respectively. Feature importance analysis of the MLP model identified key contributing features, including Pre-FEF25-75 (%), Pre-FVC (L), Post FEV1/FVC, Change-FEV1 (L), and Change-FEF25-75 (%), providing insight into the interpretability and clinical applicability of the model. Conclusions: These results highlight the potential of the model to utilize readily available spirometry data, particularly FEV1 and bronchodilator responses, to accurately predict MBPT results. Our findings suggest that AI-based prediction can improve asthma diagnostic workflows by minimizing the reliance on MBPT and enabling faster and more accessible assessments.
Collapse
Affiliation(s)
- SangJee Park
- Biomedical Research Institute, Kangwon National University Hospital, Chuncheon 24289, Republic of Korea;
| | - Yehyeon Yi
- Department of Internal Medicine, Seoul Medical Center, Seoul 02053, Republic of Korea; (Y.Y.); (S.K.)
| | - Seon-Sook Han
- Department of Internal Medicine, Kangwon National University, Chuncheon 24341, Republic of Korea; (S.-S.H.); (T.-H.K.)
| | - Tae-Hoon Kim
- Department of Internal Medicine, Kangwon National University, Chuncheon 24341, Republic of Korea; (S.-S.H.); (T.-H.K.)
| | - So Jeong Kim
- Division of Pulmonary, Allergy and Critical Care Medicine, Department of Internal Medicine, Hallym University Dongtan Sacred Heart Hospital, Hwaseong 18450, Republic of Korea;
| | - Young Soon Yoon
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Dongguk University Ilsan Hospital, Goyang 10326, Republic of Korea;
| | - Suhyun Kim
- Department of Internal Medicine, Seoul Medical Center, Seoul 02053, Republic of Korea; (Y.Y.); (S.K.)
| | - Hyo Jin Lee
- Internal Medicine, Seoul National University Seoul Metropolitan Government Boramae Medical Center, Seoul 07061, Republic of Korea;
| | - Yeonjeong Heo
- Department of Internal Medicine, Kangwon National University, Chuncheon 24341, Republic of Korea; (S.-S.H.); (T.-H.K.)
| |
Collapse
|
2
|
Kang N, Lee K, Byun S, Lee JY, Choi DC, Lee BJ. Novel Artificial Intelligence-Based Technology to Diagnose Asthma Using Methacholine Challenge Tests. ALLERGY, ASTHMA & IMMUNOLOGY RESEARCH 2024; 16:42-54. [PMID: 38262390 PMCID: PMC10823143 DOI: 10.4168/aair.2024.16.1.42] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2023] [Revised: 08/11/2023] [Accepted: 10/06/2023] [Indexed: 01/25/2024]
Abstract
PURPOSE The methacholine challenge test (MCT) has high sensitivity but relatively low specificity for asthma diagnosis. This study aimed to develop and validate machine learning (ML) models to improve the diagnostic performance of MCT for asthma. METHODS Data from 1,501 patients with asthma symptoms who underwent MCT between 2015 and 2020 were analyzed. The patients were grouped as either the training (80%, n = 1,265) and test sets (20%, n = 236) depending on the time of referral. The conventional model (provocative concentration that causes a 20% decrease in forced expiratory volume in one second [FEV1]; PC20 ≤ 16 mg/mL) was compared with the prediction models derived from five ML methods: logistic regression, support vector machine, random forest, extreme gradient boosting, and artificial neural network. The area under the receiver operator characteristic curves (AUROC) and area under the precision-recall curves (AUPRC) of each model were compared. The prediction models were further analyzed using different input combinations of FEV1, forced vital capacity (FVC), and forced expiratory flow at 25%-75% of forced vital capacity (FEF25%-75%) values obtained during MCT. RESULTS In total, 545 patients (36.3%) were diagnosed with asthma. The AUROC of the conventional model was 0.856 (95% confidence interval [CI], 0.852-0.861), and the AUPRC was 0.759 (95% CI, 0.751-0.766). All the five ML prediction models had higher AUROC and AUPRC values than those of the conventional model, and random forest showed both highest AUROC (0.950; 95% CI, 0.948-0.952) and AUROC (0.909; 95% CI, 0.905-0.914) when FEV1, FVC, and FEF25%-75% were included as inputs. CONCLUSIONS Artificial intelligence-based models showed excellent performance in asthma prediction compared to using PC20 ≤ 16 mg/mL. The novel technology could be used to enhance the clinical diagnosis of asthma.
Collapse
Affiliation(s)
- Noeul Kang
- Division of Allergy, Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea
| | - KyungHyun Lee
- Department of Electronics Engineering, Incheon National University, Incheon, Korea
| | - Sangwon Byun
- Department of Electronics Engineering, Incheon National University, Incheon, Korea
| | - Jin-Young Lee
- Health Promotion Center, Samsung Medical Center, Seoul, Korea
| | - Dong-Chull Choi
- Division of Allergy, Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea
| | - Byung-Jae Lee
- Division of Allergy, Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea.
| |
Collapse
|
3
|
Kim YH, Jeong JE, Chung HL, Jang YY. Relationships between lung function and clinical findings in school-age survivors of preterm birth. ALLERGY ASTHMA & RESPIRATORY DISEASE 2021. [DOI: 10.4168/aard.2021.9.2.69] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Affiliation(s)
- Young Hwan Kim
- Department of Pediatrics, Daegu Catholic University Medical Center, Daegu Catholic University School of Medicine, Daegu, Korea
| | - Ji Eun Jeong
- Department of Pediatrics, Daegu Catholic University Medical Center, Daegu Catholic University School of Medicine, Daegu, Korea
| | - Hai Lee Chung
- Department of Pediatrics, Daegu Catholic University Medical Center, Daegu Catholic University School of Medicine, Daegu, Korea
| | - Yoon Young Jang
- Department of Pediatrics, Daegu Catholic University Medical Center, Daegu Catholic University School of Medicine, Daegu, Korea
| |
Collapse
|
4
|
Kim HA, Kwon JE, Ahn JY, Choe JY, Kim DS, Park SH, Hyun MC, Choi BS. Analysis of PC 20-FEF 25%–75% and ΔFVC in the methacholine bronchial provocation test. ALLERGY ASTHMA & RESPIRATORY DISEASE 2021. [DOI: 10.4168/aard.2021.9.3.141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Affiliation(s)
- Hyeon A Kim
- Department of Pediatrics, School of Medicine, Kyungpook National University, Daegu, Korea
| | - Jung Eun Kwon
- Department of Pediatrics, School of Medicine, Kyungpook National University, Daegu, Korea
| | - Ji Young Ahn
- Department of Pediatrics, Yeungnam University College of Medicine, Daegu, Korea
| | - Jae Young Choe
- Department of Emergency Medicine, School of Medicine, Kyungpook National University, Daegu, Korea
| | - Dong Sub Kim
- Department of Pediatrics, School of Medicine, Kyungpook National University, Daegu, Korea
| | - Sook Hyun Park
- Department of Pediatrics, School of Medicine, Kyungpook National University, Daegu, Korea
| | - Myung Chul Hyun
- Department of Pediatrics, School of Medicine, Kyungpook National University, Daegu, Korea
| | - Bong Seok Choi
- Department of Pediatrics, School of Medicine, Kyungpook National University, Daegu, Korea
| |
Collapse
|
5
|
Jung DB, Jeong JE, Chung HL, Jang YY. Effect of overweight or obesity on lung function and asthma severity in prepubertal asthmatic children. ALLERGY ASTHMA & RESPIRATORY DISEASE 2021. [DOI: 10.4168/aard.2021.9.4.231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Affiliation(s)
- Da Bin Jung
- Department of Pediatrics, Daegu Catholic University Medical Center, Daegu Catholic University School of Medicine, Daegu, Korea
| | - Ji Eun Jeong
- Department of Pediatrics, Daegu Catholic University Medical Center, Daegu Catholic University School of Medicine, Daegu, Korea
| | - Hai Lee Chung
- Department of Pediatrics, Daegu Catholic University Medical Center, Daegu Catholic University School of Medicine, Daegu, Korea
| | - Yoon Young Jang
- Department of Pediatrics, Daegu Catholic University Medical Center, Daegu Catholic University School of Medicine, Daegu, Korea
| |
Collapse
|
6
|
Song DJ, Song WJ, Kwon JW, Kim GW, Kim MA, Kim MY, Kim MH, Kim SH, Kim SH, Kim SH, Kim ST, Kim SH, Kim JK, Kim JH, Kim HJ, Kim HB, Park KH, Yoon JK, Lee BJ, Lee SE, Lee YM, Lee YJ, Lim KH, Jeon YH, Jo EJ, Jee YK, Jin HJ, Choi SH, Hur GY, Cho SH, Kim SH, Lim DH. KAAACI Evidence-Based Clinical Practice Guidelines for Chronic Cough in Adults and Children in Korea. ALLERGY, ASTHMA & IMMUNOLOGY RESEARCH 2018; 10:591-613. [PMID: 30306744 PMCID: PMC6182199 DOI: 10.4168/aair.2018.10.6.591] [Citation(s) in RCA: 53] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/30/2018] [Accepted: 05/24/2018] [Indexed: 12/13/2022]
Abstract
Chronic cough is common in the community and causes significant morbidity. Several factors may underlie this problem, but comorbid conditions located at sensory nerve endings that regulate the cough reflex, including rhinitis, rhinosinusitis, asthma, eosinophilic bronchitis, and gastroesophageal reflux disease, are considered important. However, chronic cough is frequently non-specific and accompanied by not easily identifiable causes during the initial evaluation. Therefore, there are unmet needs for developing empirical treatment and practical diagnostic approaches that can be applied in primary clinics. Meanwhile, in referral clinics, a considerable proportion of adult patients with chronic cough are unexplained or refractory to conventional treatment. The present clinical practice guidelines aim to address major clinical questions regarding empirical treatment, practical diagnostic tools for non-specific chronic cough, and available therapeutic options for chronic wet cough in children and unexplained chronic cough in adults in Korea.
Collapse
Affiliation(s)
- Dae Jin Song
- Department of Pediatrics, Korea University College of Medicine and Environmental Health Center for Childhood Asthma, Korea University Anam Hospital, Seoul, Korea
| | - Woo Jung Song
- Department of Internal Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Jae Woo Kwon
- Department of Internal Medicine, Kangwon National University School of Medicine, Chuncheon, Korea
| | - Gun Woo Kim
- Department of Internal Medicine, St. Carollo General Hospital, Suncheon, Korea
| | - Mi Ae Kim
- Department of Pulmonology, Allergy and Critical Care Medicine, CHA Bundang Medical Center, CHA University, Seongnam, Korea
| | - Mi Yeong Kim
- Department of Internal Medicine, Busan Paik Hospital, Inje University College of Medicine, Busan, Korea
| | - Min Hye Kim
- Department of Internal Medicine, Ewha Womans University College of Medicine, Seoul, Korea
| | - Sang Ha Kim
- Department of Internal Medicine, Yonsei University Wonju College of Medicine, Wonju, Korea
| | - Sang Heon Kim
- Department of Internal Medicine, Hanyang University College of Medicine, Seoul, Korea
| | - Sang Hyuck Kim
- Department of Family Medicine, Seoul National University Hospital, Seoul, Korea
| | - Sun Tae Kim
- Department of Otorhinolaryngology, Gachon University, Gil Medical center, Incheon, Korea
| | - Sae Hoon Kim
- Department of Internal Medicine, Seoul National University Bundang Hospital, Bundang, Korea
| | - Ja Kyoung Kim
- Department of Pediatrics, Kangwon National University School of Medicine, Chuncheon, Korea
| | - Joo Hee Kim
- Department of Medicine, Hallym University Sacred Heart Hospital, Hallym University College of Medicine, Anyang, Korea
| | - Hyun Jung Kim
- Institute for Evidence-based Medicine Cochrane Korea, Department of Preventive Medicine, Korea University College of Medicine, Seoul, Korea
| | - Hyo Bin Kim
- Department of Pediatrics, Inje University Sanggye Paik Hospital, Seoul, Korea
| | - Kyung Hee Park
- Division of Allergy and Immunology, Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Korea
| | | | - Byung Jae Lee
- Department of Medicine, Sungkyunkwan University School of Medicine, Seoul, Korea
| | - Seung Eun Lee
- Respiratory and Allergy Clinic, Pusan National University Yangsan Hospital, Yangsan, Korea
| | | | - Yong Ju Lee
- Department of Pediatrics, Hallym University Kangnam Sacred Heart Hospital, Seoul, Korea
| | - Kyung Hwan Lim
- Department of Internal Medicine, Armed Forces Capital Hospital, Seongnam, Korea
| | - You Hoon Jeon
- Department of Pediatrics, Hallym University Dongtan Sacred Heart Hospital, Dongtan, Korea
| | - Eun Jung Jo
- Department of Internal Medicine, Pusan National University School of Medicine, Busan, Korea
| | - Young Koo Jee
- Department of Internal Medicine, Dankook University College of Medicine, Cheonan, Korea
| | - Hyun Jung Jin
- Department of Internal medicine, Yeungnam University College of Medicine, Daegu, Korea
| | - Sun Hee Choi
- Department of Pediatrics, Kyung Hee University School of Medicine, Seoul, Korea
| | - Gyu Young Hur
- Department of Internal Medicine, Korea University College of Medicine, Seoul, Korea
| | - Sang Heon Cho
- Department of Internal Medicine, Seoul National University College of Medicine, Seoul, Korea
| | - Sang Hoon Kim
- Department of Internal Medicine, Eulji Hospital, Eulji University School of Medicine, Seoul, Korea.
| | - Dae Hyun Lim
- Department of Pediatrics, Inha University School of Medicine and Environmental Health Center for Allergic Disease, Inha University Hospital, Incheon, Korea.
| |
Collapse
|