1
|
Varol Arısoy M, Arısoy A, Uysal İ. A vision attention driven Language framework for medical report generation. Sci Rep 2025; 15:10704. [PMID: 40155699 PMCID: PMC11953376 DOI: 10.1038/s41598-025-95666-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2025] [Accepted: 03/24/2025] [Indexed: 04/01/2025] Open
Abstract
This study introduces the Medical Vision Attention Generation (MedVAG) model, a novel framework designed to facilitate the automated generation of medical reports. MedVAG integrates Vision Transformer (ViT)-based visual feature extraction and GPT-2 language modeling, enhanced by graph-based feature fusion and multiple attention mechanisms (co-attention, cross-attention, memory-guided attention), to ensure semantic coherence and diagnostic accuracy. Evaluated on IU X-Ray and COV-CTR datasets, the model achieved state-of-the-art performance across natural language generation metrics (BLEU, METEOR, ROUGE, CIDEr) and clinical effectiveness measures. Ablation studies highlighted the critical role of attention mechanisms and feature fusion in aligning visual and textual features. MedVAG demonstrates strong potential as an assistive technology, aiming to support radiologists by reducing workload and enhancing diagnostic accuracy.
Collapse
Affiliation(s)
- Merve Varol Arısoy
- Bucak Faculty of Computer and Informatics, Information Systems Engineering Department, Burdur Mehmet Akif Ersoy University, Burdur, Turkey.
| | - Ayhan Arısoy
- Bucak Faculty of Computer and Informatics, Information Systems Engineering Department, Burdur Mehmet Akif Ersoy University, Burdur, Turkey
| | - İlhan Uysal
- Information Systems and Technologies. Depart, Burdur Mehmet Akif Ersoy University, Bucak Zeliha Tolunay School of Applied Technology and Business, Burdur, Turkey
| |
Collapse
|
2
|
Alqahtani MM, Alanazi AMM, Algarni SS, Aljohani H, Alenezi FK, F Alotaibi T, Alotaibi M, K Alqahtani M, Alahmari M, S Alwadeai K, M Alghamdi S, Almeshari MA, Alshammari TF, Mumenah N, Al Harbi E, Al Nufaiei ZF, Alhuthail E, Alzahrani E, Alahmadi H, Alarifi A, Zaidan A, T Ismaeil T. Unveiling the Influence of AI on Advancements in Respiratory Care: Narrative Review. Interact J Med Res 2024; 13:e57271. [PMID: 39705080 PMCID: PMC11699506 DOI: 10.2196/57271] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2024] [Revised: 09/22/2024] [Accepted: 10/28/2024] [Indexed: 12/21/2024] Open
Abstract
BACKGROUND Artificial intelligence is experiencing rapid growth, with continual innovation and advancements in the health care field. OBJECTIVE This study aims to evaluate the application of artificial intelligence technologies across various domains of respiratory care. METHODS We conducted a narrative review to examine the latest advancements in the use of artificial intelligence in the field of respiratory care. The search was independently conducted by respiratory care experts, each focusing on their respective scope of practice and area of interest. RESULTS This review illuminates the diverse applications of artificial intelligence, highlighting its use in areas associated with respiratory care. Artificial intelligence is harnessed across various areas in this field, including pulmonary diagnostics, respiratory care research, critical care or mechanical ventilation, pulmonary rehabilitation, telehealth, public health or health promotion, sleep clinics, home care, smoking or vaping behavior, and neonates and pediatrics. With its multifaceted utility, artificial intelligence can enhance the field of respiratory care, potentially leading to superior health outcomes for individuals under this extensive umbrella. CONCLUSIONS As artificial intelligence advances, elevating academic standards in the respiratory care profession becomes imperative, allowing practitioners to contribute to research and understand artificial intelligence's impact on respiratory care. The permanent integration of artificial intelligence into respiratory care creates the need for respiratory therapists to positively influence its progression. By participating in artificial intelligence development, respiratory therapists can augment their clinical capabilities, knowledge, and patient outcomes.
Collapse
Affiliation(s)
- Mohammed M Alqahtani
- Department of Respiratory Therapy, College of Applied Medical Sciences, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
- King Abdullah International Medical Research Center, Riyadh, Saudi Arabia
- Department of Respiratory Services, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Abdullah M M Alanazi
- Department of Respiratory Therapy, College of Applied Medical Sciences, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
- King Abdullah International Medical Research Center, Riyadh, Saudi Arabia
- Department of Respiratory Services, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Saleh S Algarni
- Department of Respiratory Therapy, College of Applied Medical Sciences, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
- King Abdullah International Medical Research Center, Riyadh, Saudi Arabia
- Department of Respiratory Services, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Hassan Aljohani
- Department of Respiratory Therapy, College of Applied Medical Sciences, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
- King Abdullah International Medical Research Center, Riyadh, Saudi Arabia
- Department of Respiratory Services, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Faraj K Alenezi
- King Abdullah International Medical Research Center, Riyadh, Saudi Arabia
- Anesthesia Technology Department, College of Applied Medical Sciences, King Saud Bin Abdul-Aziz University for Health Sciences, Riyadh, Saudi Arabia
| | - Tareq F Alotaibi
- Department of Respiratory Therapy, College of Applied Medical Sciences, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
- King Abdullah International Medical Research Center, Riyadh, Saudi Arabia
- Department of Respiratory Services, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Mansour Alotaibi
- Department of Physical Therapy, Northern Border University, Arar, Saudi Arabia
| | - Mobarak K Alqahtani
- Department of Respiratory Therapy, College of Applied Medical Sciences, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
- King Abdullah International Medical Research Center, Riyadh, Saudi Arabia
- Department of Respiratory Services, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Mushabbab Alahmari
- Department of Respiratory Therapy, College of Applied Medical Sciences, University of Bisha, Bisha, Saudi Arabia
- Health and Humanities Research Center, University of Bisha, Bisha, Saudi Arabia
| | - Khalid S Alwadeai
- Department of Rehabilitation Science, College of Applied Medical Sciences, King Saud University, Riyadh, Saudi Arabia
| | - Saeed M Alghamdi
- Clinical Technology Department, Respiratory Care Program, Faculty of Applied Medical Sciences, Umm Al-Qura University, Mekkah, Saudi Arabia
| | - Mohammed A Almeshari
- Department of Rehabilitation Science, College of Applied Medical Sciences, King Saud University, Riyadh, Saudi Arabia
| | | | - Noora Mumenah
- Department of Respiratory Therapy, College of Applied Medical Sciences, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
- King Abdullah International Medical Research Center, Riyadh, Saudi Arabia
- Department of Respiratory Services, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Ebtihal Al Harbi
- Department of Respiratory Therapy, College of Applied Medical Sciences, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
- King Abdullah International Medical Research Center, Riyadh, Saudi Arabia
- Department of Respiratory Services, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| | - Ziyad F Al Nufaiei
- Department of Respiratory Therapy, College of Applied Medical Sciences, King Saud bin Abdulaziz University for Health Sciences, Jeddah, Saudi Arabia
- King Abdullah International Medical Research Center, Jeddah, Saudi Arabia
| | - Eyas Alhuthail
- King Abdullah International Medical Research Center, Riyadh, Saudi Arabia
- Basic Sciences Department, College of Sciences and Health Professions, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
| | - Esam Alzahrani
- Department of Computer Engineering, Al-Baha University, Alaqiq, Saudi Arabia
| | - Husam Alahmadi
- Department of Respiratory Therapy, Faculty of Medical Rehabilitation Sciences, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Abdulaziz Alarifi
- King Abdullah International Medical Research Center, Riyadh, Saudi Arabia
- Basic Sciences Department, College of Sciences and Health Professions, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
| | - Amal Zaidan
- King Abdullah International Medical Research Center, Riyadh, Saudi Arabia
- Department of Public Health, College of Public Health and Health Informatics, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
| | - Taha T Ismaeil
- Department of Respiratory Therapy, College of Applied Medical Sciences, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
- King Abdullah International Medical Research Center, Riyadh, Saudi Arabia
- Department of Respiratory Services, King Abdulaziz Medical City, Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| |
Collapse
|
3
|
Petrella RJ. The AI Future of Emergency Medicine. Ann Emerg Med 2024; 84:139-153. [PMID: 38795081 DOI: 10.1016/j.annemergmed.2024.01.031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Revised: 01/23/2024] [Accepted: 01/24/2024] [Indexed: 05/27/2024]
Abstract
In the coming years, artificial intelligence (AI) and machine learning will likely give rise to profound changes in the field of emergency medicine, and medicine more broadly. This article discusses these anticipated changes in terms of 3 overlapping yet distinct stages of AI development. It reviews some fundamental concepts in AI and explores their relation to clinical practice, with a focus on emergency medicine. In addition, it describes some of the applications of AI in disease diagnosis, prognosis, and treatment, as well as some of the practical issues that they raise, the barriers to their implementation, and some of the legal and regulatory challenges they create.
Collapse
Affiliation(s)
- Robert J Petrella
- Emergency Departments, CharterCARE Health Partners, Providence and North Providence, RI; Emergency Department, Boston VA Medical Center, Boston, MA; Emergency Departments, Steward Health Care System, Boston and Methuen, MA; Harvard Medical School, Boston, MA; Department of Chemistry and Chemical Biology, Harvard University, Cambridge, MA; Department of Medicine, Brigham and Women's Hospital, Boston, MA.
| |
Collapse
|
4
|
Trudzinski FC, Jörres RA, Alter P, Watz H, Vogelmeier CF, Kauczor HU, Thangamani S, Debic M, Welte T, Behr J, Kahnert K, Bals R, Herr C, Heußel CP, Biederer J, von Stackelberg O, Fähndrich S, Wouters EFM, Waschki B, Rabe KF, Herth FJF, Palm V. Midregional Proatrial Natriuretic Peptide (MRproANP) is associated with vertebral fractures and low bone density in patients with chronic obstructive pulmonary disease (COPD). Respir Res 2024; 25:274. [PMID: 39003487 PMCID: PMC11245771 DOI: 10.1186/s12931-024-02902-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2024] [Accepted: 07/02/2024] [Indexed: 07/15/2024] Open
Abstract
BACKGROUND Patients with COPD are often affected by loss of bone mineral density (BMD) and osteoporotic fractures. Natriuretic peptides (NP) are known as cardiac markers, but have also been linked to fragility-associated fractures in the elderly. As their functions include regulation of fluid and mineral balance, they also might affect bone metabolism, particularly in systemic disorders such as COPD. RESEARCH QUESTION We investigated the association between NP serum levels, vertebral fractures and BMD assessed by chest computed tomography (CT) in patients with COPD. METHODS Participants of the COSYCONET cohort with CT scans were included. Mean vertebral bone density on CT (BMD-CT) as a risk factor for osteoporosis was assessed at the level of TH12 (AI-Rad Companion), and vertebral compression fractures were visually quantified by two readers. Their relationship with N-terminal pro-B-type natriuretic peptide (NT-proBNP), Mid-regional pro-atrial natriuretic peptide (MRproANP) and Midregional pro-adrenomedullin (MRproADM) was determined using group comparisons and multivariable analyses. RESULTS Among 418 participants (58% male, median age 64 years, FEV1 59.6% predicted), vertebral fractures in TH12 were found in 76 patients (18.1%). Compared to patients without fractures, these had elevated serum levels (p ≤ 0.005) of MRproANP and MRproADM. Using optimal cut-off values in multiple logistic regression analyses, MRproANP levels ≥ 65 nmol/l (OR 2.34; p = 0.011) and age (p = 0.009) were the only significant predictors of fractures after adjustment for sex, BMI, smoking status, FEV1% predicted, SGRQ Activity score, daily physical activity, oral corticosteroids, the diagnosis of cardiac disease, and renal impairment. Correspondingly, MRproANP (p < 0.001), age (p = 0.055), SGRQ Activity score (p = 0.061) and active smoking (p = 0.025) were associated with TH12 vertebral density. INTERPRETATION MRproANP was a marker for osteoporotic vertebral fractures in our COPD patients from the COSYCONET cohort. Its association with reduced vertebral BMD on CT and its known modulating effects on fluid and ion balance are suggestive of direct effects on bone mineralization. TRIAL REGISTRATION ClinicalTrials.gov NCT01245933, Date of registration: 18 November 2010.
Collapse
Affiliation(s)
- Franziska C Trudzinski
- Department of Pneumology and Critical Care Medicine), German Center for Lung Research (DZL), Translational Lung Research Center Heidelberg (TLRC-H), Thoraxklinik University of Heidelberg, Röntgenstrasse 1, 69126, Heidelberg, Germany.
| | - Rudolf A Jörres
- Institute and Outpatient Clinic for Occupational, Social and Environmental Medicine, German Center for Lung Research (DZL), LMU University Hospital, Ludwig-Maximilians-University (LMU), Comprehensive Pneumology Center Munich (CPC-M), Munich, Germany
| | - Peter Alter
- Department of Medicine, Pulmonary and Critical Care Medicine, German Center for Lung Research (DZL), Philipps University of Marburg (UMR), Marburg, Germany
| | - Henrik Watz
- Pulmonary Research Institute at LungenClinic Grosshansdorf, Grosshansdorf, Germany
- Airway Research Center North (ARCN), German Center for Lung Research (DZL), Woehrendamm 80, 22927, Grosshansdorf, Germany
| | - Claus F Vogelmeier
- Department of Medicine, Pulmonary and Critical Care Medicine, German Center for Lung Research (DZL), Philipps University of Marburg (UMR), Marburg, Germany
| | - Hans-Ulrich Kauczor
- Department of Diagnostic & Interventional Radiology, University Hospital of Heidelberg, Heidelberg, Germany
- German Center for Lung Research (DZL), Translational Lung Research Center Heidelberg (TLRC-H), Heidelberg, Germany
| | - Subasini Thangamani
- Department of Diagnostic & Interventional Radiology, University Hospital of Heidelberg, Heidelberg, Germany
- German Center for Lung Research (DZL), Translational Lung Research Center Heidelberg (TLRC-H), Heidelberg, Germany
| | - Manuel Debic
- Department of Diagnostic & Interventional Radiology, University Hospital of Heidelberg, Heidelberg, Germany
- German Center for Lung Research (DZL), Translational Lung Research Center Heidelberg (TLRC-H), Heidelberg, Germany
| | - Tobias Welte
- Department of Pneumology, Hannover Medical School, Carl-Neuberg-Str. 1, 30625, Hannover, Germany
| | - Jürgen Behr
- Department of Internal Medicine V, CPC Comprehensive Pneumology Center, Member of the German Center for Lung Research (DZL), University Hospital, LMU Munich, Munich, Germany
| | - Kathrin Kahnert
- Department of Internal Medicine V, CPC Comprehensive Pneumology Center, Member of the German Center for Lung Research (DZL), University Hospital, LMU Munich, Munich, Germany
- MediCenterGermering, Germering, Germany
| | - Robert Bals
- Department of Internal Medicine V - Pulmonology, Allergology, Critical Care Care Medicine, Saarland University Hospital, Homburg, Germany
| | - Christian Herr
- Department of Internal Medicine V - Pulmonology, Allergology, Critical Care Care Medicine, Saarland University Hospital, Homburg, Germany
| | - Claus Peter Heußel
- German Center for Lung Research (DZL), Translational Lung Research Center Heidelberg (TLRC-H), Heidelberg, Germany
- Department of Diagnostic and Interventional Radiology With Nuclear Medicine, Thoraxklinik, University Medical Center Heidelberg, Heidelberg, Germany
| | - Jürgen Biederer
- Department of Diagnostic & Interventional Radiology, University Hospital of Heidelberg, Heidelberg, Germany
- German Center for Lung Research (DZL), Translational Lung Research Center Heidelberg (TLRC-H), Heidelberg, Germany
- Faculty of Medicine, University of Latvia, Riga, Latvia
- Faculty of Medicine, Christian-Albrechts-Universität Zu Kiel, Kiel, Germany
| | - Oyunbileg von Stackelberg
- Department of Diagnostic & Interventional Radiology, University Hospital of Heidelberg, Heidelberg, Germany
- German Center for Lung Research (DZL), Translational Lung Research Center Heidelberg (TLRC-H), Heidelberg, Germany
| | - Sebastian Fähndrich
- Department of Pneumology, University Medical Centre Freiburg, Freiburg, Germany
| | - Emiel F M Wouters
- Department of Respiratory Medicine, Maastricht University Medical Center, Maastricht, The Netherlands
- Medical Faculty, Sigmund Freud University, Vienna, Austria
- Department of Internal Medicine, Sigmund Freud Private University, Vienna, Austria
| | - Benjamin Waschki
- LungenClinic Grosshansdorf, Airway Research Center North, Member of the German Center for Lung Research, Pulmonary Research Institute, Woehrendamm 80, 22927, Grosshansdorf, Germany
- Department of Pneumology, Itzehoe Hospital, Itzehoe, Germany
| | - Klaus F Rabe
- LungenClinic Grosshansdorf, Airway Research Center North, Member of the German Center for Lung Research, Pulmonary Research Institute, Woehrendamm 80, 22927, Grosshansdorf, Germany
| | - Felix J F Herth
- Department of Pneumology and Critical Care Medicine), German Center for Lung Research (DZL), Translational Lung Research Center Heidelberg (TLRC-H), Thoraxklinik University of Heidelberg, Röntgenstrasse 1, 69126, Heidelberg, Germany
| | - Viktoria Palm
- Department of Diagnostic & Interventional Radiology, University Hospital of Heidelberg, Heidelberg, Germany
- German Center for Lung Research (DZL), Translational Lung Research Center Heidelberg (TLRC-H), Heidelberg, Germany
| |
Collapse
|
5
|
Weckbach S, Wielpütz MO, von Stackelberg O. [Patient-centered, value-based management of incidental findings in radiology]. RADIOLOGIE (HEIDELBERG, GERMANY) 2023; 63:657-664. [PMID: 37566128 DOI: 10.1007/s00117-023-01200-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 08/01/2023] [Indexed: 08/12/2023]
Abstract
As a byproduct of the increased use of high-resolution radiological imaging, the prevalence of incidental findings (IFs) has been increasing for years. The discovery of an incidental finding can allow early treatment of a potentially health-threatening disease and thus decisively change the course of the disease. However, many incidental findings are of low risk with little or no health impact, and yet their discovery often leads to a cascade of additional investigations. It is undisputed that incidental findings can have a direct impact on the life of the person and that not only psychosocial aspects such as worries and anxiety due to false-positive findings play a role, but that insurance, legal or professional problems can also occur under certain circumstances, which is why the correct handling of incidental findings and the accompanying ethical challenges that apply to them regularly give rise to discussions. General principles to consider when managing incidental findings are responsibility for the well-being of the patient/study participant and of society. In order to avoid overdiagnosis and overtreatment and to achieve high patient benefit, radiologists and clinicians must know how to properly deal with IFs. In recent years, various national and international societies have published important guidelines ("white papers") on how to deal with the management of IFs. It is important that radiologists are fully aware of and follow these guidelines and are also available to referring physicians for further discussions and advice. The most important fact is that the well-being of the patient must always be at the center of all decisions.
Collapse
Affiliation(s)
- Sabine Weckbach
- Research & Development, Pharmaceuticals, Radiology, Diagnostic Imaging, Data and AI Research-General Clinical Imaging Services (GCIS), Bayer AG, 13353, Berlin, Deutschland.
- University Hospital Heidelberg, Diagnostic and Interventional Radiology, Heidelberg, Deutschland.
| | - Mark O Wielpütz
- University Hospital Heidelberg, Diagnostic and Interventional Radiology, Heidelberg, Deutschland
- German Center for Lung Research (DZL), Translational Lung Research Center (TLRC) Heidelberg, Heidelberg, Deutschland
- Department of Diagnostic and Interventional Radiology with Nuclear Medicine, Thoraxklinik at University Hospital Heidelberg, Heidelberg, Deutschland
| | - Oyunbileg von Stackelberg
- University Hospital Heidelberg, Diagnostic and Interventional Radiology, Heidelberg, Deutschland
- German Center for Lung Research (DZL), Translational Lung Research Center (TLRC) Heidelberg, Heidelberg, Deutschland
- Department of Diagnostic and Interventional Radiology with Nuclear Medicine, Thoraxklinik at University Hospital Heidelberg, Heidelberg, Deutschland
| |
Collapse
|