1
|
Golder S, O’Connor K, Lopez-Garcia G, Tatonetti N, Gonzalez-Hernandez G. LEVERAGING UNSTRUCTURED DATA IN ELECTRONIC HEALTH RECORDS TO DETECT ADVERSE EVENTS FROM PEDIATRIC DRUG USE - A SCOPING REVIEW. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2025:2025.03.20.25324320. [PMID: 40166566 PMCID: PMC11957175 DOI: 10.1101/2025.03.20.25324320] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 04/02/2025]
Abstract
Adverse drug events (ADEs) in pediatric populations pose significant public health challenges, yet research on their detection and monitoring remains limited. This scoping review evaluates the use of unstructured data from electronic health records (EHRs) to identify ADEs in children. We searched six databases, including MEDLINE, Embase and IEEE Xplore, in September 2024. From 984 records, only nine studies met our inclusion criteria, indicating a significant gap in research towards identify ADEs in children. We found that unstructured data in EHRs can indeed be of value and enhance pediatric pharmacovigilance, although its use has been so far very limited. Traditional Natural Language Processing (NLP) methods have been employed to extract ADEs, but the approaches utilized face challenges in generalizability and context interpretation. These challenges could be addressed with recent advances in transformer-based models and large language models (LLMs), unlocking the use of EHR data at scale for pediatric pharmacovigilance.
Collapse
Affiliation(s)
- Su Golder
- Department of Health Sciences, University of York, York, United Kingdom
| | - Karen O’Connor
- Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Guillermo Lopez-Garcia
- Department of Computational Biomedicine, Cedars-Sinai Medical Center, West Hollywood, CA, USA
| | - Nicholas Tatonetti
- Department of Computational Biomedicine, Cedars-Sinai Medical Center, West Hollywood, CA, USA
| | | |
Collapse
|
2
|
Daniel C, Embí PJ. Clinical Research Informatics: a Decade-in-Review. Yearb Med Inform 2024; 33:127-142. [PMID: 40199298 PMCID: PMC12020646 DOI: 10.1055/s-0044-1800732] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/10/2025] Open
Abstract
BACKGROUND Clinical Research Informatics (CRI) is a subspeciality of biomedical informatics that has substantially matured during the last decade. Advances in CRI have transformed the way clinical research is conducted. In recent years, there has been growing interest in CRI, as reflected by a vast and expanding scientific literature focused on the topic. The main objectives of this review are: 1) to provide an overview of the evolving definition and scope of this biomedical informatics subspecialty over the past 10 years; 2) to highlight major contributions to the field during the past decade; and 3) to provide insights about more recent CRI research trends and perspectives. METHODS We adopted a modified thematic review approach focused on understanding the evolution and current status of the CRI field based on literature sources identified through two complementary review processes (AMIA CRI year-in-review/IMIA Yearbook of Medical Informatics) conducted annually during the last decade. RESULTS More than 1,500 potentially relevant publications were considered, and 205 sources were included in the final review. The review identified key publications defining the scope of CRI and/or capturing its evolution over time as illustrated by impactful tools and methods in different categories of CRI focus. The review also revealed current topics of interest in CRI and prevailing research trends. CONCLUSION This scoping review provides an overview of a decade of research in CRI, highlighting major changes in the core CRI discoveries as well as increasingly impactful methods and tools that have bridged the principles-to-practice gap. Practical CRI solutions as well as examples of CRI-enabled large-scale, multi-organizational and/or multi-national research projects demonstrate the maturity of the field. Despite the progress demonstrated, some topics remain challenging, highlighting the need for ongoing CRI development and research, including the need of more rigorous evaluations of CRI solutions and further formalization and maturation of CRI services and capabilities across the research enterprise.
Collapse
Affiliation(s)
- Christel Daniel
- AP-HP, France
- Sorbonne Université, INSERM UMR_S 1142, LIMICS, F-75006, Paris, France
| | - Peter J. Embí
- Vanderbilt University Medical Center, Department of Biomedical Informatics, Nashville, Tennessee, USA
| |
Collapse
|
3
|
Seleman M, Mehta NM, Yang Y. Medication Errors: Detection Methodology Matters. J Patient Saf 2024; 20:e6-e7. [PMID: 38240643 DOI: 10.1097/pts.0000000000001201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/21/2024]
|
4
|
Morland K, Gerges C, Elwing J, Visovatti SH, Weatherald J, Gillmeyer KR, Sahay S, Mathai SC, Boucly A, Williams PG, Harikrishnan S, Minty EP, Hobohm L, Jose A, Badagliacca R, Lau EMT, Jing Z, Vanderpool RR, Fauvel C, Leonidas Alves J, Strange G, Pulido T, Qian J, Li M, Mercurio V, Zelt JGE, Moles VM, Cirulis MM, Nikkho SM, Benza RL, Elliott CG. Real-world evidence to advance knowledge in pulmonary hypertension: Status, challenges, and opportunities. A consensus statement from the Pulmonary Vascular Research Institute's Innovative Drug Development Initiative's Real-world Evidence Working Group. Pulm Circ 2023; 13:e12317. [PMID: 38144948 PMCID: PMC10739115 DOI: 10.1002/pul2.12317] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 10/26/2023] [Accepted: 11/21/2023] [Indexed: 12/26/2023] Open
Abstract
This manuscript on real-world evidence (RWE) in pulmonary hypertension (PH) incorporates the broad experience of members of the Pulmonary Vascular Research Institute's Innovative Drug Development Initiative Real-World Evidence Working Group. We aim to strengthen the research community's understanding of RWE in PH to facilitate clinical research advances and ultimately improve patient care. Herein, we review real-world data (RWD) sources, discuss challenges and opportunities when using RWD sources to study PH populations, and identify resources needed to support the generation of meaningful RWE for the global PH community.
Collapse
Affiliation(s)
- Kellie Morland
- Global Medical AffairsUnited Therapeutics CorporationResearch Triangle ParkNorth CarolinaUSA
| | - Christian Gerges
- Department of Internal Medicine II, Division of CardiologyMedical University of ViennaViennaAustria
| | - Jean Elwing
- Division of Pulmonary, Critical Care, and Sleep MedicineUniversity of CincinnatiCincinnatiOhioUSA
| | - Scott H. Visovatti
- Division of Cardiovascular MedicineThe Ohio State UniversityColumbusOhioUSA
| | - Jason Weatherald
- Department of Medicine, Division of Pulmonary MedicineUniversity of AlbertaEdmontonCanada
| | - Kari R. Gillmeyer
- The Pulmonary CenterBoston University Chobian & Avedisian School of MedicineBostonMassachusettsUSA
- Center for Healthcare Organization & Implementation ResearchVA Bedford Healthcare System and VA Boston Healthcare SystemBedfordMassachusettsUSA
| | - Sandeep Sahay
- Division of Pulmonary, Critical Care & Sleep MedicineHouston Methodist HospitalHoustonTexasUSA
| | - Stephen C. Mathai
- Division of Pulmonary and Critical Care MedicineJohns Hopkins University School of MedicineBaltimoreMarylandUSA
| | - Athénaïs Boucly
- Faculté de MédecineUniversité Paris‐SaclayLe Kremlin‐BicêtreFrance
- Service de Pneumologie et Soins Intensifs Respiratoires, Centre de Référence de l'Hypertension Pulmonaire, Hôpital BicêtreAssistance Publique Hôpitaux de ParisLe Kremlin BicêtreFrance
- National Heart and Lung InstituteImperial CollegeLondonUK
| | - Paul G. Williams
- Center of Chest Diseases & Critical CareMilpark HospitalJohannesburgSouth Africa
| | | | - Evan P. Minty
- Department of Medicine & O'Brien Institute for Public HealthUniversity of CalgaryCalgaryCanada
| | - Lukas Hobohm
- Department of CardiologyUniversity Medical Center of the Johannes Gutenberg University MainzMainzGermany
- Center for Thrombosis and Hemostasis (CTH)University Medical Center of the Johannes Gutenberg University MainzMainzGermany
| | - Arun Jose
- Division of Pulmonary, Critical Care, and Sleep MedicineUniversity of CincinnatiCincinnatiOhioUSA
| | - Roberto Badagliacca
- Department of Clinical, Anesthesiological and Cardiovascular Sciences, Sapienza University of RomePoliclinico Umberto IRomeItaly
| | - Edmund M. T. Lau
- Department of Respiratory Medicine, Royal Prince Alfred HospitalUniversity of SydneyCamperdownNew South WalesAustralia
- Faculty of Medicine and HealthUniversity of SydneyCamperdownNew South WalesAustralia
| | - Zhi‐Cheng Jing
- State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College HospitalChinese Academy of Medical Sciences and Peking Union Medical CollegeBeijingChina
| | | | - Charles Fauvel
- Service de Cardiologie, Centre de Compétence en Hypertension Pulmonaire 27/76, Centre Hospitalier Universitaire Charles Nicolle, INSERM EnVI U1096Université de RouenRouenFrance
| | - Jose Leonidas Alves
- Pulmonary Division, Heart InstituteUniversity of São Paulo Medical SchoolSão PauloBrazil
| | - Geoff Strange
- School of MedicineThe University of Notre Dame AustraliaPerthWestern AustraliaAustralia
| | - Tomas Pulido
- Ignacio Chávez National Heart InstituteMéxico CityMexico
| | - Junyan Qian
- Department of Rheumatology and Clinical Immunology, Chinese Academy of Medical Sciences & Peking Union Medical College, National Clinical Research Center for Dermatologic and Immunologic Diseases (NCRC‐DID), Ministry of Science & Technology, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital (PUMCH), Key Laboratory of Rheumatology and Clinical ImmunologyMinistry of EducationBeijingChina
| | - Mengtao Li
- Department of Rheumatology and Clinical Immunology, Chinese Academy of Medical Sciences & Peking Union Medical College, National Clinical Research Center for Dermatologic and Immunologic Diseases (NCRC‐DID), Ministry of Science & Technology, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital (PUMCH), Key Laboratory of Rheumatology and Clinical ImmunologyMinistry of EducationBeijingChina
| | - Valentina Mercurio
- Department of Translational Medical SciencesFederico II UniversityNaplesItaly
| | - Jason G. E. Zelt
- Department of Medicine, Faculty of MedicineUniversity of OttawaOttawaCanada
| | - Victor M. Moles
- Division of Cardiovascular MedicineUniversity of MichiganAnn ArborMichiganUSA
| | - Meghan M. Cirulis
- Division of Pulmonary and Critical Care MedicineUniversity of UtahSalt Lake CityUtahUSA
- Department of Pulmonary and Critical Care MedicineIntermountain Medical Center MurraySalt Lake CityUtahUSA
| | | | - Raymond L. Benza
- Mount Sinai HeartIcahn School of Medicine at Mount SinaiNew YorkNew YorkUSA
| | - C. Gregory Elliott
- Division of Pulmonary and Critical Care MedicineUniversity of UtahSalt Lake CityUtahUSA
- Department of Pulmonary and Critical Care MedicineIntermountain Medical Center MurraySalt Lake CityUtahUSA
| |
Collapse
|
5
|
Botsis T, Kreimeyer K. Improving drug safety with adverse event detection using natural language processing. Expert Opin Drug Saf 2023; 22:659-668. [PMID: 37339273 DOI: 10.1080/14740338.2023.2228197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Accepted: 06/19/2023] [Indexed: 06/22/2023]
Abstract
INTRODUCTION Pharmacovigilance (PV) involves monitoring and aggregating adverse event information from a variety of data sources, including health records, biomedical literature, spontaneous adverse event reports, product labels, and patient-generated content like social media posts, but the most pertinent details in these sources are typically available in narrative free-text formats. Natural language processing (NLP) techniques can be used to extract clinically relevant information from PV texts to inform decision-making. AREAS COVERED We conducted a non-systematic literature review by querying the PubMed database to examine the uses of NLP in drug safety and distilled the findings to present our expert opinion on the topic. EXPERT OPINION New NLP techniques and approaches continue to be applied for drug safety use cases; however, systems that are fully deployed and in use in a clinical environment remain vanishingly rare. To see high-performing NLP techniques implemented in the real setting will require long-term engagement with end users and other stakeholders and revised workflows in fully formulated business plans for the targeted use cases. Additionally, we found little to no evidence of extracted information placed into standardized data models, which should be a way to make implementations more portable and adaptable.
Collapse
Affiliation(s)
- Taxiarchis Botsis
- Department of Oncology, the Sidney Kimmel Comprehensive Cancer Center, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Kory Kreimeyer
- Department of Oncology, the Sidney Kimmel Comprehensive Cancer Center, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| |
Collapse
|
6
|
Aronson JK. Artificial Intelligence in Pharmacovigilance: An Introduction to Terms, Concepts, Applications, and Limitations. Drug Saf 2022; 45:407-418. [PMID: 35579806 DOI: 10.1007/s40264-022-01156-5] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/10/2022] [Indexed: 01/29/2023]
Abstract
The tools of artificial intelligence (AI) have enormous potential to enhance activities in pharmacovigilance. Pharmacovigilance experts need not be AI experts, but they should know enough about AI to explore the possibilities of collaboration with those who are. Modern concepts of AI date from Alan Turing's work, especially his paper on "the imitation game", in the late 1940s and early 1950s. Its scope today includes computational skills, including the formulation of mathematical proofs; visual perception, including facial recognition and virtual reality; decision making by expert systems; aspects of language, such as language processing, speech recognition, creative composition, and translation; and combinations of these, e.g. in self-driving vehicles. Machines can be programmed with the ability to learn, using neural networks that mimic cognitive actions of the human brain, leading to deep structural learning. Limitations of AI include difficulties with language, arising from the need to understand context and interpret ambiguities, which particularly affect translation, and inadequacies of databases, requiring careful preparation and curation. New techniques may cause unforeseen difficulties via unexpected malfunctioning. Relevant terms and concepts include different types of machine learning, neural networks, natural language programming, ontologies, and expert systems. Adoption of the tools of AI in pharmacovigilance has been slow. Machine learning, in conjunction with natural language processing and data mining, to study adverse drug reactions in databases such as those found in electronic health records, claims databases, and social media, has the potential to enhance the characterization of known adverse effects and reactions and detect new signals.
Collapse
Affiliation(s)
- Jeffrey K Aronson
- Centre for Evidence-Based Medicine, Nuffield Department of Primary Care Health Sciences, Oxford, UK.
| |
Collapse
|
7
|
Daniel C, Bellamine A, Kalra D. Key Contributions in Clinical Research Informatics. Yearb Med Inform 2021; 30:233-238. [PMID: 34479395 PMCID: PMC8416193 DOI: 10.1055/s-0041-1726514] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
Objectives:
To summarize key contributions to current research in the field of Clinical Research Informatics (CRI) and to select best papers published in 2020.
Method:
A bibliographic search using a combination of Medical Subject Headings (MeSH) descriptors and free-text terms on CRI was performed using PubMed, followed by a double-blind review in order to select a list of candidate best papers to be then peer-reviewed by external reviewers. After peer-review ranking, a consensus meeting between two section editors and the editorial team was organized to finally conclude on the selected four best papers.
Results:
Among the 877 papers published in 2020 and returned by the search, there were four best papers selected. The first best paper describes a method for mining temporal sequences from clinical documents to infer disease trajectories and enhancing high-throughput phenotyping. The authors of the second best paper demonstrate that the generation of synthetic Electronic Health Record (EHR) data through Generative Adversarial Networks (GANs) could be substantially improved by more appropriate training and evaluation criteria. The third best paper offers an efficient advance on methods to detect adverse drug events by computer-assisting expert reviewers with annotated candidate mentions in clinical documents. The large-scale data quality assessment study reported by the fourth best paper has clinical research informatics implications, in terms of the trustworthiness of inferences made from analysing electronic health records.
Conclusions:
The most significant research efforts in the CRI field are currently focusing on data science with active research in the development and evaluation of Artificial Intelligence/Machine Learning (AI/ML) algorithms based on ever more intensive use of real-world data and especially EHR real or synthetic data. A major lesson that the coronavirus disease 2019 (COVID-19) pandemic has already taught the scientific CRI community is that timely international high-quality data-sharing and collaborative data analysis is absolutely vital to inform policy decisions.
Collapse
Affiliation(s)
- Christel Daniel
- Information Technology Department, AP-HP, F-75012 Paris, France.,Sorbonne University, University Paris 13, Sorbonne Paris Cité, INSERM UMR_S 1142, LIMICS, F-75006 Paris, France
| | - Ali Bellamine
- Information Technology Department, AP-HP, F-75012 Paris, France
| | | | | |
Collapse
|