Improving reporting standards for phenotyping algorithm in biomedical research: 5 fundamental dimensions

Exploring beyond diagnoses in electronic health records to improve discovery: a review of the phenome-wide association study

Objective

The phenome-wide association study (PheWAS) systematically examines the phenotypic spectrum extracted from electronic health records (EHRs) to uncover correlations between phenotypes and exposures. This review explores methodologies, highlights challenges, and outlines future directions for EHR-driven PheWAS.

Materials and Methods

We searched the PubMed database for articles spanning from 2010 to 2023, and we collected data regarding exposures, phenotypes, cohorts, terminologies, replication, and ancestry.

Results

Our search yielded 690 articles. Following exclusion criteria, we identified 291 articles published between January 1, 2010, and December 31, 2023. A total number of 162 (55.6%) articles defined phenomes using phecodes, indicating that research is reliant on the organization of billing codes. Moreover, 72.8% of articles utilized exposures consisting of genetic data, and the majority (69.4%) of PheWAS lacked replication analyses.

Discussion

Existing literature underscores the need for deeper phenotyping, variability in PheWAS exposure variables, and absence of replication in PheWAS. Current applications of PheWAS mainly focus on cardiovascular, metabolic, and endocrine phenotypes; thus, applications of PheWAS in uncommon diseases, which may lack structured data, remain largely understudied.

Conclusions

With modern EHRs, future PheWAS should extend beyond diagnosis codes and consider additional data like clinical notes or medications to create comprehensive phenotype profiles that consider severity, temporality, risk, and ancestry. Furthermore, data interoperability initiatives may help mitigate the paucity of PheWAS replication analyses. With the growing availability of data in EHR, PheWAS will remain a powerful tool in precision medicine.

Validation of large language models for detecting pathologic complete response in breast cancer using population-based pathology reports

AIMS

The primary goal of this study is to evaluate the capabilities of Large Language Models (LLMs) in understanding and processing complex medical documentation. We chose to focus on the identification of pathologic complete response (pCR) in narrative pathology reports. This approach aims to contribute to the advancement of comprehensive reporting, health research, and public health surveillance, thereby enhancing patient care and breast cancer management strategies.

METHODS

The study utilized two analytical pipelines, developed with open-source LLMs within the healthcare system's computing environment. First, we extracted embeddings from pathology reports using 15 different transformer-based models and then employed logistic regression on these embeddings to classify the presence or absence of pCR. Secondly, we fine-tuned the Generative Pre-trained Transformer-2 (GPT-2) model by attaching a simple feed-forward neural network (FFNN) layer to improve the detection performance of pCR from pathology reports.

RESULTS

In a cohort of 351 female breast cancer patients who underwent neoadjuvant chemotherapy (NAC) and subsequent surgery between 2010 and 2017 in Calgary, the optimized method displayed a sensitivity of 95.3% (95%CI: 84.0-100.0%), a positive predictive value of 90.9% (95%CI: 76.5-100.0%), and an F1 score of 93.0% (95%CI: 83.7-100.0%). The results, achieved through diverse LLM integration, surpassed traditional machine learning models, underscoring the potential of LLMs in clinical pathology information extraction.

CONCLUSIONS

The study successfully demonstrates the efficacy of LLMs in interpreting and processing digital pathology data, particularly for determining pCR in breast cancer patients post-NAC. The superior performance of LLM-based pipelines over traditional models highlights their significant potential in extracting and analyzing key clinical data from narrative reports. While promising, these findings highlight the need for future external validation to confirm the reliability and broader applicability of these methods.

Quality of Reporting Electronic Health Record Data in Glaucoma: A Systematic Literature Review

TOPIC

Assessing reporting standards in glaucoma studies utilizing electronic health records (EHR).

CLINICAL RELEVANCE

Glaucoma's significance, underscored by its status as a leading cause of irreversible blindness worldwide, necessitates reliable research findings. This study evaluates adherence to the CODE-EHR best-practice framework in glaucoma studies using EHR, aiming to improve clinical care and patient outcomes.

METHODS

A systematic review, following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (PROSPERO CRD42023430025), identified relevant studies (January 2022-May 2023) in MEDLINE, EMBASE, CINAHL, and Web of Science. Eligible studies, using EHR data from clinical institutions for glaucoma research, were assessed for study design, participant characteristics, EHR data, and sources. Quality appraisal used the CODE-EHR best-practice framework, focusing on data construction, linkage, fitness for purpose, disease and outcome definitions, analysis, and ethics and governance.

RESULTS

Of 31 identified studies, predominant EHR sources were hospitals and clinical warehouses. Commonly reported elements included age, gender, glaucoma diagnosis, and intraocular pressure. Only 16% fully adhered to CODE-EHR best-practice framework's minimum standards, with none meeting preferred standards. While statistical analysis and ethical considerations were relatively well-addressed, areas such as EHR data management and study design showed room for improvement. Patient and public involvement, and acknowledgment of data linkage processes, data security, and storage reporting were often missed.

CONCLUSION

Adherence to CODE-EHR best-practice framework's standards in EHR-based studies of glaucoma can be improved upon. Standardized reporting of EHR data are essential to ensure the reliability of research, facilitating its translation into clinical practice and improving healthcare decision-making for better patient outcomes.

FINANCIAL DISCLOSURE(S)

Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.