1
|
Hatef E, Chang HY, Richards TM, Kitchen C, Budaraju J, Foroughmand I, Lasser EC, Weiner JP. Development of a Social Risk Score in the Electronic Health Record to Identify Social Needs Among Underserved Populations: Retrospective Study. JMIR Form Res 2024; 8:e54732. [PMID: 38470477 DOI: 10.2196/54732] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 02/02/2024] [Accepted: 02/08/2024] [Indexed: 03/13/2024] Open
Abstract
BACKGROUND Patients with unmet social needs and social determinants of health (SDOH) challenges continue to face a disproportionate risk of increased prevalence of disease, health care use, higher health care costs, and worse outcomes. Some existing predictive models have used the available data on social needs and SDOH challenges to predict health-related social needs or the need for various social service referrals. Despite these one-off efforts, the work to date suggests that many technical and organizational challenges must be surmounted before SDOH-integrated solutions can be implemented on an ongoing, wide-scale basis within most US-based health care organizations. OBJECTIVE We aimed to retrieve available information in the electronic health record (EHR) relevant to the identification of persons with social needs and to develop a social risk score for use within clinical practice to better identify patients at risk of having future social needs. METHODS We conducted a retrospective study using EHR data (2016-2021) and data from the US Census American Community Survey. We developed a prospective model using current year-1 risk factors to predict future year-2 outcomes within four 2-year cohorts. Predictors of interest included demographics, previous health care use, comorbidity, previously identified social needs, and neighborhood characteristics as reflected by the area deprivation index. The outcome variable was a binary indicator reflecting the likelihood of the presence of a patient with social needs. We applied a generalized estimating equation approach, adjusting for patient-level risk factors, the possible effect of geographically clustered data, and the effect of multiple visits for each patient. RESULTS The study population of 1,852,228 patients included middle-aged (mean age range 53.76-55.95 years), White (range 324,279/510,770, 63.49% to 290,688/488,666, 64.79%), and female (range 314,741/510,770, 61.62% to 278,488/448,666, 62.07%) patients from neighborhoods with high socioeconomic status (mean area deprivation index percentile range 28.76-30.31). Between 8.28% (37,137/448,666) and 11.55% (52,037/450,426) of patients across the study cohorts had at least 1 social need documented in their EHR, with safety issues and economic challenges (ie, financial resource strain, employment, and food insecurity) being the most common documented social needs (87,152/1,852,228, 4.71% and 58,242/1,852,228, 3.14% of overall patients, respectively). The model had an area under the curve of 0.702 (95% CI 0.699-0.705) in predicting prospective social needs in the overall study population. Previous social needs (odds ratio 3.285, 95% CI 3.237-3.335) and emergency department visits (odds ratio 1.659, 95% CI 1.634-1.684) were the strongest predictors of future social needs. CONCLUSIONS Our model provides an opportunity to make use of available EHR data to help identify patients with high social needs. Our proposed social risk score could help identify the subset of patients who would most benefit from further social needs screening and data collection to avoid potentially more burdensome primary data collection on all patients in a target population of interest.
Collapse
Affiliation(s)
- Elham Hatef
- Division of General Internal Medicine, Department of Medicine, Johns Hopkins School of Medicine, Baltimore, MD, United States
- Center for Population Health Information Technology, Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | - Hsien-Yen Chang
- Center for Population Health Information Technology, Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | - Thomas M Richards
- Center for Population Health Information Technology, Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | - Christopher Kitchen
- Center for Population Health Information Technology, Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | - Janya Budaraju
- Center for Population Health Information Technology, Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | - Iman Foroughmand
- Center for Population Health Information Technology, Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | - Elyse C Lasser
- Center for Population Health Information Technology, Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | - Jonathan P Weiner
- Center for Population Health Information Technology, Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| |
Collapse
|
2
|
Novick TK, King B. Addressing Housing Issues Among People With Kidney Disease: Importance, Challenges, and Recommendations. Am J Kidney Dis 2024:S0272-6386(24)00631-0. [PMID: 38458376 DOI: 10.1053/j.ajkd.2024.01.521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Revised: 01/08/2024] [Accepted: 01/12/2024] [Indexed: 03/10/2024]
Abstract
Kidney disease disproportionately impacts people with low socioeconomic status, and low socioeconomic status is associated with worse outcomes for people with kidney disease. Unstable housing, which includes housing insecurity and homelessness, is increasing due to rising housing costs. There is mounting evidence that unstable housing and other health-related social needs are partially driving worse outcomes for people with low socioeconomic status. In this perspective, we consider the challenges to addressing housing for people with kidney disease, such as difficulty with identification of those with unstable housing, strict eligibility criteria for housing support, inadequate supply of affordable housing, and flaws in communities' prioritization of affordable housing. We discuss ways to tailor management for people experiencing unstable housing with kidney disease, and the importance of addressing safety, trauma, and emotional concerns as a part of care. We identify opportunities for the nephrology community to surmount challenges through increased screening, investment in workforce dedicated to community resource navigation, advocacy for investment in affordable housing, restructuring of communities' prioritization of affordable housing, and conducting needed research. Identifying and addressing housing needs among people with kidney disease is critical to eliminating kidney health disparities.
Collapse
Affiliation(s)
- Tessa K Novick
- Division of Nephrology, Department of Internal Medicine, Dell Medical School, University of Texas at Austin, Austin.
| | - Ben King
- Tilman J. Fertitta Family College of Medicine, University of Houston, Houston, Texas
| |
Collapse
|
3
|
Li C, Mowery DL, Ma X, Yang R, Vurgun U, Hwang S, Donnelly HK, Bandhey H, Akhtar Z, Senathirajah Y, Sadhu EM, Getzen E, Freda PJ, Long Q, Becich MJ. Realizing the Potential of Social Determinants Data: A Scoping Review of Approaches for Screening, Linkage, Extraction, Analysis and Interventions. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.02.04.24302242. [PMID: 38370703 PMCID: PMC10871446 DOI: 10.1101/2024.02.04.24302242] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
Background Social determinants of health (SDoH) like socioeconomics and neighborhoods strongly influence outcomes, yet standardized SDoH data is lacking in electronic health records (EHR), limiting research and care quality. Methods We searched PubMed using keywords "SDOH" and "EHR", underwent title/abstract and full-text screening. Included records were analyzed under five domains: 1) SDoH screening and assessment approaches, 2) SDoH data collection and documentation, 3) Use of natural language processing (NLP) for extracting SDoH, 4) SDoH data and health outcomes, and 5) SDoH-driven interventions. Results We identified 685 articles, of which 324 underwent full review. Key findings include tailored screening instruments implemented across settings, census and claims data linkage providing contextual SDoH profiles, rule-based and neural network systems extracting SDoH from notes using NLP, connections found between SDoH data and healthcare utilization/chronic disease control, and integrated care management programs executed. However, considerable variability persists across data sources, tools, and outcomes. Discussion Despite progress identifying patient social needs, further development of standards, predictive models, and coordinated interventions is critical to fulfill the potential of SDoH-EHR integration. Additional database searches could strengthen this scoping review. Ultimately widespread capture, analysis, and translation of multidimensional SDoH data into clinical care is essential for promoting health equity.
Collapse
Affiliation(s)
- Chenyu Li
- University of Pittsburgh School of Medicine Department of Biomedical Informatics
| | - Danielle L. Mowery
- University of Pennsylvania, Institute for Biomedical Informatics
- University of Pennsylvania, Department of Biostatistics, Epidemiology and Informatics
| | - Xiaomeng Ma
- University of Toronto, Institute of Health Policy Management and Evaluations
| | - Rui Yang
- Duke-NUS Medical School, Centre for Quantitative Medicine
| | - Ugurcan Vurgun
- University of Pennsylvania, Institute for Biomedical Informatics
| | - Sy Hwang
- University of Pennsylvania, Institute for Biomedical Informatics
| | | | - Harsh Bandhey
- Cedars-Sinai Medical Center, Department of Computational Biomedicine
| | - Zohaib Akhtar
- Northwestern University, Kellogg School of Management
| | - Yalini Senathirajah
- University of Pittsburgh School of Medicine Department of Biomedical Informatics
| | - Eugene Mathew Sadhu
- University of Pittsburgh School of Medicine Department of Biomedical Informatics
| | - Emily Getzen
- University of Pennsylvania, Department of Biostatistics, Epidemiology and Informatics
| | - Philip J Freda
- Cedars-Sinai Medical Center, Department of Computational Biomedicine
| | - Qi Long
- University of Pennsylvania, Institute for Biomedical Informatics
- University of Pennsylvania, Department of Biostatistics, Epidemiology and Informatics
| | - Michael J. Becich
- University of Pittsburgh School of Medicine Department of Biomedical Informatics
| |
Collapse
|
4
|
Chapman AB, Scharfstein D, Byrne TH, Montgomery AE, Suo Y, Effiong A, Velasquez T, Pettey W, Dalrymple R, Tsai J, Nelson RE. Temporary Financial Assistance Reduced The Probability Of Unstable Housing Among Veterans For More Than 1 Year. Health Aff (Millwood) 2024; 43:250-259. [PMID: 38315929 DOI: 10.1377/hlthaff.2023.00730] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2024]
Abstract
The Department of Veterans Affairs (VA) aims to reduce homelessness among veterans through programs such as Supportive Services for Veteran Families (SSVF). An important component of SSVF is temporary financial assistance. Previous research has demonstrated the effectiveness of temporary financial assistance in reducing short-term housing instability, but studies have not examined its long-term effect on housing outcomes. Using data from the VA's electronic health record system, we analyzed the effect of temporary financial assistance on veterans' housing instability for three years after entry into SSVF. We extracted housing outcomes from clinical notes, using natural language processing, and compared the probability of unstable housing among veterans who did and did not receive temporary financial assistance. We found that temporary financial assistance rapidly reduced the probability of unstable housing, but the effect attenuated after forty-five days. Our findings suggest that to maintain long-term housing stability for veterans who have exited SSVF, additional interventions may be needed.
Collapse
Affiliation(s)
- Alec B Chapman
- Alec B. Chapman , University of Utah, Salt Lake City, Utah
| | | | - Thomas H Byrne
- Thomas H. Byrne, Bedford Veterans Affairs (VA) Medical Center and Boston University, Bedford, Massachusetts
| | - Ann Elizabeth Montgomery
- Ann Elizabeth Montgomery, Birmingham VA Medical Center and University of Alabama at Birmingham, Birmingham, Alabama
| | | | | | | | | | | | - Jack Tsai
- Jack Tsai, Department of Veterans Affairs, Washington, D.C
| | - Richard E Nelson
- Richard E. Nelson, VA Salt Lake City and University of Utah, Salt Lake City, Utah
| |
Collapse
|
5
|
Chapman AB, Scharfstein DO, Montgomery AE, Byrne T, Suo Y, Effiong A, Velasquez T, Pettey W, Nelson RE. Using natural language processing to study homelessness longitudinally with electronic health record data subject to irregular observations. AMIA ... ANNUAL SYMPOSIUM PROCEEDINGS. AMIA SYMPOSIUM 2024; 2023:894-903. [PMID: 38222404 PMCID: PMC10785905] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 01/16/2024]
Abstract
The Electronic Health Record (EHR) contains information about social determinants of health (SDoH) such as homelessness. Much of this information is contained in clinical notes and can be extracted using natural language processing (NLP). This data can provide valuable information for researchers and policymakers studying long-term housing outcomes for individuals with a history of homelessness. However, studying homelessness longitudinally in the EHR is challenging due to irregular observation times. In this work, we applied an NLP system to extract housing status for a cohort of patients in the US Department of Veterans Affairs (VA) over a three-year period. We then applied inverse intensity weighting to adjust for the irregularity of observations, which was used generalized estimating equations to estimate the probability of unstable housing each day after entering a VA housing assistance program. Our methods generate unique insights into the long-term outcomes of individuals with a history of homelessness and demonstrate the potential for using EHR data for research and policymaking.
Collapse
Affiliation(s)
- Alec B Chapman
- IDEAS Center, Veterans Affairs Salt Lake City Health Care System, Salt Lake City, UT
- Department of Population Health Sciences, University of Utah School of Medicine, Salt Lake City, UT
| | - Daniel O Scharfstein
- Department of Population Health Sciences, University of Utah School of Medicine, Salt Lake City, UT
| | | | - Thomas Byrne
- National Center on Homelessness among Veterans
- School of Social Work, Boston University, Boston, MA
- Center for Healthcare Organization and Implementation Research, Bedford VA Medical Center, Bedford, MA
| | - Ying Suo
- IDEAS Center, Veterans Affairs Salt Lake City Health Care System, Salt Lake City, UT
- Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, UT
| | - Atim Effiong
- IDEAS Center, Veterans Affairs Salt Lake City Health Care System, Salt Lake City, UT
- Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, UT
| | - Tania Velasquez
- IDEAS Center, Veterans Affairs Salt Lake City Health Care System, Salt Lake City, UT
- Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, UT
| | - Warren Pettey
- Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, UT
| | - Richard E Nelson
- IDEAS Center, Veterans Affairs Salt Lake City Health Care System, Salt Lake City, UT
- Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, UT
- National Center on Homelessness among Veterans
| |
Collapse
|
6
|
Espinoza JC, Sehgal S, Phuong J, Bahroos N, Starren J, Wilcox A, Meeker D. Development of a social and environmental determinants of health informatics maturity model. J Clin Transl Sci 2023; 7:e266. [PMID: 38380394 PMCID: PMC10877515 DOI: 10.1017/cts.2023.691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 11/04/2023] [Accepted: 11/29/2023] [Indexed: 02/22/2024] Open
Abstract
Introduction Integrating social and environmental determinants of health (SEDoH) into enterprise-wide clinical workflows and decision-making is one of the most important and challenging aspects of improving health equity. We engaged domain experts to develop a SEDoH informatics maturity model (SIMM) to help guide organizations to address technical, operational, and policy gaps. Methods We established a core expert group consisting of developers, informaticists, and subject matter experts to identify different SIMM domains and define maturity levels. The candidate model (v0.9) was evaluated by 15 informaticists at a Center for Data to Health community meeting. After incorporating feedback, a second evaluation round for v1.0 collected feedback and self-assessments from 35 respondents from the National COVID Cohort Collaborative, the Center for Leading Innovation and Collaboration's Informatics Enterprise Committee, and a publicly available online self-assessment tool. Results We developed a SIMM comprising seven maturity levels across five domains: data collection policies, data collection methods and technologies, technology platforms for analysis and visualization, analytics capacity, and operational and strategic impact. The evaluation demonstrated relatively high maturity in analytics and technological capacity, but more moderate maturity in operational and strategic impact among academic medical centers. Changes made to the tool in between rounds improved its ability to discriminate between intermediate maturity levels. Conclusion The SIMM can help organizations identify current gaps and next steps in improving SEDoH informatics. Improving the collection and use of SEDoH data is one important component of addressing health inequities.
Collapse
Affiliation(s)
- Juan C. Espinoza
- Stanley Manne Children’s Research Institute, Ann & Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL, USA
- Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Shruti Sehgal
- Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Jimmy Phuong
- Division of Biomedical and Health Informatics, University of Washington, Seattle, WA, USA
- Harborview Injury Prevention Research Center, University of Washington, Seattle, WA, USA
| | - Neil Bahroos
- University of Southern California Keck School of Medicine, Los Angeles, CA, USA
| | - Justin Starren
- Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Adam Wilcox
- Institute for Informatics, Department of Medicine, Washington University in St. Louis, St. Louis, MO, USA
| | - Daniella Meeker
- Department of Biomedical Informatics & Data Science, Yale University School of Medicine, New Haven, CT, USA
| |
Collapse
|
7
|
Xie F, Wang S, Viveros L, Rich A, Nguyen HQ, Padilla A, Lyons L, Nau CL. Using natural language processing to identify the status of homelessness and housing instability among serious illness patients from clinical notes in an integrated healthcare system. JAMIA Open 2023; 6:ooad082. [PMID: 37744213 PMCID: PMC10517738 DOI: 10.1093/jamiaopen/ooad082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Revised: 08/28/2023] [Accepted: 09/06/2023] [Indexed: 09/26/2023] Open
Abstract
Background Efficiently identifying the social risks of patients with serious illnesses (SIs) is the critical first step in providing patient-centered and value-driven care for this medically vulnerable population. Objective To apply and further hone an existing natural language process (NLP) algorithm that identifies patients who are homeless/at risk of homeless to a SI population. Methods Patients diagnosed with SI between 2019 and 2020 were identified using an adapted list of diagnosis codes from the Center for Advance Palliative Care from the Kaiser Permanente Southern California electronic health record. Clinical notes associated with medical encounters within 6 months before and after the diagnosis date were processed by a previously developed NLP algorithm to identify patients who were homeless/at risk of homelessness. To improve the generalizability to the SI population, the algorithm was refined by multiple iterations of chart review and adjudication. The updated algorithm was then applied to the SI population. Results Among 206 993 patients with a SI diagnosis, 1737 (0.84%) were identified as homeless/at risk of homelessness. These patients were more likely to be male (51.1%), age among 45-64 years (44.7%), and have one or more emergency visit (65.8%) within a year of their diagnosis date. Validation of the updated algorithm yielded a sensitivity of 100.0% and a positive predictive value of 93.8%. Conclusions The improved NLP algorithm effectively identified patients with SI who were homeless/at risk of homelessness and can be used to target interventions for this vulnerable group.
Collapse
Affiliation(s)
- Fagen Xie
- Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA 91101, United States
| | - Susan Wang
- Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA 91101, United States
| | - Lori Viveros
- Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA 91101, United States
| | - Allegra Rich
- Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA 91101, United States
| | - Huong Q Nguyen
- Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA 91101, United States
| | - Ariadna Padilla
- Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA 91101, United States
| | - Lindsey Lyons
- Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA 91101, United States
| | - Claudia L Nau
- Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA 91101, United States
| |
Collapse
|
8
|
Magoc T, Allen KS, McDonnell C, Russo JP, Cummins J, Vest JR, Harle CA. Generalizability and portability of natural language processing system to extract individual social risk factors. Int J Med Inform 2023; 177:105115. [PMID: 37302362 DOI: 10.1016/j.ijmedinf.2023.105115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2023] [Revised: 05/15/2023] [Accepted: 05/30/2023] [Indexed: 06/13/2023]
Abstract
OBJECTIVE The objective of this study is to validate and report on portability and generalizability of a Natural Language Processing (NLP) method to extract individual social factors from clinical notes, which was originally developed at a different institution. MATERIALS AND METHODS A rule-based deterministic state machine NLP model was developed to extract financial insecurity and housing instability using notes from one institution and was applied on all notes written during 6 months at another institution. 10% of positively-classified notes by NLP and the same number of negatively-classified notes were manually annotated. The NLP model was adjusted to accommodate notes at the new site. Accuracy, positive predictive value, sensitivity, and specificity were calculated. RESULTS More than 6 million notes were processed at the receiving site by the NLP model, which resulted in about 13,000 and 19,000 classified as positive for financial insecurity and housing instability, respectively. The NLP model showed excellent performance on the validation dataset with all measures over 0.87 for both social factors. DISCUSSION Our study illustrated the need to accommodate institution-specific note-writing templates as well as clinical terminology of emergent diseases when applying NLP model for social factors. A state machine is relatively simple to port effectively across institutions. Our study. showed superior performance to similar generalizability studies for extracting social factors. CONCLUSION Rule-based NLP model to extract social factors from clinical notes showed strong portability and generalizability across organizationally and geographically distinct institutions. With only relatively simple modifications, we obtained promising performance from an NLP-based model.
Collapse
Affiliation(s)
- Tanja Magoc
- College of Medicine, University of Florida, Gainesville, FL, USA.
| | - Katie S Allen
- Regenstrief Institute, Inc., Indianapolis, IN, USA; Richard M. Fairbanks School of Public Health, IUPUI, Indianapolis, IN, USA
| | - Cara McDonnell
- College of Medicine, University of Florida, Gainesville, FL, USA
| | - Jean-Paul Russo
- College of Medicine, University of Florida, Gainesville, FL, USA; Miller School of Medicine, University of Miami, Miami, FL, USA
| | | | - Joshua R Vest
- Regenstrief Institute, Inc., Indianapolis, IN, USA; Richard M. Fairbanks School of Public Health, IUPUI, Indianapolis, IN, USA
| | - Christopher A Harle
- Regenstrief Institute, Inc., Indianapolis, IN, USA; Richard M. Fairbanks School of Public Health, IUPUI, Indianapolis, IN, USA
| |
Collapse
|
9
|
Chapman AB, Cordasco K, Chassman S, Panadero T, Agans D, Jackson N, Clair K, Nelson R, Montgomery AE, Tsai J, Finley E, Gabrielian S. Assessing longitudinal housing status using Electronic Health Record data: a comparison of natural language processing, structured data, and patient-reported history. Front Artif Intell 2023; 6:1187501. [PMID: 37293237 PMCID: PMC10244644 DOI: 10.3389/frai.2023.1187501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2023] [Accepted: 05/05/2023] [Indexed: 06/10/2023] Open
Abstract
Introduction Measuring long-term housing outcomes is important for evaluating the impacts of services for individuals with homeless experience. However, assessing long-term housing status using traditional methods is challenging. The Veterans Affairs (VA) Electronic Health Record (EHR) provides detailed data for a large population of patients with homeless experiences and contains several indicators of housing instability, including structured data elements (e.g., diagnosis codes) and free-text clinical narratives. However, the validity of each of these data elements for measuring housing stability over time is not well-studied. Methods We compared VA EHR indicators of housing instability, including information extracted from clinical notes using natural language processing (NLP), with patient-reported housing outcomes in a cohort of homeless-experienced Veterans. Results NLP achieved higher sensitivity and specificity than standard diagnosis codes for detecting episodes of unstable housing. Other structured data elements in the VA EHR showed promising performance, particularly when combined with NLP. Discussion Evaluation efforts and research studies assessing longitudinal housing outcomes should incorporate multiple data sources of documentation to achieve optimal performance.
Collapse
Affiliation(s)
- Alec B. Chapman
- Informatics, Decision-Enhancement and Analytic Sciences (IDEAS) Center, Salt Lake City Veterans Affairs Healthcare System, Salt Lake City, UT, United States
- Division of Epidemiology, University of Utah, School of Medicine, Salt Lake City, UT, United States
| | - Kristina Cordasco
- Center for the Study of Healthcare Innovation, Implementation and Policy (CSHIIP), Greater Los Angeles Veterans Affairs Healthcare System, Los Angeles, CA, United States
- Department of Medicine, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, United States
| | - Stephanie Chassman
- Center for the Study of Healthcare Innovation, Implementation and Policy (CSHIIP), Greater Los Angeles Veterans Affairs Healthcare System, Los Angeles, CA, United States
- Desert Pacific Mental Illness Research, Education, and Clinical Center (MIRECC), Veterans Affairs Greater Los Angeles, Los Angeles, CA, United States
| | - Talia Panadero
- Center for the Study of Healthcare Innovation, Implementation and Policy (CSHIIP), Greater Los Angeles Veterans Affairs Healthcare System, Los Angeles, CA, United States
- Department of Epidemiology, Fielding School of Public Health, University of California, Los Angeles, Los Angeles, CA, United States
| | - Dylan Agans
- Center for the Study of Healthcare Innovation, Implementation and Policy (CSHIIP), Greater Los Angeles Veterans Affairs Healthcare System, Los Angeles, CA, United States
- Department of Community Health Sciences, Fielding School of Public Health, University of California, Los Angeles, Los Angeles, CA, United States
| | - Nicholas Jackson
- Center for the Study of Healthcare Innovation, Implementation and Policy (CSHIIP), Greater Los Angeles Veterans Affairs Healthcare System, Los Angeles, CA, United States
- Department of Medicine Statistics Core, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, United States
| | - Kimberly Clair
- Center for the Study of Healthcare Innovation, Implementation and Policy (CSHIIP), Greater Los Angeles Veterans Affairs Healthcare System, Los Angeles, CA, United States
| | - Richard Nelson
- Informatics, Decision-Enhancement and Analytic Sciences (IDEAS) Center, Salt Lake City Veterans Affairs Healthcare System, Salt Lake City, UT, United States
- Division of Epidemiology, University of Utah, School of Medicine, Salt Lake City, UT, United States
| | - Ann Elizabeth Montgomery
- United States Department of Veteran Affairs, Birmingham Veterans Affairs Health Care System, Birmingham, AL, United States
- School of Public Health, University of Alabama at Birmingham, Birmingham, AL, United States
| | - Jack Tsai
- National Homeless Programs Office, United States Department of Veterans Affairs, Washington, DC, United States
| | - Erin Finley
- United States Department of Veteran Affairs, Birmingham Veterans Affairs Health Care System, Birmingham, AL, United States
| | - Sonya Gabrielian
- Center for the Study of Healthcare Innovation, Implementation and Policy (CSHIIP), Greater Los Angeles Veterans Affairs Healthcare System, Los Angeles, CA, United States
- Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, United States
| |
Collapse
|
10
|
Tsai J, Szymkowiak D, Jutkowitz E. Developing an operational definition of housing instability and homelessness in Veterans Health Administration's medical records. PLoS One 2022; 17:e0279973. [PMID: 36584201 PMCID: PMC9803152 DOI: 10.1371/journal.pone.0279973] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2022] [Accepted: 12/19/2022] [Indexed: 01/01/2023] Open
Abstract
The main objective of this study was to examine how homelessness and housing instability is captured across data sources in the Veterans Health Administration (VHA). Data from 2021 were extracted from three data repositories, including the Corporate Data Warehouse (CDW), the Homeless Operations Management System (HOMES), and the Homeless Management Information System (HMIS). Using these three data sources, we identified the number of homeless and unstably housed veterans across a variety of indicators. The results showed that the use of diagnostic codes and clinic stop codes identified a large number of homeless and unstably housed veterans, but the use of HOMES and HMIS data identified additional homeless and unstably housed veterans to provide a complete count. A total of 290,431 unique veterans were identified as experiencing homelessness or housing instability in 2021 and there was regional variability in how homelessness and housing stability were captured across data sources, supporting the need for more uniform ways to operationalize these conditions. Together, these findings highlight the and encourage use of all available indicators and data sources to identify homelessness and housing instability in VHA. These methodologies applied to the largest healthcare system in the U.S. demonstrate their utility and possibilities for other healthcare systems. Transparent practices about data sources and indicators used to capture homelessness and housing instability should be shared to increase uniform use.
Collapse
Affiliation(s)
- Jack Tsai
- VA National Center on Homelessness among Veterans, Tampa, FL, United States of America
- School of Public Health, University of Texas Health Science Center at Houston, Houston, TX, United States of America
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT, United States of America
- * E-mail:
| | - Dorota Szymkowiak
- VA National Center on Homelessness among Veterans, Tampa, FL, United States of America
| | - Eric Jutkowitz
- VA National Center on Homelessness among Veterans, Tampa, FL, United States of America
- Center of Innovation in Long Term Services and Supports, Providence VA Medical Center, Providence, RI, United States of America
- Department of Health Services, Policy & Practice, Brown University School of Public Health, Providence, RI, United States of America
| |
Collapse
|
11
|
Chapman AB, Peterson KS, Rutter E, Nevers M, Zhang M, Ying J, Jones M, Classen D, Jones B. Development and evaluation of an interoperable natural language processing system for identifying pneumonia across clinical settings of care and institutions. JAMIA Open 2022; 5:ooac114. [PMID: 36601365 PMCID: PMC9801965 DOI: 10.1093/jamiaopen/ooac114] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 11/26/2022] [Accepted: 12/22/2022] [Indexed: 12/31/2022] Open
Abstract
Objective To evaluate the feasibility, accuracy, and interoperability of a natural language processing (NLP) system that extracts diagnostic assertions of pneumonia in different clinical notes and institutions. Materials and Methods A rule-based NLP system was designed to identify assertions of pneumonia in 3 types of clinical notes from electronic health records (EHRs): emergency department notes, radiology reports, and discharge summaries. The lexicon and classification logic were tailored for each note type. The system was first developed and evaluated using annotated notes from the Department of Veterans Affairs (VA). Interoperability was assessed using data from the University of Utah (UU). Results The NLP system was comprised of 782 rules and achieved moderate-to-high performance in all 3 note types in VA (precision/recall/f1: emergency = 88.1/86.0/87.1; radiology = 71.4/96.2/82.0; discharge = 88.3/93.0/90.1). When applied to UU data, performance was maintained in emergency and radiology but decreased in discharge summaries (emergency = 84.7/94.3/89.3; radiology = 79.7/100.0/87.9; discharge = 65.5/92.7/76.8). Customization with 34 additional rules increased performance for all note types (emergency = 89.3/94.3/91.7; radiology = 87.0/100.0/93.1; discharge = 75.0/95.1/83.4). Conclusion NLP can be used to accurately identify the diagnosis of pneumonia across different clinical settings and institutions. A limited amount of customization to account for differences in lexicon, clinical definition of pneumonia, and EHR structure can achieve high accuracy without substantial modification.
Collapse
Affiliation(s)
- Alec B Chapman
- Informatics, Decision-Enhancement and Analytic Sciences (IDEAS) Center, Veterans Affairs (VA) Salt Lake City Health Care System, Salt Lake City, Utah, USA,Division of Epidemiology, University of Utah School of Medicine, Salt Lake City, Utah, USA,Department of Population Health Sciences, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Kelly S Peterson
- Informatics, Decision-Enhancement and Analytic Sciences (IDEAS) Center, Veterans Affairs (VA) Salt Lake City Health Care System, Salt Lake City, Utah, USA,Division of Epidemiology, University of Utah School of Medicine, Salt Lake City, Utah, USA,Veterans Health Administration Office of Analytics and Performance Integration, Washington, District of Columbia, USA
| | - Elizabeth Rutter
- George E. Wahlen Veterans Affairs (VA) Medical Center, Salt Lake City, Utah, USA,Emergency Physicians Integrated Care (EPIC, LLC), Salt Lake City, Utah, USA
| | - Mckenna Nevers
- Division of Epidemiology, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Mingyuan Zhang
- Department of Population Health Sciences, University of Utah School of Medicine, Salt Lake City, Utah, USA,Data Science Service, University of Utah, Salt Lake City, Utah, USA
| | - Jian Ying
- Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Makoto Jones
- Informatics, Decision-Enhancement and Analytic Sciences (IDEAS) Center, Veterans Affairs (VA) Salt Lake City Health Care System, Salt Lake City, Utah, USA,Division of Epidemiology, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - David Classen
- Division of Epidemiology, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Barbara Jones
- Corresponding Author: Barbara Jones, MD, MS, Division of Pulmonary & Critical Care Medicine, University of Utah School of Medicine, 295 Chipeta Way, Salt Lake City, UT 84108, USA;
| |
Collapse
|
12
|
Delcher C, Harris DR, Anthony N, Stoops WW, Thompson K, Quesinberry D. Substance use disorders and social determinants of health from electronic medical records obtained during Kentucky's "triple wave". Pharmacol Biochem Behav 2022; 221:173495. [PMID: 36427682 PMCID: PMC10082996 DOI: 10.1016/j.pbb.2022.173495] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Revised: 10/15/2022] [Accepted: 11/15/2022] [Indexed: 11/23/2022]
Abstract
Social determinants of health (SDOH) play a critical role in the risk of harmful drug use. Examining SDOH as a means of differentiating populations with multiple co-occurring substance use disorders (SUDs) is particularly salient in the era of prevalent opioid and stimulant use known as the "Third Wave". This study uses electronic medical records (EMRs) from a safety net hospital system from 14,032 patients in Kentucky from 2017 to 2019 in order to 1) define three types of SUD cohorts with shared/unique risk factors, 2) identify patients with unstable housing using novel methods for EMRs and 3) link patients to their residential neighborhood to obtain quantitative perspective on social vulnerability. We identified patients in three cohorts with statistically significant unique risk factors that included race, biological sex, insurance type, smoking status, and urban/rural residential location. Adjusting for these variables, we found a statistically significant, increasing risk gradient for patients experiencing unstable housing by cohort type: opioid-only (n = 7385, reference), stimulant-only (n = 4794, odds ratio (aOR) 1.86 95 % confidence interval (CI): 1.66-2.09), and co-diagnosed (n = 1853, aOR = 2.75, 95 % CI: 2.39 to 3.16). At the neighborhood-level, we used 8 different measures of social vulnerability and found that, for the most part, increasing proportions of patients with stimulant use living in a census tract was associated with more social vulnerability. Our study identifies potentially modifiable factors that can be tailored by substance type and demonstrates robust use of EMRs to meet national goals of enhancing research on social determinants of health.
Collapse
Affiliation(s)
- Chris Delcher
- Institute for Pharmaceutical Outcomes & Policy, Department of Pharmacy Practice and Science, College of Pharmacy, University of Kentucky, United States of America; Kentucky Injury Prevention and Research Center, University of Kentucky, United States of America.
| | - Daniel R Harris
- Institute for Pharmaceutical Outcomes & Policy, Department of Pharmacy Practice and Science, College of Pharmacy, University of Kentucky, United States of America; Kentucky Injury Prevention and Research Center, University of Kentucky, United States of America
| | - Nicholas Anthony
- Institute for Pharmaceutical Outcomes & Policy, Department of Pharmacy Practice and Science, College of Pharmacy, University of Kentucky, United States of America
| | - William W Stoops
- Departments of Behavioral Science and Psychiatry, College of Medicine, Department of Psychology, College of Arts & Sciences, University of Kentucky, United States of America
| | - Katherine Thompson
- Department of Statistics, College of Arts & Sciences, University of Kentucky, United States of America
| | - Dana Quesinberry
- Department of Health Management and Policy, College of Public Health, University of Kentucky, United States of America; Kentucky Injury Prevention and Research Center, University of Kentucky, United States of America
| |
Collapse
|