Characterizing physician EHR use with vendor derived data: a feasibility study and cross-sectional analysis

Cumulated time to chart closure: a novel electronic health record-derived metric associated with clinician burnout

Objective

We sought to determine whether average cumulated time to chart closure (CTCC), a novel construct to measure clinician workload burden, and electronic health record (EHR) measures were associated with a validated measure of burnout.

Materials and methods

Physicians at a large academic institution participated in a well-being survey that was linked to their EHR use data. CTCC was defined as the average time from the start of patient encounters to chart closure over a set of encounters. Established EHR use measures including daily total time in the EHR (EHR-Time8), time in the EHR outside scheduled hours, work outside of work (WOW8), and time spent on inbox (IB-Time8) were calculated. We examined the relationship between CTCC, EHR use metrics, and burnout using descriptive statistics and adjusted logistic regression models.

Results

We included data from 305 attendings, encompassing 242 432 ambulatory encounters (2021). Among them, 42% (128 physicians) experienced burnout. The median CTCC for all clinicians was 32.5 h. Unadjusted analyses revealed significant associations between CTCC, WOW8, IB-Time8, and burnout. In a final adjusted model, only CTCC remained statistically significant with an odds ratio estimate of 1.42 (95% CI, 1.00-2.01).

Discussion

These results suggest that CTCC is predictive of burnout and that purely measuring duration of interaction with the EHR itself is not sufficient to capture burnout.

Conclusion

Workload burden as manifested by average CTCC has the potential to be a practical, quantifiable measure that will allow for identification of clinicians at risk of burnout and to assess the success of interventions designed to address burnout.

Quantifying EHR and Policy Factors Associated with the Gender Productivity Gap in Ambulatory, General Internal Medicine

BACKGROUND

The gender gap in physician compensation has persisted for decades. Little is known about how differences in use of the electronic health record (EHR) may contribute.

OBJECTIVE

To characterize how time on clinical activities, time on the EHR, and clinical productivity vary by physician gender and to identify factors associated with physician productivity.

DESIGN, SETTING, AND PARTICIPANTS

This longitudinal study included general internal medicine physicians employed by a large ambulatory practice network in the Northeastern United States from August 2018 to June 2021.

MAIN MEASURES

Monthly data on physician work relative value units (wRVUs), physician and practice characteristics, metrics of EHR use and note content, and temporal trend variables.

KEY RESULTS

The analysis included 3227 physician-months of data for 108 physicians (44% women). Compared with men physicians, women physicians generated 23.8% fewer wRVUs per month, completed 22.1% fewer visits per month, spent 4.0 more minutes/visit and 8.72 more minutes on the EHR per hour worked (all p < 0.001), and typed or dictated 36.4% more note characters per note (p = 0.006). With multivariable adjustment for physician age, practice characteristics, EHR use, and temporal trends, physician gender was no longer associated with productivity (men 4.20 vs. women 3.88 wRVUs/hour, p = 0.31). Typing/dictating fewer characters per note, relying on greater teamwork to manage orders, and spending less time on documentation were associated with higher wRVUs/hour. The 2021 E/M code change was associated with higher wRVUs/hour for all physicians: 10% higher for men physicians and 18% higher for women physicians (p < 0.001 and p = 0.009, respectively).

CONCLUSIONS

Increased team support, briefer documentation, and the 2021 E/M code change were associated with higher physician productivity. The E/M code change may have preferentially benefited women physicians by incentivizing time-intensive activities such as medical decision-making, preventive care discussion, and patient counseling that women physicians have historically spent more time performing.

Explaining Variability in Electronic Health Record Effort in Primary Care Ambulatory Encounters

BACKGROUND

 Electronic health record (EHR) user interface event logs are fast providing another perspective on the value and efficiency EHR technology brings to health care. Analysis of these detailed usage data has demonstrated their potential to identify EHR and clinical process design factors related to user efficiency, satisfaction, and burnout.

OBJECTIVE

 This study aimed to analyze the event log data across 26 different health systems to determine the variability of use of a single vendor's EHR based on four event log metrics, at the individual, practice group, and health system levels.

METHODS

 We obtained de-identified event log data recorded from June 1, 2018, to May 31, 2019, from 26 health systems' primary care physicians. We estimated the variability in total Active EHR Time, Documentation Time, Chart Review Time, and Ordering Time across health systems, practice groups, and individual physicians.

RESULTS

 In total, 5,444 physicians (Family Medicine: 3,042 and Internal Medicine: 2,422) provided care in a total of 2,285 different practices nested in 26 health systems. Health systems explain 1.29, 3.55, 3.45, and 3.30% of the total variability in Active Time, Documentation Time, Chart Review Time, and Ordering Time, respectively. Practice-level variability was estimated to be 7.96, 13.52, 8.39, and 5.57%, respectively, and individual physicians explained the largest proportion of the variability for those same outcomes 17.09, 27.49, 17.51, and 19.75%, respectively.

CONCLUSION

 The most variable physician EHR usage patterns occurs at the individual physician level and decreases as you move up to the practice and health system levels. This suggests that interventions to improve individual users' EHR usage efficiency may have the most potential impact compared with those directed at health system or practice levels.

Guidance for reporting analyses of metadata on electronic health record use

INTRODUCTION

Research on how people interact with electronic health records (EHRs) increasingly involves the analysis of metadata on EHR use. These metadata can be recorded unobtrusively and capture EHR use at a scale unattainable through direct observation or self-reports. However, there is substantial variation in how metadata on EHR use are recorded, analyzed and described, limiting understanding, replication, and synthesis across studies.

RECOMMENDATIONS

In this perspective, we provide guidance to those working with EHR use metadata by describing 4 common types, how they are recorded, and how they can be aggregated into higher-level measures of EHR use. We also describe guidelines for reporting analyses of EHR use metadata-or measures of EHR use derived from them-to foster clarity, standardization, and reproducibility in this emerging and critical area of research.

The role of organizations in shaping physician use of electronic health records

OBJECTIVE

The aim of the study was to (1) characterize organizational differences in primary care physicians' electronic health record (EHR) behavior; (2) assess within-organization consistency in EHR behaviors; and (3) identify whether organizational consistency is associated with physician-level efficiency.

DATA SOURCES

EHR metadata capturing averaged weekly measures of EHR time and documentation composition from 75,124 US primary care physicians across 299 organizations between September 2020 and May 2021 were taken. EHR time measures include active time in orders, chart review, notes, messaging, time spent outside of scheduled hours, and total EHR time. Documentation composition measures include note length and percentage use of templated text or copy/paste. Efficiency is measured as the percent of visits with same-day note completion.

STUDY DESIGN

All analyses are cross-sectional. Across-organization differences in EHR use and documentation composition are presented via 90th-to-10th percentile ratios of means and SDs. Multilevel modeling with post-estimation variance partitioning assesses the extent of an organizational signature-the proportion of variation in our measures attributable to organizations (versus specialty and individual behaviors). We measured organizational internal consistency for each measure via organization-level SD, which we grouped into quartiles for regression. Association between internally consistent (i.e., low SD) organizational EHR use and physician-level efficiency was assessed with multi-variable OLS models.

DATA COLLECTION

Extraction from Epic's Signal platform used for measuring provider EHR efficiency.

PRINCIPAL FINDINGS

EHR time per visit for physicians at a 90th percentile organization is 1.94 times the average EHR time at a 10th percentile organization. There is little evidence, on average, of an organizational signature. However, physicians in organizations with high internal consistency in EHR use demonstrate increased efficiency. Physicians in organizations with the highest internal consistency (top quartile) have a 3.77 percentage point higher same-day visit closure rates compared with peers in bottom quartile organizations (95% confidence interval: 0.0142-0.0612).

CONCLUSIONS

Results suggest unrealized opportunities for organizations and policymakers to support consistency in how physicians engage in EHR-supported work.

Creating Conversion Factors from EHR Event Log Data: A Comparison of Investigator-Derived and Vendor-Derived Metrics for Primary Care Physicians

Physicians spend a large amount of time with the electronic health record (EHR), which the majority believe contributes to their burnout. However, there are limitedstandardized measures of physician EHR time. Vendor-derived metrics are standardized but may underestimate real-world EHR experience. Investigator-derived metrics may be more reliable but not standardized, particularly with regard to timeout thresholds defining inactivity. This study aimed to enable standardized investigator-derived metrics using conversion factors between raw event log-derived metrics and Signal (Epic System's standardized metric) for primary care physicians. This was an observational, retrospective longitudinal study of EHR raw event logs and Signal data from a quaternary academic medical center and its community affiliates in California, over a 6-month period. The study evaluated 242 physicians over 1370 physician-months, comparing 53.7 million event logs to 6850 Signal metrics, in five different time based metrics. Results show that inactivity thresholds for event log metric derivation that most closely approximate Signal metrics ranged from 90 seconds (Visit Navigator) to 360 seconds ("Pajama time") depending on the metric. Based on this data, conversion factors for investigator-derived metrics across a wide range of inactivity thresholds, via comparison with Signal metrics, are provided which may allow researchers to consistently quantify EHR experience.

A Practical Approach to Optimize Computerized Provider Order Entry Systems and Reduce Clinician Burden: Pre-Post Evaluation of Vendor-Derived "Order Friction" Data

Computerized provider order entry (CPOE) systems have been cited as a significant contributor to clinician burden. Vendor-derived measures and data sets have been developed to help with optimization of CPOE systems. We describe how we analyzed vendor-derived Order Friction (OF) EHR log data at our health system and propose a practical approach for optimizing CPOE systems by reducing OF. We also conducted a pre-post intervention study using OF data to evaluate the impact of defaulting the frequency of urine, stool and nasal swab tests and found that all modified orders had significantly fewer changes required per order (p<0.01). Our proposed approach is a six-step process: 1) understand the ordering process, 2) understand OF data elements contextually, 3) explore ordering user-level factors, 4) evaluate order volume and friction from different order sources, 5) optimize order-level design, 6) identify high volume alerts to evaluate for appropriateness.

Identifying and Addressing Barriers to Implementing Core Electronic Health Record Use Metrics for Ambulatory Care: Virtual Consensus Conference Proceedings

Precise, reliable, valid metrics that are cost-effective and require reasonable implementation time and effort are needed to drive electronic health record (EHR) improvements and decrease EHR burden. Differences exist between research and vendor definitions of metrics. PROCESS:  We convened three stakeholder groups (health system informatics leaders, EHR vendor representatives, and researchers) in a virtual workshop series to achieve consensus on barriers, solutions, and next steps to implementing the core EHR use metrics in ambulatory care. CONCLUSION:  Actionable solutions identified to address core categories of EHR metric implementation challenges include: (1) maintaining broad stakeholder engagement, (2) reaching agreement on standardized measure definitions across vendors, (3) integrating clinician perspectives, and (4) addressing cognitive and EHR burden. Building upon the momentum of this workshop's outputs offers promise for overcoming barriers to implementing EHR use metrics.

Association of physician burnout with perceived EHR work stress and potentially actionable factors

OBJECTIVE

Physicians of all specialties experienced unprecedented stressors during the COVID-19 pandemic, exacerbating preexisting burnout. We examine burnout's association with perceived and actionable electronic health record (EHR) workload factors and personal, professional, and organizational characteristics with the goal of identifying levers that can be targeted to address burnout.

MATERIALS AND METHODS

Survey of physicians of all specialties in an academic health center, using a standard measure of burnout, self-reported EHR work stress, and EHR-based work assessed by the number of messages regarding prescription reauthorization and use of a staff pool to triage messages. Descriptive and multivariable regression analyses examined the relationship among burnout, perceived EHR work stress, and actionable EHR work factors.

RESULTS

Of 1038 eligible physicians, 627 responded (60% response rate), 49.8% reported burnout symptoms. Logistic regression analysis suggests that higher odds of burnout are associated with physicians feeling higher level of EHR stress (odds ratio [OR], 1.15; 95% confidence interval [CI], 1.07-1.25), having more prescription reauthorization messages (OR, 1.23; 95% CI, 1.04-1.47), not feeling valued (OR, 3.38; 95% CI, 1.69-7.22) or aligned in values with clinic leaders (OR, 2.81; 95% CI, 1.87-4.27), in medical practice for ≤15 years (OR, 2.57; 95% CI, 1.63-4.12), and sleeping for <6 h/night (OR, 1.73; 95% CI, 1.12-2.67).

DISCUSSION

Perceived EHR stress and prescription reauthorization messages are significantly associated with burnout, as are non-EHR factors such as not feeling valued or aligned in values with clinic leaders. Younger physicians need more support.

CONCLUSION

A multipronged approach targeting actionable levers and supporting young physicians is needed to implement sustainable improvements in physician well-being.

Documentation dynamics: Note composition, burden, and physician efficiency

OBJECTIVE

To analyze how physician clinical note length and composition relate to electronic health record (EHR)-based measures of burden and efficiency that have been tied to burnout.

DATA SOURCES AND STUDY SETTING

Secondary EHR use metadata capturing physician-level measures from 203,728 US-based ambulatory physicians using the Epic Systems EHR between September 2020 and May 2021.

STUDY DESIGN

In this cross-sectional study, we analyzed physician clinical note length and note composition (e.g., content from manual or templated text). Our primary outcomes were three time-based measures of EHR burden (time writing EHR notes, time in the EHR after-hours, and EHR time on unscheduled days), and one measure of efficiency (percent of visits closed in the same day). We used multivariate regression to estimate the relationship between our outcomes and note length and composition.

DATA EXTRACTION

Physician-week measures of EHR usage were extracted from Epic's Signal platform used for measuring provider EHR efficiency. We calculated physician-level averages for our measures of interest and assigned physicians to overall note length deciles and note composition deciles from six sources, including templated text, manual text, and copy/paste text.

PRINCIPAL FINDINGS

Physicians in the top decile of note length demonstrated greater burden and lower efficiency than the median physician, spending 39% more time in the EHR after hours (p < 0.001) and closing 5.6 percentage points fewer visits on the same day (p < 0.001). Copy/paste demonstrated a similar dose/response relationship, with top-decile copy/paste users closing 6.8 percentage points fewer visits on the same day (p < 0.001) and spending more time in the EHR after hours and on days off (both p < 0.001). Templated text (e.g., Epic's SmartTools) demonstrated a non-linear relationship with burden and efficiency, with very low and very high levels of use associated with increased EHR burden and decreased efficiency.

CONCLUSIONS

"Efficiency tools" like copy/paste and templated text meant to reduce documentation burden and increase provider efficiency may have limited efficacy.

Physician Note Composition Patterns and Time on the EHR Across Specialty Types: a National, Cross-sectional Study

BACKGROUND

The burden of clinical documentation in electronic health records (EHRs) has been associated with physician burnout. Numerous tools (e.g., note templates and dictation services) exist to ease documentation burden, but little evidence exists regarding how physicians use these tools in combination and the degree to which these strategies correlate with reduced time spent on documentation.

OBJECTIVE

To characterize EHR note composition strategies, how these strategies differ in time spent on notes and the EHR, and their distribution across specialty types.

DESIGN

Secondary analysis of physician-level measures of note composition and EHR use derived from Epic Systems' Signal data warehouse. We used k-means clustering to identify documentation strategies, and ordinary least squares regression to analyze the relationship between documentation strategies and physician time spent in the EHR, on notes, and outside scheduled hours.

PARTICIPANTS

A total of 215,207 US-based ambulatory physicians using the Epic EHR between September 2020 and May 2021.

MAIN MEASURES

Percent of note text derived from each of five documentation tools: SmartTools, copy/paste, manual text, NoteWriter, and voice recognition and transcription; average total and after-hours EHR time per visit; average time on notes per visit.

KEY RESULTS

Six distinct note composition strategies emerged in cluster analyses. The most common strategy was predominant SmartTools use (n=89,718). In adjusted analyses, physicians using primarily transcription and dictation (n=15,928) spent less time on notes than physicians with predominant Smart Tool use. (b=-1.30, 95% CI=-1.62, -0.99, p<0.001; average 4.8 min per visit), while those using mostly copy/paste (n=23,426) spent more time on notes (b=2.38, 95% CI=1.92, 2.84, p<0.001; average 13.1 min per visit).

CONCLUSIONS

Physicians' note composition strategies have implications for both time in notes and after-hours EHR use, suggesting that how physicians use EHR-based documentation tools can be a key lever for institutions investing in EHR tools and training to reduce documentation time and alleviate EHR-associated burden.

Early Performance of the Patients Over Paperwork Initiative among Family Medicine Physicians

OBJECTIVES

In 2019, the Centers for Medicare & Medicaid Services began implementing the Patients Over Paperwork (POP) initiative in response to clinicians reporting burdensome documentation regulations. To date, no study has evaluated how these policy changes have influenced documentation burden.

METHODS

Our data came from the electronic health records of an academic health system. Using quantile regression models, we assessed the association between the implementation of POP and clinical documentation word count using data from family medicine physicians in an academic health system from January 2017 to May 2021 inclusive. Studied quantiles included the 10th, 25th, 50th, 75th, and 90th quantiles. We controlled for patient-level (race/ethnicity, primary language, age, comorbidity burden), visit-level (primary payer, level of clinical decision making involved, whether a visit was done through telemedicine, whether a visit was for a new patient), and physician-level (sex) characteristics.

RESULTS

We found that the POP initiative was associated with lower word counts across all of the quantiles. In addition, we found lower word counts among notes for private payers and telemedicine visits. Conversely, higher word counts were observed in notes that were written by female physicians, notes for new patient visits, and notes involving patients with greater comorbidity burden.

CONCLUSIONS

Our initial evaluation suggests that documentation burden, as measured by word count, has declined over time, particularly following implementation of the POP in 2019. Additional research is needed to see whether the same occurs when examining other medical specialties, clinician types, and longer evaluation periods.

Predicting physician departure with machine learning on EHR use patterns: A longitudinal cohort from a large multi-specialty ambulatory practice

Physician turnover places a heavy burden on the healthcare industry, patients, physicians, and their families. Having a mechanism in place to identify physicians at risk for departure could help target appropriate interventions that prevent departure. We have collected physician characteristics, electronic health record (EHR) use patterns, and clinical productivity data from a large ambulatory based practice of non-teaching physicians to build a predictive model. We use several techniques to identify possible intervenable variables. Specifically, we used gradient boosted trees to predict the probability of a physician departing within an interval of 6 months. Several variables significantly contributed to predicting physician departure including tenure (time since hiring date), panel complexity, physician demand, physician age, inbox, and documentation time. These variables were identified by training, validating, and testing the model followed by computing SHAP (SHapley Additive exPlanation) values to investigate which variables influence the model's prediction the most. We found these top variables to have large interactions with other variables indicating their importance. Since these variables may be predictive of physician departure, they could prove useful to identify at risk physicians such who would benefit from targeted interventions.

Using event logs to observe interactions with electronic health records: an updated scoping review shows increasing use of vendor-derived measures

OBJECTIVE

The aim of this article is to compare the aims, measures, methods, limitations, and scope of studies that employ vendor-derived and investigator-derived measures of electronic health record (EHR) use, and to assess measure consistency across studies.

MATERIALS AND METHODS

We searched PubMed for articles published between July 2019 and December 2021 that employed measures of EHR use derived from EHR event logs. We coded the aims, measures, methods, limitations, and scope of each article and compared articles employing vendor-derived and investigator-derived measures.

RESULTS

One hundred and two articles met inclusion criteria; 40 employed vendor-derived measures, 61 employed investigator-derived measures, and 1 employed both. Studies employing vendor-derived measures were more likely than those employing investigator-derived measures to observe EHR use only in ambulatory settings (83% vs 48%, P = .002) and only by physicians or advanced practice providers (100% vs 54% of studies, P < .001). Studies employing vendor-derived measures were also more likely to measure durations of EHR use (P < .001 for 6 different activities), but definitions of measures such as time outside scheduled hours varied widely. Eight articles reported measure validation. The reported limitations of vendor-derived measures included measure transparency and availability for certain clinical settings and roles.

DISCUSSION

Vendor-derived measures are increasingly used to study EHR use, but only by certain clinical roles. Although poorly validated and variously defined, both vendor- and investigator-derived measures of EHR time are widely reported.

CONCLUSION

The number of studies using event logs to observe EHR use continues to grow, but with inconsistent measure definitions and significant differences between studies that employ vendor-derived and investigator-derived measures.

Management Opportunities and Challenges After Achieving Widespread Health System Digitization

The adoption of electronic health records (EHRs) and digitization of health data over the past decade is ushering in the next generation of digital health tools that leverage artificial intelligence (AI) to improve varied aspects of health system performance. The decade ahead is therefore shaping up to be one in which digital health becomes even more at the forefront of health care delivery - demanding the time, attention, and resources of health care leaders and frontline staff, and becoming inextricably linked with all dimensions of health care delivery. In this chapter, we look back and look ahead. There are substantive lessons learned from the first era of large-scale adoption of enterprise EHRs and ongoing challenges that organizations are wrestling with - particularly related to the tension between standardization and flexibility/customization of EHR systems and the processes they support. Managing this tension during efforts to implement and optimize enterprise systems is perhaps the core challenge of the past decade, and one that has impeded consistent realization of value from initial EHR investments. We describe these challenges, how they manifest, and organizational strategies to address them, with a specific focus on alignment with broader value-based care transformation. We then look ahead to the AI wave - the massive number of applications of AI to health care delivery, the expected benefits, the risks and challenges, and approaches that health systems can consider to realize the benefits while avoiding the risks.

It's time to change our documentation philosophy: writing better neurology notes without the burnout

Succinct clinical documentation is vital to effective twenty-first-century healthcare. Recent changes in outpatient and inpatient evaluation and management (E/M) guidelines have allowed neurology practices to make changes that reduce the documentation burden and enhance clinical note usability. Despite favorable changes in E/M guidelines, some neurology practices have not moved quickly to change their documentation philosophy. We argue in favor of changes in the design, structure, and implementation of clinical notes that make them shorter yet still information-rich. A move from physician-centric to team documentation can reduce work for physicians. Changing the documentation philosophy from "bigger is better" to "short but sweet" can reduce the documentation burden, streamline the writing and reading of clinical notes, and enhance their utility for medical decision-making, patient education, medical education, and clinical research. We believe that these changes can favorably affect physician well-being without adversely affecting reimbursement.

Evaluating the Impact of a Point-of-Care Cardiometabolic Clinical Decision Support Tool on Clinical Efficiency Using Electronic Health Record Audit Log Data: Algorithm Development and Validation

Background

Electronic health record (EHR) systems are becoming increasingly complicated, leading to concerns about rising physician burnout, particularly for primary care physicians (PCPs). Managing the most common cardiometabolic chronic conditions by PCPs during a limited clinical time with a patient is challenging.

Objective

This study aimed to evaluate a Cardiometabolic Sutter Health Advanced Reengineered Encounter (CM-SHARE), a web-based application to visualize key EHR data, on the EHR use efficiency.

Methods

We developed algorithms to identify key clinic workflow measures (eg, total encounter time, total physician time in the examination room, and physician EHR time in the examination room) using audit data, and we validated and calibrated the measures with time-motion data. We used a pre-post parallel design to identify propensity score–matched CM-SHARE users (cases), nonusers (controls), and nested-matched patients. Cardiometabolic encounters from matched case and control patients were used for the workflow evaluation. Outcome measures were compared between the cases and controls. We applied this approach separately to both the CM-SHARE pilot and spread phases.

Results

Time-motion observation was conducted on 101 primary care encounters for 9 PCPs in 3 clinics. There was little difference (<0.8 minutes) between the audit data–derived workflow measures and the time-motion observation. Two key unobservable times from audit data, physician entry into and exiting the examination room, were imputed based on time-motion studies. CM-SHARE was launched with 6 pilot PCPs in April 2016. During the prestudy period (April 1, 2015, to April 1, 2016), 870 control patients with 2845 encounters were matched with 870 case patients and encounters, and 727 case patients with 852 encounters were matched with 727 control patients and 3754 encounters in the poststudy period (June 1, 2016, to June 30, 2017). Total encounter time was slightly shorter (mean −2.7, SD 1.4 minutes, 95% CI −4.7 to −0.9; mean –1.6, SD 1.1 minutes, 95% CI −3.2 to −0.1) for cases than controls for both periods. CM-SHARE saves physicians approximately 2 minutes EHR time in the examination room (mean −2.0, SD 1.3, 95% CI −3.4 to −0.9) compared with prestudy period and poststudy period controls (mean −1.9, SD 0.9, 95% CI −3.8 to −0.5). In the spread phase, 48 CM-SHARE spread PCPs were matched with 84 control PCPs and 1272 cases with 3412 control patients, having 1119 and 4240 encounters, respectively. A significant reduction in total encounter time for the CM-SHARE group was observed for short appointments (≤20 minutes; 5.3-minute reduction on average) only. Total physician EHR time was significantly reduced for both longer and shorter appointments (17%-33% reductions).

Conclusions

Combining EHR audit log files and clinical information, our approach offers an innovative and scalable method and new measures that can be used to evaluate clinical EHR efficiency of digital tools used in clinical settings.

Physician Electronic Health Record Usage as Affected by the COVID-19 Pandemic

OBJECTIVES

To utilize metrics from physician action logs to analyze volume, physician efficiency and burden as impacted by telemedicine implementation during the COVID-19 (coronavirus disease 2019) pandemic, and physician characteristics such as gender, years since graduation, and specialty category.

METHODS

We selected 11 metrics from Epic Signal, a functionality of the Epic electronic health record (EHR). Metrics measuring time spent in the EHR outside working hours were used as a correlate for burden. We performed an analysis of these metrics among active physicians at our institution across three time periods-prepandemic and telehealth implementation (August 2019), postimplementation of telehealth (May 2020), and follow-up (July 2020)-and correlated them with physician characteristics.

RESULTS

Analysis of 495 physicians showed that after the start of the pandemic, physicians overall had fewer appointments per day, higher same day visit closure rates, and spent less time writing notes in the EHR outside 7 a.m. to 7 p.m. on patient scheduled days. Across all three time periods, male physicians had better EHR-defined "efficiency" measures and spent less time in the EHR outside working hours. Years since graduation only had modest associations with higher same day visit closure rates and appointments per day in May 2020. Specialty category was significantly associated with appointments per day and same day closure visit rates and also was a significant factor in the observed changes seen across the three time periods.

CONCLUSION

Utilizing EHR-generated reports may provide a scalable and nonintrusive way to monitor trends in physician usage and experience to help guide health systems in increasing productivity and reducing burnout.

The Impact of Telemedicine on Physicians' After-hours Electronic Health Record "Work Outside Work" During the COVID-19 Pandemic: Retrospective Cohort Study

Background

Telemedicine as a mode of health care work has grown dramatically during the COVID-19 pandemic; the impact of this transition on clinicians’ after-hours electronic health record (EHR)–based clinical and administrative work is unclear.

Objective

This study assesses the impact of the transition to telemedicine during the COVID-19 pandemic on physicians’ EHR-based after-hours workload (ie, “work outside work”) at a large academic medical center in New York City.

Methods

We conducted an EHR-based retrospective cohort study of ambulatory care physicians providing telemedicine services before the pandemic, during the acute pandemic, and after the acute pandemic, relating EHR-based after-hours work to telemedicine intensity (ie, percentage of care provided via telemedicine) and clinical load (ie, patient load per provider).

Results

A total of 2129 physicians were included in this study. During the acute pandemic, the volume of care provided via telemedicine significantly increased for all physicians, whereas patient volume decreased. When normalized by clinical load (ie, average appointments per day by average clinical days per week), telemedicine intensity was positively associated with work outside work across time periods. This association was strongest after the acute pandemic.

Conclusions

Taking physicians’ clinical load into account, physicians who devoted a higher proportion of their clinical time to telemedicine throughout various stages of the pandemic engaged in higher levels of EHR-based after-hours work compared to those who used telemedicine less intensively. This suggests that telemedicine, as currently delivered, may be less efficient than in-person–based care and may increase the after-hours work burden of physicians.

Association between state-level malpractice environment and clinician electronic health record (EHR) time

OBJECTIVE

Clinicians spend significant time working in the electronic health record (EHR). The US is an outlier in EHR time, suggesting that EHR-related work may be driven in part by the legal environment and threat of malpractice. To assess this, we evaluate the association between state-level malpractice climate and clinician time spent in the EHR.

MATERIALS AND METHODS

We use EHR metadata from 351 ambulatory care health systems in the United States using Epic from January-August 2019 combined with state-level data on malpractice incidence and payouts. We used descriptive statistics to measure variation in clinician EHR time, including total EHR time, documentation time per day, and after-hours EHR time per day. Multi-variable regression evaluated the association between clinicians in high malpractice states and EHR use.

RESULTS

We found no association between location in a state in the top-quartile of malpractice payouts and time spent in the EHR per day, time spent in the EHR outside of scheduled hours, or time spent documenting per day, except for a subgroup of the clinicians in the highest malpractice specialties, where there was a small increase in EHR time per day (B = 6.08 min, P < 0.001) and time spent documenting notes (B = 2.77 min, P < 0.001).

DISCUSSION

State-level differences in malpractice incidence are unlikely to be a significant driver of EHR work for most clinicians.

CONCLUSION

Policymakers seeking to address EHR documentation burden should examine burden driven by other socio-technical demands on clinician time, such as billing or quality measurement.

Early Changes in Billing and Notes After Evaluation and Management Guideline Change

BACKGROUND

The American Medical Association updated guidance in 2021 for frequently used billing codes for outpatient evaluation and management (E/M) visits. The intent was to account for provider time outside of face-to-face encounters and to reduce onerous documentation requirements.

OBJECTIVE

To analyze E/M visit use, documentation length, and time spent in the electronic health record (EHR) before and after the guideline change.

DESIGN

Observational, retrospective, pre-post study.

SETTING

U.S.-based ambulatory practices using the Epic Systems EHR.

PARTICIPANTS

303 547 advanced practice providers and physicians across 389 organizations.

MEASUREMENTS

Data from September 2020 through April 2021 containing weekly provider-level E/M code and EHR use metadata were extracted from the Epic Signal database. We descriptively analyzed overall and specialty-specific changes in E/M visit use, note length, and time spent in the EHR before and after the new guidelines using provider-level paired t tests.

RESULTS

Following the new guidelines, level 3 visits decreased by 2.41 percentage points (95% CI, -2.48 to -2.34 percentage points) to 38.5% of all E/M visits, a 5.9% relative decrease from fall 2020. Level 4 visits increased by 0.89 percentage points (CI, 0.82 to 0.96 percentage points) to 40.9% of E/M visits, a 2.2% relative increase. Level 5 visits (the highest acuity level) increased by 1.85 percentage points (CI, 1.81 to 1.89 percentage points) to 10.1% of E/M visits, a 22.6% relative increase. These changes varied by specialty. We found no meaningful changes in measures of note length or time spent in the EHR.

LIMITATION

The Epic ambulatory client base may underrepresent smaller and independent practices.

CONCLUSION

Immediate changes in E/M coding contrast with null findings for changes in both note length and EHR time. Provider organizations are positioned to respond more rapidly to billing process changes than to changes in care delivery and associated EHR use behaviors. Fully realizing the intended benefits of this guideline change will require more time, facilitation, and scaling of best practices that more directly address EHR documentation practices and associated burden.

PRIMARY FUNDING SOURCE

None.

Exploration of Primary Care Physician Phenotypes for Electronic Health Record Use

Background

Electronic health records (EHRs) have become ubiquitous in US office-based physician practices. However, the different ways in which users engage with EHRs remain poorly characterized.

Objective

The aim of this study is to explore EHR use phenotypes among ambulatory care physicians.

Methods

In this retrospective cohort analysis, we applied affinity propagation, an unsupervised clustering machine learning technique, to identify EHR user types among primary care physicians.

Results

We identified 4 distinct phenotype clusters generalized across internal medicine, family medicine, and pediatrics specialties. Total EHR use varied for physicians in 2 clusters with above-average ratios of work outside of scheduled hours. This finding suggested that one cluster of physicians may have worked outside of scheduled hours out of necessity, whereas the other preferred ad hoc work hours. The two remaining clusters represented physicians with below-average EHR time and physicians who spend the largest proportion of their EHR time on documentation.

Conclusions

These findings demonstrate the utility of cluster analysis for exploring EHR use phenotypes and may offer opportunities for interventions to improve interface design to better support users’ needs.

Gender Differences in Time Spent on Documentation and the Electronic Health Record in a Large Ambulatory Network

This cross-sectional study assesses gender differences in time spent on documentation and electronic health records in a large ambulatory care network.

Primary care physicians' electronic health record proficiency and efficiency behaviors and time interacting with electronic health records: a quantile regression analysis

OBJECTIVE

This study aimed to understand the association between primary care physician (PCP) proficiency with the electronic health record (EHR) system and time spent interacting with the EHR.

MATERIALS AND METHODS

We examined the use of EHR proficiency tools among PCPs at one large academic health system using EHR-derived measures of clinician EHR proficiency and efficiency. Our main predictors were the use of EHR proficiency tools and our outcomes focused on 4 measures assessing time spent in the EHR: (1) total time spent interacting with the EHR, (2) time spent outside scheduled clinical hours, (3) time spent documenting, and (4) time spent on inbox management. We conducted multivariable quantile regression models with fixed effects for physician-level factors and time in order to identify factors that were independently associated with time spent in the EHR.

RESULTS

Across 441 primary care physicians, we found mixed associations between certain EHR proficiency behaviors and time spent in the EHR. Across EHR activities studied, QuickActions, SmartPhrases, and documentation length were positively associated with increased time spent in the EHR. Models also showed a greater amount of help from team members in note writing was associated with less time spent in the EHR and documenting.

DISCUSSION

Examining the prevalence of EHR proficiency behaviors may suggest targeted areas for initial and ongoing EHR training. Although documentation behaviors are key areas for training, team-based models for documentation and inbox management require further study.

CONCLUSIONS

A nuanced association exists between physician EHR proficiency and time spent in the EHR.

Assessing the impact of the COVID-19 pandemic on clinician ambulatory electronic health record use

Objective

The COVID-19 pandemic changed clinician electronic health record (EHR) work in a multitude of ways. To evaluate how, we measure ambulatory clinician EHR use in the United States throughout the COVID-19 pandemic.

Materials and Methods

We use EHR meta-data from ambulatory care clinicians in 366 health systems using the Epic EHR system in the United States from December 2019 to December 2020. We used descriptive statistics for clinician EHR use including active-use time across clinical activities, time after-hours, and messages received. Multivariable regression to evaluate total and after-hours EHR work adjusting for daily volume and organizational characteristics, and to evaluate the association between messages and EHR time.

Results

Clinician time spent in the EHR per day dropped at the onset of the pandemic but had recovered to higher than prepandemic levels by July 2020. Time spent actively working in the EHR after-hours showed similar trends. These differences persisted in multivariable models. In-Basket messages received increased compared with prepandemic levels, with the largest increase coming from messages from patients, which increased to 157% of the prepandemic average. Each additional patient message was associated with a 2.32-min increase in EHR time per day (P < .001).

Discussion

Clinicians spent more total and after-hours time in the EHR in the latter half of 2020 compared with the prepandemic period. This was partially driven by increased time in Clinical Review and In-Basket messaging.

Conclusions

Reimbursement models and workflows for the post-COVID era should account for these demands on clinician time that occur outside the traditional visit.

Analysis of Electronic Health Record Use and Clinical Productivity and Their Association With Physician Turnover

Importance

Physician turnover takes a heavy toll on patients, physicians, and health care organizations. Survey research has established associations of electronic health record (EHR) use with professional burnout and reduction in professional effort, but these findings are subject to response fatigue and bias.

Objective

To evaluate the association of physician productivity and EHR use patterns, as determined by vendor-derived EHR use data platforms, with physician turnover.

Design, Setting, and Participants

This retrospective cohort study was conducted among nonteaching ambulatory physicians at a large ambulatory practice network based in New England. Data were collected from March 2018 to February 2020.

Main Outcomes and Measures

Physician departure from the practice network; 4 time-based core measures of EHR use, normalized to 8 hours of scheduled clinical time; teamwork, percentage of a physician's orders that are placed by other members of the care team; and productivity measures of patient volume, intensity, and demand.

Results

Among 335 physicians assessed for eligibility, 314 unique physicians (89.2%) were included in the analysis (123 [39%] women; 100 [32%] aged 45-54 years), with 5663 physician-months of data. The turnover rate was 5.1%/year (32 of 314 physicians). Physicians completed a mean 2.6 appointments/hour (95% CI, 2.5-2.6 appointments/hour) and 206 appointments/month (95% CI, 197-215 appointments/month) with 5.5 hours (95% CI, 5.3-5.8 hours) of EHR time for every 8 hours of scheduled patient time. After controlling for gender, medical specialty, and time, the following variables were associated with turnover: inbox time (odds ratio [OR], 0.70; 95% CI, 0.61-0.82; P < .001), teamwork (OR, 0.68; 95% CI, 0.52-0.87; P = .003), demand (ie, proportion of available appointments filled: OR, 0.49; 95% CI, 0.35-0.70; P < .001), and age 45 to 54 years vs 25 to 34 years (OR, 0.19; 95% CI, 0.04-0.93; P = .04).

Conclusions and Relevance

In this study, physician productivity and EHR use metrics were associated with physician departure. Prospectively tracking these metrics could identify physicians at high risk of departure who would benefit from early, team-based, targeted interventions. The counterintuitive finding that less time spent on the EHR (in particular inbox management) was associated with physician departure warrants further investigation.

Novel Nonproprietary Measures of Ambulatory Electronic Health Record Use Associated with Physician Work Exhaustion

BACKGROUND

Accumulating evidence indicates an association between physician electronic health record (EHR) use after work hours and occupational distress including burnout. These studies are based on either physician perception of time spent in EHR through surveys which may be prone to bias or by utilizing vendor-defined EHR use measures which often rely on proprietary algorithms that may not take into account variation in physician's schedules which may underestimate time spent on the EHR outside of scheduled clinic time. The Stanford team developed and refined a nonproprietary EHR use algorithm to track the number of hours a physician spends logged into the EHR and calculates the Clinician Logged-in Outside Clinic (CLOC) time, the number of hours spent by a physician on the EHR outside of allocated time for patient care.

OBJECTIVE

The objective of our study was to measure the association between CLOC metrics and validated measures of physician burnout and professional fulfillment.

METHODS

Physicians from adult outpatient Internal Medicine, Neurology, Dermatology, Hematology, Oncology, Rheumatology, and Endocrinology departments who logged more than 8 hours of scheduled clinic time per week and answered the annual wellness survey administered in Spring 2019 were included in the analysis.

RESULTS

We observed a statistically significant positive correlation between CLOC ratio (defined as the ratio of CLOC time to allocated time for patient care) and work exhaustion (Pearson's r = 0.14; p = 0.04), but not interpersonal disengagement, burnout, or professional fulfillment.

CONCLUSION

The CLOC metrics are potential objective EHR activity-based markers associated with physician work exhaustion. Our results suggest that the impact of time spent on EHR, while associated with exhaustion, does not appear to be a dominant factor driving the high rates of occupational burnout in physicians.