Physician experience with speech recognition software in psychiatry: usage and perspective

Machine learning-based speech recognition system for nursing documentation - A pilot study

PURPOSE

Considering the significant workload of nursing tasks, enhancing the efficiency of nursing documentation is imperative. This study aimed to evaluate the effectiveness of a machine learning-based speech recognition (SR) system in reducing the clinical workload associated with typing nursing records, implemented in a psychiatry ward.

METHODS

The study was conducted between July 15, 2020, and June 30, 2021, at Cheng Hsin General Hospital in Taiwan. The language corpus was based on the existing records from the hospital nursing information system. The participating ward's nursing activities, clinical conversation, and accent data were also collected for deep learning-based SR-engine training. A total of 21 nurses participated in the evaluation of the SR system. Documentation time and recognition error rate were evaluated in parallel between SR-generated records and keyboard entry over 4 sessions. Any differences between SR and keyboard transcriptions were regarded as SR errors.

FINDINGS

A total of 200 data were obtained from four evaluation sessions, 10 participants were asked to use SR and keyboard entry in parallel at each session and 5 entries were collected from each participant. Overall, the SR system processed 30,112 words in 32,456 s (0.928 words per second). The mean accuracy of the SR system improved after each session, from 87.06% in 1st session to 95.07% in 4th session.

CONCLUSION

This pilot study demonstrated our machine learning-based SR system has an acceptable recognition accuracy and may reduce the burden of documentation for nurses. However, the potential error with the SR transcription should continually be recognized and improved. Further studies are needed to improve the integration of SR in digital documentation of nursing records, in terms of both productivity and accuracy across different clinical specialties.

Physician Note Composition Patterns and Time on the EHR Across Specialty Types: a National, Cross-sectional Study

BACKGROUND

The burden of clinical documentation in electronic health records (EHRs) has been associated with physician burnout. Numerous tools (e.g., note templates and dictation services) exist to ease documentation burden, but little evidence exists regarding how physicians use these tools in combination and the degree to which these strategies correlate with reduced time spent on documentation.

OBJECTIVE

To characterize EHR note composition strategies, how these strategies differ in time spent on notes and the EHR, and their distribution across specialty types.

DESIGN

Secondary analysis of physician-level measures of note composition and EHR use derived from Epic Systems' Signal data warehouse. We used k-means clustering to identify documentation strategies, and ordinary least squares regression to analyze the relationship between documentation strategies and physician time spent in the EHR, on notes, and outside scheduled hours.

PARTICIPANTS

A total of 215,207 US-based ambulatory physicians using the Epic EHR between September 2020 and May 2021.

MAIN MEASURES

Percent of note text derived from each of five documentation tools: SmartTools, copy/paste, manual text, NoteWriter, and voice recognition and transcription; average total and after-hours EHR time per visit; average time on notes per visit.

KEY RESULTS

Six distinct note composition strategies emerged in cluster analyses. The most common strategy was predominant SmartTools use (n=89,718). In adjusted analyses, physicians using primarily transcription and dictation (n=15,928) spent less time on notes than physicians with predominant Smart Tool use. (b=-1.30, 95% CI=-1.62, -0.99, p<0.001; average 4.8 min per visit), while those using mostly copy/paste (n=23,426) spent more time on notes (b=2.38, 95% CI=1.92, 2.84, p<0.001; average 13.1 min per visit).

CONCLUSIONS

Physicians' note composition strategies have implications for both time in notes and after-hours EHR use, suggesting that how physicians use EHR-based documentation tools can be a key lever for institutions investing in EHR tools and training to reduce documentation time and alleviate EHR-associated burden.

Evaluating the adoption of voice recognition technology for real-time dictation in a rural healthcare system: A retrospective analysis of dragon medical one

BACKGROUND

In 2013, Marshfield Clinic Health System (MCHS) implemented the Dragon Medical One (DMO) system provided by Nuance Management Center (NMC) for Real-Time Dictation (RTD), embracing the idea of streamlined clinic workflow, reduced dictation hours, and improved documentation legibility. Since then, MCHS has observed a trend of reduced time in documentation, however, the target goal of 100% adoption of voice recognition (VR)-based RTD has not been met.

OBJECTIVE

To evaluate the uptake/adoption of VR technology for RTD in MCHS, between 2018-2020.

METHODS

DMO data for 1,373 MCHS providers from 2018-2020 were analyzed. The study outcome was VR uptake, defined as the median number of hours each provider used VR technology to dictate patient information, and classified as no/yes. Covariates included sex, age, US-trained/international medical graduates, trend, specialty, and facility. Descriptive statistics and unadjusted and adjusted logistic regression analyses were performed. Stata/SE.version.17 was used for analyses. P-values less than/equal to 0.05 were considered statistically significant.

RESULTS

Of the 1,373 MCHS providers, the mean (SD) age was 48.3 (12.4) years. VR uptake was higher than no uptake (72.0% vs. 28.0%). In both unadjusted and adjusted analyses, VR uptake was 4.3 times and 7.7 times higher in 2019-2020 compared to 2018, respectively (OR:4.30,95%CI:2.44-7.46 and AOR:7.74,95%CI:2.51-23.86). VR uptake was 0.5 and 0.6 times lower among US-trained physicians compared to internationally-trained physicians (OR:0.53,95%CI:0.37-0.76 and AOR:0.58,95%CI:0.35-0.97). Uptake was 0.2 times lower among physicians aged 60/above than physicians aged 29/less (OR:0.20,95%CI:0.10-0.59, and AOR:0.17,95%CI:0.27-1.06).

CONCLUSION

Since 2018, VR adoption has increased significantly across MCHS. However, it was lower among US-trained physicians than among internationally-trained physicians (although internationally physicians were in minority) and lower among more senior physicians than among younger physicians. These findings provide critical information about VR trends, physician factors, and which providers could benefit from additional training to increase VR adoption in healthcare systems.

Tackling the Burden of Electronic Health Record Use Among Physicians in a Mental Health Setting: Physician Engagement Strategy

The burden associated with using the electronic health record system continues to be a critical issue for physicians and is potentially contributing to physician burnout. At a large academic mental health hospital in Canada, we recently implemented a Physician Engagement Strategy focused on reducing the burden of electronic health record use through close collaboration with clinical leadership, information technology leadership, and physicians. Built on extensive stakeholder consultation, this strategy highlights initiatives that we have implemented (or will be implementing in the near future) under four components: engage, inspire, change, and measure. In this viewpoint paper, we share our process of developing and implementing the Physician Engagement Strategy and discuss the lessons learned and implications of this work.

Application of the i-PARIHS framework in the implementation of speech recognition technology as a way of addressing documentation burden within a mental health context

Documentation burden continues to be a critical issue in the adoption of comprehensive electronic health record systems. This case study demonstrates how the i-PARIHS framework can be applied to support the implementation of interventions in reducing documentation and EHR-related burden in a mental health context. As part of pre-adoption implementation activities for Speech Recognition Technology (SRT), a cross-sectional survey was conducted with physicians, residents, and fellows at an academic mental health hospital to explore their perceptions on SRT. Open-ended responses and follow-up interviews explored challenges and concerns on using SRT in practice. Through an analysis using the i-PARIHS framework, key considerations were mapped across the four components of the framework. This study demonstrates the value of applying well-established implementation frameworks, such as the i-PARIHS framework, in mitigating challenges related to documentation burden. Future studies should explore how implementation frameworks can be systematically embedded in addressing EHR-related burden.

Leveraging the Power of Nondisruptive Technologies to Optimize Mental Health Treatment: Case Study

Regular assessment of the effectiveness of behavioral interventions is a potent tool for improving their relevance to patients. However, poor provider and patient adherence characterize most measurement-based care tools. Therefore, a new approach for measuring intervention effects and communicating them to providers in a seamless manner is warranted. This paper provides a brief overview of the available research evidence on novel ways to measure the effects of behavioral treatments, integrating both objective and subjective data. We highlight the importance of analyzing therapeutic conversations through natural language processing. We then suggest a conceptual framework for capitalizing on data captured through directly collected and nondisruptive methodologies to describe the client's characteristics and needs and inform clinical decision-making. We then apply this context in exploring a new tool to integrate the content of therapeutic conversations and patients' self-reports. We present a case study of how both subjective and objective measures of treatment effects were implemented in cognitive-behavioral treatment for depression and anxiety and then utilized in treatment planning, delivery, and termination. In this tool, called Eleos, the patient completes standardized measures of depression and anxiety. The content of the treatment sessions was evaluated using nondisruptive, independent measures of conversation content, fidelity to the treatment model, and the back-and-forth of client-therapist dialogue. Innovative applications of advances in digital health are needed to disseminate empirically supported interventions and measure them in a noncumbersome way. Eleos appears to be a feasible, sustainable, and effective way to assess behavioral health care.