Association of note quality and quality of care: a cross-sectional study

Comparison of medical documentation between pharmacist-led anticoagulation clinics and physician-led anticoagulation clinics: A retrospective study

Background and objectives

High-quality documentation is critical in medical settings for providing safe patient care. This study was done with the objective of assessing the standard of medical records in anticoagulation clinics and investigating the distinctions between notes written by pharmacists and physicians.

Methods

A retrospective cross-sectional analysis of data from electronic health records (EHRs) was performed on patients who received anticoagulation and were observed at anticoagulation clinics from October to December 2020. Patients were monitored in two anticoagulation clinics, one administered by pharmacists and the other by physicians. The quality of the documentation was assessed using a score, and the note was assigned one of five categories according to its score: very good, good, average, poor, and very poor. The data was analyzed using Stata/SE 13.1. P value<0.05 was considered significant in all analytical tests.

Results

A total of 331 patients were included. While 160 patients (48.3%) were followed by the physician-led clinic, 171 (51.6%) were by the pharmacist-led clinic. The average age of the patients was 54 ± 15. 60.73% of them were female, and 90.3% of them were Saudi nationals. Warfarin was the most widely used anticoagulant (70%), followed by rivaroxaban (15.7%). Compared to physicians, pharmacists demonstrated very strong documentation (54% vs. 18%). The examination of the variables considered in the study revealed that physicians had significantly less drug-drug interaction documentation (17 vs. 71 times) or drug-food interaction documentation (23 vs. 71 times) than pharmacists. In terms of follow-up frequency, pharmacists were found to adhere to the clinic protocol (150 times) more frequently than physicians (104 times). However, there was no significant difference in therapeutic plan documentation between the two groups. (p = 0.416).

Conclusion

Pharmacists were more comprehensive in their documentation than physicians in anticoagulation clinics. Unified clinic documentation can ensure consistent documentation within EHRs across all disciplines.

How does work environment relate to diagnostic quality? A prospective, mixed methods study in primary care

OBJECTIVES

The quest to measure and improve diagnosis has proven challenging; new approaches are needed to better understand and measure key elements of the diagnostic process in clinical encounters. The aim of this study was to develop a tool assessing key elements of the diagnostic assessment process and apply it to a series of diagnostic encounters examining clinical notes and encounters' recorded transcripts. Additionally, we aimed to correlate and contextualise these findings with measures of encounter time and physician burnout.

DESIGN

We audio-recorded encounters, reviewed their transcripts and associated them with their clinical notes and findings were correlated with concurrent Mini Z Worklife measures and physician burnout.

SETTING

Three primary urgent-care settings.

PARTICIPANTS

We conducted in-depth evaluations of 28 clinical encounters delivered by seven physicians.

RESULTS

Comparing encounter transcripts with clinical notes, in 24 of 28 (86%) there was high note/transcript concordance for the diagnostic elements on our tool. Reliably included elements were red flags (92% of notes/encounters), aetiologies (88%), likelihood/uncertainties (71%) and follow-up contingencies (71%), whereas psychosocial/contextual information (35%) and mentioning common pitfalls (7%) were often missing. In 22% of encounters, follow-up contingencies were in the note, but absent from the recorded encounter. There was a trend for higher burnout scores being associated with physicians less likely to address key diagnosis items, such as psychosocial history/context.

CONCLUSIONS

A new tool shows promise as a means of assessing key elements of diagnostic quality in clinical encounters. Work conditions and physician reactions appear to correlate with diagnostic behaviours. Future research should continue to assess relationships between time pressure and diagnostic quality.

Physician Note Composition Patterns and Time on the EHR Across Specialty Types: a National, Cross-sectional Study

BACKGROUND

The burden of clinical documentation in electronic health records (EHRs) has been associated with physician burnout. Numerous tools (e.g., note templates and dictation services) exist to ease documentation burden, but little evidence exists regarding how physicians use these tools in combination and the degree to which these strategies correlate with reduced time spent on documentation.

OBJECTIVE

To characterize EHR note composition strategies, how these strategies differ in time spent on notes and the EHR, and their distribution across specialty types.

DESIGN

Secondary analysis of physician-level measures of note composition and EHR use derived from Epic Systems' Signal data warehouse. We used k-means clustering to identify documentation strategies, and ordinary least squares regression to analyze the relationship between documentation strategies and physician time spent in the EHR, on notes, and outside scheduled hours.

PARTICIPANTS

A total of 215,207 US-based ambulatory physicians using the Epic EHR between September 2020 and May 2021.

MAIN MEASURES

Percent of note text derived from each of five documentation tools: SmartTools, copy/paste, manual text, NoteWriter, and voice recognition and transcription; average total and after-hours EHR time per visit; average time on notes per visit.

KEY RESULTS

Six distinct note composition strategies emerged in cluster analyses. The most common strategy was predominant SmartTools use (n=89,718). In adjusted analyses, physicians using primarily transcription and dictation (n=15,928) spent less time on notes than physicians with predominant Smart Tool use. (b=-1.30, 95% CI=-1.62, -0.99, p<0.001; average 4.8 min per visit), while those using mostly copy/paste (n=23,426) spent more time on notes (b=2.38, 95% CI=1.92, 2.84, p<0.001; average 13.1 min per visit).

CONCLUSIONS

Physicians' note composition strategies have implications for both time in notes and after-hours EHR use, suggesting that how physicians use EHR-based documentation tools can be a key lever for institutions investing in EHR tools and training to reduce documentation time and alleviate EHR-associated burden.

Assessing the Assessment-Developing and Deploying a Novel Tool for Evaluating Clinical Notes' Diagnostic Assessment Quality

BACKGROUND

Ambulatory diagnostic errors are increasingly being recognized as an important quality and safety issue, and while measures of diagnostic quality have been sought, tools to evaluate diagnostic assessments in the medical record are lacking.

OBJECTIVE

To develop and test a tool to measure diagnostic assessment note quality in primary care urgent encounters and identify common elements and areas for improvement in diagnostic assessment.

DESIGN

Retrospective chart review of urgent care encounters at an urban academic setting.

PARTICIPANTS

Primary care physicians.

MAIN MEASURES

The Assessing the Assessment (ATA) instrument was evaluated for inter-rater reliability, internal consistency, and findings from its application to EHR notes.

KEY RESULTS

ATA had reasonable performance characteristics (kappa 0.63, overall Cronbach's alpha 0.76). Variability in diagnostic assessment was seen in several domains. Two components of situational awareness tended to be well-documented ("Don't miss diagnoses" present in 84% of charts, red flag symptoms in 87%), while Psychosocial context was present only 18% of the time.

CONCLUSIONS

The ATA tool is a promising framework for assessing and identifying areas for improvement in diagnostic assessments documented in clinical encounters.

Comparison of clinical note quality between an automated digital intake tool and the standard note in the emergency department

BACKGROUND

Medical encounters require an efficient and focused history of present illness (HPI) to create differential diagnoses and guide diagnostic testing and treatment. Our aim was to compare the HPI of notes created by an automated digital intake tool versus standard medical notes created by clinicians.

METHODS

Prospective trial in a quaternary academic Emergency Department (ED). Notes were compared using the 5-point Physician Documentation Quality Instrument (PDQI-9) scale and the Centers for Medicare & Medicaid Services (CMS) level of complexity index. Reviewers were board certified emergency medicine physicians blinded to note origin. Reviewers received training and calibration prior to note assessments. A difference of 1 point was considered clinically significant. Analysis included McNemar's (binary), Wilcoxon-rank (Likert), and agreement with Cohen's Kappa.

RESULTS

A total of 148 ED medical encounters were charted by both digital note and standard clinical note. The ability to capture patient information was assessed through comparison of note content across paired charts (digital-standard note on the same patient), as well as scores given by the reviewers. Reviewer agreement was kappa 0.56 (CI 0.49-0.64), indicating moderate level of agreement between reviewers scoring the same patient chart. Considering all 18 questions across PDQI-9 and CMS scales, the average agreement between standard clinical note and digital note was 54.3% (IQR 44.4-66.7%). There was a moderate level of agreement between content of standard and digital notes (kappa 0.54, 95%CI 0.49-0.60). The quality of the digital note was within the 1 point clinically significant difference for all of the attributes, except for conciseness. Digital notes had a higher frequency of CMS severity elements identified.

CONCLUSION

Digitally generated clinical notes had moderate agreement compared to standard clinical notes and within the one point clinically significant difference except for the conciseness attribute. Digital notes more reliably documented billing components of severity. The use of automated notes should be further explored to evaluate its utility in facilitating documentation of patient encounters.

Comparison of the quality of documentation between electronic and paper medical records in orthopaedic trauma patients

ObjectiveThe medical record is critical for documentation and communication between healthcare professionals. This study compared the completeness of orthopaedic documentation between the electronic medical record (EMR) and paper medical record (PMR).MethodsA review was undertaken of 400 medical records (200 EMR, 200 PMR) of patients with operatively managed traumatic lower limb injury. The operative report, discharge summary and first and second out-patient reviews were evaluated using criteria designed by a senior orthopaedic surgeon and senior physiotherapist. The criteria included information deemed critical to the post-operative care of the patient in the first 6 weeks post-surgery.ResultsIn all cases, an operative report was completed by a senior surgeon. Notable findings included inferior documentation of patient weight-bearing status on the operative report in the EMR than PMR group (P = 0.018). There was a significant improvement in the completion of discharge summaries in the EMR compared with PMR cohort (100% vs 82.5% respectively; P < 0.001). In the PMR group, 70.0% of discharge summaries were completed and adequately documented, compared with 91.5% of those in the EMR group (P < 0.001). At out-patient review, there was an improvement in documentation of weight-bearing instructions in the EMR compared with PMR group (81.1% vs 76.2% respectively; P = 0.032).ConclusionThe EMR is associated with an improvement in the standard of orthopaedic medical record documentation, but deficiencies remain in key components of the medical record.What is known about the topic?Medical records are an essential tool in modern medical practice and have significant implications for patient care and management, communication and medicolegal issues. Despite the importance of comprehensive documentation, numerous examples of poor documentation continue to be demonstrated. Recently, significant changes to the medical record in Australia have been implemented with the conversion of some hospitals to an EMR and the implementation of the My Health Record.What does this paper add?Standards of patient care should be monitored continuously and deficiencies identified in order to implement measures for improvement and to close the quality loop. This study has highlighted that although there has been improvement in medical record keeping with the implementation of an EMR, the standard of orthopaedic medical record keeping continues to be below what is expected, and several key areas of documentation require improvement.What are the implications for practitioners?The implications of these findings for practitioners are to highlight current deficiencies in documentation and promote change in current practice to improve the quality of medical record documentation among medical staff. Although the EMR has improved documentation, there remain areas for further improvement, and hospital administrators will find these observations useful in implementing ongoing change.

Validation of an electronic trigger to measure missed diagnosis of stroke in emergency departments

OBJECTIVE

Diagnostic errors are major contributors to preventable patient harm. We validated the use of an electronic health record (EHR)-based trigger (e-trigger) to measure missed opportunities in stroke diagnosis in emergency departments (EDs).

METHODS

Using two frameworks, the Safer Dx Trigger Tools Framework and the Symptom-disease Pair Analysis of Diagnostic Error Framework, we applied a symptom-disease pair-based e-trigger to identify patients hospitalized for stroke who, in the preceding 30 days, were discharged from the ED with benign headache or dizziness diagnoses. The algorithm was applied to Veteran Affairs National Corporate Data Warehouse on patients seen between 1/1/2016 and 12/31/2017. Trained reviewers evaluated medical records for presence/absence of missed opportunities in stroke diagnosis and stroke-related red-flags, risk factors, neurological examination, and clinical interventions. Reviewers also estimated quality of clinical documentation at the index ED visit.

RESULTS

We applied the e-trigger to 7,752,326 unique patients and identified 46,931 stroke-related admissions, of which 398 records were flagged as trigger-positive and reviewed. Of these, 124 had missed opportunities (positive predictive value for "missed" = 31.2%), 93 (23.4%) had no missed opportunity (non-missed), 162 (40.7%) were miscoded, and 19 (4.7%) were inconclusive. Reviewer agreement was high (87.3%, Cohen's kappa = 0.81). Compared to the non-missed group, the missed group had more stroke risk factors (mean 3.2 vs 2.6), red flags (mean 0.5 vs 0.2), and a higher rate of inadequate documentation (66.9% vs 28.0%).

CONCLUSION

In a large national EHR repository, a symptom-disease pair-based e-trigger identified missed diagnoses of stroke with a modest positive predictive value, underscoring the need for chart review validation procedures to identify diagnostic errors in large data sets.

Impact of a medical scribe on clinical efficiency and quality in an academic general internal medicine practice

Background

Scribes have been proposed as an intervention to decrease physician electronic health record (EHR) workload and improve clinical quality. We aimed to assess the impact of a scribe on clinical efficiency and quality in an academic internal medicine practice.

Methods

Six faculty physicians worked with one scribe at an urban academic general internal medicine clinic April through June 2017. Patient visits during the 3 months prior to intervention (baseline, n = 789), unscribed visits during the intervention (concurrent control, n = 605), and scribed visits (n = 579) were included in the study. Clinical efficiency outcomes included time to close encounter, patient time in clinic, and number of visits per clinic session. Quality outcomes included EHR note quality, rates of medication and immunization review, population of patient instructions, reconciliation of outside information, and completion of preventative health recommendations.

Results

Median time to close encounter (IQR) was lower for scribed visits [0.4 (4.8) days] compared to baseline and unscribed visits [1.2 (5.9) and 2.9 (5.4) days, both p < 0.001]. Scribed notes were more likely to have a clear history of present illness (HPI) [OR = 7.30 (2.35–22.7), p = 0.001] and sufficient HPI information [OR = 2.21 (1.13–4.35), p = 0.02] compared to unscribed notes. Physicians were more likely to review the medication list during scribed vs. baseline visits [OR = 1.70 (1.22–2.35), p = 0.002]. No differences were found in the number of visits per clinic session, patient time in clinic, completion of preventative health recommendations, or other outcomes.

Conclusions

Working with a scribe in an academic internal medicine practice was associated with more timely documentation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06710-y.

Effect of Outpatient Note Templates on Note Quality: NOTE (Notation Optimization through Template Engineering) Randomized Clinical Trial

BACKGROUND

This is the first randomized controlled trial evaluating the impact of note template design on note quality using a simulated patient encounter and a validated assessment tool.

OBJECTIVE

To compare note quality between two different templates using a novel randomized clinical simulation process.

DESIGN

A randomized non-blinded controlled trial of a standard note template versus redesigned template.

PARTICIPANTS

PGY 1-3 IM residents.

INTERVENTIONS

Residents documented the simulated patient encounter using one of two templates. The standard template was modeled after the usual outpatient progress note. The new template placed the assessment and plan section in the beginning, grouped subjective data into the assessment, and deemphasized less useful elements.

MAIN MEASURES

Note length; time to note completion; note template evaluation by resident authors; note evaluation by faculty reviewers.

KEY RESULTS

36 residents participated, 19 randomized to standard template, 17 to new. New template generated shorter notes (103 vs 285 lines, p < 0.001) that took the same time to complete (19.8 vs 21.6 min, p = 0.654). Using a 5-point Likert scale, residents considered new notes to have increased visual appeal (4 vs 3, p = 0.05) and less redundancy and clutter (4 vs 3, p = 0.006). Overall template satisfaction was not statistically different. Faculty reviewers rated the standard note more up-to-date (4.3 vs 2.7, p = 0.001), accurate (3.9 vs 2.6, p = 0.003), and useful (4 vs 2.8, p = 0.002), but less organized (3.3 vs 4.5, p < 0.001). Total quality was not statistically different.

CONCLUSIONS

Residents rated the new note template more visually appealing, shorter, and less cluttered. Faculty reviewers rated both note types equivalent in the overall quality but rated new notes inferior in terms of accuracy and usefulness though better organized. This study demonstrates a novel method of a simulated clinical encounter to evaluate note templates before the introduction into practice.

TRIAL REGISTRATION

ClinicalTrials.gov ID: NCT04333238.

Are health workers reduced to being drug dispensers of antiretroviral treatment? A randomized cross-sectional assessment of the quality of health care for HIV patients in northern Uganda

High quality of care (QoC) for antiretroviral treatment (ART) is essential to prevent treatment failure. Uganda, as many sub-Saharan African countries, increased access to ART by decentralizing provision to districts. However, little is known whether this rapid scale-up maintained high-quality clinical services. We assess the quality of ART in the Acholi and Lango sub-regions of northern Uganda to identify whether the technical quality of critical ART sub-system needs improvement. We conducted a randomized cross-sectional survey among health facilities (HF) in Acholi (n = 11) and Lango (n = 10). Applying lot quality assurance sampling principles with a rapid health facility assessment tool, we assessed ART services vis-à-vis national treatment guidelines using 37 indicators. We interviewed health workers (n = 21) using structured questionnaires, directly observed clinical consultations (n = 126) and assessed HF infrastructure, human resources, medical supplies and patient records in each health facility (n = 21). The district QoC performance standard was 80% of HF had to comply with each guideline. Neither sub-region complied with treatment guidelines. No HF displayed adequate: patient monitoring, physical examination, training, supervision and regular monitoring of patients' immunology. The full range of first and second line antiretroviral (ARV) medication was not available in Acholi while Lango had sufficient stocks. Clinicians dispensed available ARVs without benefit of physical examination or immunological monitoring. Patients reported compliance with drug use (>80%). Patients' knowledge of preventing HIV/AIDS transmission concentrated on condom use; otherwise it was poor. The poor ART QoC in northern Uganda raises major questions about ART quality although ARVs were dispensed. Poor clinical care renders patients' reports of treatment compliance as insufficient evidence that it takes place. Further studies need to test patients' immunological status and QoC in more regions of Uganda and elsewhere in sub-Saharan Africa to identify topical and geographical areas which are priorities for improving HIV care.

Electronic Health Record and Problem Lists in Leeds, United Kingdom: Variability of general practitioners' views

Data sharing of Electronic Health Records from general practices to secondary care in Leeds occurs through the so-called Leeds Care Records, which collects a specific set of codes from primary care, known as 'Active Problems', and presents it to the user. Variability on its content is a known issue. To explore general practitioners' views on their use of 'Active Problems' and on sharing data, so lessons could be learnt on how to homogenise and improve shared data. Assessing Leeds general practitioners' views through two parallel processes (60 online surveys and 17 interviews). General practitioners feel they do not have the time nor the training required for keeping a shared approach to concise and current Problem Lists in electronic patient records. Action is needed to reduce current variability, and to improve the quality of shared information. Some types of codes currently present in Problem Lists have very little support among general practitioners who consider the focus should be on long-term conditions and probably adding current acute diagnoses and life expectancy items and not omitting sensitive information. There is a perceived need of training and time to update Problem Lists if their quality is to improve.

Challenges of developing a digital scribe to reduce clinical documentation burden

Clinicians spend a large amount of time on clinical documentation of patient encounters, often impacting quality of care and clinician satisfaction, and causing physician burnout. Advances in artificial intelligence (AI) and machine learning (ML) open the possibility of automating clinical documentation with digital scribes, using speech recognition to eliminate manual documentation by clinicians or medical scribes. However, developing a digital scribe is fraught with problems due to the complex nature of clinical environments and clinical conversations. This paper identifies and discusses major challenges associated with developing automated speech-based documentation in clinical settings: recording high-quality audio, converting audio to transcripts using speech recognition, inducing topic structure from conversation data, extracting medical concepts, generating clinically meaningful summaries of conversations, and obtaining clinical data for AI and ML algorithms.

Variation in Physicians' Electronic Health Record Documentation and Potential Patient Harm from That Variation

BACKGROUND

Physician-to-physician variation in electronic health record (EHR) documentation not driven by patients' clinical status could be harmful.

OBJECTIVE

Measure variation in completion of common clinical documentation domains. Identify perceived causes and effects of variation and strategies to mitigate negative effects.

DESIGN

Sequential, explanatory, mixed methods using log data from a commercial EHR vendor and semi-structured interviews with outpatient primary care practices.

PARTICIPANTS

Quantitative: 170,332 encounters led by 809 physicians in 237 practices. Qualitative: 40 interviewees in 10 practices.

MAIN MEASURES

Interquartile range (IQR) of the proportion of encounters in which a physician completed documentation, for each documentation category. Multilevel linear regression measured the proportion of variation at the physician level.

KEY RESULTS

Five clinical documentation categories had substantial and statistically significant (p < 0.001) variation at the physician level after accounting for state, organization, and practice levels: (1) discussing results (IQR = 50.8%, proportion of variation explained by physician level = 78.1%); (2) assessment and diagnosis (IQR = 60.4%, physician-level variation = 76.0%); (3) problem list (IQR = 73.1%, physician-level variation = 70.1%); (4) review of systems (IQR = 62.3%, physician-level variation = 67.7%); and (5) social history (IQR = 53.3%, physician-level variation = 62.2%). Drivers of variation from interviews included user preferences and EHR designs with multiple places to record similar information. Variation was perceived to create documentation inefficiencies and risk patient harm due to missed or misinterpreted information. Mitigation strategies included targeted user training during EHR implementation and practice meetings focused on documentation standardization.

CONCLUSIONS

Physician-to-physician variation in EHR documentation impedes effective and safe use of EHRs, but there are potential strategies to mitigate negative consequences.

Electronic Health Record Interactions through Voice: A Review

BACKGROUND

Usability problems in the electronic health record (EHR) lead to workflow inefficiencies when navigating charts and entering or retrieving data using standard keyboard and mouse interfaces. Voice input technology has been used to overcome some of the challenges associated with conventional interfaces and continues to evolve as a promising way to interact with the EHR.

OBJECTIVE

This article reviews the literature and evidence on voice input technology used to facilitate work in the EHR. It also reviews the benefits and challenges of implementation and use of voice technologies, and discusses emerging opportunities with voice assistant technology.

METHODS

We performed a systematic review of the literature to identify articles that discuss the use of voice technology to facilitate health care work. We searched MEDLINE and the Google search engine to identify relevant articles. We evaluated articles that discussed the strengths and limitations of voice technology to facilitate health care work. Consumer articles from leading technology publications addressing emerging use of voice assistants were reviewed to ascertain functionalities in existing consumer applications.

RESULTS

Using a MEDLINE search, we identified 683 articles that were reviewed for inclusion eligibility. The references of included articles were also reviewed. Sixty-one papers that discussed the use of voice tools in health care were included, of which 32 detailed the use of voice technologies in production environments. Articles were organized into three domains: Voice for (1) documentation, (2) commands, and (3) interactive response and navigation for patients. Of 31 articles that discussed usability attributes of consumer voice assistant technology, 12 were included in the review.

CONCLUSION

We highlight the successes and challenges of voice input technologies in health care and discuss opportunities to incorporate emerging voice assistant technologies used in the consumer domain.

Electronic health record reviews to measure diagnostic uncertainty in primary care

RATIONALE, AIMS AND OBJECTIVES

Diagnostic uncertainty is common in primary care. Because it is challenging to measure, there is inadequate scientific understanding of diagnostic decision-making during uncertainty. Our objective was to understand how diagnostic uncertainty was documented in the electronic health record (EHR) and explore a strategy to retrospectively identify it using clinician documentation.

METHODS

We reviewed the literature to identify documentation language that could identify both direct expression and indirect inference of diagnostic uncertainty and designed an instrument to facilitate record review. Direct expression included clinician's use of question marks, differential diagnoses, symptoms as diagnosis, or vocabulary such as "probably, maybe, likely, unclear or unknown," while describing the diagnosis. Indirect inference included absence of documented diagnosis at the end of the visit, ordering of multiple consultations or diagnostic tests to resolve diagnostic uncertainty, and use of suspended judgement, test of treatment, and risk-averse disposition. Two physician-reviewers independently reviewed notes on a sample of outpatient visits to identify diagnostic uncertainty at the end of the visit. Documented Ninth Revision of the International Classification of Diseases (ICD-9) diagnosis codes and note quality were assessed.

RESULTS

Of 389 patient records reviewed, 218 had evidence of diagnostic activity and were included. In 156 visits (71.6%), reviewers identified clinicians who experienced diagnostic uncertainty with moderate inter-reviewer agreement (81.7%; Cohen's kappa: 0.609). Most cases (125, 80.1%) showed evidence of both direct expression and indirect inference. Uncertainty was directly expressed in 139 (89.1%) cases, most commonly by using symptoms as diagnosis (98, 62.8%), and inferred in 144 (92.3%). In more than 1/3 of visits (58, 37.2%), diagnostic uncertainty was recorded inappropriately using ICD-9 codes.

CONCLUSIONS

While current diagnosis coding mechanisms (ICD-9 and ICD-10) are unable to capture uncertainty, our study finds that review of EHR documentation can help identify diagnostic uncertainty with moderate reliability. Better measurement and understanding of diagnostic uncertainty could help inform strategies to improve the safety and efficiency of diagnosis.

Is problem alcohol use being detected and treated in Irish general practice?

BACKGROUND

The pattern of alcohol consumption in Ireland has serious societal and health consequences. General practice is well placed to screen for problem alcohol use and to carry out brief interventions. The aims of this study were to investigate the prevalence of documentation of problem alcohol use in patient records in Irish general practice, and to describe the documentation of its diagnosis and treatment.

METHODS

General practitioners (GPs) affiliated with an Irish medical school were invited to participate in the study. One hundred patients were randomly selected from each participating practice using the practice software and the clinical records were reviewed for evidence of problem alcohol use. The following was recorded: patient demographics, whether problem alcohol use was documented, whether they had an intervention, a psychotropic medication or if a referral was made. Descriptive statistics and an estimate of the prevalence were calculated using SPSS and SAS software.

RESULTS

Seventy one percent of the practices participated (n = 40), generating a sample of 3, 845 active patients. Only 57 patients (1.5%, 95% confidence interval 1 to 2%) were identified as having problem alcohol use in the previous two years. 29 (51%) of those with documented problem alcohol use were referred to other specialist services. 28 (49%) received a psychological intervention. 40 (70%) were prescribed psychotropic medications.

CONCLUSION

This is the first large scale study of patient records in general practice in Ireland looking at documentation of screening and treatment of problem alcohol use. It highlights the current lack of documentation of alcohol problems and the need to re-inforce positive attitudes among GPs in relation to preventive work.

Medical record keeping and system performance in orthopaedic trauma patients

Objective The medical record is critical for documentation and communication between healthcare professionals. The aim of the present study was to evaluate important aspects of the orthopaedic medical record and system performance to determine whether any deficiencies exist in these areas. Methods Review of 200 medical records of surgically treated traumatic lower limb injury patients was undertaken. The operative report, discharge summary and first and second outpatient reviews were evaluated. Results In all cases, an operative report was completed by a senior surgeon. Weight-bearing status was adequately documented in 91% of reports. Discharge summaries were completed for 82.5% of admissions, with 87.3% of these having instructions reflective of those in the operative report. Of first and second outpatient reviews, 69% and 73%, respectively, occurred within 1 week of the requested time. Previously documented management plans were changed in 30% of reviews. At 6-months post-operatively, 42% of patients had been reviewed by a member of their operating team. Discussion Orthopaedic medical record documentation remains an area for improvement. In addition, hospital out-patient systems perform suboptimally and may affect patient outcomes. What is known about the topic? Medical records are an essential tool in modern medical practice. Despite the importance of comprehensive documentation in the medical record, numerous examples of poor documentation have been demonstrated, including substandard documentation during consultant ward rounds by junior doctors leading to a breakdown in healthcare professional communication and potential patient mismanagement. Further inadequacies of medical record documentation have been demonstrated in surgical discharge notes, with complete and correct documentation reported to be as low as 65%. What does this paper add? Standards of patient care should be constantly monitored and deficiencies identified in order to implement a remedy and close the quality loop. The present study has highlighted that the standard of orthopaedic trauma medical record keeping at an Australian Level 1 trauma centre is below what is expected and several key areas of documentation require improvement. This paper further evaluates the system performance of the out-patient system, an area where, to the authors knowledge, there is no previous work published. The findings show that the performance was below what is expected for surgical review, with many patients failing to be reviewed by their operating surgeon. What are the implications for practitioners? The present study shows that there is a poor level of documentation and a standard of out-patient review below what is expected. The implications of these findings will be to highlight current deficiencies to practitioners and promote change in current practice to improve the quality of medical record documentation among medical staff. Further, the findings of poor system performance will promote change in the current system of delivering out-patient care to patients.

Making midwifery work visible: The multiple purposes of documentation

BACKGROUND

Midwives have a professional, ethical and legal obligation to effectively and thoroughly document the care provided to women and the decisions made within the partnership relationship. To appreciate the best approach to documenting midwifery care, it is important to first understand the purpose of midwifery documentation.

AIM

The aim of this article is to explore the literature in relation to the purposes of midwifery documentation.

METHOD

A literature search was performed using the CINAHL and Pubmed databases. Hand searching of reference and citation lists was employed to deepen the literature pool.

FINDINGS AND DISCUSSION

No research articles with a midwifery focus were found addressing the purpose of documentation. Broader searching of literature from other healthcare fields was drawn on to identify the contribution of record keeping to: partnership and continuity of care; communication between health professionals; improved standards of care; audits and clinical reviews; research and education; the visibility of midwifery work; the reflective practices of midwives; professional accountability; the legal record of care; the narrative record of experience for women.

CONCLUSION

The purpose of midwifery documentation is complex and multi-factorial, involving much more than the recording of clinical and legal details of a woman's care. Midwifery documentation may potentially enhance the maternity care experience for women, support the role of the midwife, positively impact collaboration between health professionals, and contribute to organisational processes and research. Further research is needed to clarify how to address the documentation priorities of women and midwives, within the context of the maternity record.

Access to Electronic Personal Health Records Among Patients With Multiple Chronic Conditions: A Secondary Data Analysis

BACKGROUND

In the United States, national incentives for offering access to electronic personal health records (ePHRs) through electronic means are geared toward creating a culture of patient engagement. One group of patients who stand to benefit from online access to ePHRs is the growing population with multiple chronic conditions (MCC). However, little is known about the current availability and use of ePHRs and patient portals among those managing MCC.

OBJECTIVE

The aim was to determine the associations between number of chronic conditions and sociodemographic characteristics and usage of ePHRs, and to assess how the public's use of ePHRs varies across subpopulations, including those with MCC.

METHODS

This study used data collected from the 2014 Health Information National Trends Survey (HINTS), and assessed differences in use of ePHRs between those with and without MCC (N=3497) using multiple logistic regression techniques. Variables associated with health care systems (insurance status, having a regular provider) and patient-reported self-efficacy were included in the statistical models.

RESULTS

Those with MCC (n=1555) had significantly higher odds of accessing their records three or more times in the past year compared to those reporting no chronic conditions (n=1050; OR 2.46, 95% CI 1.37-4.45), but the overall percentage of those with MCC using ePHRs remained low (371 of 1529 item respondents, 25.63% weighted). No difference in odds of accessing their records was found between those reporting one chronic condition (n=892) and those reporting none (n=1050; OR 1.02, 95% CI 0.66-1.58). Significant differences in odds of accessing ePHRs were seen between income and age groups (P<.001 and P=.05, respectively), and by whether respondents had a regular provider (P=.03).

CONCLUSIONS

We conclude that ePHRs provide a unique opportunity to enhance MCC patient self-management, but additional effort is needed to ensure that these patients are able to access their ePHRs. An increase in availability of patient access to their ePHRs may provide an opportunity to increase patient engagement and support self-management for all patients and especially those with MCC.

Problem-oriented charting: A review

Problem-oriented charting is form of medical documentation that organizes patient data by a diagnosis or problem. In this review, we discuss the history and current use of problem-oriented charting by critically evaluating the literature on the topic. We provide insights with regard to our own institutional use of problem-oriented charting and potential opportunities for research.

Safe Practices for Copy and Paste in the EHR. Systematic Review, Recommendations, and Novel Model for Health IT Collaboration

BACKGROUND

Copy and paste functionality can support efficiency during clinical documentation, but may promote inaccurate documentation with risks for patient safety. The Partnership for Health IT Patient Safety was formed to gather data, conduct analysis, educate, and disseminate safe practices for safer care using health information technology (IT).

OBJECTIVE

To characterize copy and paste events in clinical care, identify safety risks, describe existing evidence, and develop implementable practice recommendations for safe reuse of information via copy and paste.

METHODS

The Partnership 1) reviewed 12 reported safety events, 2) solicited expert input, and 3) performed a systematic literature review (2010 to January 2015) to identify publications addressing frequency, perceptions/attitudes, patient safety risks, existing guidance, and potential interventions and mitigation practices.

RESULTS

The literature review identified 51 publications that were included. Overall, 66% to 90% of clinicians routinely use copy and paste. One study of diagnostic errors found that copy and paste led to 2.6% of errors in which a missed diagnosis required patients to seek additional unplanned care. Copy and paste can promote note bloat, internal inconsistencies, error propagation, and documentation in the wrong patient chart. Existing guidance identified specific responsibilities for authors, organizations, and electronic health record (EHR) developers. Analysis of 12 reported copy and paste safety events was congruent with problems identified from the literature review.

CONCLUSION

Despite regular copy and paste use, evidence regarding direct risk to patient safety remains sparse, with significant study limitations. Drawing on existing evidence, the Partnership developed four safe practice recommendations: 1) Provide a mechanism to make copy and paste material easily identifiable; 2) Ensure the provenance of copy and paste material is readily available; 3) Ensure adequate staff training and education; 4) Ensure copy and paste practices are regularly monitored, measured, and assessed.

A patient feedback reporting tool for OpenNotes: implications for patient-clinician safety and quality partnerships

BACKGROUND

OpenNotes, a national movement inviting patients to read their clinicians' notes online, may enhance safety through patient-reported documentation errors.

OBJECTIVE

To test an OpenNotes patient reporting tool focused on safety concerns.

METHODS

We invited 6225 patients through a patient portal to provide note feedback in a quality improvement pilot between August 2014 and 2015. A link at the end of the note led to a 9-question survey. Patient Relations personnel vetted responses, shared safety concerns with providers and documented whether changes were made.

RESULTS

2736/6225(44%) of patients read notes; among these, 1 in 12 patients used the tool, submitting 260 reports. Nearly all (96%) respondents reported understanding the note. Patients and care partners documented potential safety concerns in 23% of reports; 2% did not understand the care plan and 21% reported possible mistakes, including medications, existing health problems, something important missing from the note or current symptoms. Among these, 64% were definite or possible safety concerns on clinician review, and 57% of cases confirmed with patients resulted in a change to the record or care. The feedback tool exceeded the reporting rate of our ambulatory online clinician adverse event reporting system several-fold. After a year, 99% of patients and care partners found the tool valuable, 97% wanted it to continue, 98% reported unchanged or improved relationships with their clinician, and none of the providers in the small pilot reported worsening workflow or relationships with patients.

CONCLUSIONS

Patients and care partners reported potential safety concerns in about one-quarter of reports, often resulting in a change to the record or care. Early data from an OpenNotes patient reporting tool may help engage patients as safety partners without apparent negative consequences for clinician workflow or patient-clinician relationships.

The map is not the territory: medical records and 21st century practice

Documentation of care is at risk of overtaking the delivery of care in terms of time, clinician focus, and perceived importance. The medical record as currently used for documentation contributes to increased cognitive workload, strained clinician-patient relationships, and burnout. We posit that a near verbatim transcript of the clinical encounter is neither feasible nor desirable, and that attempts to produce this exact recording are harmful to patients, clinicians, and the health system. In this Viewpoint, we focus on the alternative constructions of the medical record to bring them back to their primary purpose-to aid cognition, communicate, create a succinct account of care, and support longitudinal comprehensive care-thereby to support the building of relationships and medical decision making while decreasing workload.

The Use of Evidence-Based, Problem-Oriented Templates as a Clinical Decision Support in an Inpatient Electronic Health Record System

BACKGROUND

The integration of clinical decision support (CDS) in documentation practices remains limited due to obstacles in provider workflows and design restrictions in electronic health records (EHRs). The use of electronic problem-oriented templates (POTs) as a CDS has been previously discussed but not widely studied.

OBJECTIVE

We evaluated the voluntary use of evidence-based POTs as a CDS on documentation practices.

METHODS

This was a randomized cohort (before and after) study of Hospitalist Attendings in an Academic Medical Center using EPIC EHRs. Primary Outcome measurement was note quality, assessed by the 9-item Physician Documentation Quality Instrument (PDQI-9). Secondary Outcome measurement was physician efficiency, assessed by the total charting time per note.

RESULTS

Use of POTs increased the quality of note documentation [score 37.5 vs. 39.0, P = 0.0020]. The benefits of POTs scaled with use; the greatest improvement in note quality was found in notes using three or more POTs [score 40.2, P = 0.0262]. There was no significant difference in total charting time [30 minutes vs. 27 minutes, P = 0.42].

CONCLUSION

Use of evidence-based and problem-oriented templates is associated with improved note quality without significant change in total charting time. It can be used as an effective CDS during note documentation.

Use of Electronic Health Record Simulation to Understand the Accuracy of Intern Progress Notes

Background With the widespread adoption of electronic health records (EHRs), there is a growing awareness of problems in EHR training for new users and subsequent problems with the quality of information present in EHR-generated progress notes. By standardizing the case, simulation allows for the discovery of EHR patterns of use as well as a modality to aid in EHR training. Objective To develop a high-fidelity EHR training exercise for internal medicine interns to understand patterns of EHR utilization in the generation of daily progress notes. Methods Three months after beginning their internship, 32 interns participated in an EHR simulation designed to assess patterns in note writing and generation. Each intern was given a simulated chart and instructed to create a daily progress note. Notes were graded for use of copy-paste, macros, and accuracy of presented data. Results A total of 31 out of 32 interns (97%) completed the exercise. There was wide variance in use of macros to populate data, with multiple macro types used for the same data category. Three-quarters of notes contained either copy-paste elements or the elimination of active medical problems from the prior days' notes. This was associated with a significant number of quality issues, including failure to recognize a lack of deep vein thrombosis prophylaxis, medications stopped on admission, and issues in prior discharge summary. Conclusions Interns displayed wide variation in the process of creating progress notes. Additional studies are being conducted to determine the impact EHR-based simulation has on standardization of note content.

Identification of Nonresponse to Treatment Using Narrative Data in an Electronic Health Record Inflammatory Bowel Disease Cohort

BACKGROUND

Electronic health records, increasingly a part of healthcare, provide a wealth of untapped narrative free text data that have the potential to accurately inform clinical outcomes.

METHODS

From a validated cohort of patients with Crohn's disease or ulcerative colitis, we identified patients with ≥1 coded or narrative mention of monoclonal antibodies to tumor necrosis factor α. Chart review by ascertained true use of therapy, time of initiation, and cessation of treatment, and also clinical response stratified as nonresponse, partial, or complete response at 1 year. Internal consistency was assessed in an independent validation cohort.

RESULTS

A total of 3087 patients had a mention of an antibodies to tumor necrosis factor α. Actual therapy initiation was within 60 days of the first coded mention in 74% of patients. In the derivation cohort, 18% of antibodies to tumor necrosis factor α starts were classified as nonresponse at 1 year, 21% as partial, and 56% as complete response. On multivariate analysis, the number of narrative mentions of diarrhea (odds ratio 1.08; 95% confidence interval, 1.02-1.14) and fatigue (odds ratio 1.16; 95% confidence interval, 1.02-1.32) was independently associated with nonresponse at 1 year (area under the curve 0.82). A likelihood of nonresponse score comprising a weighted sum of both demonstrated a good dose-response relationship across nonresponders (2.18), partial (1.20), and complete (0.50) responders (P < 0.0001) and correlated well with need for surgery or hospitalizations.

CONCLUSIONS

Narrative data in an electronic health record offer considerable potential to define temporally evolving disease outcomes such as nonresponse to treatment.

Internal medicine progress note writing attitudes and practices in an electronic health record

BACKGROUND

The electronic health record (EHR) has been viewed with both praise and skepticism. Multiple editorials have expressed concerns that EHR implementation and "efficiency tools" such as copy forward and auto population have resulted in a decrement in note accuracy, relevance, and critical thinking.

OBJECTIVE

To evaluate the perceptions of internal medicine housestaff and attendings on inpatient progress note quality at 4 academic institutions after the implementation of an EHR.

DESIGN

Cross-sectional survey.

MEASUREMENTS

We developed surveys that assessed housestaff and attendings opinion of current progress note quality, the impact of the EHR on quality, and the purposes of a progress note.

RESULTS

We received 99 completed surveys from interns (66%), 155 from residents (49%), and 153 from attendings (70%) across 4 institutions. The majority of housestaff responded that the quality of notes was "unchanged" or "better" following the implementation of an EHR, whereas attendings believed note quality was "unchanged" or "worse." Attendings' perceptions of housestaff notes were significantly lower than housestaff perceptions of their own notes across all domains. With regard to the effect of copy forward and autopopulation, the majority of housestaff viewed these to be "neutral" or "somewhat positive," whereas attendings viewed these as "neutral" or "somewhat negative." Housestaff and attendings had nearly perfect agreement regarding the purpose of the progress note.

CONCLUSIONS

Attendings and housestaff disagree on the current quality of progress notes and the impact of an EHR on note quality, but agree on the purpose of a progress note.