Lessons Learned from OpenNotes Learning Mode and Subsequent Implementation across a Pediatric Health System

Acceptability of Adolescent Portal Access Policies to Parents and Adolescents: A Delphi Study

PURPOSE

United States healthcare systems have enacted varied adolescent online patient portal policies. No prior work has established whether these policies are acceptable to adolescents and parents.

METHODS

Mixed-method Delphi approach with 18 parents and 18 adolescents with and without chronic illness. We presented 19 policies related to (1) who can access different types of information through the portal; (2) timing of results release; and (3) portal messaging policies, such as whether individuals are charged for portal messages. Panelists voted on whether they "supported," "could live with," or "opposed" each policy.

RESULTS

Thirty-six panelists completed surveys with no attrition. For access-related policies, panelists opposed prohibiting parent or adolescent access, and they accepted policies that provided transparent access to sensitive and nonsensitive information for parents and adolescents. Panelists failed to reach consensus about whether adolescents should have the granular ability to determine which parts of the medical record their parents can see. For policies related to timing of release, panelists found either immediate or delayed access to results to be acceptable, although more panelists supported immediate access. For portal messaging policies, panelists supported the ability of parents and adolescents to send messages and opposed being charged for portal messages. Panelists found it acceptable for adolescents to see messages written by their parents, but failed to reach consensus on whether parents should see messages written by adolescents.

DISCUSSION

Some healthcare systems have implemented adolescent portal policies that panelists opposed or found concerning. Hospital leaders should consider these data as they re-evaluate institutional policies.

Provider Perspectives on Adolescent Confidentiality and the Electronic Health Record Postimplementation of the 21st Century Cures Act Final Rule

PURPOSE

The 21st Century Cures Act Final Rule mandates increased transparency and accessibility of the Electronic Health Record (EHR). This mandate has exacerbated tensions in adolescent healthcare between transparency and confidentiality. This study evaluates clinicians' perspectives on how well the EHR maintains confidentiality for adolescents in the post-Cures Act era.

METHODS

A web-based survey was distributed via the national listserv of the Society for Adolescent Health and Medicine in March-April 2022. English-speaking members practicing in the Unites States who used an EHR to document clinical visits with minors were eligible. The survey included questions about EHR training, features, and approach to information sharing with adolescent patients and proxies.

RESULTS

Participants included 97 respondents from 32 states. Most participants were physicians (98%) and identified themselves as attending (89%). Several EHR vendors were represented, although the majority used Epic (76%). As has been seen in prior studies, there remains significant variability in approaches to patient portal access for adolescent patients and their adult proxies. Respondents report that training around adolescent-specific privacy issues remains infrequent and is perceived as inadequate. Adolescent providers, despite feeling confident in navigating the EHR generally, continue to report low rates of confidence in how well their EHR may protect adolescent privacy.

DISCUSSION

Clinicians have persistent concerns about adolescent confidentiality postimplementation of the 21st Century Cures Act. Sharing sufficient information while protecting adolescent confidentiality might require standardization by EHR vendors to improve granularity of proxy information sharing. Healthcare institutions must also commit to training providers on management of adolescent confidentiality.

Providing Adolescents with Access to Online Patient Portals: Interviews with Parent-Adolescent Dyads

OBJECTIVE

To identify perceived benefits, problems, facilitators, and barriers to adolescent online patient portal use.

STUDY DESIGN

Qualitative, semi-structured interviews with dyads of parents and adolescents with or without chronic illness. The study team purposively sampled for racial and ethnic minorities and fathers. Three team members then performed thematic analysis of the transcripts, with subsequent dyadic analysis of themes represented by related parents and adolescents.

RESULTS

We performed 102 interviews with 51 dyads of parents and adolescents (26 with chronic illness, 25 without chronic illness). Nearly all participants believed that adolescents should be permitted portal access. We identified 4 themes related to portal benefits: improves adolescent's knowledge of health; supports medical self-management and autonomy; strengthens communication and relationships; and supports parental influence. We identified 4 themes related to portal problems: misunderstanding or confusion; emotional distress; strain on relationships; and irresponsible use of portal. Facilitators of portal use included severity of illness, adolescent's curiosity, and ease of technology use. Barriers included lack of awareness or interest, complexity of information, and access difficulties. Twenty adolescents (39%) did not know they could access the portal, and 23 (45%) lacked interest in portals. Parents and adolescents seldom used the portal as a collaborative tool, and instead were engaging with the portal independently.

CONCLUSION

Parents and adolescents perceive several benefits and problems with portal use, but many adolescents lack interest in using portals. Adolescent portals represent an underutilized resource to engage adolescents in their care.

Confidentiality in the Care of Adolescents: Technical Report

Confidentiality is a foundational element of high-quality, accessible, and equitable health care. Despite strong grounding in federal and state laws, professional guidelines, and ethical standards, health care professionals and adolescent patients face a range of complexities and barriers to seeking and providing confidential care to adolescents across different settings and circumstances. The dynamic needs of adolescents, the oftentimes competing interests of key stakeholders, the rapidly evolving technological context of care, and variable health care billing and claims requirements are all important considerations in understanding how to optimize care to focus on and meet the needs of the adolescent patient. The following assessment of the evolving evidence base offers a view of the current state and best practices while pointing to numerous unmet needs and opportunities for improvement in the care experiences of youth as well as their health outcomes.

Guiding Principles for Adolescent Web-Based Portal Access Policies: Interviews With Informatics Administrators

BACKGROUND

Web-based patient portals are tools that could support adolescents in managing their health and developing autonomy. However, informatics administrators must navigate competing interests when developing portal access policies for adolescents and their parents.

OBJECTIVE

We aimed to assess the perspectives of informatics administrators on guiding principles for the development of web-based health care portal access policies in adolescent health care.

METHODS

We interviewed informatics administrators from US hospitals with ≥50 dedicated pediatric beds. We performed a thematic analysis of guiding principles for developing and implementing adolescent portal access policies.

RESULTS

We interviewed 65 informatics leaders who represented 63 pediatric hospitals, 58 health care systems, 29 states, and 14,379 pediatric hospital beds. Participants described 9 guiding principles related to three overarching themes: (1) balancing confidentiality and other care needs, (2) balancing simplicity and granularity, and (3) collaborating and advocating. Participants described the central importance of prioritizing the health and safety of the adolescent while also complying with state and federal laws. However, there were differing beliefs about how to prioritize health and safety and what role parents should play in supporting the adolescent's health care. Participants also identified areas where clinicians and institutions can advocate for adolescents, especially with electronic health record vendors and legislators.

CONCLUSIONS

Informatics administrators provided guiding principles for adolescent portal access policies that aimed to balance the competing needs of adolescent confidentiality and the usefulness of the portal. Portal access policies must prioritize the adolescent's health and safety while complying with state and federal laws. However, institutions must determine how to best enact these principles. Institutions and clinicians should strive for consensus on principles to strengthen advocacy efforts with institutional leadership, electronic health record vendors, and lawmakers.

Shifting Mindsets: The Impact of a Patient Portal on Functioning and Recovery in a Mental Health Setting

OBJECTIVE

This study aims to understand whether higher use of a patient portal can have an impact on mental health functioning and recovery.

METHOD

A mixed methods approach was used for this study. In 2019-2021, patients with mental health diagnoses at outpatient clinics in an academic centre were invited to complete World Health Organization Disability Assessment Scale 12 (WHODAS-12) and Mental Health Recovery Measure surveys at baseline, 3 months, and 6 months after signing up for the portal. At the 3-month time point, patients were invited to a semistructured interview with a member of the team to contextualize the findings obtained from the surveys. Analytics data was also collected from the platform to understand usage patterns on the portal.

RESULTS

Overall, 113 participants were included in the analysis. There was no significant change in mental health functioning and recovery scores over the 6-month period. However, suboptimal usage was observed as 46% of participants did not complete any tasks within the portal. Thirty-five participants had low use of the portal (1-9 interactions) and 18 participants had high usage (10+ interactions). There were also no differences in mental health functioning and recovery scores between low and high users of the portal. Qualitative interviews highlighted many opportunities where the portal can support overall functioning and mental health recovery.

CONCLUSIONS

Collectively, this study suggests that higher use of a portal had no impact, either positive or negative, on mental health outcomes. While it may offer convenience and improved patient satisfaction, adequate support is needed to fully enable these opportunities for patient care. As the type of interaction with the portal was not specifically addressed, future work should focus on looking at ways to support patient engagement and portal usage throughout their care journey.

Perils of Auto-Population of Newborn EHR With Maternal Intimate Partner Violence History

In 2020, the 21st Century Cures Act was enacted, mandating that patients have access to their electronic health record. This has the potential to benefit both patients and clinicians by increasing communication, transparency, and patient autonomy. However, with the onset of the act, a number of unintended consequences of the act have been identified. Presently, we discuss a case where documentation of intimate partner violence and the safety plan documented in a mother's electronic health record automatically populated her newborn's admission note. This confidential information inadvertently became accessible to the perpetrator: the infant's father.

The State-of-the-Art of Patient Portals: Adapting to External Factors, Addressing Barriers, and Innovating

BACKGROUND AND OBJECTIVE

Recent external factors-the 21st Century Cures Act and the coronavirus disease 2019 (COVID-19) pandemic-have stimulated major changes in the patient portal landscape. The objective of this state-of-the-art review is to describe recent developments in the patient portal literature and to identify recommendations and future directions for the design, implementation, and evaluation of portals.

METHODS

To focus this review on salient contemporary issues, we elected to center it on four topics: (1) 21st Century Cures Act's impact on patient portals (e.g., Open Notes); (2) COVID-19's pandemic impact on portals; (3) proxy access to portals; and (4) disparities in portal adoption and use. We conducted targeted PubMed searches to identify recent empirical studies addressing these topics, used a two-part screening process to determine relevance, and conducted thematic analyses.

RESULTS

Our search identified 174 unique papers, 74 were relevant empirical studies and included in this review. Among these papers, we identified 10 themes within our four a priori topics, including preparing for and understanding the consequences of increased patient access to their electronic health information (Cures Act); developing, deploying, and evaluating new virtual care processes (COVID-19); understanding current barriers to formal proxy use (proxy access); and addressing disparities in portal adoption and use (disparities).

CONCLUSION

Our results suggest that the recent trends toward understanding the implications of immediate access to most test results, exploring ways to close gaps in portal adoption and use among different sub-populations, and finding ways to leverage portals to improve health and health care are the next steps in the maturation of patient portals and are key areas that require more research. It is important that health care organizations share their innovative portal efforts, so that successful measures can be tested in other contexts, and progress can continue.

A Natural Language Processing Model to Identify Confidential Content in Adolescent Clinical Notes

BACKGROUND

The 21st Century Cures Act mandates the immediate, electronic release of health information to patients. However, in the case of adolescents, special consideration is required to ensure that confidentiality is maintained. The detection of confidential content in clinical notes may support operational efforts to preserve adolescent confidentiality while implementing information sharing.

OBJECTIVES

This study aimed to determine if a natural language processing (NLP) algorithm can identify confidential content in adolescent clinical progress notes.

METHODS

A total of 1,200 outpatient adolescent progress notes written between 2016 and 2019 were manually annotated to identify confidential content. Labeled sentences from this corpus were featurized and used to train a two-part logistic regression model, which provides both sentence-level and note-level probability estimates that a given text contains confidential content. This model was prospectively validated on a set of 240 progress notes written in May 2022. It was subsequently deployed in a pilot intervention to augment an ongoing operational effort to identify confidential content in progress notes. Note-level probability estimates were used to triage notes for review and sentence-level probability estimates were used to highlight high-risk portions of those notes to aid the manual reviewer.

RESULTS

The prevalence of notes containing confidential content was 21% (255/1,200) and 22% (53/240) in the train/test and validation cohorts, respectively. The ensemble logistic regression model achieved an area under the receiver operating characteristic of 90 and 88% in the test and validation cohorts, respectively. Its use in a pilot intervention identified outlier documentation practices and demonstrated efficiency gains over completely manual note review.

CONCLUSION

An NLP algorithm can identify confidential content in progress notes with high accuracy. Its human-in-the-loop deployment in clinical operations augmented an ongoing operational effort to identify confidential content in adolescent progress notes. These findings suggest NLP may be used to support efforts to preserve adolescent confidentiality in the wake of the information blocking mandate.

The Prevalence of Confidential Content in Adolescent Progress Notes Prior to the 21st Century Cures Act Information Blocking Mandate

BACKGROUND

The 21st Century Cures Act information blocking final rule mandated the immediate and electronic release of health care data in 2020. There is anecdotal concern that a significant amount of information is documented in notes that would breach adolescent confidentiality if released electronically to a guardian.

OBJECTIVES

The purpose of this study was to quantify the prevalence of confidential information, based on California laws, within progress notes for adolescent patients that would be released electronically and assess differences in prevalence across patient demographics.

METHODS

This is a single-center retrospective chart review of outpatient progress notes written between January 1, 2016, and December 31, 2019, at a large suburban academic pediatric network. Notes were labeled into one of three confidential domains by five expert reviewers trained on a rubric defining confidential information for adolescents derived from California state law. Participants included a random sampling of eligible patients aged 12 to 17 years old at the time of note creation. Secondary analysis included prevalence of confidentiality across age, gender, language spoken, and patient race.

RESULTS

Of 1,200 manually reviewed notes, 255 notes (21.3%) (95% confidence interval: 19-24%) contained confidential information. There was a similar distribution among gender and age and a majority of English speaking (83.9%) and white or Caucasian patients (41.2%) in the cohort. Confidential information was more likely to be found in notes for females (p < 0.05) as well as for English-speaking patients (p < 0.05). Older patients had a higher probability of notes containing confidential information (p < 0.05).

CONCLUSION

This study demonstrates that there is a significant risk to breach adolescent confidentiality if historical progress notes are released electronically to proxies without further review or redaction. With increased sharing of health care data, there is a need to protect the privacy of the adolescents and prevent potential breaches of confidentiality.

Creating a Guardrail System to Ensure Appropriate Activation of Adolescent Portal Accounts

The parent of an adolescent patient noticed an upcoming appointment in the patient's portal account that should have remained confidential to the parent. As it turned out, this parent was directly accessing their child's adolescent patient portal account instead of using a proxy account. After investigation of this case, it was found that the adolescent account had been activated with the parent's demographic (i.e., phone/email) information. This case illustrates the challenges of using adult-centric electronic health record (EHR) systems and how our institution addressed the problem of incorrect portal account activations.Confidentiality is fundamental to providing healthcare to adolescents. To comply with the 21st Century Cures Act's information blocking rules, confidential information must be released to adolescent patients when appropriate while also remaining confidential from their guardians. While complying with this national standard, systems of care must also account for interstate variability in which services allow for confidential adolescent consent. Unfortunately, there are high rates of guardian access to adolescent portal accounts which may lead to unintended disclosure of confidential information. Therefore, measures must be taken to minimize the risk of inadvertent confidentiality breaches via adolescent patient portals.Our institution implemented a guardrail system that checks the adolescent patient's contact information against the contact information of their parent/guardian/guarantor. This guardrail reduced the rate of account activation errors after implementation. However, the guardrail can be bypassed when demographic fields are missing. Thus, ongoing efforts to create pediatric-appropriate demographic fields, clearly distinguishing patient from proxy, in the EHR and workflows for registration of proxy accounts in the patient portal are needed.

Factors influencing the conduction of confidential conversations with adolescents in the emergency department: A multicenter, qualitative analysis

BACKGROUND

Health care providers (HCPs) in the emergency department (ED) frequently must decide whether to conduct or forego confidential conversations with adolescent patients about sensitive topics, such as those related to mental health, substance use, and sexual and reproductive health. The objective of this multicenter qualitative analysis was to identify factors that influence the conduct of confidential conversations with adolescent patients in the ED.

METHODS

In this qualitative study, we conducted semistructured interviews of ED HCPs from five academic, pediatric EDs in distinct geographic regions. We purposively sampled HCPs across gender, professional title, and professional experience. We used the Theoretical Domains Framework (TDF) to develop an interview guide to assess individual and system-level factors affecting HCP behavior regarding the conduct of confidential conversations with adolescents. Enrollment continued until we reached saturation. Interviews were recorded, transcribed, and coded by three investigators based on thematic analysis. We used the coded transcripts to collaboratively generate belief statements, which are first-person statements that reflect shared perspectives.

RESULTS

We conducted 38 interviews (18 physicians, 11 registered nurses, five nurse practitioners, and four physician assistants). We generated 17 belief statements across nine TDF domains. Predominant influences on having confidential conversations included self-efficacy in speaking with adolescents alone, wanting to address sexual health complaints, maintaining patient flow, experiencing parental resistance and limited space, and having inadequate resources to address patient concerns and personal preconceptions about patients. Perspectives divided between wanting to provide focused medical care related only to their chief complaint versus self-identifying as a holistic medical HCP.

CONCLUSIONS

The factors influencing the conduct of confidential conversations included multiple TDF domains, elucidating how numerous intersecting factors influence whether ED HCPs address sensitive adolescent health needs. These data suggest methods to enhance and facilitate confidential conversations when deemed appropriate in the care of adolescents in the ED.

Parent Perspectives on Sharing Pediatric Hospitalization Clinical Notes

BACKGROUND AND OBJECTIVES

Federal guidelines mandate that hospitals provide patients and caregivers with free, online access to their physician's clinical notes. This study sought to identify parent perceptions of the benefits and challenges of real-time note access during their child's hospitalization and strategies to optimize note-sharing at the bedside.

METHODS

This qualitative study was conducted with parents of children aged <12 years admitted to a pediatric hospitalist service in April 2019. Parents were given access to their child's admission and daily progress notes on a bedside tablet (iPad), and interviewed upon discharge. In-depth, 60-minute interviews were audio-recorded and transcribed. Two researchers developed and refined a codebook and coded data inductively and deductively with validation by a third researcher. Thematic analysis was used to identify emergent themes.

RESULTS

The 28 interviewed parents described 6 benefits of having note access, which: provided a recap and improved their knowledge about their child's care plan, enhanced communication, facilitated empowerment, increased autonomy, and incited positive emotions. Potential challenges included that notes: caused confusion, hindered communication with the health care team, highlighted problems with note content, and could incite negative emotions. Parents recommended 4 strategies to support sharing: provide preemptive communication about expectations, optimize the note release process, consider parent-friendly note template modifications, and offer informational resources for parents.

CONCLUSIONS

Findings provide a framework for operationalizing note-sharing with parents during hospitalization. These results have important implications for hospitals working to comply with federal regulations and researchers assessing the effects of increased information transparency in the inpatient setting.

Effect of Notes' Access and Complexity on OpenNotes' Utility

BACKGROUND

Health care providers are now required to provide their patients access to their consultation and progress notes. Early research of this concept, known as "OpenNotes," showed promising results in terms of provider acceptability and patient adoption, yet objective evaluations relating to patients' interactions with the notes are limited.

OBJECTIVES

To assess the effect of the complexity level of notes and number of accesses (initial read vs. continuous access) on the user's performance, perceived usability, cognitive workload, and satisfaction with the notes.

METHODS

We used a 2*2 mixed subjects experimental design with two independent variables: (1) note's complexity at two levels (simple vs. complex) and (2) number of accesses to notes at two levels (initial vs. continuous). Fifty-three participants were randomly assigned to receive a simple versus complex radiation oncology clinical note and were tested on their performance for understanding the note content after an initial read, and then with continuous access to the note. Performance was quantified by comparing each participant's answers to the ones developed by the research team and assigning a score of 0 to 100 based on participants' understanding of the notes. Usability, cognitive workload, and satisfaction scores of the notes were quantified using validated tools.

RESULTS

Performance for understanding was significantly better in simple versus complex notes with continuous access (p = 0.001). Continuous access to the notes was also positively associated with satisfaction scores (p = 0.03). The overall perceived usability, cognitive workload, and satisfaction scores were considered low for both simple and complex notes.

CONCLUSION

Simplifying notes can improve understanding of notes for patients/families. However, perceived usability, cognitive workload, and satisfaction with even the simplified notes were still low. To make notes more useful for patients and their families, there is a need for dramatic improvements to the overall usability and content of the notes.