Enhancing reproducibility using interprofessional team best practices

Developing a Translational Team Training Program using the Wisconsin Interventions in Team Science Framework

The Clinical and Translational Science Awards (CTSA) Program supports a national network of medical research institutions working to improve the translational process. High-performing translational teams (TTs) are critical for advancing evidence-based approaches that improve human health. When focused on content-appropriate knowledge, skills, and attitudes, targeted training results in the substantial internalization of training content, producing new skills that can be applied to improve team outputs, outcomes, and benefits. More rigorous approaches to develop, test, and evaluate interventions are needed, and we used the Wisconsin Interventions in Team Science framework as a model to systematize our efforts. We designed, built, and tested a five-session TT Training Program for translational researchers. The 90-minute sessions were pilot-tested with 47 postdoctoral fellows and evaluated through a structured evaluation plan. Ninety-five percent of post-session survey respondents indicated that the content and skills provided would make them more effective collaborators, and one hundred percent would recommend the sessions to colleagues. Respondents' scores increased from pretest to posttest for most learning outcomes. Refinements from participant feedback are described. This work provides a foundation for the continued evolution of evidence-based training programs in the CTSA environment.

Freelance information management agents: why information management is so hard on translational teams

Introduction

To conduct high-quality, rigorous research, and advance scientific knowledge, Translational Teams (TTs) engage in information behaviors, including seeking, using, creating, sharing, storing, and retrieving information, in ways specific to the translational context. Currently, little is known about TTs' approach to information management. This qualitative pilot study explored how TTs at the University of Wisconsin-Madison interact with information, as well as the scientific and organizational impact of their interactions.

Methods

We conducted interviews with ten members of UW TTs. Interviews were transcribed and thematic analysis was conducted.

Results

Four themes emerged: (1) TT members did not recognize the centrality of information or information behaviors to their scientific work; (2) TT members engaged in similar information behaviors and used similar tools across disciplines and topics; (3) TT members did not receive support or guidance from their institution in managing information; and (4) Individualized choices of TT members conflicted at the team level, causing confusion and increasing the potential for data and information loss. Acting as freelance information management agents, TT members made individualized decisions about what tools to use and how to use them, often in a piecemeal manner and without communicating these decisions to other team members.

Conclusion

Research institutions should both encourage teams to discuss their information management approaches at the beginning of a project and provide leaders with training on how to have these conversations and what topics should be included. Additionally, institutions can provide researchers with guidelines for using software platforms to help mitigate information management challenges.

Toward a translational team science hierarchy of needs: Exploring the information management challenges of team science

Background

Clinical and Translational Research (CTR) requires a team-based approach, with successful teams engaging in skilled management and use of information. Yet we know little about the ways that Translational Teams (TTs) engage with information across the lifecycle of CTR projects. This qualitative study explored the challenges that information management imposes on the conduct of team-based CTR.

Methods

We conducted interviews with ten members of TTs at University of Wisconsin. Interviews were transcribed and thematic analysis was conducted.

Results

TTs' piecemeal and reactive approaches to information management created conflict within the team and slowed scientific progress. The lack of cohesive information management strategies made it more difficult for teams to develop strong team processes like communication, scientific coordination, and project management. While TTs' research was hindered by the institutional challenges of interdisciplinary team information sharing, TTs who had developed shared approaches to information management that foregrounded transparency, accountability, and trust, described substantial benefits to their teamwork.

Conclusion

We propose a new model for the Science of Team Science field - a Translational Team Science Hierarchy of Needs - that suggests interventions should be targeted at the appropriate stage of team development in order to maximize a team's scientific potential.

A leadership model supporting maturation of high-performance translational teams

Despite understanding its impact on organizational effectiveness, practical guidance on how to train translational team (TT) leaders is lacking. Previously, we developed an evolutionary learning model of TT maturation consisting of three goal-directed phases: (1). team assembly (Formation); (2). conducting research (Knowledge Generation); and (3). dissemination and implementation (Translation). At each phase, the team acquires group-level knowledge, skills, and attitudes (KSAs) that enhance its performance. Noting that the majority of team-emergent KSAs are promoted by leadership behaviors, we examine the SciTS literature to identify the relevant behaviors for each phase. We propose that effective team leadership evolves from a hierarchical, transformational model early in team Formation to a shared, functional leadership model during Translation. We synthesized an integrated model of TT leadership, mapping a generic "functional leadership" taxonomy to relevant leadership behaviors linked to TT performance, creating an evidence-informed Leadership and Skills Enhancement for Research (LASER) training program. Empirical studies indicate that leadership behaviors are stable across time; to enhance leadership skills, ongoing reflection, evaluation, and practice are needed. We provide a comprehensive multi-level evaluation framework for tracking the growth of TT leadership skills. This work provides a framework for assessing and training relevant leadership behaviors for high-performance TTs.

"Technical" Contributors and Authorship Distribution in Health Science

In health sciences, technical contributions may be undervalued and excluded in the author byline. In this paper, I demonstrate how authorship is a historical construct which perpetuates systemic injustices including technical undervaluation. I make use of Pierre Bourdieu's conceptual work to demonstrate how the power dynamics at play in academia make it very challenging to change the habitual state or "habitus". To counter this, I argue that we must reconceive technical contributions to not be a priori less important based on its nature when assigning roles and opportunities leading to authorship. I make this argument based on two premises. First, science has evolved due to major information and biotechnological innovation; this requires 'technicians' to acquire and exercise a commensurate high degree of both technical and intellectual expertise which in turn increases the value of their contribution. I will illustrate this by providing a brief historical view of work statisticians, computer programmers/data scientists and laboratory technicians. Second, excluding or undervaluing this type of work is contrary to norms of responsibility, fairness and trustworthiness of the individual researchers and of teams in science. Although such norms are continuously tested because of power dynamics, their importance is central to ethical authorship practice and research integrity. While it may be argued that detailed disclosure of contributions (known as contributorship) increases accountability by clearly identifying who did what in the publication, I contend that this may unintentionally legitimize undervaluation of technical roles and may decrease integrity of science. Finally, this paper offers recommendations to promote ethical inclusion of technical contributors.

Application of team science best practices to the project management of a large, multi-site lung cancer screening research consortium

Research is increasingly conducted through multi-institutional consortia, and best practices for establishing multi-site research collaborations must be employed to ensure efficient, effective, and productive translational research teams. In this manuscript, we describe how the Population-based Research to Optimize the Screening Process Lung Research Center (PROSPR-Lung) utilized evidence-based Science of Team Science (SciTS) best practices to establish the consortium's infrastructure and processes to promote translational research in lung cancer screening. We provide specific, actionable examples of how we: (1) developed and reinforced a shared mission, vision, and goals; (2) maintained a transparent and representative leadership structure; (3) employed strong research support systems; (4) provided efficient and effective data management; (5) promoted interdisciplinary conversations; and (6) built a culture of trust. We offer guidance for managing a multi-site research center and data repository that may be applied to a variety of settings. Finally, we detail specific project management tools and processes used to drive collaboration, efficiency, and scientific productivity.

Temporal development of high-performance translational teams

Successful translation involves the coupled application of knowledge-generating research with product development to advance a device, drug, diagnostic, or evidence-based intervention for clinical adoption to improve human health. Critical to the success of the CTSA consortium, translation can be more effectively accomplished by training approaches that focus on improving team-emergent knowledge skills and attitudes (KSAs) linked to performance. We earlier identified 15 specific evidence-informed, team-emergent competencies that facilitate translational team (TT) performance. Here, we examine the SciTS literature describing developmental, temporal dynamics, and adaptive learning stages of interdisciplinary teams and integrate these with real-world observations on TT maturation pathways. We propose that TTs undergo ordered developmental phases, each representing a learning cycle that we call Formation, Knowledge Generation, and Translation. We identify major activities of each phase linked to development goals. Transition to subsequent phases is associated with a team learning cycle, resulting in adaptations that enabling progression towards clinical translation. We present known antecedents of stage-dependent competencies and rubrics for their assessment. Application of this model will ease assessment, facilitate goal identification and align relevant training interventions to improve performance of TTs in the CTSA context.

Competencies supporting high-performance translational teams: A review of the SciTS evidence base

A translational team (TT) is a specific type of interdisciplinary team that seeks to improve human health. Because high-performing TTs are critical to accomplishing CTSA goals, a greater understanding of how to promote TT performance is needed. Previous work by a CTSA Workgroup formulated a taxonomy of 5 interrelated team-emergent competency "domains" for successful translation: 1). affect, 2). communication, 3). management, 4). collaborative problem-solving, and 5). leadership. These Knowledge Skills and Attitudes (KSAs) develop within teams from the team's interactions. However, understanding how practice in these domains enhance team performance was unaddressed. To fill this gap, we conducted a scoping literature review of empirical team studies from the broader Science of Team Science literature domains. We identified specific team-emergent KSAs that enhance TT performance, mapped these to the earlier "domain" taxonomy, and developed a rubric for their assessment. This work identifies important areas of intersection of practices in specific competencies across other competency domains. We find that inclusive environment, openness to transdisciplinary knowledge sharing, and situational leadership are a core triad of team-emergent competencies that reinforce each other and are highly linked to team performance. Finally, we identify strategies for enhancing these competencies. This work provides a grounded approach for training interventions in the CTSA context.

Win-win interactions: Results and implications of a user needs assessment of clinical and translational scientists

Introduction

This study describes a needs assessment of clinical and translational research (CTR) scientists at a large, distributed, School of Medicine within a public university and affiliated clinics.

Method

We performed an Exploratory Conversion Mixed-Methods analysis using a quantitative survey and qualitative interviews with CTR scientists across the training continuum, from early-career scholars, mid-career mentors, and senior administrators at the University of Wisconsin and Marshfield Clinics. Qualitative findings were confirmed using epistemic network analysis (ENA). A survey was distributed to CTR scientists in training.

Results

Analyses supported that early-career and senior-career scientists have unique needs. Scientists who identified as non-White or female reported needs that differed from White male scientists. Scientists expressed the needs for educational training in CTR, for institutional support of career development, and trainings for building stronger relationships with community stakeholders. The tension between meeting tenure clocks and building deep community connections was particularly meaningful for scholars who identified as under-represented, including based on race, gender, and discipline.

Conclusions

This study yielded clear differences in support needs between scientists based upon their years in research and diversity of identities. The validation of qualitative findings, through quantification with ENA, enables robust identification of unique needs of CTR investigators. It is critically important to the future of CTR that scientists are provided with supports throughout the career. Delivery of that support in efficient and timely ways improves scientific outcomes. Advocacy at the level of the institution for under-represented scientists is of utmost importance.

Team Science Principles Enhance Cancer Care Delivery Quality Improvement: Interdisciplinary Implementation of Breast Cancer Screening Shared Decision Making

PURPOSE

Implementing shared decision making (SDM), recommended in screening mammography by national guidelines for women age 40-49 years, faces challenges that innovations in quality improvement and team science (TS) are poised to address. We aimed to improve the effectiveness, patient-centeredness, and efficiency of SDM in primary care for breast cancer screening.

METHODS

Our interdisciplinary team included primary and specialty care, psychology, epidemiology, communication science, engineering, and stakeholders (patients and clinicians). Over a 6-year period, we executed two iterative cycles of plan-do-study-act (PDSA) to develop, revise, and implement a SDM tool using TS principles. Patient and physician surveys and retrospective analysis of tool performance informed our first PDSA cycle. Patient and physician surveys, toolkit use, and clinical outcomes in the second PDSA cycle supported SDM implementation. We gathered team member assessments on the importance of individual TS activities.

RESULTS

Our first PDSA cycle successfully generated a SDM tool called Breast Cancer Risk Estimator, deemed valuable by 87% of patients surveyed. Our second PDSA cycle increased Breast Cancer Risk Estimator utilization, from 2,000 sessions in 2017 to 4,097 sessions in 2019 while maintaining early-stage breast cancer diagnoses. Although TS activities such as culture, trust, and communication needed to be sustained throughout the project, shared goals, research/data infrastructure support, and leadership were more important earlier in the project and persisted in the later stages of the project.

CONCLUSION

Combining rigorous quality improvement and TS principles can support the complex, interdependent, and interdisciplinary activities necessary to improve cancer care delivery exemplified by our implementation of a breast cancer screening SDM tool.

Coordinating Centers as a Strategy for Accelerating Cancer Epidemiology Consortia: Best Practices

Purposeof Review

This review highlights six “best practices” for cancer epidemiology coordinating centers to facilitate the success of a research consortium.

Recent Findings

Evidence from emerging literature regarding the Science of Team Science suggests that coordinating centers can more effectively foster collaborative cancer epidemiology research in consortia by (1) establishing collaboration as a shared goal at the start, (2) providing scientific expertise complementary to the research sites that adapts over the course of the project, (3) enacting anti-racist and inclusive approaches in all consortium decisions and activities, (4) fostering early-stage investigator career development, (5) engaging stakeholders including cancer survivors as peers, and (6) delivering reliable logistical support and technology tools with planned process evaluation so that researchers can collaboratively focus on the science.

Summary

By drawing on the Science of Team Science, coordinating centers can accelerate research progress and increase the impact of cancer epidemiology consortia.

Implementing an evidence-based competency model for science team training and evaluation: TeamMAPPS

INTRODUCTION

In response to a call issued by the National Research Council to investigate the knowledge, skills, and attitudes of effective science teams, we designed a team training program for conducting science in collaborative contexts.

METHODS

We reviewed the literature to develop an evidence-based competency model for effective science teams along with exemplary behaviors that can be used for founding team training and evaluation. We discuss the progress of teamwork and team development research that serves as a foundation for this work, as well as previous research involving team-based competencies.

RESULTS

Three overarching competencies emerged from the literature as key for science team effectiveness: psychological safety, awareness and exchange, and self-correction and adaptation. These competencies are fully described, including their evidence base.

CONCLUSIONS

We developed a competency model and implementation plan for a team training program specific to science teams - TeamMAPPS (Team Methods to Advance Processes and Performance in Science). This paper details steps in the implementation process, including plans for consortia dissemination, evaluation, and future development.

Partnered innovation to implement timely and personalized care: A case study

Background:

Understanding how to translate research discoveries into solutions for healthcare improvement is a priority of NIH-funded Clinical and Translational Science Awards (CTSA). This study, supported by one CTSA, aims to capture one process of shaping and implementing innovations to advance the timeliness and patient-centeredness of cardiovascular care. Specifically, we sought to understand a partnership between a private digital health startup company, a university innovation lab, and an academic health system’s cardiology program pursuing this goal.

Findings:

The collaboration proceeded through clear phases to address the questions and challenges: problem definition, exploration and formalization of the partnership, innovation co-creation and pilot test, and scale-up planning. Phases were punctuated by key decisions, such as forming the partnership, negotiating terms of the partnership, iterating form and features of the innovation, and exploring sufficiency of its value-add for scale-up and sustainment. Key implementation concepts were apparent, including implementation strategies (e.g., champions and iterative trialing) and the implementation outcomes of acceptability, sustainment, and scale-up. Participants identified potential risks of collaboration, reflected on their co-creation process, and the value of engaging stakeholders in innovation design. Findings may inform subsequent collaborations between innovators and translational researchers.

Methods:

We conducted a case study to understand the partnership; characterize the questions they pursued, their decision points, information and data sources; and identify the challenges and risks. Data were collected through a series of four focus groups with members of each partnering organization. A transdisciplinary research team iteratively worked to condense and synthesize data from audio recorded transcripts into a case narrative.

Operationalization, implementation, and evaluation of Collaboration Planning: A pilot interventional study of nascent translational teams

BACKGROUND

The University of Wisconsin Institute for Clinical and Translational Research hub supports multiple pilot award programs that engage cross-disciplinary Translational Teams. To support those teams, our Team Science group aims to offer a learning experience that is accessible, active, and actionable. We identified Collaboration Planning as a high-impact intervention to stimulate team-building activities that provide Translational Team members with the skills to lead and participate in high-impact teams.

METHODS

We adapted the published materials on Collaboration Planning to develop a 90-minute facilitated intervention with questions in 10 areas, presuming no previous knowledge of Science of Team Science (SciTS) or team-science best practices. Attendees received a short follow-up survey and submitted a written collaboration plan with their first quarterly progress report.

RESULTS

Thirty-nine participants from 13 pilot teams from a wide range of disciplines engaged in these sessions. We found that teams struggled to know who to invite, that some of our questions were confusing and too grounded in the language of SciTS, and groups lacked plans for managing their information and communications. We identified several areas for improvement including ensuring that the process is flexible to meet the needs of different teams, continuing to evolve the questions so they resonate with teams, and the need to provide resources for areas where teams needed additional guidance, including information and data management, authorship policies, and conflict management.

CONCLUSIONS

With further development and testing, Collaboration Planning has the potential to support Translational Teams in developing strong team dynamics and team functioning.