Fidelity challenges while implementing an intervention aimed at increasing eating performance among nursing home residents with cognitive decline: A multicentre, qualitative descriptive study design

AIMS AND OBJECTIVES

To increase the knowledge on fidelity challenges in intervention studies promoting eating independence in residents with cognitive decline living in nursing homes (NHs).

BACKGROUND

A few studies have documented to date factors affecting fidelity in intervention studies performed in NH settings. Moreover, fidelity issues in intervention studies aimed at promoting eating independence among NH residents with cognitive decline have not been studied to date.

DESIGN

A hybrid study design was performed in 2018 and reported here according to the COnsolidated criteria for REporting Qualitative research.

METHODS

In a clustered multicentre before/after intervention study design, a nested, multicentre qualitative descriptive design was performed. Four researchers with a nursing background, who received appropriate training, implemented the designed intervention. This consisted in intentional rounds in the dining rooms during lunchtime and was based on supportive, prescriptive and informative prompts delivered to residents with cognitive decline aimed at stimulating eating independence. A momentary assessment method was used, based on daily diary filled in by participant researchers after every session of intervention delivery on the following five dimensions of fidelity: (a) adherence, (b) dose (or exposure), (c) intervention quality, (d) participant responsiveness and (e) programme differentiation. A direct content analysis of the narratives reported on the diaries was performed.

RESULTS

Factors increasing or hindering intervention fidelity during its implementation emerged at the NH, staff, family caregivers, resident, researchers and at the intervention itself levels.

CONCLUSIONS

Several factors emerged and all reported potentially both positive and negative influences on fidelity while implementing an intervention aimed at promoting eating independence among NH residents. Fidelity challenges should be considered as dynamic in NH intervention studies, where continuous adjustments of the intervention delivered are required.

RELEVANCE TO CLINICAL PRACTICE

A calm environment, with staff members showing a caring behaviour, and researchers having achieved good familiarity with the NH setting, the residents, their family carers and the staff members, can all increase intervention fidelity.

Evaluation of the enhanced upper limb therapy programme within the Robot-Assisted Training for the Upper Limb after Stroke trial: descriptive analysis of intervention fidelity, goal selection and goal achievement

Objective:

To report the fidelity of the enhanced upper limb therapy programme within the Robot-Assisted Training for the Upper Limb after stroke (RATULS) randomized controlled trial, the types of goals selected and the proportion of goals achieved.

Design:

Descriptive analysis of data on fidelity, goal selection and achievement from an intervention group within a randomized controlled trial.

Setting:

Out-patient stroke rehabilitation within four UK NHS centres.

Subjects:

259 participants with moderate-severe upper limb activity limitation (Action Research Arm Test 0–39) between one week and five years post first stroke.

Intervention:

The enhanced upper limb therapy programme aimed to provide 36 one-hour sessions, including 45 minutes of face-to-face therapy focusing on personal goals, over 12 weeks.

Results:

7877/9324 (84%) sessions were attended; a median of 34 [IQR 29–36] per participant. A median of 127 [IQR 70–190] repetitions were achieved per participant per session attended. Based upon the Canadian Occupational Performance Measure, goal categories were: self-care 1449/2664 (54%); productivity 374/2664 (14%); leisure 180/2664 (7%) and ‘other’ 661/2664 (25%). For the 2051/2664 goals for which data were available, 1287 (51%) were achieved, ranging between 27% by participants more than 12 months post stroke with baseline Action Research Arm Test scores 0–7, and 88% by those less than three months after stroke with scores 8–19.

Conclusions:

Intervention fidelity was high. Goals relating to self-care were most commonly selected. The proportion of goals achieved varied, depending on time post stroke and baseline arm activity limitation.

Applying the Behavior Change Technique Taxonomy to Four Multicomponent Childhood Obesity Interventions

Applying the Behavior Change Technique Taxonomy has the potential to facilitate identification of effective childhood obesity intervention components. This article evaluates the feasibility of coding Childhood Obesity Prevention and Treatment Consortium interventions and compares reliability between external taxonomy-familiar coders and internal intervention-familiar coders. After training, coder pairs independently coded prespecified portions of intervention materials. An adjudication process was used to explore coding discrepancies. Reliability between internal and external coders was moderate (prevalence and bias-adjusted kappa .38 to .55). Reliability for specific target behaviors varied with substantial agreement for physical activity (.63 to .76) and moderate for dietary intake (.44 to .63). Applying the taxonomy to these interventions was feasible, but agreement was modest. Coding discrepancies highlight the importance of refining coding to capture the complexities of childhood obesity interventions, which often engage multiple recipients (e.g., parents and/or children) and address multiple behaviors (e.g., diet, physical activity, screen time).

Appraising and addressing design and implementation failure in global health: A pragmatic framework

There have been recent concerns about the failure of several global health interventions. Interventions are considered to have failed when they are unable to achieve the intended results. Failure may be linked to how the intervention was designed (design failure) or how it was implemented (implementation failure). Recently, substantial efforts have been employed to improve the outcomes of health interventions. These efforts have led to the development of several theories, models, and frameworks in implementation science to improve the quality of implementation, bridging the divide between evidence and practice. But significant gaps still exist. Whereas much work has been done to develop frameworks and approaches to improve implementation fidelity, not as much effort has been done to guide the adherence of interventions to program theory during the design of the programs. Further, there have been concerns about the applicability of these frameworks in the real-world. This article uses examples to illustrate these gaps and further proposes a pragmatic framework to address identified gaps, thus aiding evidence-informed program design and implementation. The proposed Theory-Design-Implementation (TyDI) framework will support policymakers, program planners and implementers to address potential design and implementation failure, thus improving the fidelity of interventions.

The Motor skills At Playtime intervention improves children's locomotor skills: A feasibility study

BACKGROUND

Interventions are needed to teach fundamental motor skills (FMS) to preschoolers. There is a need to design more practical and effective interventions that can be successfully implemented by non-motor experts and fit within the existing gross motor opportunities such as outdoor free play at the preschool. The purpose of this study was to evaluate the feasibility and efficacy of a non-motor expert FMS intervention that was implemented during outdoor free play, Motor skills At Playtime (MAP).

METHODS

Participants were preschoolers from two Head Start centres (N = 46; Mage = 4.7 ± 0.46 years; 41% boys) and were divided into a MAP (n = 30) or control (outdoor free play; n = 16) group. Children completed either a 1,350-min MAP intervention or control condition (outdoor free play) from January to April of 2018. FMS were assessed before and after each programme using both the Test of Gross Motor Development-3rd Edition and skill outcome measures (running speed, hopping speed, jump distance, throwing speed, kicking speed and catching percentage). Intervention implementation feasibility was measured through daily fidelity checks. Fidelity was evaluated as the percentage of intervention sessions that included all explicit intervention criteria. FMS data were analysed using linear mixed modelling. Models were fit with fixed effects of time and treatment, covariates of sex and height, and a random intercept for each individual.

RESULTS

The non-motor expert was feasibly able to implement MAP with high fidelity (>93%). There was a significant treatment effect for MAP on process and product locomotor FMS (P < 0.05) and a trend for a treatment effect for MAP on total process FMS (P = 0.07).

CONCLUSION

Results support that MAP was successfully implemented by a non-motor expert and led to improvements in children's FMS, especially locomotor FMS.

The Validation of a Provider-Reported Fidelity Measure for the Transdiagnostic Sleep and Circadian Intervention in a Community Mental Health Setting

Monitoring treatment fidelity is essential to check if patients receive adequate doses of treatment and to enhance our theoretical understanding of how psychosocial treatments work. Developing valid and efficient measures to assess fidelity is a priority for dissemination and implementation efforts. The present study reports on the psychometric properties of the Provider-Rated TranS-C Checklist-a provider-reported fidelity measure for the Transdiagnostic Sleep and Circadian Intervention (TranS-C). Adults with severe mental illness (SMI; N = 101) seeking treatment in a community mental health setting received eight sessions of TranS-C. Therapists completed the Provider-Rated TranS-C Checklist at the end of each treatment session (N = 808) to indicate which modules they delivered during that session. To assess convergent validity, independent raters scored modules delivered from audio recordings of a subset of sessions (n = 257) for the modules delivered using the Independent-Rater TranS-C Checklist. Using exploratory factor analysis, a unidimensional scale composed of TranS-C's modules was identified. Provider-Rated TranS-C Checklist scores were positively associated with the Independent-Rater TranS-C Checklist scores demonstrating convergent validity. Results indicate that the Provider-Rated TranS-C Checklist yields reliable and valid scores of providers' delivery of TranS-C.

More Is Not Always Better in Simulation. Learners' Evaluation of a "Chest Model"

Background: Fidelity in simulation is an important design feature. Although it is typically seen as bipolar (i.e., "high" or "low"), fidelity is actually multidimensional. There are concerns that "low fidelity" might impede the immersion of learners during simulation training. "Locally built models" are characterized by decreased cost and reduced "structural" fidelity (how the simulator looks) while satisfying "functional" fidelity (what the simulator does). Objective: To 1) describe the use of a locally built chest tube model in building a mastery-based simulation curriculum and 2) describe evaluation of the model from learners in different stages and contexts. Methods: The model was built on the basis of key functional features of the assigned training task. A curriculum that combined progressive difficulty and opportunities for deliberate practice and mastery was developed. An analysis of the learner's survey responses was performed using SAS studio (SAS Software). Results: We describe the process of creating the chest tube model and a curriculum in which the model is used for increasing levels of difficulty to reach skill mastery. Learners at different stages and in different contexts, such as practicing physicians and trainees from developed and developing countries, evaluated the model similarly. We provide validity evidence for the content, response process, and relationship with other variables when using the model in the assessment of chest tube insertion skills. Conclusion: As demonstrated in our chest tube critical care medicine curriculum, the locally built models are simple to build and feasible to use. Contrary to current thinking that low-fidelity models might impede immersion in simulation training for experienced learners, the survey results show that different learners provide very similar evaluations after practicing with the model.

Implementation of the 'Optimising the Health Extension Program' Intervention in Ethiopia: A Process Evaluation Using Mixed Methods

An intervention called 'Optimising the Health Extension Program', aiming to increase care-seeking for childhood illnesses in four regions of Ethiopia, was implemented between 2016 and 2018, and it included community engagement, capacity building, and district ownership and accountability. A pragmatic trial comparing 26 districts that received the intervention with 26 districts that did not found no evidence to suggest that the intervention increased utilisation of services. Here we used mixed methods to explore how the intervention was implemented. A fidelity analysis of each 31 intervention activities was performed, separately for the first phase and for the entire implementation period, to assess the extent to which what was planned was carried out. Qualitative interviews were undertaken with 39 implementers, to explore the successes and challenges of the implementation, and were analysed by using thematic analysis. Our findings show that the implementation was delayed, with only 19% (n = 6/31) activities having high fidelity in the first phase. Key challenges that presented barriers to timely implementation included the following: complexity both of the intervention itself and of administrative systems; inconsistent support from district health offices, partly due to competing priorities, such as the management of disease outbreaks; and infrequent supervision of health extension workers at the grassroots level. We conclude that, for sustainability, evidence-based interventions must be aligned with national health priorities and delivered within an existing health system. Strategies to overcome the resulting complexity include a realistic time frame and investment in district health teams, to support implementation at grassroots level.

Symbiosis and stress: how plant microbiomes affect host evolution

Existing paradigms for plant microevolution rarely acknowledge the potential impacts of diverse microbiomes on evolutionary processes. Many plant-associated microorganisms benefit the host via access to resources, protection from pathogens, or amelioration of abiotic stress. In doing so, they alter the plant's perception of the environment, potentially reducing the strength of selection acting on plant stress tolerance or defence traits or altering the traits that are the target of selection. We posit that the microbiome can affect plant microevolution via (1) manipulation of plant phenotypes in ways that increase plant fitness under stress and (2) direct microbial responses to the environment that benefit the plant. Both mechanisms might favour plant genotypes that attract or stimulate growth of the most responsive microbial populations or communities. We provide support for these scenarios using infectious disease and quantitative genetics models. Finally, we discuss how beneficial plant-microbiome associations can evolve if traditional mechanisms maintaining cooperation in pairwise symbioses, namely partner fidelity, partner choice and fitness alignment, also apply to the interactions between plants and diverse foliar and soil microbiomes. To understand the role of the plant microbiome in host evolution will require a broad ecological understanding of plant-microbe interactions across both space and time. This article is part of the theme issue 'The role of the microbiome in host evolution'.

Assessing Adherence, Competence and Differentiation in a Stepped-Wedge Randomised Clinical Trial of a Complex Behaviour Change Intervention

BACKGROUND

A key challenge in behavioural medicine is developing interventions that can be delivered adequately (i.e., with fidelity) within real-world consultations. Accordingly, clinical trials should (but tend not to) report what is actually delivered (adherence), how well (competence) and the distinction between intervention and comparator conditions (differentiation).

PURPOSE

To address this important clinical and research priority, we apply best practice guidelines to evaluate fidelity within a real-world, stepped-wedge evaluation of "EAT: Eating As Treatment", a new dietitian delivered health behaviour change intervention designed to reduce malnutrition in head and neck cancer (HNC) patients undergoing radiotherapy.

METHODS

Dietitians (n = 18) from five Australian hospitals delivered a period of routine care and following a randomly determined order each site received training and began delivering the EAT Intervention. A 20% random stratified sample of audio-recorded consultations (control n = 196; intervention n = 194) was coded by trained, independent, raters using a study specific checklist and the Behaviour Change Counselling Inventory. Intervention adherence and competence were examined relative to apriori benchmarks. Differentiation was examined by comparing control and intervention sessions (adherence, competence, non-specific factors, and dose), via multiple linear regression, logistic regression, or mixed-models.

RESULTS

Achievement of adherence benchmarks varied. The majority of sessions attained competence. Post-training consultations were clearly distinct from routine care regarding motivational and behavioural, but not generic, skills.

CONCLUSIONS

Although what level of fidelity is "good enough" remains an important research question, findings support the real-world feasibility of integrating EAT into dietetic consultations with HNC patients and provide a foundation for interpreting treatment effects.

Reverse Transcriptase: From Transcriptomics to Genome Editing

Reverse transcriptases (RTs) are enzymes that can generate a complementary strand of DNA (cDNA) from RNA. Coupled with PCR, RTs have been widely used to detect RNAs and to clone expressed genes. Classical retroviral RTs have been improved by protein engineering. These enzymes and newly characterized RTs are key elements in the development of next-generation sequencing techniques that are now being applied to the study of transcriptomics. In addition, engineered RTs fused to a CRISPR/Cas9 nickase have recently shown great potential as tools to manipulate eukaryotic genomes. In this review, we discuss the properties and uses of wild type and engineered RTs in biotechnological applications, from conventional RT-PCR to recently introduced prime editing.

Effects of partial measurements on quantum resources and quantum Fisher information of a teleported state in a relativistic scenario

We address the teleportation of single- and two-qubit quantum states, parametrized by weight θ and phase ϕ parameters, in the presence of the Unruh effect experienced by a mode of a free Dirac field. We investigate the effects of the partial measurement (PM) and partial measurement reversal (PMR) on the quantum resources and quantum Fisher information (QFI) of the teleported states. In particular, we discuss the optimal behaviour of the QFI, quantum coherence (QC) as well as fidelity with respect to the PM and PMR strength and examine the effect of the Unruh noise on optimal estimation. It is found that, in the single-qubit scenario, the PM (PMR) strength at which the optimal estimation of the phase parameter occurs is the same as the PM (PMR) strength with which the teleportation fidelity and the QC of the teleported single-qubit state reaches its maximum value. On the other hand, generalizing the results to two-qubit teleportation, we find that the encoded information in the weight parameter is better protected against the Unruh noise in two-qubit teleportation than in the one-qubit scenario. However, extraction of information encoded in the phase parameter is more efficient in single-qubit teleportation than in the two-qubit version.

Cross-Site Process Evaluation Results for the Early Childhood Education Center Setting: CORD Study

Background: The Childhood Obesity Research Demonstration project aimed to deliver evidence-based obesity prevention interventions to at-risk families at three demonstration sites. The interventions were delivered in multiple settings, including early childhood education centers (ECECs), public schools, and primary care clinics. An evaluation center conducted cross-site process, impact, and sustainability evaluations. Results of the cross-site process evaluation for the ECECs will be described. Methods: Reach (proportion of the target population who participated), dose delivered (materials and interventions that were distributed), and fidelity (proportion of planned intervention components delivered) were assessed at two levels (researcher-to-provider and provider-to-family levels). Standardized data forms were completed by research team members at each demonstration site with assistance from the evaluation center. Results: The Childhood Obesity Research Demonstration project reached 5174 children and 390 teachers in 58 ECECs. The centers delivered an average of 3.9 hours of training to teachers. A total of 1382 different types of materials were distributed to providers, and from 1.3 to 4.3 hours of technical support were delivered to centers monthly. For fidelity at the researcher-to-provider level, 49.5% (n = 370) of eligible teachers completed all training sessions. Considerable variations across demonstration sites in reach, dose delivered, and fidelity across were observed. Conclusion: The Childhood Obesity Research Demonstration project reached large numbers of children, families, teachers, and ECECs. Maintaining intervention fidelity while reaching large numbers of at-risk individuals proved to be a challenge.

How much, how often, how well? Adherence to a neuromuscular training warm-up injury prevention program in youth basketball

Adherence is a key implementation outcome that determines the effectiveness of an intervention. This study, an observational design involving coaches and players from 33 high school basketball teams, evaluated the dimensions of adherence to a basketball-specific neuromuscular training (NMT) warm-up program in youth basketball. Coach adherence (daily report of team adherence) was collected prospectively. Adherence measures: cumulative utilization (proportion of total sessions possible), utilization fidelity (average # of exercises completed per NMT session), utilization frequency (average # of NMT sessions completed per week) were calculated and further evaluated for optimal adherence (≥80%, ≥10.4 exercises/session and ≥2 sessions/week, respectively) per coach. Additionally, exercise fidelity (proportion of players performing individual exercises correctly) was assessed. Coach (n = 31; 27-59 years) median cumulative utilization was 80%, utilization fidelity was 12 (of a possible 13 exercises per session) and utilization frequency was 2.3 sessions per week. Optimal adherence ranged from 52% to 71% across measures of adherence. Player exercise fidelity was 48%. Time constraint (47%) was the most frequently reported adherence barrier. While coach adherence to the NMT warm-up program was reasonably high across measures of adherence, a considerable proportion of coaches did not attain optimal adherence levels and player exercise fidelity was low.

A Low Fidelity Virus Shows Increased Recombination during the Removal of an Alphavirus Reporter Gene

Reporter genes for RNA viruses are well-known to be unstable due to putative RNA recombination events that excise inserted nucleic acids. RNA recombination has been demonstrated to be co-regulated with replication fidelity in alphaviruses, but it is unknown how recombination events at the minority variant level act, which is important for vaccine and trans-gene delivery design. Therefore, we sought to characterize the removal of a reporter gene by a low-fidelity alphavirus mutant over multiple replication cycles. To examine this, GFP was inserted into TC-83, a live-attenuated vaccine for the alphavirus Venezuelan equine encephalitis virus, as well as a low-fidelity variant of TC-83, and passaged until fluorescence was no longer observed. Short-read RNA sequencing using ClickSeq was performed to determine which regions of the viral genome underwent recombination and how this changed over multiple replication cycles. A rapid removal of the GFP gene was observed, where minority variants in the virus population accumulated small deletions that increased in size over the course of passaging. Eventually, these small deletions merged to fully remove the GFP gene. The removal was significantly enhanced during the passaging of low-fidelity TC-83, suggesting that increased levels of recombination are a defining characteristic of this mutant.

Mechanisms of nucleotide selection by telomerase

Telomerase extends telomere sequences at chromosomal ends to protect genomic DNA. During this process it must select the correct nucleotide from a pool of nucleotides with various sugars and base pairing properties, which is critically important for the proper capping of telomeric sequences by shelterin. Unfortunately, how telomerase selects correct nucleotides is unknown. Here, we determined structures of Tribolium castaneum telomerase reverse transcriptase (TERT) throughout its catalytic cycle and mapped the active site residues responsible for nucleoside selection, metal coordination, triphosphate binding, and RNA template stabilization. We found that TERT inserts a mismatch or ribonucleotide ~1 in 10,000 and ~1 in 14,000 insertion events, respectively. At biological ribonucleotide concentrations, these rates translate to ~40 ribonucleotides inserted per 10 kilobases. Human telomerase assays determined a conserved tyrosine steric gate regulates ribonucleotide insertion into telomeres. Cumulatively, our work provides insight into how telomerase selects the proper nucleotide to maintain telomere integrity.

Iterative Decision-making for Evaluation of Adaptations (IDEA): A decision tree for balancing adaptation, fidelity, and intervention impact

BACKGROUND

Evidence-based practices (EBPs) are frequently adapted to maximize outcomes while maintaining fidelity to core EBP elements. Many step-by-step frameworks for adapting EBPs have been developed, but these models may not account for common complexities in the adaptation process. In this paper, we introduce the Iterative Decision-making for Evaluation of Adaptations (IDEA), a tool to guide adaptations that addresses these issues.

FRAMEWORK DESIGN AND USE

Adapting EBPs requires attending to key contingencies incorporated into the IDEA, including: the need for adaptations; fidelity to core EBP elements; the timeframe in which to make adaptations; the potential to collect pilot data; key clinical and implementation outcomes; and stakeholder viewpoints. We use two examples to illustrate application of the IDEA.

CONCLUSIONS

The IDEA is a practical tool to guide EBP adaptation that incorporates important decision points and the dynamism of ongoing adaptation. Its use may help implementation scientists, clinicians, and administrators maximize EBP impact.

Early Implementation of Comprehensive Medication Management within an Academic Medical Center Primary Care Pharmacy Team

Introduction:

University of Utah Health is an academic health care system that serves residents in Utah and beyond. Clinical pharmacists with the health care system’s pharmacy primary care services (PPCS) team provide medication education, population-based care, and medication management through collaborative practice agreements. With the expansion of clinical pharmacist and technician positions and services, the need to measure and assess the impact of pharmacy services and create a value proposition for internal and external stakeholders became an important goal, and the decision was made to better align practices across all PPCS sites. This paper highlights University of Utah Health’s approach to implement comprehensive medication management (CMM) across all primary care clinics with embedded clinical pharmacy staff and subsequent evaluation of implementation fidelity.

Methods:

Implementation of CMM was assisted by participation in the National A3 Collaborative and by using selected principles from the Active Implementation Framework. Stages of implementation included exploration, instillation, and initiating improvement cycles. An implementation team consisting of PPCS employees was created to help with standardization, developing implementation plans, and creating a dissemination strategy for all PPCS team members. The CMM care process was subsequently presented and implemented by clinical pharmacists in primary care clinics. Following implementation, fidelity measures were collected including identification and resolution of medication therapy problems (MTPs) and responses from a questionnaire distributed to the clinical pharmacists to self-report understanding and implementation of CMM key elements. The number and type of MTPs identified were tracked over 18 months.

Results:

Within the measurement window, clinical pharmacists identified 17,953 MTPs. Of the total number of MTPs identified, 21% were related to indication, 53% to efficacy, 15% to safety and 11% to adherence. The questionnaire was distributed to clinical pharmacists 9 months after CMM implementation, with a 71% response rate. Pharmacists reported “always” or “often” performing each step in the patient care process as follows: indication (93%), effectiveness (93%), safety (87%), and adherence (93%). Reported barriers to implementation of the CMM include lack of time to complete all aspects of the process efficiently, lack of a standardized format for documentation, and changing practice habits.

Conclusion:

Implementation of a CMM process within University of Utah Health’s PPCS services with the help of a national collaborative and implementation framework yielded identification of 17,953 MTPs over 18 months and foundational fidelity to core principles.

A Framework for the Testing and Validation of Simulated Environments in Experimentation and Training

New computer technologies, like virtual reality (VR), have created opportunities to study human behavior and train skills in novel ways. VR holds significant promise for maximizing the efficiency and effectiveness of skill learning in a variety of settings (e.g., sport, medicine, safety-critical industries) through immersive learning and augmentation of existing training methods. In many cases the adoption of VR for training has, however, preceded rigorous testing and validation of the simulation tool. In order for VR to be implemented successfully for both training and psychological experimentation it is necessary to first establish whether the simulation captures fundamental features of the real task and environment, and elicits realistic behaviors. Unfortunately evaluation of VR environments too often confuses presentation and function, and relies on superficial visual features that are not the key determinants of successful training outcomes. Therefore evidence-based methods of establishing the fidelity and validity of VR environments are required. To this end, we outline a taxonomy of the subtypes of fidelity and validity, and propose a variety of practical methods for testing and validating VR training simulations. Ultimately, a successful VR environment is one that enables transfer of learning to the real-world. We propose that key elements of psychological, affective and ergonomic fidelity, are the real determinants of successful transfer. By adopting an evidence-based approach to VR simulation design and testing it is possible to develop valid environments that allow the potential of VR training to be maximized.

Outcomes associated with scale-up of the Stepping On falls prevention program: A case study in redesigning for dissemination

Introduction:

Translating complex behavior change interventions into practice can be accompanied by a loss of fidelity and effectiveness. We present the evaluation of two sequential phases of implementation of a complex evidence-based community workshop to reduce falls, using the Replicating Effective Programs Framework. Between the two phases, workshop training and delivery were revised to improve fidelity with key elements.

Methods:

Stepping On program participants completed a questionnaire at baseline (phase 1: n = 361; phase 2: n = 2219) and 6 months post-workshop (phase 1: n = 232; phase 2: n = 1281). Phase 2 participants had an additional follow-up at 12 months (n = 883). Outcomes were the number of falls in the prior 6 months and the Falls Behavioral Scale (FaB) score.

Results:

Workshop participation in phase 1 was associated with a 6% reduction in falls (RR = 0.94, 95% CI 0.74–1.20) and a 0.14 improvement in FaB score (95% CI, 0.11– 0.18) at 6 months. Workshop participation in phase 2 was associated with a 38% reduction in falls (RR = 0.62, 95% CI 0.57–0.68) and a 0.16 improvement in FaB score (95% CI 0.14–0.18) at 6 months, and a 28% reduction in falls (RR = 0.72, 95% CI 0.65–0.80) and a 0.19 score improvement in FaB score (95% CI 0.17–0.21) at 12-month follow-up.

Conclusions:

Effectiveness can be maintained with widespread dissemination of a complex behavior change intervention if attention is paid to fidelity of key elements. An essential role for implementation science is to ensure effectiveness as programs transition from research to practice.

Duplication of leucyl-tRNA synthetase in an archaeal extremophile may play a role in adaptation to variable environmental conditions

Aminoacyl-tRNA synthetases (aaRSs) are ancient enzymes that play a fundamental role in protein synthesis. They catalyze the esterification of specific amino acids to the 3'-end of their cognate tRNAs and therefore play a pivotal role in protein synthesis. Although previous studies suggest that aaRS-dependent errors in protein synthesis can be beneficial to some microbial species, evidence that reduced aaRS fidelity can be adaptive is limited. Using bioinformatics analyses, we identified two distinct leucyl-tRNA synthetase (LeuRS) genes within all genomes of the archaeal family Sulfolobaceae. Remarkably, one copy, designated LeuRS-I, had key amino acid substitutions within its editing domain that would be expected to disrupt hydrolytic editing of mischarged tRNA^Leu and to result in variation within the proteome of these extremophiles. We found that another copy, LeuRS-F, contains canonical active sites for aminoacylation and editing. Biochemical and genetic analyses of the paralogs within Sulfolobus islandicus supported the hypothesis that LeuRS-F, but not LeuRS-I, functions as an essential tRNA synthetase that accurately charges leucine to tRNA^Leu for protein translation. Although LeuRS-I was not essential, its expression clearly supported optimal S. islandicus growth. We conclude that LeuRS-I may have evolved to confer a selective advantage under the extreme and fluctuating environmental conditions characteristic of the volcanic hot springs in which these archaeal extremophiles reside.

West Nile Virus fidelity modulates the capacity for host cycling and adaptation

The fidelity of flaviviruses is thought to be tightly regulated for optimal fitness within and between hosts. West Nile virus (WNV) high-fidelity (HiFi) mutations V793I and G806R within the RNA-dependent RNA polymerase, and low-fidelity (LoFi) mutation T248I within the methyltransferase, were previously shown to attenuate infectivity and replicative fitness in Culex mosquitoes and Culex tarsalis (CXT) cells but not in mammalian cells. We hypothesized that fidelity alterations would modify adaptation and maintenance in a host-specific manner. To test this hypothesis, wild-type (WT), HiFi (V793I/G806R) and LoFi (T248I) variants were sequentially passaged eight times in avian (PDE) or mosquito cells, or alternately between the two. Initial characterization confirmed that fidelity mutants are attenuated in mosquito, but not avian, cells. Deep sequencing revealed mutations unique to both cell lines and fidelity mutants, including ENV G1378A, a mutation associated with avian cell adaptation. To characterize maintenance and adaptation, viral outputs were monitored throughout passaging and viral fitness was assessed. The results indicate that fidelity mutants can at times recover fitness during mosquito cell passage, but remain attenuated relative to WT. Despite similar initial fitness, LoFi mutants were impaired during sequential passage in avian cells. Conversely, HiFi mutants passaged in avian cells showed increased adaptation, suggesting that increased fidelity may be advantageous in avian hosts. Although some adaptation occurred with individual mutants, the output titres of fidelity mutants were on average lower and were often lost during host switching. These data confirm that arbovirus fidelity is likely fine-tuned to maximize survival in disparate hosts.

A Glaucoma-Specific Brief Motivational Interviewing Training Program for Ophthalmology Para-professionals: Assessment of Feasibility and Initial Patient Impact

Our objective was to test the feasibility of, fidelity to, and initial impact of a brief, glaucoma-specific motivational interviewing (MI) training program for ophthalmic para-professionals. This prospective, mixed-methods study had two components, one for staff and one for patients. Staff fidelity to MI principles was graded through audio-recorded encounters after initial and final training sessions. After training, patients graded staff for adherence to autonomy supportive care. Semi-structured interviews with para-professionals elicited feedback about the training and about their ability to implement MI in the clinic. The impact on patient satisfaction with staff communication, eye drop instillation self-efficacy, and overall health activation was assessed using a survey pre- and post-training. Para-professionals met two of three program goals for MI skills and improved in their overall scores for MI fidelity. Para-professionals noted lack of time in the clinic as a significant barrier to implementing counseling. Patient satisfaction with staff communication increased after the training (p = 0.04) among patients who rated their staff above the mean for providing autonomy supportive care. The intervention did not improve patients' eye drop instillation self-efficacy or overall health activation. Training para-professional staff in brief, glaucoma-specific MI techniques is feasible and may improve patient satisfaction, though dedicated time in clinic is needed to implement MI counseling into glaucoma practice.

Emergent life events in the delivery of a caregiver-mediated evidence-based intervention for children with autism spectrum disorder in publicly funded mental health services

LAY ABSTRACT

Mental health clinicians often report significant challenges when delivering evidence-based interventions (EBI) in community settings, particularly when unexpected client stressors (or emergent life events; ELEs) interfere with the therapy process. The current study sought to extend the study of ELEs to children with Autism Spectrum Disorder (ASD) by examining the occurrence and impact of ELEs in the context of a collaborative, caregiver-mediated intervention for reducing challenging behaviors in children with ASD. This intervention was An Individualized Mental Health Intervention for children with ASD (referred to as AIM HI). Participants included 38 clinicians and child clients who were enrolled in a community effectiveness trial of AIM HI. Video recordings of 100 therapy sessions were coded for caregiver-reported ELEs and also how well clinicians adhered to the AIM HI protocol. Results indicated that mild to severe ELEs were reported in 36% of therapy sessions, and were reported for 58% of children at some point during the intervention. Children who had a greater number of diagnoses (in addition to the autism diagnosis) tended to have more ELEs. In addition, clinicians with less years of experience tended to have sessions with more ELEs. There was no significant link between ELEs and how well clinicians adhered to the AIM HI protocol. Findings offer implications for the implementation of EBI, particularly the importance of incorporating clinician training in addressing complex presentations and crises in the context of EBIs.

Implementation of a fidelity monitoring process to assess delivery of an evidence-based adherence counseling intervention in a multi-site biomedical HIV prevention study

Pre-Exposure Prophylaxis (PrEP) trials often implement counseling to support product adherence. Counseling fidelity can vary significantly across providers and time. Fidelity monitoring can ensure that counseling is delivered as designed. We describe the process, feasibility, and outcomes of monitoring Options counseling fidelity in an open-label study of the dapivirine vaginal ring MTN-025/HOPE. After initial training, 63 counselors from 14 sites in Sub-Sahara Africa audio-recorded counseling sessions with study participants. Sessions were rated by a New York-based team that included bilingual emigres from the study countries. Completed session rating forms were sent to counselors to provide feedback and counseling difficulties were discussed during monthly calls. Of 1456 study participants, 85.7% consented to at least one session, and 20% to all sessions, being audio-recorded. Among 9926 study visits in which Options was expected to occur, 5366 (54.1%) Options sessions were audio-recorded, of which 1238 (23.1%) were reviewed; 1039 (83.9%) were rated as "good" or "fair." Eleven counselors who failed to consistently deliver the intervention were reassigned to back-up status. This study demonstrates the feasibility and benefits of monitoring counseling fidelity using audio-recordings in a multi-site, multi-language, multi-country PrEP trial. Given the investment necessary to conduct such trials, providing counseling oversight is highly warranted.