Fidelity issues in secondhand smoking interventions for children

Looking under the hood of a hybrid two-way texting intervention to improve early retention on antiretroviral therapy in Malawi: an implementation fidelity evaluation

BACKGROUND

While key to interpreting findings and assessing generalizability, implementation fidelity is underreported in mobile health (mHealth) literature. We evaluated implementation fidelity of an opt-in, hybrid, two-way texting (2wT) intervention previously demonstrated to improve 12-month retention on antiretroviral therapy (ART) among people living with HIV (PLHIV) in a quasi-experimental study in Lilongwe, Malawi.

METHODS

Short message service (SMS) data and ART refill visit records were used to evaluate adherence to 2wT content, frequency and duration through the lens of the Conceptual Framework for Implementation Fidelity. Message delivery and 2wT participant interactions were considered across four core 2wT components: 1) weekly motivational SMS messages; 2) proactive SMS appointment reminders; 3) SMS reminders after missed appointments; and 4) interactive messaging with 2wT staff about transfers and appointment rescheduling. Using mixed-effects logistic regression models adjusted for participant demographics, we examined the effect of core 2wT component fidelity on a) on-time appointment attendance and b) timely return to care after a missed appointment, presenting adjusted odds ratios (aORs) and 95% confidence intervals (CIs).

RESULTS

The 468 2wT participants had a median of 52 study weeks (interquartile range [IQR] 34 - 52) with 6 ART appointments (IQR 4-7) of which 2 (IQR 1 - 3) were missed. On average, participants received a motivation message for 75% (IQR 56%-83%) of enrolled weeks, a reminder before 83% (IQR 67%-100%) of appointments, and after 67% (IQR 0%-100%) of missed appointments. Participants reported 9 transfers and rescheduled 46 appointments through 2wT prompts; 196 appointments were changed via unprompted interaction. Participants with 10% higher expected motivation message delivery were more likely to attend clinic appointments on time (aOR: 1.08; 95%CI: 1.01 - 1.16, p = 0.03). Receiving and responding to an appointment reminder in any way were also associated with increased on-time appointment attendance (aOR: 1.35; 95%CI: 1.03 - 1.79, p = 0.03 and aOR: 1.47, 95%CI: 1.16 - 1.87, p = 0.001, respectively). No associations were found for 2wT messages and timely return to care following a missed appointment.

CONCLUSION

Greater 2wT implementation fidelity was associated with improved care outcomes. Although implementation fidelity monitoring of mHealth interventions is complex, it should be integrated into study design.

Looking under the hood of a hybrid two-way texting intervention to improve early retention on antiretroviral therapy in Malawi: an implementation fidelity evaluation

Background

While key to interpreting findings and assessing generalizability, implementation fidelity is underreported in mobile health (mHealth) literature. We evaluated implementation fidelity of an opt-in, hybrid, two-way texting (2wT) intervention previously demonstrated to improve 12-month retention on antiretroviral therapy (ART) among people living with HIV (PLHIV) in a quasi-experimental study in Lilongwe, Malawi.

Methods

Short message service (SMS) data and ART refill visit records were used to evaluate adherence to 2wT content, frequency and duration through the lens of the Conceptual Framework for Implementation Fidelity. Message delivery and 2wT participant interactions were considered across four core 2wT components: 1) weekly motivational SMS messages; 2) proactive SMS appointment reminders; 3) SMS reminders after missed appointments; and 4) interactive messaging with 2wT staff about transfers and appointment rescheduling. In mixed-effects logistic regression, associations were assessed between 2wT messages and on-time appointment attendance and timely return to care after a missed appointment, respectively, presenting odds ratios (ORs) and 95% confidence intervals (CIs).

Results

The 468 2wT participants had a median of 52 study weeks (interquartile range [IQR] 34-52) with 6 ART appointments (IQR 4-7) of which 2 (IQR 1-3) were missed. On average, participants received a motivation message for 75% (IQR 56% - 83%) of enrolled weeks, a reminder before 83% (IQR 67% - 100%) of appointments, and after 67% (IQR 0% - 100%) of missed appointments. Participants reported 9 transfers and rescheduled 46 appointments through 2wT prompts; 196 appointments were changed via unprompted interaction. Participants with 10% higher expected motivation message delivery were more likely to attend clinic on time (OR: 1.13; 95%CI: 1.06-1.20, p < 0.001) and return to care within 14 days of a missed appointment (OR: 1.12; 95%CI: 1.03-1.22, p = 0.01). Receiving an appointment reminder increased on-time attendance (OR: 1.83; 95%CI: 1.44-2.33, p < 0.001).

Conclusion

Greater 2wT implementation fidelity was associated with improved care outcomes. Although implementation fidelity monitoring of mHealth interventions is complex, it should be integrated into study design.

Treatment Fidelity in 94 Randomized Controlled Trials of Physical Rehabilitation in the ICU: A Scoping Review

OBJECTIVES

Recent reviews demonstrated discordant effects of ICU-based physical rehabilitation on physical function. These inconsistencies may be related to differences in treatment fidelity-the extent to which a protocol is delivered as planned. Before evaluating the association of fidelity with outcomes, we must first understand the extent of treatment fidelity reporting in ICU-based physical rehabilitation randomized controlled trials (RCTs).

DATA SOURCES

Six electronic databases from inception to December 2022.

STUDY SELECTION

We included RCTs enrolling adults or children admitted to the ICU, if greater than or equal to 50% were invasively mechanically ventilated greater than 24 hours, and underwent an ICU-based physical rehabilitation intervention, with no limitation to comparators or outcomes.

DATA EXTRACTION

We screened and extracted data independently and in duplicate, with a third reviewer as needed. Extracted data included study characteristics, treatment descriptions, and the presence of National Institutes of Health Behaviour Change Consortium (NIH-BCC) treatment fidelity tool components. Treatment fidelity scores were calculated as the proportion of reported (numerator) out of total NIH-BCC components (denominator). We calculated scores across studies and by treatment group (intervention vs. comparator). We used linear regression to assess for a time trend in study treatment fidelity scores.

DATA SYNTHESIS

Of 20,433 citations, 94 studies met inclusion criteria. Authors reported a median (first-third quartiles) of 19% (14-26%) of treatment fidelity components across studies. Intervention group scores were higher than comparator groups (24% [19-33%] vs. 14% [5-24%], p < 0.01). We found a mean increase in study treatment fidelity scores by 0.7% (0.3 points) per year.

CONCLUSIONS

Only 19% of treatment fidelity components were reported across studies, with comparator groups more poorly reported. Future research could investigate ways to optimize treatment fidelity reporting and determine characteristics associated with treatment fidelity conduct in ICU-based physical rehabilitation RCTs.

The Methodological Quality and Intervention Fidelity of Randomised Controlled Trials Evaluating Social Skills Group Programs in Autistic Adolescents: A Systematic Review and Meta-analysis

A systematic review and meta-analysis were utilised to explore the methodological quality, program fidelity, and efficacy of social skills group programs (SSGPs) aiming to support autistic adolescents in navigating their everyday social worlds. The study evaluated the methodological quality and theoretical fidelity of studies, with a random effect meta-analysis conducted to summarise the overall efficacy of SSGP and its effect on social communication and interaction, behavioural/emotional challenges, adaptive functioning, and autism characteristics. Although findings from the 18 identified studies indicated an adjusted medium overall effect with these programs successfully supporting autistic adolescents' socialisation needs (g = 0. 60, p < 0.001), most studies demonstrated medium to low program fidelity despite their good methodological quality. Given the significant heterogeneity of SSGPs and variations in the design and measurement frameworks of efficacy studies, understanding the generalisability of the findings of this research is unclear.

Factors Influencing Fidelity to a Calorie Posting Policy in Public Hospitals: A Mixed Methods Study

Background: Labelling menus with nutrition information has increasingly become an important obesity policy option. While much research to-date has focused on determining its effectiveness, few studies report the extent to which menu labelling is implemented as designed. The aim of this study was to explore factors influencing fidelity to a calorie posting policy in Irish acute public hospitals.

Methods: A mixed methods sequential explanatory study design was employed, with a nested case study for the qualitative component. Quantitative data on implementation fidelity at hospitals were analysed first and informed case sampling in the follow-on qualitative phase. Maximum variation sampling was used to select four hospitals with high and low levels of implementation and variation in terms of geographic location, hospital size, complexity of care provided and hospital type. Data were collected using structured observations, unstructured non-participant observations and in-depth semi-structured interviews. The Consolidated Framework for Implementation Research guided qualitative data collection and analysis. Using framework analysis, factors influencing implementation were identified. A triangulation protocol was used to integrate fidelity findings from multiple sources. Data on influencing factors and fidelity were then combined using joint displays for within and cross-case analysis.

Results: Quantitative fidelity data showed seven hospitals were categorised as low implementers and 28 hospitals were high implementers of the policy. Across the four hospitals selected as cases, qualitative analysis revealed factors influencing implementation and fidelity were multiple, and operated independently and in combination. Factors were related to the internal hospital environment (e.g., leadership support, access to knowledge and information, perceived importance of calorie posting implementation), external hospital environment (e.g., national policy, monitoring), features of the calorie posting policy (e.g., availability of supporting materials), and the implementation process (e.g., engaging relevant stakeholders). Integrated analysis of fidelity indicated a pattern of partial adherence to the calorie posting policy across the four hospitals. Across all hospitals, there was a consistent pattern of low adherence to calorie posting across all menu items on sale, low adherence to calorie information displayed per standard portion or per meal, low adherence to standardised recipes/portions, and inaccurate calorie information.

Conclusion: Efforts to maximise fidelity require multi-level, multi-component strategies in order to reduce or mitigate barriers and to leverage facilitators. Future research should examine the relative importance of calorie posting determinants and the association between implementation strategies and shifts in fidelity to intervention core components.

A Novel Approach to the Assessment of Fidelity to a Cognitive Behavioral Therapy for PTSD Using Clinical Worksheets: A Proof of Concept With Cognitive Processing Therapy

Fidelity monitoring is a critical indicator of psychotherapy quality and is central to successful implementation. A major barrier to fidelity in routine care is the lack of feasible, scalable, and valid measurement strategies. A reliable, low-burden fidelity assessment would promote sustained implementation of cognitive behavioral therapies (CBTs). The current study examined fidelity measurement for cognitive processing therapy (CPT) for posttraumatic stress disorder (PTSD) using clinical worksheets. External raters evaluated patient worksheets done as a part of treatment, both guided by the therapist and completed independently as homework. Results demonstrated that fidelity ratings from CPT session worksheets were feasible and efficient. Notably, they were strongly correlated with observer ratings of the fidelity of CPT strategies that were present on the worksheets. Agreement among ratings conducted by individuals with a range of experience with CPT was acceptable to high. There was not a main effect of therapist-guided, in-session worksheet ratings on PTSD symptom change. However, patient competence in completing worksheets independently was associated with greater PTSD symptom decline and in-session, therapist-guided worksheet completion was associated with larger symptom decreases among patients with high levels of competence. With further research and refinement, rating of worksheets may be an efficient way to examine therapist and patient skill in key CPT elements, and their interactions, compared to the gold standard of observer ratings of therapy video-recordings. Additional research is needed to determine if worksheets are an accurate and scalable alternative to gold standard observer ratings in settings in which time and resources are limited.

Intervention Fidelity Within Trials of Infant Feeding Behavioral Interventions to Prevent Childhood Obesity: A Systematic Review

Background

Intervention fidelity refers to whether an intervention has been implemented as intended. Trials of infant feeding behavioral interventions to prevent childhood obesity show inconsistent evidence of effectiveness. However, intervention fidelity has not been previously explored within these trials, limiting interpretation of findings.

Purpose

To review the use and/or reporting of strategies to enhance and assess intervention fidelity within trials of infant feeding interventions to prevent childhood obesity, and their association with study quality, effectiveness, and publication year.

Methods

Seven electronic databases were searched, with articles screened for inclusion by two reviewers. The National Institutes of Health Behaviour Change Consortium fidelity checklist was used to assess use and/or reporting of fidelity strategies across five domains (design, provider training, delivery, receipt, and enactment).

Results

Ten trials (16 papers) were identified. Average use/reporting of fidelity strategies was moderate (54%), ranging from 28.9% to 76.7%. Levels of use/reporting ranged from 15.9% in the domain of provider training to 95% for enactment. No association was found between these levels and study quality, effectiveness, or publication year.

Conclusions

The moderate use/reporting of fidelity strategies within trials of infant feeding interventions suggests that previous findings of inconsistent effectiveness may not fully reflect the intended interventions. The review highlights key considerations for improving future research, both in the area of behavioral infant feeding and wider behavior change literature. This includes improving reporting across all fidelity domains and ensuring an enhanced focus on provider training and control group content to optimize the translation of research into practice.

PROSPERO Registration number

CRD42016033492.

Focusing on fidelity: narrative review and recommendations for improving intervention fidelity within trials of health behaviour change interventions

Background: Interventions to change behaviour have substantial potential to impact positively on individual and overall public health. Despite an increasing focus on health behaviour change intervention research, interventions do not always have the desired effect on outcomes, while others have diluted effects once implemented into real-life settings. There is little investment into understanding how or why such interventions work or do not work. Methodological inadequacies of trials of behavioural interventions have been previously suggested as a barrier to the quality and advancement of behavioural research, with intervention fidelity acknowledged as a key area for improvement. However, there is much ambiguity regarding the terminology and conceptualisation of intervention fidelity and a lack of practical guidance regarding how to address it sufficiently, particularly within trials of complex behavioural interventions. Objectives: This article outlines specific issues concerning intervention fidelity within trials of health behaviour change interventions and suggests practical considerations and specific recommendations for researchers, with examples from the literature presented. Conclusions: Recommendations pertain to (1) clarifying how fidelity is defined and conceptualised, (2) considering fidelity beyond intervention delivery, (3) considering strategies to both enhance and assess fidelity, (4) making use of existing frameworks and guidance, (5) considering the quality and comprehensiveness of fidelity assessment strategies, (6) considering the balance between fidelity and adaptation and (7) reporting the use of fidelity enhancement and assessment strategies and their results. Suggestions for future research to improve our understanding of, and ability to, address fidelity in behaviour change interventions are also provided.

Rationale and study design of the MyHEART study: A young adult hypertension self-management randomized controlled trial

Young adults (18-39 year-olds) with hypertension have a higher lifetime risk for cardiovascular disease. However, less than 50% of young adults achieve hypertension control in the United States. Hypertension self-management programs are recommended to improve control, but have been targeted to middle-aged and older populations. Young adults need hypertension self-management programs (i.e., home blood pressure monitoring and lifestyle modifications) tailored to their unique needs to lower blood pressure and reduce the risks and medication burden they may face over a lifetime. To address the unmet need in hypertensive care for young adults, we developed MyHEART (My Hypertension Education And Reaching Target), a multi-component, theoretically-based intervention designed to achieve self-management among young adults with uncontrolled hypertension. MyHEART is a patient-centered program, based upon the Self-Determination Theory, that uses evidence-based health behavior approaches to lower blood pressure. Therefore, the objective of this study is to evaluate MyHEART's impact on changes in systolic and diastolic blood pressure compared to usual care after 6 and 12 months in 310 geographically and racially/ethnically diverse young adults with uncontrolled hypertension. Secondary outcomes include MyHEART's impact on behavioral outcomes at 6 and 12 months, compared to usual clinical care (increased physical activity, decreased sodium intake) and to examine whether MyHEART's effects on self-management behavior are mediated through variables of perceived competence, autonomy, motivation, and activation (mediation outcomes). MyHEART is one of the first multicenter, randomized controlled hypertension trials tailored to young adults with primary care. The design and methodology will maximize the generalizability of this study. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT03158051.

Addressing fidelity within complex health behaviour change interventions: A protocol of a scoping review of intervention fidelity frameworks and models

Intervention fidelity is crucial to facilitate accurate interpretation of research outcomes, but has been inadequately addressed within complex health behaviour change interventions. Recent research has highlighted a need for practical guidance to improve understanding and use of existing fidelity frameworks and models within complex health behaviour change intervention research. The aim of this paper is to present a protocol for a scoping review of existing intervention fidelity frameworks and models.  In accordance with scoping review guidelines, the following stages will be conducted: (1) identifying the research question, (2) identifying potentially relevant studies of fidelity frameworks and models, (3) study screening and selection, (4) charting and extracting data from identified frameworks and models, (5) collating, summarising and reporting the results and (6) consultation with stakeholders. Two reviewers will independently conduct the screening and extraction stages. Identified frameworks will be collated, summarized and categorized iteratively by one reviewer in consultation with the review team. The findings of this review will provide a useful resource by identifying and comparing existing fidelity frameworks and models. It is intended that increased clarity and understanding in this area will facilitate the appropriate selection and application of fidelity frameworks for complex health behaviour change interventions, inform areas for future research, and ultimately contribute towards improving how intervention fidelity is addressed in this area.

Surveying knowledge, practice and attitudes towards intervention fidelity within trials of complex healthcare interventions

Background

Intervention fidelity is the degree to which interventions have been implemented as intended by their developers. Assessing fidelity is crucial for accurate interpretation of intervention effectiveness, but fidelity is often poorly addressed within trials of complex healthcare interventions. The reasons for this are unclear, and information on the use of methods to enhance and assess fidelity in trials of complex interventions remains insufficient. This study aimed to explore the knowledge, practice and attitudes towards intervention fidelity amongst researchers, triallists and healthcare professionals involved with the design and conduct of trials of complex healthcare interventions.

Methods

An online survey consisting of closed and open-ended questions exploring four sections (Demographics, Fidelity knowledge, Practice and Attitudes) was conducted. This was an opportunistic sample of individuals with experience of direct involvement in trials of complex healthcare interventions (e.g. design/development, conduct, evaluation).

Results

Data from 264 participants representing 15 countries were analysed. The majority (65.9%, n = 174) of participants identified themselves as ‘Researchers’. The majority of participants were familiar with the term “intervention fidelity” (69.7%, n = 184) and indicated that fidelity is important (89.7%, n = 236). Mean self-reported understanding of fidelity was moderate. Although 68% (n = 182) had previously used strategies to assess (e.g. audio/video-recording sessions) and enhance (e.g. training manual) fidelity in trials of complex interventions, only a limited proportion of participants indicated always reporting these strategies in subsequent publications (30.9%, n = 56). Poor knowledge or understanding was the most commonly cited barrier to addressing intervention fidelity in trials (77.4%, n = 202). Over half of respondents (52.1%, n = 137) had never completed specific fidelity training or research, and the vast majority (89.7%, n = 236) would welcome specific training in this area.

Conclusion

Despite good awareness of intervention fidelity and its importance, poor knowledge and understanding appears to be a key factor limiting how intervention fidelity is addressed in trials of complex interventions. Participants identified a need for further training and education in this area. Additionally, clarification of the terminology, definition and components of intervention fidelity would facilitate better understanding of the concept. A discrepancy between participants’ use of fidelity strategies and subsequent reporting raises concerns around inadequate fidelity reporting in the trials literature.

Electronic supplementary material

The online version of this article (10.1186/s13063-018-2838-6) contains supplementary material, which is available to authorized users.

A Cluster Randomised Controlled Trial of a Brief Child Health Nurse Intervention to Reduce Infant Secondhand Smoke Exposure

Background Exposure to secondhand smoke (SHS) is a significant contributor to ill health in children. A study was undertaken to determine the effectiveness of two brief multi-strategic child health nurse delivered interventions in: decreasing the prevalence of infants exposed to SHS; decreasing the prevalence of smoking amongst parent/carers of infants and increasing the prevalence of household smoking bans. Methods This study was a 3 arm, cluster randomised controlled trial. Clusters were 39 community based well child health clinics in one local area health service. Clinics were stratified according to annual number of client appointments and then randomly assigned in a 1:1:1 ratio, (Intervention 1: Intervention 2: Control), with 13 clinics in each cluster. Parents/carers of infants in the intervention groups received a brief multi-strategic intervention from child health nurses during clinic consultations. Treatment condition 1 included computer delivered risk assessment and feedback and nurse brief advice. Treatment condition 2 included all elements of Treatment condition 1 with the addition of biochemical feedback of infant SHS exposure. Results When compared to the Control group at 12 months, no significant differences in the prevalence of infant exposure to SHS were detected from baseline to follow-up for Treatment condition 1 (OR 1.16, 95 % CI 0.73-1.85, p = 0.53) or Treatment condition 2 (OR 1.30, 95 % CI 0.88-1.92, p = 0.19) Similarly, no significant differences were detected in the proportion of parent/carers who reported that they were smokers (T1:OR 0.95, 95 % CI 0.78-1.15, p = 0.58 and T2:OR 0.97, 95 % CI 0.80-1.18, p = 0.77), or in the proportion of households reported to have a complete smoking ban (T1:OR 1.21, 95 % CI 0.89-1.64, p = 0.23 and T2:OR 1.06, 95 % CI 0.79-1.43, p = 0.68). Conclusions Further research is required to identify effective interventions that can be consistently provided by child health nurses if the potential of such settings to contribute to reductions in child SHS exposure is to be realised.

The Effectiveness of Community Health Workers for CVD Prevention in LMIC

Community health workers (CHW) may be effective in tackling the burden of cardiovascular diseases in low- and middle-income countries (LMIC). This review examines whether CHWs can improve the identification and control of cardiovascular risk factors in LMIC. We searched for studies that used CHW as a basis for cardiovascular risk factor management. Our search yielded 11 articles that targeted cardiovascular risk factor assessment, hypertension, diabetes, smoking, diet and physical activity. There were 4 randomized controlled trials, 3 quasi-experimental studies, 3 cross-sectional studies, and 1 retrospective analysis. Eight studies reported positive results with CHW being able to effectively screen for cardiovascular risk factors, decrease systolic blood pressure, decrease fasting blood glucose, increase quit rates of smoking, decrease weight, and improve diet and physical activity. Our review demonstrates that CHW may be effective in helping tackle the burden of cardiovascular disease in LMIC.

Reporting of treatment fidelity in behavioural paediatric obesity intervention trials: a systematic review

Behavioural interventions for paediatric obesity are promising, but detailed information on treatment fidelity (i.e. design, training, delivery, receipt and enactment) is needed to optimize the implementation of more effective interventions. Little is known about current practices for reporting treatment fidelity in paediatric obesity studies. This systematic review, in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, describes the methods used to report treatment fidelity in randomized controlled trials. Treatment fidelity was double-coded using the National Institutes of Health Fidelity Framework checklist. Three hundred articles (N = 193 studies) were included. Mean inter-coder reliability across items was 0.83 (SD = 0.09). Reporting of treatment design elements within the field was high (e.g. 77% of studies reported designed length of treatment session), but reporting of other domains was low (e.g. only 7% of studies reported length of treatment sessions delivered). Few reported gold standard methods to evaluate treatment fidelity (e.g. coding treatment content delivered). General study quality was associated with reporting of treatment fidelity (p < 0.01) as was the number of articles published for a given study (p < 0.01). The frequency of reporting treatment fidelity components has not improved over time (p = 0.26). Specific recommendations are made to support paediatric obesity researchers in leading health behaviour disciplines towards more rigorous measurement and reporting of treatment fidelity.

Methods used to address fidelity of receipt in health intervention research: a citation analysis and systematic review

BACKGROUND

The American Behaviour Change Consortium (BCC) framework acknowledges patients as active participants and supports the need to investigate the fidelity with which they receive interventions, i.e. receipt. According to this framework, addressing receipt consists in using strategies to assess or enhance participants' understanding and/or performance of intervention skills. This systematic review aims to establish the frequency with which receipt is addressed as defined in the BCC framework in health research, and to describe the methods used in papers informed by the BCC framework and in the wider literature.

METHODS

A forward citation search on papers presenting the BCC framework was performed to determine the frequency with which receipt as defined in this framework was addressed. A second electronic database search, including search terms pertaining to fidelity, receipt, health and process evaluations was performed to identify papers reporting on receipt in the wider literature and irrespective of the framework used. These results were combined with forward citation search results to review methods to assess receipt. Eligibility criteria and data extraction forms were developed and applied to papers. Results are described in a narrative synthesis.

RESULTS

19.6% of 33 studies identified from the forward citation search to report on fidelity were found to address receipt. In 60.6% of these, receipt was assessed in relation to understanding and in 42.4% in relation to performance of skill. Strategies to enhance these were present in 12.1% and 21.1% of studies, respectively. Fifty-five studies were included in the review of the wider literature. Several frameworks and operationalisations of receipt were reported, but the latter were not always consistent with the guiding framework. Receipt was most frequently operationalised in relation to intervention content (16.4%), satisfaction (14.5%), engagement (14.5%), and attendance (14.5%). The majority of studies (90.0%) included subjective assessments of receipt. These relied on quantitative (76.0%) rather than qualitative (42.0%) methods and studies collected data on intervention recipients (50.0%), intervention deliverers (28.0%), or both (22.0%). Few studies (26.0%) reported on the reliability or validity of methods used.

CONCLUSIONS

Receipt is infrequently addressed in health research and improvements to methods of assessment and reporting are required.

MyHEART: A Non Randomized Feasibility Study of a Young Adult Hypertension Intervention

BACKGROUND

In the United States, young adults (18-39 year-olds) have the lowest hypertension control rates (35%) compared to middle-aged (58%) and older (54%) adults. Ambulatory care for hypertension management often focuses on medication with little time for self-management and behavioral counseling. This study was designed to evaluate the feasibility of MyHEART, a telephone-based health coach self-management intervention for young adults. The goals were to determine the intervention's ability to: 1) recruit young adults with uncontrolled hypertension, 2) maintain ongoing communication between the coach and participants, 3) increase participants' engagement in self-management, 4) document coach-patient communication in the electronic health record, and 5) assess patient acceptability.

METHODS

Eligible participants were identified through the electronic health record. Inclusion criteria included 18-39 year-olds, with ICD-9 hypertension diagnoses and uncontrolled hypertension (≥ 140/90 mmHg), receiving regular primary care at a large multispecialty group practice. The intervention consisted of 6 telephone self-management sessions by a health coach targeting lifestyle modifications. Patients completed an open-ended acceptability survey.

RESULTS

Study uptake was 47% (9 enrolled/19 eligible). Mean (SD) age was 35.8 (2.6) years, 78% male, and 33% Black. Over 85% of enrolled young adults maintained communication with their health coach. At baseline, 11% reported checking their blood pressure outside of clinic; 44% reported blood pressure monitoring after the study. All coach-patient encounters were successfully documented in the electronic health record for primary care provider review. Open-ended responses from all surveys indicated that participants had a positive experience with the MyHEART intervention.

CONCLUSIONS

This study demonstrated that MyHEART was feasible and acceptable to young adults with uncontrolled hypertension. Health coaches can effectively maintain ongoing communication with young adults, document communication in the electronic health record, and increase engagement with home blood pressure monitoring. The results of this study will inform a multi-center young adult randomized controlled trial of MyHEART.

Consideration of treatment fidelity to improve manual therapy research

OBJECTIVES

The purpose of this paper was to define treatment fidelity, review its use in health care research and suggest how it may be utilized in manual therapy research to improve the reliability and validity of the literature.

RESULTS

We offer an outline and a table of how manual therapy research may benefit from the concept of treatment fidelity.

DISCUSSION

While treatment fidelity is a newer concept, and has not been integrated into Physical Therapy or Manual Therapy research, when utilized, it can have positive effects on the reliability and validity of the techniques we evaluate.

Development of a Feasible Implementation Fidelity Protocol Within a Complex Physical Therapy-Led Self-Management Intervention

BACKGROUND

Implementation fidelity is poorly addressed within physical therapy interventions, which may be due to limited research on how to develop and implement an implementation fidelity protocol.

OBJECTIVE

The purpose of this study was to develop a feasible implementation fidelity protocol within a pilot study of a physical therapy-led intervention to promote self-management for people with chronic low back pain or osteoarthritis.

DESIGN

A 2-phase mixed-methods design was used.

METHODS

Phase 1 involved the development of an initial implementation fidelity protocol using qualitative interviews with potential stakeholders to explore the acceptability of proposed strategies to enhance and assess implementation fidelity. Phase 2 involved testing and refining the initial implementation fidelity protocol to develop a finalized implementation fidelity protocol. Specifically, the feasibility of 3 different strategies (physical therapist self-report checklists, independently rated direct observations, and audio-recorded observations) for assessing implementation fidelity of intervention delivery was tested, followed by additional stakeholder interviews that explored the overall feasibility of the implementation fidelity protocol.

RESULTS

Phase 1 interviews determined the proposed implementation fidelity strategies to be acceptable to stakeholders. Phase 2 showed that independently rated audio recordings (n=6) and provider self-report checklists (n=12) were easier to implement than independently rated direct observations (n=12) for assessing implementation fidelity of intervention delivery. Good agreement (79.8%-92.8%) was found among all methods. Qualitative stakeholder interviews confirmed the acceptability, practicality, and implementation of the implementation fidelity protocol.

LIMITATIONS

The reliability and validity of assessment checklists used in this study have yet to be fully tested, and blinding of independent raters was not possible.

CONCLUSIONS

A feasible implementation fidelity protocol was developed based on a 2-phase development process involving intervention stakeholders. This study provides valuable information on the feasibility of rigorously addressing implementation fidelity within physical therapy interventions and provides recommendations for researchers wanting to address implementation fidelity in similar areas.

Implementation fidelity of physiotherapist-delivered group education and exercise interventions to promote self-management in people with osteoarthritis and chronic low back pain: a rapid review part II

BACKGROUND

Implementation fidelity is the extent to which an intervention is delivered as intended by intervention developers, and is extremely important as it increases confidence that changes in study outcomes are due to the effect of the intervention itself and not due to variability in implementation. A paucity of literature exists concerning implementation fidelity in physiotherapy research.

DESIGN AND OBJECTIVES

This rapid review aimed to evaluate the implementation fidelity of group-based self-management interventions for people with osteoarthritis (OA) and/or chronic low back pain (CLBP).

METHOD

Group-based self-management interventions delivered by health-care professionals (including at least one physiotherapist) involving adults with OA and/or CLBP were eligible for inclusion. The National Institutes of Health Behaviour Change Consortium Treatment Fidelity checklist was used to assess fidelity and applied independently by two reviewers.

RESULTS

In total, 22 studies were found. Fidelity was found to be very low (mean score 36%) within the included studies with only one study achieving >80% on the framework. The domain of Training of Providers achieved the lowest fidelity rating (10%) across all studies.

CONCLUSIONS

Overall levels of implementation fidelity are low in self-management interventions for CLBP and/or OA; however it is unclear whether fidelity is poor within the trials included in this review, or just poorly reported. There is a need for the development of fidelity reporting guidelines and for the refinement of fidelity frameworks upon which to base these guidelines.

Training and fidelity monitoring of alcohol treatment interventions integrated into routine tuberculosis care in Tomsk, Russia: the IMPACT Effectiveness Trial

IMPACT (Integrated Management of Physician-Delivered Alcohol Care for Tuberculosis patients) is a randomized, controlled effectiveness trial based in Tomsk, Russia, that assesses the effect of oral naltrexone and brief behavioral counseling on tuberculosis outcomes and alcohol use in 200 patients. Tuberculosis physicians without addiction experience delivered interventions as part of routine care over a 6-month period, focusing on alcohol intake reduction to support successful tuberculosis treatment. We describe design, training, and fidelity monitoring using a Russian and American team of physicians, bilingual coders, and supervisors. Culturally appropriate adaptations, limitations, and implications for future trials are discussed. The clinical trial identification number is NCT00675961. Funding came from the National Institutes of Health and National Institute on Drug Abuse.

Providing coaching and cotinine results to preteens to reduce their secondhand smoke exposure: a randomized trial

BACKGROUND

Secondhand smoke exposure (SHSe) poses health risks to children living with smokers. Most interventions to protect children from SHSe have coached adult smokers. This trial determined whether coaching and cotinine feedback provided to preteens can reduce their SHSe.

METHODS

Two hundred one predominantly low-income families with a resident smoker and a child aged 8 to 13 years who was exposed to two or more cigarettes per day or had a urine cotinine concentration ≥ 2.0 ng/mL were randomized to control or SHSe reduction coaching groups. During eight in-home sessions over 5 months, coaches presented to the child graphic charts of cotinine assay results as performance feedback and provided differential praise and incentives for cotinine reductions. Generalized estimating equations were used to determine the differential change in SHSe over time by group.

RESULTS

For the baseline to posttest period, the coaching group had a greater decrease in both urine cotinine concentration (P = .039) and reported child SHSe in the number of cigarettes exposed per day (child report, P = .003; parent report, P = .078). For posttest to month 12 follow-up, no group or group by time differences were obtained, and both groups returned toward baseline.

CONCLUSIONS

Coaching preteens can reduce their SHSe, although reductions may not be sustained without ongoing counseling, feedback, and incentives. Unlike interventions that coach adults to reduce child SHSe, programs that increase child avoidance of SHSe have the potential to reduce SHSe in all settings in which the child is exposed, without requiring a change in adult smoking behavior.

The Assessment, Monitoring, and Enhancement of Treatment Fidelity In Public Health Clinical Trials

OBJECTIVES: To discuss methods of preservation of treatment fidelity in health behavior change trials conducted in public health contexts. METHODS: The treatment fidelity framework provided by the NIH's Behavioral Change Consortium (BCC) (1) includes five domains of treatment fidelity (Study Design, Training, Delivery, Receipt, and Enactment). A measure of treatment fidelity was previously developed and validated using these categories. RESULTS: Strategies for assessment, monitoring, and enhancing treatment fidelity within each of the five treatment fidelity domains are discussed. The previously created measure of treatment fidelity is updated to include additional items on selecting providers, additional confounders, theory testing, and multicultural considerations. CONCLUSIONS: Implementation of a treatment fidelity plan may require extra staff time and costs. However, the economic and scientific costs of lack of attention to treatment fidelity are far greater than the costs of treatment fidelity implementation. Maintaining high levels of treatment fidelity with flexible adaptation according to setting, provider, and patient is the goal for public health trials.