Teaching Medical Students to Help Patients Manage Their Weight: Outcomes of an Eight-School Randomized Controlled Trial

Content Validition and Psychometric Evaluation of the Self-efficacy and Performance in Self-management Support Instrument for Physiotherapists

OBJECTIVE

To develop and psychometrically test the Self-Efficacy and Performance in Self-Management Support instrument for physiotherapists (SEPSS-PT), based on the SEPSS-36, the corresponding instrument for nurses.

DESIGN

Instrument development including content validation and psychometric evaluation (construct validity, factor structure, and reliability).

SETTING

Data were collected from literature, expertmeetings, and online questionnaire PARTICIPANTS: Next to a comprehensive literature study, experts (self-management experts (n=2); physiotherapists (n=10); patients (n=6)) and physiotherapists and physiotherapy students (n=334), participated in different stages of the study.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Not applicable. A literature study (n=42 reviews) and consultations with physiotherapists and patients identified the specific content for physiotherapy. The Five-A's model and overarching competencies of "supportive partnership attitude", were used to structure the items. Psychometric evaluation of the draft questionnaire (40 items) was tested in a sample of 334 physiotherapists and physiotherapy students from the Netherlands, of whom 33 filled out the questionnaire twice to establish the test-retest reliability.

RESULTS

Confirmatory factor analyses revealed satisfactory fit indices for both the 6-factor model and hierarchical model, with best fit for the 6-factor model. The questionnaire discriminated between physiotherapists and physiotherapy students, and between physiotherapists who did or did not consider self-management support important. The overall internal consistency (Cronbach's alpha) was high, both for the self-efficacy and the performance items. In most of the subscales, test-retest intra-class correlation coefficients for both overall self-efficacy and performance were good, but in 3 subscales insufficient for performance.

CONCLUSION

The SEPSS-PT questionnaire is a 40-item, Likert-scaled instrument with good content and construct validity, good internal consistency and reliability, and sufficient test-retest reliability. Future research in a larger and more diverse sample could confirm stability and discriminating power.

Video-based communication assessment for weight management counseling training in medical residents: a mixed methods study

BACKGROUND

Physician delivered weight management counseling (WMC) occurs infrequently and physicians report lack of training and poor self-efficacy. The purpose of this study was to develop and test the Video-based Communication Assessment (VCA) for weight management counseling (WMC) training in medical residents.

METHODS

This study was a mixed methods pilot conducted in 3 phases. First, we created five vignettes based on our prior data and expert feedback, then administered the vignettes via the VCA to Internal Medicine categorical residents (n = 16) from a University Medical School. Analog patients rated responses and also provided comments. We created individualized feedback reports which residents were able to view on the VCA. Lastly, we conducted debriefing interviews with the residents (n = 11) to obtain their feedback on the vignettes and personalized feedback. Interviews were transcribed, and we used thematic analysis to generate and apply codes, followed by identifying themes.

RESULTS

Descriptive statistics were calculated and learning points were created for the individualized feedback reports. In VCA debriefing interviews with residents, five themes emerged: 1) Overall the VCA was easy to use, helpful and more engaging than traditional learning and assessment modes, 2) Patient scenarios were similar to those encountered in the clinic, including diversity, health literacy and different stages of change, 3) The knowledge, skills, and reminders from the VCA can be transferred to practice, 4) Feedback reports were helpful, to the point and informative, including the exemplar response of how to best respond to the scenario, and 5) The VCA provide alternatives and practice scenarios to real-life patient situations when they aren't always accessible.

CONCLUSIONS

We demonstrated the feasibility and acceptability of the VCA, a technology delivered platform, for delivering WMC to residents. The VCA exposed residents to diverse patient experiences and provided potential opportunities to tailor providers responses to sociological and cultural factors in WMC scenarios. Future work will examine the effect of the VCA on WMC in actual clinical practice.

Development of a telehealth obesity OSCE and reliable checklist for assessment of resident physicians: a pilot study

BACKGROUND

Obesity is a major public health problem, yet residents undergo little formal training and assessment in obesity-related care. Given the recent growth of telehealth, physicians must further learn to apply these skills using a virtual platform. Therefore, we aimed to develop an objective structured clinical examination (OSCE) with reliable checklists to assess resident ability to take a patient-centered obesity-focused history that was feasible over telehealth based on published obesity competencies for medical education.

METHODS

We developed a 15-minute telehealth OSCE to simulate an obesity-related encounter for residents modified from a script used to assess medical student obesity competencies. We designed three checklists to assess resident skills in history taking, communication and professionalism during the obesity-related encounter. Resident performance was assessed as the percentage of obesity-related history taking questions asked during the encounter and as the mean communication and professionalism scores on a scale of 1 through 5 with 1 representing unacceptable/offensive behavior and 5 representing excellent skills. Encounters and assessments were completed by two commissioned actors (standardized patients) and 26 internal medicine residents over a secure online platform. We assessed the reliability of each checklist by calculating the percent agreement between standardized patients and the kappa (κ) statistic on each checklist overall and by each checklist item.

RESULTS

Overall agreement between standardized patients on the history taking, communication and professionalism checklists were 83.2% (κ = 0.63), 99.5% (κ = 0.72) and 97.8% (κ =0.44), respectively. On average, residents asked 64.8% of questions on the history taking checklist and scored 3.8 and 3.9 out of 5 on the communication and professionalism checklists, respectively.

CONCLUSIONS

Results from this pilot study suggest that our telehealth obesity OSCE and checklists are moderately reliable for assessing key obesity competencies among residents on a virtual platform. Integrating obesity OSCEs and other educational interventions into residency curricula are needed to improve resident ability to take an obesity-focused history.