Fibromyalgia antirheumatic drug trials: Effects of a standardized instructional videotape on the reliability of observer-dependent outcome measures

Towards a conceptual framework demonstrating the effectiveness of audiovisual patient descriptions (patient video cases): a review of the current literature

BACKGROUND

Technological advances have enabled the widespread use of video cases via web-streaming and online download as an educational medium. The use of real subjects to demonstrate acute pathology should aid the education of health care professionals. However, the methodology by which this effect may be tested is not clear.

METHODS

We undertook a literature review of major databases, found relevant articles relevant to using patient video cases as educational interventions, extracted the methodologies used and assessed these methods for internal and construct validity.

RESULTS

A review of 2532 abstracts revealed 23 studies meeting the inclusion criteria and a final review of 18 of relevance. Medical students were the most commonly studied group (10 articles) with a spread of learner satisfaction, knowledge and behaviour tested. Only two of the studies fulfilled defined criteria on achieving internal and construct validity. The heterogeneity of articles meant it was not possible to perform any meta-analysis.

CONCLUSIONS

Previous studies have not well classified which facet of training or educational outcome the study is aiming to explore and had poor internal and construct validity. Future research should aim to validate a particular outcome measure, preferably by reproducing previous work rather than adopting new methods. In particular cognitive processing enhancement, demonstrated in a number of the medical student studies, should be tested at a postgraduate level.

An evaluation of the effectiveness of a videotape programme on interobserver reliability in outcome assessment for ankylosing spondylitis

AIMS

A study was designed to assess the effects of a standardized instructional videotape on training senior medical students to acceptable levels of reliability in performing several commonly used obsever dependent outcome measures in patients with ankylosing spondylilis (AS).

METHODS

During a single day, six third-year medical students independently examined five patients with AvS in predetermined order using a Latin Square design, before and after viewing a standardized videotape demonstrating 14 examination techniques. Reliability coefficients were calculated based on the variance components of the analysis of variance (ANOVA) table.

RESULTS

Prestandardization reliability coefficients were < 0.80 for three measures. Following standardization 12 reliability coefficients exceeded 0.80. For the majority of measures prestandardization reliability coefficients were high and no further improvement in reliability could be demonstrated.

CONCLUSIONS

High levels of interobserver agreement were noted prior to viewing the instructional videotape. This may represent the success of undergraduate clinical skills training programmes, or it may be the result of having reviewed an illustrated instructional text just prior to the initial patient examinations. With the exception of chest excursion, high levels of prestandardization reliability, by necessity, precluded the demonstration of significant effects from viewing the videotape. Nevertheless, the data indicate that senior medical students arc capable of reliably performing quantitative measurement in AS. Recent surveys in Canada and Australia, showing a general lack of quantitative clinical measurement in the longitudinal follow up of AS outpatients by rheumatologists, suggest that the lack of quantitation is not due to inability to reliably perform the measurements.

An evaluation of the effectiveness of a videotape programme on interobserver reliability in outcome assessment for rheumatoid arthritis

AIMS

A study was designed to assess the effects of a standardized instructional videotape on training senior medical students to acceptable levels of reliability in performing several commonly used observer dependent outcome measures in patients with rheumatoid arthritis (RA).

METHODS

During a single day, six third-year medical students independently examined six patients with RA in predetermined order using a Latin Square design, before and after viewing a standardized videotape demonstrating 15 examination techniques. Reliability coefficients were calculated based on the variance components of the analysis of variance (ANOVA) table.

RESULTS

Prestandardization reliability coefficients were >0.80 for all measures and remained above 0.80 following standardization except for one measure.

CONCLUSIONS

High levels of interobserver agreement were noted prior to viewing the instructional videotape. This may represent the success of undergraduate clinical skills training programmes or it may be me result of the students having reviewed an illustrated instructional text just prior to the initial patient examinations. High levels of prestandardization reliability, by necessity, precluded the demonstration of significant effects from viewing the videotape. Nevertheless, the data indicate that senior medical students are capable of reliably performing quantitative measurement in RA. Recent surveys in Canada and Australia, showing a general lack of quantitative clinical measurement in the longitudinal follow up of RA outpatients by rheumatologists, suggest that the lack of standardization is not due to inability to reliably perform the measurements.

An evaluation of the effectiveness of a videotape programme on interobserver reliability in outcome assessment for osteoarthritis

AIMS

A study was designed to assess the effects of a standardized instructional videotape on training senior medical students to acceptable levels of reliability in performing several commonly used observer dependent outcome measures in patients with osteoarthritis (OA).

METHODS

During a single day, six third-year medical students independently examined six patients with OA in predetermined order using a Latin Square design, before and after viewing a standardized videotape demonstrating 13 examination techniques. Reliability coefficients were calculated based on variance components of the analysis of variance (ANOVA) table.

RESULTS

Preslandardization reliability coefficients were <0.80 for seven measures. Coefficients for the performance of knee goniometry were uniformly low. Following the intervention, all but four reliability coefficients were >/= 0.93.

CONCLUSIONS

For many measures, high levels of interobserver agreement were noted prior to viewing the instructional videotape. This may represent the success of undergraduate clinical skills training programmes, or it may be the result of having reviewed an illustrated instructional text just prior to the initial patient examinations. The notable exception was knee goniometry. Despite apparent familiarity with the technique, prestandardization reliability coefficients were very low. However, following the intervention, all coefficients improved dramatically, two-thirds achieving very high levels. These data suggest that skills development in senior medical students is not uniform and that, while reliability is high for many, the assessment of knee range of movement can be improved by viewing an instructional videotape.

Perceptual variation in categorizing individual peripheral joints for the presence or absence of osteoarthritis using a standard homunculus: observations based on an australian twin registry study of osteoarthritis

The clinical diagnosis of osteoarthritis in the peripheral skeleton is dependent on the skilled examination of several features characteristic of the condition. However, we have previously observed that even highly experienced rheumatologists in Australia and Canada may not completely agree on the clinical examination in individuals with osteoarthritis (OA), rheumatoid arthritis, ankylosing spondylitis, fibromyalgia, scleroderma and painful shoulder.