The quest to quantify quality

Variation in Long-Term Care Needs Assessors’ Willingness to Support Clients’ Requests for Admission to a Residential Home

Objectives: The purpose of this study is to determine what client, needs assessor, and agency factors explain variation in decision making by long-term care needs assessors concerning clients requesting admission to a residential home.

Method: Hypothetical case vignettes were sent to needs assessors allocating services for the elderly. Multilevel logistic regression analysis provided random and fixed effects.

Results: The authors found random effects of the level of needs assessors are negligible, of the level of agencies small though statistically significant, clients receiving largest relative share of the variance. The amount of care already present appeared most important in the decision. Needs assessors were willing to support their clients’ wishes only when they were clearly motivated. Policy implications considering the tension between clients’ preferences and equity are discussed.

Training and validation of standardized patients for evaluation of general practitioners' performance in management of obesity and overweight

BACKGROUND

Standardized patient (SP) can serve as a valuable tool to measure the physician performance in actual clinical settings, but it has not been validated for obesity/overweight disorders. This study has been conducted to describe the process of creating reliable and valid SPs for evaluation of general-practitioners' management of obesity/overweight in Iran.

MATERIALS AND METHODS

A total of 6 obese/overweight volunteers (potential SPs) took part in training. Three scenarios, along with corresponding checklists including 102 items representing different aspects of diagnosis and treatment of obesity/overweight, were developed by an expert group. The SPs were trained using role playing method. During this part, one of the SPs failed. The SPs' portrayal of their respective scenario was online watched in another room and the checklist filled independently by the physician, research assistant and other SPs. The reliability of the checklist to be used by the SPs was assessed by Cronbach's alpha. The overall inter-rater agreement was calculated by the intraclass correlation coefficient statistic for total scores.

RESULTS

The 5 eligible SPs were all women between 20 years and 39 years of age. Inter-rater agreement between the SPs' total scores was 0.899, value (95% confidence intervals) were 11.8 (0.68-0.98) and P value was <0.001. The Cronbach's alpha for reliability of completed checklists was 0.91.

CONCLUSION

SP could be a powerful instrument for evaluating medical performance of general practitioners in the field of obesity/overweight management. Further research is needed to find the more aspects of training and validation of unannounced SPs in this field.

Image Theory’s counting rule in clinical decision making: Does it describe how clinicians make patient-specific forecasts?

The field of clinical decision making is polarized by two predominate views. One holds that treatment recommendations should conform with guidelines; the other emphasizes clinical expertise in reaching case-specific judgments. Previous work developed a test for a proposed alternative, that clinical judgment should systematically incorporate both general knowledge and patient-specific information. The test was derived from image theory’s two phase-account of decision making and its “simple counting rule”, which describes how possible courses of action are pre-screened for compatibility with standards and values. The current paper applies this rule to clinical forecasting, where practitioners indicate how likely a specific patient will respond favorably to a recommended treatment. Psychiatric trainees evaluated eight case vignettes that exhibited from 0 to 3 incompatible attributes. They made two forecasts, one based on a guideline recommendation, the other based on their own alternative. Both forecasts were predicted by equally- and unequally-weighted counting rules. Unequal weighting provided a better fit and exhibited a clearer rejection threshold, or point at which forecasts are not diminished by additional incompatibilities. The hypothesis that missing information is treated as an incompatibility was not confirmed. There was evidence that the rejection threshold was influenced by clinician preference. Results suggests that guidelines may have a de-biasing influence on clinical judgment. Subject to limitations pertaining to the subject sample and population, clinical paradigm, guideline, and study procedure, the data support the use of a compatibility test to describe how clinicians make patient-specific forecasts.

Practitioner perceptions of attenuated psychosis syndrome

The "Attenuated Psychosis Syndrome" (APS, sometimes referred to as the "schizophrenia prodrome") is characterized by subthreshold psychotic-like symptoms and functional decline, and is often associated with significant disability. These symptoms may cause impairment and are of further interest due to their predictive relation to schizophrenia and other psychotic disorders. These symptoms currently are not represented in the diagnostic system for mental health, and it is unclear how they are conceptualized by relevant professionals. The current study surveyed a national sample (n=303) of clinical psychologists, psychiatrists, and general practitioners regarding their clinical appraisal of APS. Practitioners were asked to respond to vignettes representing three conditions: psychosis, subthreshold psychosis (indicating 'attenuated' psychosis symptoms), and no psychotic symptoms. Practitioners' responses suggested that APS is viewed consistently with a DSM-IV-TR defined mental disorder and that most clinicians may diagnose this condition as a full threshold psychotic disorder. Findings tentatively suggest that the inclusion of an attenuated psychosis symptoms category in the forthcoming DSM-5 may be helpful in improving diagnostic reliability and facilitating best practice among community practitioners.

Hydroxyurea and sickle cell anemia: effect on quality of life

Background

The Multicenter Study of Hydroxyurea (HU) in Sickle Cell Anemia (MSH) previously showed that daily oral HU reduces painful sickle cell (SS) crises by 50% in patients with moderate to severe disease. The morbidity associated with this disease is known to have serious negative impact on the overall quality of life(QOL) of affected individuals.

Methods

The data in this report were collected from the 299 patients enrolled in the MSH. Health quality of llife (HQOL) measures were assessed in the MSH as a secondary endpoint to determine if the clinical benefit of HU could translate into a measurable benefit perceptible to the patients. HQOL was assessed with the Profile of Mood States, the Health Status Short Form 36 (SF-36), including 4-week pain recall, and the Ladder of Life, self-administered twice 2-weeks apart pre-treatment and every 6 months during the two-year, randomized, double-blind, treatment phase. The effects of factors including randomized treatment, age, gender, pre-treatment crises frequency, Hb-F level mean, daily pain from 4-week pre-treatment diaries, and 2-year Hb-F response level (low or high) were investigated.

Results

Over two years of treatment, the benefit of HU treatment on QOL, other than pain scales, was limited to those patients taking HU who maintained a high HbF response, compared to those with low HbF response or on placebo. These restricted benefits occurred in social function, pain recall and general health perception. Stratification according to average daily pain prior to treatment showed that responders to HU whose average daily pain score was 5–9 (substantial pain) achieved significant reduction in the tension scale compared to the placebo group and to non-responders. HU had no apparent effect on other QOL measures.

Conclusion

Treatment of SS with HU improves some aspects of QOL in adult patients who already suffer from moderate-to-severe SS.

Client, needs assessor and agency-related factors predicting allocation of electric scooters to community-dwelling elderly in The Netherlands: a vignette study

PURPOSE

To determine what client factors predict allocation of an electric scooter and to determine what needs assessor and agency factors explain variation in decision-making by long-term care needs assessors concerning clients requesting electric scooters.

METHOD

Hypothetical case vignettes were sent to needs assessors allocating services for the elderly, and questionnaires were used to obtain organizational and individual needs assessor data. Multilevel logistic regression analysis provided random and fixed effects.

RESULTS

The decision whether or not to allocate an electric scooter was influenced primarily by the clients' driving safety, their disabilities and whether or not there were possibilities to stall the electric scooter. Transportation goals and the clients' activity level were not taken into account. There was some random variation on the level of needs assessors.

CONCLUSIONS

A system whereby all clients who request an electric scooter, have disabilities that limit mobility, have shown to be safe drivers and have a shed to stall the scooter are allocated a scooter may be more appropriate in maintaining elderly persons' independence and preventing social isolation. Regular evaluation afterwards and extra driving lessons may prevent allocation of scooters to clients who do not use them.

Using standardised patients to measure physicians' practice: validation study using audio recordings

OBJECTIVE

To assess the validity of standardised patients to measure the quality of physicians' practice.

DESIGN

Validation study of standardised patients' assessments. Physicians saw unannounced standardised patients presenting with common outpatient conditions. The standardised patients covertly tape recorded their visit and completed a checklist of quality criteria immediately afterwards. Their assessments were compared against independent assessments of the recordings by a trained medical records abstractor.

SETTING

Four general internal medicine primary care clinics in California.

PARTICIPANTS

144 randomly selected consenting physicians.

MAIN OUTCOME MEASURES

Rates of agreement between the patients' assessments and independent assessment.

RESULTS

40 visits, one per standardised patient, were recorded. The overall rate of agreement between the standardised patients' checklists and the independent assessment of the audio transcripts was 91% (kappa=0.81). Disaggregating the data by medical condition, site, level of physicians' training, and domain (stage of the consultation) gave similar rates of agreement. Sensitivity of the standardised patients' assessments was 95%, and specificity was 85%. The area under the receiver operator characteristic curve was 90%.

CONCLUSIONS

Standardised patients' assessments seem to be a valid measure of the quality of physicians' care for a variety of common medical conditions in actual outpatient settings. Properly trained standardised patients compare well with independent assessment of recordings of the consultations and may justify their use as a "gold standard" in comparing the quality of care across sites or evaluating data obtained from other sources, such as medical records and clinical vignettes.