Prescribing hand strengthening exercise for patients with rheumatoid arthritis; clinical cues influencing occupational therapists' and physiotherapists' judgements

OBJECTIVE

To explore the clinical judgements of therapists in prescribing the intensity of hand strengthening exercise in rheumatoid arthritis (RA).

METHODS

Phase I: Eleven therapists knowledgeable in treating patients with RA subjectively identified seven clinical cues. These were incorporated into 54 hypothetical patient case scenarios.

PHASE II

Therapists with ≥2 years post-registration experience and current or recent experience in treating patients with RA were asked to assess 69 case scenarios in total (54 + 15 repeats) and judge what intensity of hand strengthening exercise they would prescribe using the OMNI-Resistance Exercise Scale of perceived exertion. Using responses to the repeated cases, the Cochran-Weiss-Shanteau index of expertise was used to identify therapists who prescribed more consistently. Multiple regression was used to determine which clinical cues were most strongly associated with the intensity of exercise prescribed. A sub-group analysis explored differences between consistent and inconsistent prescribers.

RESULTS

Fifty-three therapists took part. Thirty completed all 69 case scenarios. Across all therapists, the three most important clinical cues associated with lower intensity of exercise prescribed were (1) Patient's reported pain intensity whilst practising the exercise (β = -1.150, p < 0.001), (2) Disease activity (β = -0.425, p < 0.001) and (3) average hand pain over the last week (β = -0.353 p < 0.001). Twelve therapists were categorised as consistent prescribers. This group relied on fewer clinical cues (three vs. seven) when judging what intensity of exercise to prescribe.

CONCLUSION

This study provides insights into how therapists prescribe hand exercises. Intensity of hand strengthening exercise was influenced by three key clinical cues, including pain intensity and disease activity.

Peer reviewers' dilemmas: a qualitative exploration of decisional conflict in the evaluation of grant applications in the medical humanities and social sciences

Independent evaluations of grant applications by subject experts are an important part of the peer-review system. However, little is known about the real-time experiences of peer reviewers or experts who perform reviews of a grant application independently. This study sought to gain insight into this stage of the grant evaluation process by observing how experts conduct an independent review in near real time. Using the think aloud approach and Critical Decision Method of interviewing, in-depth interviews were conducted with 16 peer reviewers from a range of roles and disciplines within the medical humanities and social sciences. Participants were asked to think aloud while reviewing applications to different grant schemes from a single prestigious funder. The analysis shows reviewers encountered five dilemmas during the evaluation process. These dilemmas were related to whether or not one should (1) accept an invitation to review, (2) rely exclusively on the information presented in the application, (3) pay attention to institutional prestige, (4) offer comments about aspects that are not directly related to academics' area of expertise, and (5) to take risks and overlook shortcomings rather than err on the side of caution. In order to decide on the appropriate course of action, reviewers often engaged in a series of deliberations and trade-offs-varying in length and complexity. However, their interpretation of what was 'right' was influenced by their values, preferences and experiences, but also by relevant norms and their understanding of the funder's guidelines and priorities. As a result, the way reviewers approached the identified dilemmas was idiosyncratic and sometimes diametrically opposed to other reviewers' views, which could lead to variation in peer-review outcomes. The dilemmas we have uncovered suggest that peer reviewers engage in thoughtful considerations during the peer-review process. We should, therefore, be wary of reducing the absence of consensus as resulting from biased, instinctive thinking. Rather, these findings highlight the diversity of values, priorities and habits and ways of working each reviewer brings to the fore when reviewing the applicants and their project proposals and call for further reflection on, and study of, this "invisible work" to better understand and continue to improve the peer-reviewing process.

Specialist palliative medicine physicians and nurses accuracy at predicting imminent death (within 72 hours): a short report

Objectives

Research suggests that clinicians are not very accurate at prognosticating in palliative care. The ‘horizon effect’ suggests that accuracy ought to be better when the survival of patients is shorter. The aim of this study was to determine the accuracy of specialist palliative care clinicians at identifying which patients are likely to die within 72 hours.

Design

In a secondary data analysis of a prospective observational study, specialist palliative care doctors and nurses (in a hospice and a hospital palliative care team) provided survival predictions (yes/no/uncertain) about which patients would die within 72 hours.

Results

Survival predictions were obtained for 49 patients. A prediction from a nurse was obtained for 37/49 patients. A prediction from a doctor was obtained for 46/49 patients. In total, 23 (47%)/49 patients actually died within 72 hours of assessment. Nurses accurately predicted the outcome in 27 (73%)/37 cases. Doctors accurately predicted the outcome in 30 (65%)/46 cases. When comparing predictions given on the same patients (27 [55%]/49), nurses were slightly better at recognising imminent death than doctors (positive predictive value (the proportion of patients who died when the clinician predicted death)=79% vs 60%, respectively). The difference in c-statistics (nurses 0.82 vs doctors 0.63) was not significant (p=0.13).

Conclusion

Even when patients are in the terminal phase and close to death, clinicians are not very good at predicting how much longer they will survive. Further research is warranted to improve prognostication in this population.

Online training improves medical students' ability to recognise when a person is dying: The ORaClES randomised controlled trial

BACKGROUND

Recognising dying is a key clinical skill for doctors, yet there is little training.

AIM

To assess the effectiveness of an online training resource designed to enhance medical students' ability to recognise dying.

DESIGN

Online multicentre double-blind randomised controlled trial (NCT03360812). The training resource for the intervention group was developed from a group of expert palliative care doctors' weightings of various signs/symptoms to recognise dying. The control group received no training.

SETTING/PARTICIPANTS

Participants were senior UK medical students. They reviewed 92 patient summaries and provided a probability of death within 72 hours (0% certain survival - 100% certain death) pre, post, and 2 weeks after the training. Primary outcome: (1) Mean Absolute Difference (MAD) score between participants' and the experts' scores, immediately post intervention. Secondary outcomes: (2) weight attributed to each factor, (3) learning effect and (4) level of expertise (Cochran-Weiss-Shanteau (CWS)).

RESULTS

Out of 168 participants, 135 completed the trial (80%); 66 received the intervention (49%). After using the training resource, the intervention group had better agreement with the experts in their survival estimates (δMAD = -3.43, 95% CI -0.11 to -0.34, p = <0.001) and weighting of clinical factors. There was no learning effect of the MAD scores at the 2-week time point (δMAD = 1.50, 95% CI -0.87 to 3.86, p = 0.21). At the 2-week time point, the intervention group was statistically more expert in their decision-making versus controls (intervention CWS = 146.04 (SD 140.21), control CWS = 110.75 (SD 104.05); p = 0.01).

CONCLUSION

The online training resource proved effective in altering the decision-making of medical students to agree more with expert decision-making.

The (un)availability of prognostic information in the last days of life: a prospective observational study

OBJECTIVES

The aims of this study were (1) to document the clinical condition of patients considered to be in the last 2 weeks of life and (2) to compare patients who did or did not survive for 72 hours.

DESIGN

A prospective observational study.

SETTING

Two sites in London, UK (a hospice and a hospital palliative care team).

PARTICIPANTS

Any inpatient, over 18 years old, English speaking, who was identified by the palliative care team as at risk of dying within the next 2 weeks was eligible.

OUTCOME MEASURES

Prognostic signs and symptoms were documented at a one off assessment and patients were followed up 7 days later to determine whether or not they had died.

RESULTS

Fifty participants were recruited and 24/50 (48%) died within 72 hours of assessment. The most prevalent prognostic features observed were a decrease in oral food intake (60%) and a rapid decline of the participant's global health status (56%). Participants who died within 72 hours had a lower level of consciousness and had more care needs than those who lived longer. A large portion of data was unavailable, particularly that relating to the psychological and spiritual well-being of the patient, due to the decreased consciousness of the patient.

CONCLUSIONS

The prevalence of prognostic signs and symptoms in the final days of life has been documented between those predicted to die and those who did not. How doctors make decisions with missing information is an area for future research, in addition to understanding the best way to use the available information to make more accurate predictions.

Imminent death: clinician certainty and accuracy of prognostic predictions

OBJECTIVES

To determine the accuracy of predictions of dying at different cut-off thresholds and to acknowledge the extent of clinical uncertainty.

DESIGN

Secondary analysis of data from a prospective cohort study.

SETTING

An online prognostic test, accessible by eligible participants across the UK.

PARTICIPANTS

Eligible participants were members of the Association of Palliative Medicine. 99/166 completed the test (60%), resulting in 1980 estimates (99 participants × 20 summaries).

MAIN OUTCOME MEASURES

The probability of death occurring within 72 hours (0% certain survival-100% certain death) for 20 patient summaries. The estimates were analysed using five different thresholds: 50/50%, 40/60%, 30/70%, 20/80% and 10/90%, with percentage values between these extremes being regarded as 'indeterminate'. The positive predictive value (PPV), negative predictive value (NPV) and the number of indeterminate cases were calculated for each cut-off.

RESULTS

Using a <50% versus >50% threshold produced a PPV of 62%, an NPV of 74% and 5% indeterminate cases. When the threshold was changed to ≤10% vs ≥90%, the PPV and NPV increased to 75% and 88%, respectively, at the expense of an increase of indeterminate cases up to 62%.

CONCLUSION

When doctors assign a very high (≥90%) or very low (≤10%) probability of imminent death, their prognostic accuracy is improved; however, this increases the number of 'indeterminate' cases. This suggests that clinical predictions may continue to have a role for routine prognostication but that other approaches (such as the use of prognostic scores) may be required for those cases where doctors' estimates are indeterminate.

Protocol for the ORaClES study: an online randomised controlled trial to improve clinical estimates of survival using a training resource for medical students

INTRODUCTION

Clinicians often struggle to recognise when palliative care patients are imminently dying (last 72 hours of life). A previous study identified the factors that expert palliative care doctors (with demonstrated prognostic skills) had used, to form a judgement about which patients were imminently dying. This protocol describes a study to evaluate whether an online training resource showing how experts weighted the importance of various symptoms and signs can teach medical students to formulate survival estimates for palliative care patients that are more similar to the experts' estimates.

METHODS AND ANALYSIS

This online double-blind randomised controlled trial will recruit at least 128 students in the penultimate or final year of medical school in the UK. Participants are asked to review three series of vignettes describing patients referred to palliative care and provide an estimate about the probability (0%-100%) that each patient will die within 72 hours. After the first series, students randomised to the intervention arm are given access to an online training resource. All participants are asked to complete a second series of vignettes. After 2 weeks, all participants are asked to complete a third series. The primary outcome will be the probability of death estimates (0%-100%) provided by students in the intervention and control arms for the second series of vignettes. Secondary outcomes include the maintenance effect at 2-week follow-up, weighting of individual symptoms and signs, and level of expertise (discrimination and consistency).

ETHICS AND DISSEMINATION

Approval has been obtained from the UCL Research Ethics Committee (8675/002) and local approvals will be obtained as appropriate. Results will be published in peer-reviewed journals using an open access format and presented at academic conferences. We will also publicise our findings on the Marie Curie website.

TRIAL REGISTRATION NUMBER

NCT03360812; Pre-results.

Critical care usage after major gastrointestinal and liver surgery: a prospective, multicentre observational study

BACKGROUND

Patient selection for critical care admission must balance patient safety with optimal resource allocation. This study aimed to determine the relationship between critical care admission, and postoperative mortality after abdominal surgery.

METHODS

This prespecified secondary analysis of a multicentre, prospective, observational study included consecutive patients enrolled in the DISCOVER study from UK and Republic of Ireland undergoing major gastrointestinal and liver surgery between October and December 2014. The primary outcome was 30-day mortality. Multivariate logistic regression was used to explore associations between critical care admission (planned and unplanned) and mortality, and inter-centre variation in critical care admission after emergency laparotomy.

RESULTS

Of 4529 patients included, 37.8% (n=1713) underwent planned critical care admissions from theatre. Some 3.1% (n=86/2816) admitted to ward-level care subsequently underwent unplanned critical care admission. Overall 30-day mortality was 2.9% (n=133/4519), and the risk-adjusted association between 30-day mortality and critical care admission was higher in unplanned [odds ratio (OR): 8.65, 95% confidence interval (CI): 3.51-19.97) than planned admissions (OR: 2.32, 95% CI: 1.43-3.85). Some 26.7% of patients (n=1210/4529) underwent emergency laparotomies. After adjustment, 49.3% (95% CI: 46.8-51.9%, P<0.001) were predicted to have planned critical care admissions, with 7% (n=10/145) of centres outside the 95% CI.

CONCLUSIONS

After risk adjustment, no 30-day survival benefit was identified for either planned or unplanned postoperative admissions to critical care within this cohort. This likely represents appropriate admission of the highest-risk patients. Planned admissions in selected, intermediate-risk patients may present a strategy to mitigate the risk of unplanned admission. Substantial inter-centre variation exists in planned critical care admissions after emergency laparotomies.

How do palliative care doctors recognise imminently dying patients? A judgement analysis

OBJECTIVES

To identify a group of palliative care doctors who perform well on a prognostic test and to understand how they make their survival predictions.

DESIGN

Prospective observational study and two cross-sectional online studies.

SETTING

Phase I: an online prognostic test, developed from a prospective observational study of patients referred to palliative care. Phase II: an online judgement task consisting of 50 hypothetical vignettes.

PARTICIPANTS

All members of the Association of Palliative Medicine (APM) were eligible (n=~1100). 99 doctors completed the prognostic test and were included in the phase I analysis. The top 20% were invited to participate in phase II; 14/19 doctors completed the judgement task and were included in the phase II analysis.

MEASURES

Phase I: participants were asked to give a probability of death within 72 hours (0%-100%) for all 20 cases. Accuracy on the prognostic test was measured with the Brier score which was used to identify the 'expert' group (scale range: 0 (expert)-1 (non-expert)). Phase II: participants gave a probability of death within 72 hours (0%-100%). A mixed model regression analysis was completed using the percentage estimate as the outcome and the patient information included in the vignettes as the predictors.

RESULTS

The mean Brier score of all participants was 0.237 (95% CI 0.235 to 0.239). The mean Brier score of the 'experts' was 0.184 (95% CI 0.176 to 0.192). Six of the seven prognostic variables included in the hypothetical vignettes were significantly associated with clinician predictions of death. The Palliative Performance Score was identified as being the most influential in the doctors' prognostic decision making (β=0.48, p<0.001).

CONCLUSIONS

This study identified six clinical signs and symptoms which influenced the judgement policies of palliative care doctors. These results may be used to teach novice doctors how to improve their prognostic skills.

35 Online randomised controlled trial to improve clinical estimates of survival (ORACLES): study design

Introduction

Clinicians often struggle to recognise whether palliative care patients are imminently dying.1 2 A previous study identified the factors that expert palliative care doctors (with demonstrated prognostic skills) had used to judge the probability of patients dying within 72 hours.

Aim and methods

To evaluate whether an online training resource can teach medical students to formulate survival estimates for palliative care patients that are more similar to experts’ estimates. In this online randomised controlled trial we will recruit 128 students in the penultimate/final year of medical school. Participants are asked to review three series of vignettes describing patients referred to palliative care and provide estimates (0%–100%) about the probability that patients will die within 72 hours. After the first series of vignettes students in the intervention arm are given access to the training resource showing how experts weighted the various symptoms/signs. Participants are asked to complete a second series of vignettes and then a third series after two weeks to assess if any effect has been maintained.

Results

Students’ survival estimates will be correlated with experts’ estimates to determine the baseline level of agreement and any changes following the intervention. The primary outcome will be the survival estimates provided in the second series of vignettes. Secondary outcomes include the estimates provided at the follow-up the weighting of symptoms/signs and levels of discrimination and consistency.

Conclusion

This study will provide evidence about whether a brief low-cost online training resource can influence how medical students make prognostic decisions in an experimental setting.

References

. Neuberger J. More care less pathway: A review of the liverpool care pathway.Department of Health2013. Available from: https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/212450/Liverpool_Care_Pathway.pdf [Accessed: 30thMay 2018]

. White N, Reid F, Harris A, Harries P, Stone P. A systematic review of predictions of survival in palliative care: How accurate are clinicians and who are the experts?PLoS One25 August 2016;11(8):e0161407. Available from: http://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0161407&type=printable [Accessed: 30th May 2018]

44 An evidenced-based heuristics model (or rule of thumb) to improve doctors’ intuition about when patients are imminently dying

Introduction

Evidence suggests that the majority of doctors are not very good at identifying when a patient is dying1 however there is little training available to improve this skill. Even experts are unable to articulate how they recognise when a patient is dying other than by saying that ‘I just knew’.2

Aim

To understand how expert palliative care doctors recognise a dying person.

Methods

Rather than relying on ‘years of experience’ as a surrogate measure of expertise we developed a test to identify which doctors really are the prognostic ‘experts’. The prognostic test consisted of 20 real patient case summaries. Participants (palliative care doctors) were asked to predict whether or not they expected the patient to die within the next 3 days. Those who were the most accurate at this task were deemed to be the ‘prognostic experts’ and were invited to complete an additional online judgement task. In this task it was possible to identify which factors were most influential in their prognostic decision-making.

Results

19/99 doctors who completed the prognostic test were deemed to be ‘experts’. Of those 14 also completed the additional judgement task. The following factors influenced the experts’ decisions: Cheyne Stokes breathing palliative performance score (PPS) a decline in condition in the previous 24 hours respiratory secretions cyanosis and level of agitation or sedation.

Conclusion

This novel study presents a simple evidenced-based heuristic (or rule of thumb) to help novices recognise when a patient is imminently dying.

References

. Neuberger J, Guthrie C, Aaronovitch D. More care less pathway: A review of the Liverpool Care Pathway. Department of Health2013.

. Taylor P, Dowding D, Johnson M. Clinical decision making in the recognition of dying: A qualitative interview study. BMC Palliative Care2017;16(1):11.

Predicting fitness-to-drive following stroke using the Occupational Therapy - Driver Off Road Assessment Battery

Introduction: It is difficult to determine if, or when, individuals with stroke are ready to undergo on-road fitness-to-drive assessment. The Occupational Therapy - Driver Off Road Assessment Battery was developed to determine client suitability to resume driving. The predictive validity of the Battery needs to be verified for people with stroke. Aim: Examine the predictive validity of the Occupational Therapy - Driver Off Road Assessment Battery for on-road performance among people with stroke. Method: Off-road data were collected from 148 people post stroke on the Battery and the outcome of their on-road assessment was recorded as: fit-to-drive or not fit-to-drive. Results: The majority of participants (76%) were able to resume driving. A classification and regression tree (CART) analysis using four subtests (three cognitive and one physical) from the Battery demonstrated an area under the curve (AUC) of 0.8311. Using a threshold of 0.5, the model correctly predicted 98/112 fit-to-drive (87.5%) and 26/36 people not fit-to-drive (72.2%). Conclusion: The three cognitive subtests from the Occupational Therapy - Driver Off Road Assessment Battery and potentially one of the physical tests have good predictive validity for client fitness-to-drive. These tests can be used to screen client suitability for proceeding to an on-road test following stroke. Implications for Rehabilitation: Following stroke, drivers should be counseled (including consideration of local legislation) concerning return to driving. The Occupational Therapy - Driver Off Road Assessment Battery can be used in the clinic to screen people for suitability to undertake on road assessment. Scores on four of the Occupational Therapy - Driver Off Road Assessment Battery subtests are predictive of resumption of driving following stroke.

A randomised controlled trial to test the effectiveness of decision training on assessors' ability to determine optimal fitness-to-drive recommendations for older or disabled drivers

BACKGROUND

Driving licensing jurisdictions require detailed assessments of fitness-to-drive from occupational therapy driver assessors (OTDAs). We developed decision training based on the recommendations of expert OTDAs, to enhance novices' capacity to make optimal fitness-to-drive decisions. The aim of this research was to determine effectiveness of training on novice occupational therapists' ability to make fitness-to-drive decisions.

METHODS

A double blind, parallel, randomised controlled trial was conducted to test the effectiveness of decision training on novices' fitness-to-drive recommendations. Both groups made recommendations on a series of 64 case scenarios with the intervention group receiving training after reviewing two thirds of the cases; the control group, at this same point, just received a message of encouragement to continue. Participants were occupational therapy students on UK and Australian pre-registration programmes who individually took part online, following the website instructions. The main outcome of training was the reduction in mean difference between novice and expert recommendations on the cases.

RESULTS

Two hundred eighty-nine novices were randomised into intervention; 166 completed the trial (70 in intervention; 96 in control). No statistical differences in scores were found pre-training. Post training, the control group showed no significant change in recommendations compared to the experts (t(96) = -.69; p = .5), whereas the intervention group exhibited a significant change (t(69) = 6.89; p < 0.001). For the intervention group, the mean difference compared with the experts' recommendations reduced with 95% CI from -.13 to .09. Effect size calculated at the post-training demonstrated a moderate effect (d = .69, r = .32).

CONCLUSIONS

Novices who received the decision training were able to change their recommendations whereas those who did not receive training did not. Those receiving training became more able to identify drivers who were not fit-to-drive, as measured against experts' decisions on the same cases. This research demonstrated that novice occupational therapists can be trained to make decisions more aligned to those of expert OTDAs. The decision training and cases have been launched as a free training resource at www.fitnesstodrive.com . This can be used by novice driver assessors to increase their skill to identify drivers who are, and are not fit-to-drive, potentially increasing international workforce capacity in this growing field of practice.

Enhanced referral prioritisation for acute adult dietetic services: A randomised control trial to test a web-based decision training tool

BACKGROUND & AIMS

Dietitians in acute adult services need to prioritise dietetic referrals in order to manage their daily workload and ensure effective treatment of patients. Newly qualified dietitians do not usually receive specific training on prioritisation and could be helped with an evidence-based, effective, decision-training tool that is based on the practice of experienced dietitians. We developed an internationally available web-based decision-training tool designed to improve novice dietitians' ability to make dietetic prioritisation decisions. The training tool comprised of a pre-training task, a post-training task and training materials. The aim of this study was to test the effectiveness of the training tool on novices' ability for dietetic prioritisation.

METHODS

Pre-registration dietitians and recent graduates (one-year) from across the UK were invited to participate in this randomised controlled trial (RCT). Each participant made prioritisation decisions on a set of dietetic referral scenarios: 53 scenarios at pre-training and 27 at post-training. After pre-training the intervention group was presented with the training materials, whereas the control group was told to carry on with the post-training task. Participants did not know which group they had been randomly allocated to. We calculated i) level of agreement between decisions made by each novice and experts' consensus using Pearson correlation, intra-class correlation (ICC(2,1)); ii) intra-rater consistency using ICC(1,1) and iii) intra-group consistency using ICC (2,1). We compared group means at pre-training and post-training; estimated effect size using the degree of change from pre- to post-training, and 2-factor mixed ANOVA to assess overall effect of the training across the groups and time-points.

RESULTS

151 participants (69 in control and 82 in intervention) completed the trial. The groups did not differ in demographic characteristics. Both Pearson and ICC(2,1) correlations increased with training intervention; a moderate effect of training was found for both metrics, d = 0.69 (r = 0.32) for the former and d = 0.54 (r = 0.26) for the latter. Intra-rater consistency improved with training but with a small effect size, d = 0.32 (r = 0.16). The intra-group consistency also improved with training: ICC = 0.48 pre-training to 0.61 post-training.

CONCLUSIONS

The training tool was found to be effective in improving the novice dietitian's ability to prioritise referrals in the acute adult setting. The training tool is freely available at www.dietitianreferral.org for use by all student or early career dietitians internationally.

A systematic review of evidence for fitness-to-drive among people with the mental health conditions of schizophrenia, stress/anxiety disorder, depression, personality disorder and obsessive compulsive disorder

BACKGROUND

Limited evidence exists regarding fitness-to-drive for people with the mental health conditions of schizophrenia, stress/anxiety disorder, depression, personality disorder and obsessive compulsive disorder (herein simply referred to as 'mental health conditions'). The aim of this paper was to systematically search and classify all published studies regarding driving for this population, and then critically appraise papers addressing assessment of fitness-to-drive where the focus was not on the impact of medication on driving.

METHODS

A systematic search of three databases (CINAHL, PSYCHINFO, EMBASE) was completed from inception to May 2016 to identify all articles on driving and mental health conditions. Papers meeting the eligibility criteria of including data relating to assessment of fitness-to-drive were critically appraised using the American Academy of Neurology and Centre for Evidence-Based Medicine protocols.

RESULTS

A total of 58 articles met the inclusion criteria of driving among people with mental health conditions studied, and of these, 16 contained data and an explicit focus on assessment of fitness-to-drive. Assessment of fitness-to-drive was reported in three ways: 1) factors impacting on the ability to drive safely among people with mental health conditions, 2) capability and perception of health professionals assessing fitness-to-drive of people with mental health conditions, and 3) crash rates. The level of evidence of the published studies was low due to the absence of controls, and the inability to pool data from different diagnostic groups. Evidence supporting fitness-to-drive is conflicting.

CONCLUSIONS

There is a relatively small literature in the area of driving with mental health conditions, and the overall quality of studies examining fitness-to-drive is low. Large-scale longitudinal studies with age-matched controls are urgently needed in order to determine the effects of different conditions on fitness-to-drive.

Using judgement analysis to identify dietitians' referral prioritisation for assessment in adult acute services

BACKGROUND/OBJECTIVES

Dietitians need to prioritise referrals in order to manage their work load. Novice dietitians may not receive training on prioritisation and could be helped with an evidence-based, effective decision-making training tool. To develop such a tool, it is necessary to understand how experts make prioritisation decisions. This study aimed to model expert decision-making policy for prioritising dietetic referrals in adult acute-care services.

METHODS/SUBJECTS

Social judgement theory was used to model expert decision-making policy. Informational cues and cue levels were identified. A set of case scenarios that replicated dietetic referrals in adult acute services were developed using fractional factorial design approach. Experienced dietitians were asked to make prioritisation decisions on case scenarios. A model was derived using multiple regression analysis to elicit the weighting given to cues and cue levels by the experts when making prioritisation decisions.

RESULTS

Six cues and 21 cue levels were identified, and 60 unique case scenarios were created. Fifty experienced dietitians made decisions on these case scenarios. The 'reason for referral' and 'biochemistry picture' were the two most influential cues, and 'weight history' was the least significant. 'Nutritional status', 'presenting complaint' and 'previous food intake' had similar weightings. In all, 95.7% of the variability in the experts' average judgement (adjusted R2=0.93) was predicted by the 6 cues.

CONCLUSIONS

A model for referral prioritisation in adult acute services described experienced dietitians' decision-making policy. This can be used to develop training materials that may increase the effectiveness and quality of prioritisation judgements.European Journal of Clinical Nutrition advance online publication, 23 August 2017; doi:10.1038/ejcn.2017.123.

What Do Psychiatric Inpatients and Ward Staff Think about Occupational Therapy?

In a study of 28 psychiatric inpatients referred to occupational therapy, their understanding about the purposes of this treatment, their initial needs and attendance, the subsequent effects of treatment and their satisfaction with interventions were measured. The perceptions of the therapists involved with these patients were also studied. Patients reported significant benefits from treatment for three specific areas of need which they considered were addressed by occupational therapy. Over all 10 areas of need for which a consensus existed that occupational therapy played a role, patients reported a 13% reduction in need after 4 weeks' treatment.

Facilitating Change in Anorexia Nervosa: The Role of Occupational Therapy

Patients with anorexia nervosa benefit from a multidisciplinary approach. This article gives a brief description of, first, the illness and its treatment and, secondly, the occupational therapy techniques used at the Maudsley Unit. It then demonstrates the progress of patients through examples of projective art.

A Systematic Review of Predictions of Survival in Palliative Care: How Accurate Are Clinicians and Who Are the Experts?

Background

Prognostic accuracy in palliative care is valued by patients, carers, and healthcare professionals. Previous reviews suggest clinicians are inaccurate at survival estimates, but have only reported the accuracy of estimates on patients with a cancer diagnosis.

Objectives

To examine the accuracy of clinicians’ estimates of survival and to determine if any clinical profession is better at doing so than another.

Data Sources

MEDLINE, Embase, CINAHL, and the Cochrane Database of Systematic Reviews and Trials. All databases were searched from the start of the database up to June 2015. Reference lists of eligible articles were also checked.

Eligibility Criteria

Inclusion criteria: patients over 18, palliative population and setting, quantifiable estimate based on real patients, full publication written in English. Exclusion criteria: if the estimate was following an intervention, such as surgery, or the patient was artificially ventilated or in intensive care.

Study Appraisal and Synthesis Methods

A quality assessment was completed with the QUIPS tool. Data on the reported accuracy of estimates and information about the clinicians were extracted. Studies were grouped by type of estimate: categorical (the clinician had a predetermined list of outcomes to choose from), continuous (open-ended estimate), or probabilistic (likelihood of surviving a particular time frame).

Results

4,642 records were identified; 42 studies fully met the review criteria. Wide variation was shown with categorical estimates (range 23% to 78%) and continuous estimates ranged between an underestimate of 86 days to an overestimate of 93 days. The four papers which used probabilistic estimates tended to show greater accuracy (c-statistics of 0.74–0.78). Information available about the clinicians providing the estimates was limited. Overall, there was no clear “expert” subgroup of clinicians identified.

Limitations

High heterogeneity limited the analyses possible and prevented an overall accuracy being reported. Data were extracted using a standardised tool, by one reviewer, which could have introduced bias. Devising search terms for prognostic studies is challenging. Every attempt was made to devise search terms that were sufficiently sensitive to detect all prognostic studies; however, it remains possible that some studies were not identified.

Conclusion

Studies of prognostic accuracy in palliative care are heterogeneous, but the evidence suggests that clinicians’ predictions are frequently inaccurate. No sub-group of clinicians was consistently shown to be more accurate than any other.

Implications of Key Findings

Further research is needed to understand how clinical predictions are formulated and how their accuracy can be improved.

Using Social Judgment Theory method to examine how experienced occupational therapy driver assessors use information to make fitness-to-drive recommendations

INTRODUCTION

As people with a range of disabilities strive to increase their community mobility, occupational therapy driver assessors are increasingly required to make complex recommendations regarding fitness-to-drive. However, very little is known about how therapists use information to make decisions. The aim of this study was to model how experienced occupational therapy driver assessors weight and combine information when making fitness-to-drive recommendations and establish their level of decision agreement.

METHOD

Using Social Judgment Theory method, this study examined how 45 experienced occupational therapy driver assessors from the UK, Australia and New Zealand made fitness-to-drive recommendations for a series of 64 case scenarios. Participants completed the task on a dedicated website, and data were analysed using discriminant function analysis and an intraclass correlation coefficient.

RESULTS

Accounting for 87% of the variance, the cues central to the fitness-to-drive recommendations made by assessors are the client's physical skills, cognitive and perceptual skills, road law craft skills, vehicle handling skills and the number of driving instructor interventions. Agreement (consensus) between fitness-to-drive recommendations was very high: intraclass correlation coefficient = .97, 95% confidence interval .96-.98).

CONCLUSION

Findings can be used by both experienced and novice driver assessors to reflect on and strengthen the fitness-to-drive recommendations made to clients.

'Without Occupation You Don't Exist': Occupational Engagement and Mental Illness

This phenomenological study explores the meanings of work for people living with severe and enduring mental health conditions. The participants were three women and seven men who were attending a mental health day centre. Data were collected through up to three depth interviews with each participant over 18 months. The interviews were digitally recorded, transcribed verbatim, and analysed according to phenomenological principles. Two overarching themes were identified. Building and maintaining an occupational identity expressed the ways in which participants used occupations as the building blocks of an evolving identity. Most of the participants wanted to work, and participation in occupations was seen as essential to recovery from mental ill-health. Work and other ways of belonging encapsulated the need to feel connected to others. Many of the participants envisaged working as a way of achieving this. The longitudinal nature of the study facilitated engagement with the developing narratives and exploration of the changes and consistencies in the participants' meaning making about their occupations. Implications for understanding individuals' occupational participation which enhances a sense of self and promotes feelings of belonging are identified.

Identifying and enhancing risk thresholds in the detection of elder financial abuse: a signal detection analysis of professionals' decision making

BACKGROUND

Financial abuse of elders is an under acknowledged problem and professionals' judgements contribute to both the prevalence of abuse and the ability to prevent and intervene. In the absence of a definitive "gold standard" for the judgement, it is desirable to try and bring novice professionals' judgemental risk thresholds to the level of competent professionals as quickly and effectively as possible. This study aimed to test if a training intervention was able to bring novices' risk thresholds for financial abuse in line with expert opinion.

METHODS

A signal detection analysis, within a randomised controlled trial of an educational intervention, was undertaken to examine the effect on the ability of novices to efficiently detect financial abuse. Novices (n = 154) and experts (n = 33) judged "certainty of risk" across 43 scenarios; whether a scenario constituted a case of financial abuse or not was a function of expert opinion. Novices (n = 154) were randomised to receive either an on-line educational intervention to improve financial abuse detection (n = 78) or a control group (no on-line educational intervention, n = 76). Both groups examined 28 scenarios of abuse (11 "signal" scenarios of risk and 17 "noise" scenarios of no risk). After the intervention group had received the on-line training, both groups then examined 15 further scenarios (5 "signal" and 10 "noise" scenarios).

RESULTS

Experts were more certain than the novices, pre (Mean 70.61 vs. 58.04) and post intervention (Mean 70.84 vs. 63.04); and more consistent. The intervention group (mean 64.64) were more certain of abuse post-intervention than the control group (mean 61.41, p = 0.02). Signal detection analysis of sensitivity (A´) and bias (C) revealed that this was due to the intervention shifting the novices' tendency towards saying "at risk" (C post intervention -.34) and away from their pre intervention levels of bias (C-.12). Receiver operating curves revealed more efficient judgments in the intervention group.

CONCLUSION

An educational intervention can improve judgements of financial abuse amongst novice professionals.

Supporting Children with Visual Stress: The Development of a Web Resource for Parents and Professionals

Introduction

Visual stress is a condition which makes reading difficult. The use of coloured lenses in spectacles to alleviate the symptoms of visual stress has attracted increasing interest. The aim was to develop a web-based resource to centralize information about the condition and the processes for the screening, assessment, and provision of coloured lenses.

Method

Action research methods were employed. The exploratory phase used semi-structured interviews to gather parents' and professionals' views on the condition and their suggestions for the content and layout of a supporting web resource. The innovatory phase was used to design the prototype web resource. The evaluative phase was used to appraise and enhance the prototype website and collate data on website usage.

Results

Parents and professionals had some awareness of the condition but felt less sure of the evidence base for coloured lenses. Professionals valued research as evidence, whereas parents preferred testimonials. Suggestions for the content of a web resource to centralize information on the topic were clearly articulated by professionals, parents, and experts in the field. In the first year, over 7,500 individual web users visited the resource.

Conclusion

The first collaborative resource on the topic has been successfully produced, thereby offering a centralized information resource.

Educating novice practitioners to detect elder financial abuse: a randomised controlled trial

BACKGROUND

Health and social care professionals are well positioned to identify and intervene in cases of elder financial abuse. An evidence-based educational intervention was developed to advance practitioners' decision-making in this domain. The objective was to test the effectiveness of a decision-training educational intervention on novices' ability to detect elder financial abuse. The research was funded by an E.S.R.C. grant reference RES-189-25-0334.

METHODS

A parallel-group, randomised controlled trial was conducted using a judgement analysis approach. Each participant used the World Wide Web to judge case sets at pre-test and post-test. The intervention group was provided with training after pre-test testing, whereas the control group were purely given instructions to continue with the task. 154 pre-registration health and social care practitioners were randomly allocated to intervention (n78) or control (n76). The intervention comprised of written and graphical descriptions of an expert consensus standard explaining how case information should be used to identify elder financial abuse. Participants' ratings of certainty of abuse occurring (detection) were correlated with the experts' ratings of the same cases at both stages of testing.

RESULTS

At pre-test, no differences were found between control and intervention on rating capacity. Comparison of mean scores for the control and intervention group at pre-test compared to immediate post-test, showed a statistically significant result. The intervention was shown to have had a positive moderate effect; at immediate post-test, the intervention group's ratings had become more similar to those of the experts, whereas the control's capacity did not improve. The results of this study indicate that the decision-training intervention had a positive effect on detection ability.

CONCLUSIONS

This freely available, web-based decision-training aid is an effective evidence-based educational resource. Health and social care professionals can use the resource to enhance their ability to detect elder financial abuse. It has been embedded in a web resource at http://www.elderfinancialabuse.co.uk.

A comparison of two-coloured filter systems for treating visual reading difficulties

Purpose

Visual disturbances that make it difficult to read text are often termed “visual stress”. Coloured filters in spectacles may help some children overcome reading problems that are often caused by visual stress. It has been suggested that for optimal effect each child requires an individually prescribed colour for each eye, as determined in systems such as the “Harris Foundation” coloured filters. Alternatively, it has been argued that only blue or yellow filters, as used in the “Dyslexia Research Trust” (DRT) filter system, are necessary to affect the underlying physiology.

Method

A randomised, double blind trial with 73 delayed readers, was undertaken to compare changes in reading and spelling as well as irregular and non-word reading skills after 3 months of wearing either the Harris or the DRT filters.

Results

Reading improved significantly after wearing either type of filter (t = −8.4, p < 0.01), with 40% of the children improving their reading age by 6 months or more during the 3 month trial. However, spelling ability (t = 2.1, p = 0.05) and non-word reading (f = 4.7, p < 0.05) improved significantly more with the DRT than with the Harris filters.

Conclusion

Education and rehabilitation professionals should therefore, consider coloured filters as an effective intervention for delayed readers experiencing visual stress.

Enhanced clarity and holism: the outcome of implementing the ICF with an acute stroke multidisciplinary team in England

PURPOSE

Although it is recommended that the ICF (International Classification of Functioning, Disability and Health) should be implemented to aid communication within multidisciplinary stroke services, there is no empirical evidence to demonstrate the outcomes of such implementation. Working with one stroke service, this project aimed to address this gap and sought to evaluate the outcomes of implementing an ICF-based clinical tool into practice.

METHOD

Using an action research framework with mixed methods, data were collected from individual interviews, a focus group, questionnaires, email communications, minutes from relevant meetings and field notes. Thematic analysis was undertaken, using immersion and crystallisation, to define overall themes. Descriptive statistics were used to analyse quantitative data. Data from both sources were combined to create key findings.

RESULTS

Three findings were determined from the data analysis. The ICF (1) fosters communication within and beyond the multidisciplinary stroke team; (2) promotes holistic thinking; and (3) helps to clarify team roles.

CONCLUSIONS

The ICF enhanced clarity of communication and team roles within the acute stroke multidisciplinary team as well as with other clinicians, patients and their relatives. In addition, the ICF challenged stroke clinicians to think holistically, thereby appropriately extending their domain of concern beyond their traditional remit.

IMPLICATIONS FOR REHABILITATION

The ICF is a globally accepted framework to describe functioning and is in use in a variety of clinical settings. Yet, the outcomes of using it in clinical practice have yet to be fully explored. This study found that the ICF enhanced clarity of communication and team roles within an acute stroke multidisciplinary team and to others beyond the team, including clinicians, patients and their relatives. Using the ICF also challenged clinicians to think holistically about patient needs following a stroke.

The meaning and experience of work in the context of severe and enduring mental health problems: an interpretative phenomenological analysis

Research into mental health and employment has indicated that work holds multiple meanings for people with mental health problems. This paper reports findings from a phenomenological study which aimed to understand the complexity of these meanings by exploration of the perspectives of one individual who was considering returning to work. Data were gathered through a series of three interviews carried out over a period of 18 months. Three themes were identified - Beliefs and Values about Work, Working with a Mental Health Problem, and Planning for the Future. Analysis and interpretation facilitated understandings of what work represented for the participant. What this study has contributed to the evidence base is a deeper understanding of the multiple meanings of work, and the varied roles that work may play in contributing to meaning and quality of life for people with mental health problems.

Boredom proneness in a psychiatric inpatient population

BACKGROUND

Boredom has been reported as a common experience for service users of acute psychiatric wards. It has been associated with negative mental and physical health. Research has yet to show what factors are associated with boredom proneness within the acute psychiatric population.

AIMS

(1) To investigate the distribution of boredom proneness in a population of mentally ill inpatients according to age, gender, diagnosis, Mental Health Act status and length of stay in hospital. (2) To test the hypothesis that boredom proneness is negatively correlated with autonomous activity levels.

METHOD

Two self-report questionnaires were used with 55 inpatients of acute psychiatric wards: the Boredom Proneness Scale (Farmer & Sundberg, 1986) and the Hospital Anxiety and Depression Scale (Zigmond & Snaith, 1983). Questions were also asked about individuals' activity engagement during their current admission. Data on age, gender, diagnosis, ethnicity, Mental Health Act status and length of stay were collected from case notes.

RESULTS AND CONCLUSIONS

The highest incidence of boredom proneness was in participants with depression. Those detained under the Mental Health Act appeared less boredom prone than those admitted voluntarily. Boredom proneness was not associated with age, gender or length of stay. There was an association between engagement in more autonomous activities and lower boredom proneness.

Teaching young dogs new tricks: improving occupational therapists' referral prioritization capacity with a web-based decision-training aid

OBJECTIVE

A web-based clinical decision aid was designed to improve novices' capacity to prioritize occupational therapy referrals in community mental health teams. The aim of this research was to test the effectiveness of the decision aid.

DESIGN

A trial was conducted using a consensus expert policy as the educational intervention; a one-group pre-test, post-test design was chosen to measure any effect of training.

PARTICIPANTS

A total of 100 pre-registration occupational therapy students accessed the decision aid; they prioritized a set of referrals before and after being trained with graphical and descriptive representations of the expert policy.

SETTING

Data were collected online via the World Wide Web from students at 12 UK universities.

RESULTS

The effect of training was demonstrated through more accurate prioritization ratings when matched with expert ratings on the same referrals and more accurate judgement policies when matched with the consensus standard judgement policy.

CONCLUSION

The tool was found to be effective as it improved referral prioritization capacity.

Effectiveness of a decision-training aid on referral prioritization capacity: a randomized controlled trial

BACKGROUND

In the community mental health field, occupational therapy students lack the capacity to prioritize referrals effectively.

OBJECTIVE

The purpose of this study was to test the effectiveness of a clinical decision-training aid on referral prioritization capacity.

DESIGN

A double-blind, parallel-group, randomized controlled trial was conducted using a judgment analysis approach.

SETTING

Each participant used the World Wide Web to prioritize referral sets at baseline, immediate posttest, and 2-wk follow-up. The intervention group was provided with training after baseline testing; control group was purely given instructions to continue with the task.

PARTICIPANTS

One hundred sixty-five students were randomly allocated to intervention (n = 87) or control (n = 81). Intervention. Written and graphical descriptions were given of an expert consensus standard explaining how referral information should be used to prioritize referrals.

MEASUREMENTS

Participants' prioritization ratings were correlated with the experts' ratings of the same referrals at each stage of testing, as well as to examine the effect on mean group scores, regression weights, and the lens model indices.

RESULTS

At baseline, no differences were found between control and intervention on rating capacity or demographic characteristics. Comparison of the difference in mean correlation baseline scores of the control and intervention group compared with immediate posttest showed a statistically significant result that was maintained at 2-wk follow-up. The effect size was classified as large. At immediate posttest and follow-up, the intervention group improved rating capacity, whereas the control group's capacity remained poor. The results of this study indicate that the decision-training aid has a positive effect on referral prioritization capacity.

CONCLUSIONS

This freely available, Web-based decision-training aid will be a valuable adjunct to the education of these novice health professionals internationally.

To adopt is to adapt: the process of implementing the ICF with an acute stroke multidisciplinary team in England

Purpose: The success of the International Classifcation of Functioning, Disability and Health (ICF) depends on its uptake in clinical practice. This project aimed to explore ways the ICF could be used with an acute stroke multidisciplinary team and identify key learning from the implementation process. Method: Using an action research approach, iterative cycles of observe, plan, act and evaluate were used within three phases: exploratory; innovatory and refective. Thematic analysis was undertaken, using a model of immersion and crystallisation, on data collected via interview and focus groups, e-mail communications, minutes from relevant meetings, feld notes and a refective diary. Results: Two overall themes were determined from the data analysis which enabled implementation. There is a need to: (1) adopt the ICF in ways that meet local service needs; and (2) adapt the ICF language and format. Conclusions: The empirical fndings demonstrate how to make the ICF classifcation a clinical reality. First, we need to adopt the ICF as a vehicle to implement local service priorities e.g. to structure a multidisciplinary team report, thus enabling ownership of the implementation process. Second, we need to adapt the ICF terminology and format to make it acceptable for use by clinicians.

Exploring Mental Health Service Users' Experiences of Social Inclusion in their Community Occupations

Introduction:

Social inclusion is a recent policy driver, which aims to develop fair access to opportunity for marginalised groups: a major goal in keeping with the values of occupational therapists. Evaluation of progress towards social inclusion includes listening to individuals' experiences of inclusion or exclusion in their local communities. This research aimed to explore the experiences of social inclusion for mental health service users when engaged in everyday community occupations and to identify possible factors that influenced the service user experience.

Method:

Eight in-depth interviews with mental health service users were carried out, using interpretative phenomenological analysis to recount participants' life world perspectives.

Findings:

The findings revealed three themes: the outside experience, which described features of the social, physical and economic environment that influenced inclusion; the internal disability, which described features within participants themselves that influenced inclusion; and an active lifestyle, which described how features of occupation influenced inclusion. Feelings of inclusion or exclusion were predominantly linked to the response received from others, which was at times stigmatising and hostile.

Conclusion:

Given the negative impact of the reactions of society, occupational therapists need to prioritise working with local communities to facilitate their capacity to support social inclusion, as well as focusing on individual skill acquisition.

Mental Health Service Users' Perspectives of Work: A Review of the Literature

Purpose:

Much of the literature about the meaning and experience of work for people with mental health problems is limited in the extent to which individual perspectives are represented, because the evidence derives from studies that are mainly quantitative in design. This literature review focused on qualitative studies, which sought to elicit the experiences of returning to work with a mental health problem.

Method:

An electronic search of the databases SCOPUS, CINAHL and PsycINFO was carried out. Papers with a publication date between December 1989 and December 2009 were sought. This time period was chosen to reflect the developments in approaches to vocational rehabilitation that have developed during the last 20 years.

Findings:

The findings indicate that work holds multiple meanings for people with mental health problems, that there are advantages and disadvantages to working, and that many barriers to work exist. The crucial nature of support for the individual in accessing employment is emphasised, and what users want from supportive relationships is detailed. The findings suggest that barriers can be overcome if the right support is available.

Conclusion:

The findings provide support for the involvement of occupational therapists working in vocational services, and offer some pointers for developing relationships with clients. The findings highlight the importance of exploring clients' feelings about work, including perceived barriers and benefits to working, and provide a deeper understanding of the type of supportive relationship required by a person with a mental health problem who wishes to access employment.

Training Novices to Make Expert, Occupationally Focused, Community Mental Health Referral Decisions

Introduction:

Currently, British health policy requires services to be prioritised according to an individual's level of need. This is particularly necessary for community mental health services, where referral demand far exceeds service availability.

Purpose:

The purpose of this study was to use expert occupational therapists' referral prioritisation policies, derived from judgement analysis, to train novices in the skill of referral prioritisation.

Method:

The therapists' policies chosen were those that supported the occupationally focused practice advocated by the profession. Thirty-seven pre-registration students were asked to prioritise a set of referrals, before and after being trained with graphical and descriptive representations of these experts' policies.

Findings:

Pre-training, the students overvalued the client's history of violence and undervalued the reason for referral and the client's diagnosis, as compared with the experts. Post-training, the students' policies were better matched to those of the experts. The effect of training was demonstrated through several measures: more accurate prioritisation scores when matched with expert ratings on the same referrals, improved consistency on repeat referrals and higher group agreement.

Conclusion:

Decision training may be useful in promoting the type of service that aims to target clients' occupational needs in the field of community mental health.

Measuring Social Inclusion: A Staff Survey of Mental Health Service Users' Participation in Community Occupations

Mental health service users frequently experience social exclusion and limited occupational engagement. A survey was conducted to gather staff reports of 199 service users' levels of engagement and social inclusion across eight domains of community occupation.

The staff reported that the majority of service users (54%) engaged in two or fewer of the community occupation domains over a 7-day period, the most common being the use of local facilities (92%) and contact with family and friends (61%). The staff reports suggested that far fewer service users were engaged in the other domains: day centres (25%), education (14%), sport (13%), arts (12%), employment (11%) and faith (8%). With regard to social inclusion, activities occurred most frequently in mainstream settings for the domains of faith (100%), use of local facilities (98%), sport (80%), and family and friends (79%). Lower levels of social inclusion were reported for the other domains. Statistical analysis revealed that service users' occupational engagement related to their accommodation type, age and gender, but not to ethnicity.

These findings indicate that further research is needed to explore service users' views on social inclusion and what they feel would support them to engage in community occupations at a level that suits their individual needs.