Outcomes and outcome measures used in evaluation of communication training in oncology - a systematic literature review, an expert workshop, and recommendations for future research

Supporting families of patients who die in adult intensive care: A scoping review of interventions

BACKGROUND

Families who perceive themselves as prepared for an impending death experience reduced psychological burden during bereavement. Understanding which interventions promote death preparedness in families during end-of-life care in intensive care will inform future intervention development and may help limit the burden of psychological symptoms associated with bereavement.

AIM

To identify and characterise interventions that help prepare families for the possibility of death in intensive care, incorporating barriers to intervention implementation, outcome variables and instruments used.

DESIGN

Scoping review using Joanna Briggs methodology, prospectively registered and reported using relevant guidelines.

DATA SOURCES

A systematic search of six databases from 2007 to 2023 for randomised controlled trials evaluating interventions that prepared families of intensive care patients for the possibility of death. Citations were screened against the inclusion criteria and extracted by two reviewers independently.

RESULTS

Seven trials met eligibility criteria. Interventions were classified: decision support, psychoeducation, information provision. Psychoeducation involving physician-led family conference, emotional support and written information reduced symptoms of anxiety, depression, prolonged grief, and post-traumatic stress in families during bereavement. Anxiety, depression, and post-traumatic stress were assessed most frequently. Barriers and facilitators to intervention implementation were seldom reported.

CONCLUSION

This review provides a conceptual framework of interventions to prepare families for death in intensive care, while highlighting a gap in rigorously conducted empirical research in this area. Future research should focus on theoretically informed, family-clinician communication, and explore the benefits of integrating existing multidisciplinary palliative care guidelines to deliver family conference within intensive care.

IMPLICATIONS FOR CLINICAL PRACTICE

Intensive care clinicians should consider innovative communication strategies to build family-clinician connectedness in remote pandemic conditions. To prepare families for an impending death, mnemonic guided physician-led family conference and printed information could be implemented to prepare families for death, dying and bereavement. Mnemonic guided emotional support during dying and family conference after death may also assist families seeking closure.

Effects of blended learning training for oncology physicians to advise their patients about complementary and integrative therapies: results from the multicenter cluster-randomized KOKON-KTO trial

BACKGROUND

Many oncology physicians are confronted with the topic of complementary and integrative medicine (CIM) by cancer patients. This study examined whether a blended learning (e-learning and a workshop) to train oncology physicians in providing advice on CIM therapies to their cancer patients, in addition to distributing an information leaflet about reputable CIM websites, had different effects on physician-reported outcomes in regard to consultations compared with only distributing the leaflet.

METHODS

In a multicenter, cluster-randomized trial, 48 oncology physicians were randomly allocated to an intervention group (CIM consultation and an information leaflet) or a control group (information leaflet only). After the training, the oncology physicians conducted 297 consultations with their cancer patients. Measurements were assessed at oncology physician, physician-patient-interaction (measured by external reviewers), and patient levels. This analysis focused on the physician outcomes of stress reaction and perceived consultation skill competency. In addition, qualitative interviews were conducted with a subsample of oncology physicians who experienced both, the intervention and control condition.

RESULTS

The oncology physicians in the intervention group showed a lower stress reaction in all measured dimensions after CIM consultations than those in the control group. There was no significant difference between oncology physicians in the intervention and control groups regarding the perceived consultation skill competency (overburden: intervention 1.4 [95% CI: 0.7;2.1]; control 2.1 [95% CI: 1.4;2.7], tension: 1.3 [95% CI: 0.7;2.0] vs. 1.9 [95% CI: 1.3;2.5], and discomfort with consultation situations: 1.0 [95% CI: 0.4;1.7]; vs. 1.7 [95% CI: 1.2;2.3]). The qualitative data showed that only providing the leaflet seemed impersonal to oncology physicians, while the training made them feel well prepared to conduct a full conversation about CIM and provide the information leaflet.

CONCLUSIONS

In our exploratory study providing structured CIM consultations showed positive effects on the perceived stress of oncology physicians, and the training was subjectively experienced as an approach that improved physician preparation for advising cancer patients about CIM, however no effects regarding perceived consultation skill competency were found.

TRIAL REGISTRATION

The trial registration number of the KOKON-KTO study is DRKS00012704 in the German Clinical Trials Register (Date of registration: 28.08.2017).

Yarning about pain: Evaluating communication training for health professionals at persistent pain services in Queensland, Australia

Background

Providing cultural education to health professionals is essential in improving the quality of care and outcomes for Aboriginal and Torres Strait Islander patients. This study reports the evaluation of a novel training workshop used as an intervention to improve communication with Aboriginal and Torres Strait Islander patients of persistent pain services.

Methods

In this single-arm intervention study, health professionals undertook a one-day workshop, which included cultural capability and communication skills training based on a clinical yarning framework. The workshop was delivered across three adult persistent pain clinics in Queensland. At the end of the training, participants completed a retrospective pre/post evaluation questionnaire (5 points Likert scale, 1 = very low to 5 = very high), to rate their perceived importance of communication training, their knowledge, ability and confidence to communicate effectively. Participants also rated their satisfaction with the training and suggested improvements for future trainings.

Results

Fifty-seven health professionals were trained (N = 57/111; 51% participation rate), 51 completed an evaluation questionnaire (n = 51/57; 90% response rate). Significant improvements in the perceived importance of communication training, knowledge, ability and confidence to effectively communicate with Aboriginal and Torres Strait Islander patients were identified (p < 0.001). The greatest increase was in the perceived confidence pre-training mean of 2.96 (SE = 0.11) to the post-training mean of 4.02 (SE = 0.09).

Conclusion

This patient-centred communication training, delivered through a novel model that combines cultural capability and the clinical yarning framework applied to the pain management setting, was highly acceptable and significantly improved participants' perceived competence. This method is transferrable to other health system sectors seeking to train their clinical workforce with culturally sensitive communication skills.

OptiScreen – ein Schulungskonzept für Pflegekräfte zur Durchführung des psychosozialen Distress-Screenings

Hintergrund

Eine angemessene, bedarfsgerechte psychoonkologische Versorgung reduziert Depressivität und Ängste von Krebserkrankten sowie ihren Angehörigen und erhöht die Lebensqualität. Psychisch belastete Krebserkrankte werden jedoch nicht flächendeckend identifiziert, um ihnen psychoonkologische Unterstützung anzubieten. Screeningfragebögen haben sich zur Identifikation bewährt, allerdings bestehen bei der Anwendung im klinischen Alltag Hürden. Pflegekräfte haben durch ihren kontinuierlichen Kontakt zu Patient_innen, die vielfältigen klinischen Eindrücke und ihre Verbindung zu anderen Berufsgruppen eine Schlüsselrolle.

Ziele

Die OptiScreen-Schulung soll Pflegekräfte in der Onkologie zur Durchführung des Distress-Screenings befähigen, entsprechendes Expert_innenwissen vermitteln und Hürden sowie Unsicherheiten im Screeningprozess abbauen, um somit belastete Erkrankte zielgerichtet identifizieren und einer psychoonkologischen Versorgung zuführen zu können.

Das Training

Die OptiScreen-Schulung gliedert sich in drei Module à 1,5–2 h zu den Themen psychische Störungen bei Krebs, psychoonkologische Versorgung, psychische Belastung, Distress-Screening, Kommunikation im Screeningprozess und Psychohygiene (vermittelt durch Vorträge, Videos, Rollenspiele, Übungen).

Ergebnisse und Diskussion

Erste praktische Erfahrungen weisen auf eine erfolgreiche Umsetzung des Schulungskonzepts hin. Weitere Ziele sind es, den Wissenszuwachs und die zunehmende Sicherheit der Pflegekräfte im Screeningprozess zu stärken sowie die Effekte langfristig aufrechtzuerhalten. Zusätzlich soll die Schulung in verschiedenen Settings etabliert und die Auswirkungen der Schulung in Bezug auf die Informiertheit und Zufriedenheit der Patient_innen mit dem Screeningprozess untersucht werden.

Effect of multimodal comprehensive communication skills training with video analysis by artificial intelligence for physicians on acute geriatric care: a mixed-methods study

OBJECTIVES

To quantitatively analyse by artificial intelligence (AI) the communication skills of physicians in an acute care hospital for geriatric care following a multimodal comprehensive care communication skills training programme and to qualitatively explore the educational benefits of this training programme.

DESIGN

A convergent mixed-methods study, including an intervention trial with a quasi-experimental design, was conducted to quantitatively analyse the communication skills of physicians. Qualitative data were collected via physicians' responses to an open-ended questionnaire administered after the training.

SETTING

An acute care hospital.

PARTICIPANTS

A total of 23 physicians.

INTERVENTIONS

In a 4-week multimodal comprehensive care communication skills training programme, including video lectures and bedside instruction, from May to October 2021, all the participants examined a simulated patient in the same scenario before and after their training. These examinations were video recorded by an eye-tracking camera and two fixed cameras. Then, the videos were analysed for communication skills by AI.

MAIN OUTCOME MEASURES

The primary outcomes were the physicians' eye contact, verbal expression, physical touch and multimodal communication skills with a simulated patient. The secondary outcomes were the physicians' empathy and burnout scores.

RESULTS

The proportion of the duration of the participants' single and multimodal types of communication significantly increased (p<0.001). The mean empathy scores and the personal accomplishment burnout scores also significantly increased after training. We developed a learning cycle model based on the six categories that changed after training from the physicians' perspective: multimodal comprehensive care communication skills training; increasing awareness of and sensitivity to changes to geriatric patients' condition; changes in clinical management; professionalism; team building and personal accomplishments.

CONCLUSIONS

Our study showed that multimodal comprehensive care communication skills training for physicians increased the proportions of time spent performing single and multimodal communication skills by video analysis through AI.

TRIAL REGISTRATION NUMBER

UMIN Clinical Trials Registry (UMIN000044288; https://center6.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000050586).

Effects of a communication training for oncologists on early addressing palliative and end-of-life care in advanced cancer care (PALLI-COM): a randomized, controlled trial

INTRODUCTION

In advanced cancer care, early communication about palliative care (PC) and end-of-life (EoL)-related issues is recommended, but is often impeded by physicians' communication insecurities. We investigated the effect of a newly developed compact communication skills training 'PALLI-COM' on oncologists' competencies to early address PC/EoL-related issues.

MATERIALS AND METHODS

We conducted a randomized, controlled trial (RCT) with an intervention group (IG; 2 × 90 min training) and a wait list control group (CG) at five sites. At two assessment points, participating oncologists led videotaped medical consultations with simulated patients (SPs) via a privacy compliant video conference platform. SPs were represented by trained actors. The taped conversations were rated for primary outcome (communication skills assessed by adapted COM-ON-checklist and COM-ON-coaching rating scales) by raters blinded for study group. Secondary outcomes included oncologists' self-reported communication skills (Self-Efficacy in Palliative Care Scale, Thanatophobia-Scale, Communication about End of Life Survey, study-specific items) as well as external rating of the SPs. Univariate analyses of covariance with baseline adjustment were used to analyze intervention effects.

RESULTS

A total of 141 oncologists [age: mean (standard deviation) = 32.7 (6.3) years, 60% female (n_IG = 73, n_CG = 68)] participated. Following intervention, the IG showed significantly more improvement in four out of five assessed communication skills: 'reacting to emotions and showing empathy', 'pointing out opportunities and giving hope', 'addressing the EoL' and 'explaining the concept of PC'. IG participants also improved more than CG participants in almost all secondary outcomes assessed by participants and SPs: oncologists' self-efficacy, attitudes towards caring for terminally ill patients, communication strategies and confidence in dealing with PC/EoL-related issues as well as communication quality from the SPs' perspective.

CONCLUSION

Findings indicate that the compact communication skills training PALLI-COM increases oncologists' competencies in early addressing PC/EoL-related issues from different perspectives. Implementation in routine oncology residency might improve advanced cancer care by strengthening these communication skills.

Addressing palliative care and end-of-life issues in patients with advanced cancer: a systematic review of communication interventions for physicians not specialised in palliative care

OBJECTIVE

To identify and summarise evaluated interventions aiming to improve the communication of palliative care (PC) and end-of-life (EoL) issues in physicians caring for cancer patients. Such interventions are needed with regard to the aim of an earlier communication of those issues in oncology daily practice, which is associated with a range of benefits for patients and caregivers but is often impeded by physicians' communication insecurities.

DESIGN

Systematic review based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.

DATA SOURCES

Relevant publications were systematically searched in MEDLINE, PsycINFO, CINAHL and Web of Science databases in September 2020 with an update in July 2021.

ELIGIBILITY CRITERIA

We included publications reporting a quantitative evaluation of a communication intervention on one or more PC/EoL issues with a communication-related main outcome. Target group had to be physicians caring for cancer patients non-specialist in PC.

DATA EXTRACTION AND SYNTHESIS

Two independent raters extracted intervention characteristics, publication characteristics and publication quality. Results were narratively synthesised.

RESULTS

24 publications reporting 22 interventions were included. 13 publications reported randomised controlled trials. A majority of the interventions addressed one specific PC/EoL issue, most often breaking bad news. Teaching strategies mostly involved role-plays. Target group were mainly oncologists. In addition to self-reported outcome measurements for evaluation, most publications also reported the use of external rating data. All but one publication reported significant intervention effects on at least one outcome parameter. Publication quality was overall moderate.

CONCLUSIONS

The empirically tested communication interventions on PC/EoL issues seem to effectively improve physicians' communication. Future interventions should focus on other issues than breaking bad news, such as preparing for the future. Target group should also be organ-specific oncologists, as all primary caring physicians are responsible for timely communication. Our risk-of-bias assessment revealed some weaknesses, indicating that more high-quality studies for evaluation are needed.

PROSPERO REGISTRATION NUMBER

CRD42020191054.

A video-based situational judgement test of medical students' communication competence in patient encounters: Development and first evaluation

OBJECTIVE

We developed and evaluated the Video-Based Assessment of Medical Communication Competence (VA-MeCo), a construct-driven situational judgement test measuring medical students' communication competence in patient encounters.

METHODS

In the construction phase, we conducted two expert studies (n_panel1 = 6, n_panel2 = 13) to ensure curricular and content validity and sufficient expert agreement on the answer key. In the evaluation phase, we conducted a cognitive pre-test (n = 12) and a pilot study (n = 117) with medical students to evaluate test usability and acceptance, item statistics and test reliability depending on the applied scoring method (raw consensus vs. pairwise comparison scoring).

RESULTS

The results of the expert interviews indicated good curricular and content validity. Expert agreement on the answer key was high (ICCs> .86). The pilot study showed favourable usability and acceptance by students. Irrespective of the scoring method, reliability for the complete test (Cronbach's α >.93) and its subscales (α >.83) was high.

CONCLUSION

There is promising evidence that medical communication competence can be validly and reliably measured using a construct-driven and video-based situational judgement test.

PRACTICE IMPLICATIONS

Video-based SJTs allow efficient online assessment of medical communication competence and are well accepted by students and educators.

Effectiveness of the combination of workshops and flipped classroom model to improve tube fixation training for nursing students

BACKGROUND

Tube indwelling is a key procedure in modern medicine. Careful tube setup is necessary to prevent unplanned extubation. The training for tube fixation is time- and resource-consuming, and optimal modes of training are currently being sought. Previous studies have compared workshops and flipped classroom models separately using conventional teaching strategies, but no study has examined a combination of both teaching models in nursing training.

AIM

To compare the effectiveness of workshops vs workshops combined with the flipped classroom model for improving tube fixation training for nursing students.

METHODS

This was a prospective cohort study. In this study, 149 nurses who joined our hospital in 2019 underwent training using workshops combined with the flipped classroom model (experimental group), while 159 nurses who joined the hospital in 2018 received only workshop-based training (control group). The combination of workshops with the flipped classroom training model was divided into two modules: pre-class and in-class training. The participation of nurses in the training activities, on-site assessment of training, nurses’ evaluation of their training, and related indicators of tube quality management were evaluated.

RESULTS

The average age of nurses in the control group was 22.94 ± 0.94 years and that of nurses in the experimental group was 25.42 ± 3.23 years (P < 0.01). The qualified rate of after-class assessments for the experimental and control groups was 100.00% (average score: 94.01 ± 2.78 points) and 91.82% (average score: 84.24 ± 2.94 points), respectively (P < 0.01). Most nurses in the experimental group completely agreed that the combined training was helpful to cultivate clinical thinking and independent learning ability and to master knowledge of tube fixation. In addition, the training content within the pre-class teaching video, pre-class tube atlas, pre-class main instructor guidance, in-class demonstration, and in-class practice was very informative. The experimental group had higher evaluation scores than the control group (4.88 ± 0.38 vs 4.67 ± 0.64; P < 0.01). Comparison of tube quality management before and after training in 2018 to 2019 revealed that the unplanned ureteral tube removal rate dropped from 0.25‰ to 0.06‰, the unplanned chest tube removal rate dropped from 1.07‰ to 0.78‰, and the unplanned gastric tube removal rate dropped from 0.36‰ to 0.17‰. The incidence rate of pressure ulcers caused by the tube decreased from 0.78‰ to 0.45‰.

CONCLUSION

The combination of workshop and flipped classroom training is effective in improving tube fixation training of nurses, cultivating nurses’ active learning abilities and clinical thinking, and improving the safety of the procedure.

Communication Skills Training: A Means to Promote Time-Efficient Patient-Centered Communication in Clinical Practice

Purpose

We hypothesized that health care providers would behave in a more patient-centered manner after the implementation of communication skills training, without causing the consultation to last longer.

Methods

This study was part of the large-scale implementation of a communication skills training program called "Clear-Cut Communication With Patients" at Lillebaelt Hospital in Denmark. Audio recordings from real-life consultations were collected in a pre-post design, with health care providers' participation in communication skills training as the intervention. The training was based on the Calgary-Cambridge Guide, and audio recordings were rated using the Observation Scheme-12.

Results

Health care providers improved their communication behavior in favor of being more patient-centered. Results were tested using a mixed-effect model and showed significant differences between pre- and postintervention assessments, with a coefficient of 1.3 (95% Cl: 0.35-2.3; P=0.01) for the overall score. The consultations did not last longer after the training.

Conclusions

Health care providers improved their communication in patient consultations after the implementation of a large-scale patient-centered communication skills training program based on the Calgary-Cambridge Guide. This did not affect the length of the consultations.

A grant-based experiment to train clinical investigators: the AACR/ASCO methods in clinical cancer research workshop

To address the need for clinical investigators in oncology, AACR and ASCO established the Methods in Clinical Cancer Research Workshop (MCCRW). The workshop's objectives were to: (1) provide training in the methods, design, and conduct of clinical trials; (2) ensure that clinical trials met federal and international ethical guidelines; (3) evaluate the effectiveness of the workshop; and (4) create networking opportunities for young investigators with mentoring senior faculty. Educational methods included: (1) didactic lectures; (2) Small Group Discussion Sessions; (3) Protocol Development Groups; (4) one-on-one mentoring. Learning focused on the development of an IRB-ready protocol, which was submitted on the last day of the workshop. Evaluation methods included: (1) pre- and post-workshop tests; (2) students' workshop evaluations; (3) faculty's ratings of protocol development; (4) students' productivity in clinical research after the workshop; (5) an independent assessment of the workshop. From 1996-2014, 1932 students from diverse backgrounds attended the workshop. There was a significant improvement in the students' level of knowledge from the pre- to the post-workshop exams (p < 0.001). Across the classes, student evaluations were very favorable. At the end of the workshop, faculty rated 92-100% of the students' protocols as ready for IRB submission. Intermediate and long-term follow-ups indicated that more than 92% of students were actively involved in patientrelated research, and 66% had implemented five or more protocols. This NCI-sponsored MCCRW has had a major impact on the training of clinicians in their ability to design and implement clinical trials in cancer research.

Effectiveness of online communication skills training for cancer and palliative care health professionals: A systematic review

OBJECTIVE

To determine the reported effect of online communication skills training (CST) on health professional (HP) communication skills and patient care outcomes in cancer and palliative care.

METHODS

Primary research published in English between January 2003 and April 2019 was identified in bibliographic databases including Medline, Embase and Proquest (Prospero: CRD42018088681). An integrated mixed-method approach included studies describing a CST intervention and its effect, for cancer or palliative care HPs, delivered online or blended with an online component. Included studies' outcomes were categorised then findings were stratified by an evaluation framework and synthesised in an effect direction plot. Risk of bias was assessed using Joanna Briggs Institute's tools.

RESULTS

Nineteen included studies (five randomised controlled trials, 11 pre-post, two post-test and one qualitative study) evaluated a CST intervention (median duration = 3.75 h; range 0.66-96 h) involving 1116 HPs, 422 students and 732 patients. Most interventions taught communication skills for specific scenarios and approximately half were delivered solely online and did not involve role plays. Online CST improved HPs' self-assessed communication skills (three studies, 215 participants), confidence (four studies, 533 participants), and objective knowledge (five studies, 753 participants). While few studies evaluated patient outcomes, CST may benefit observed communication skills in care settings (two studies, 595 participants).

CONCLUSIONS

Online CST benefits oncology HPs' subjectively-reported communication skills and confidence, and objective knowledge. Translation to patient outcomes requires further investigation. The quality of research varied and few studies had a control group. We recommend improvements to study design, evaluation and implementation.

Effects of training oncology physicians advising patients on complementary and integrative therapies on patient-reported outcomes: A multicenter, cluster-randomized trial

BACKGROUND

Many patients with cancer do not disclose complementary medicine use but want their physician's advice on this matter. This study evaluated whether using blended learning (e-learning plus a workshop) to train oncology physicians in providing advice on complementary and integrative medicine (CIM) therapies to their patients with cancer, in addition to distributing an information leaflet on reputable CIM websites, had different effects on patient-reported outcomes for the consultation than only distributing the leaflet.

METHODS

In this multicenter, cluster-randomized trial, patients from private practices/hospital departments, recruited by 48 oncology physicians randomly allocated to an intervention group (CIM consultation plus information leaflet) or a control group (information leaflet), received CIM information. Patient-reported outcomes included satisfaction (Patient Satisfaction With Information on Cancer Treatment), readiness to make a decision (Preparation for Decision Making), and physician-patient communication (European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire and Communication 26 [EORTC QLQ-COMU26]) for the consultation. Qualitative interviews were conducted with a physician subsample.

RESULTS

A total of 291 patients (128 in the intervention group and 169 in the control group) advised by 41 physicians participated. Patients in the intervention group rated physician-patient communication higher on all EORTC QLQ-COMU26 scales (mean total score, 84.3 [95% CI, 79.5-89.2] vs 73.6 [95% CI, 69.3-78.0]; P = .002), were more satisfied with the advice (mean, 4.2 [95% CI, 4.0-4.4] vs 3.7 [95% CI, 3.5-3.8]; P < .001), and were readier to make a decision (mean, 63.5 [95% CI, 57.4-69.6] vs 53.2 [95% CI, 47.8-58.7]; P = .016) than the control group. Physicians who reported patients in both settings seemed satisfied with the advice given.

CONCLUSIONS

This study evaluated a novel education intervention for training oncology physicians in providing CIM advice in routine care. Providing structured CIM consultations had positive effects on patient satisfaction, readiness to make decisions, and physician-patient communication.

The effectiveness of training interventions on nurses' communication skills: A systematic review

OBJECTIVES

The objective of this systematic review was to identify, critically appraise and synthesise evidence for the effectiveness of communication skills training interventions in nursing practice.

DESIGN

A systematic review of literature.

DATA SOURCES

Randomised controlled trials published in English from 1998 to 2018, identified in five computerised databases (Medline, Cinahl, Embase, Psychinfo and Cochrane Database). Studies were included if they reported an educational intervention to enhance nurses' communication with patients and contained an objective measure of communication skills and/or patient outcome measures.

REVIEW METHODS

The Preferred reporting Items for Systematic reviews and Meta-Analyses guided the review. Data were extracted regarding study design and effectiveness on nurses' communication skills. Trial quality was assessed using the Joanna Briggs Institute Critical Appraisal Checklist. The heterogeneity of the included studies prohibited meta-analysis.

RESULTS

Of the 7811 papers identified, seven trials met the eligibility criteria. The quality was modest. Training programs varied significantly in duration, structure, location and use of outcome measurement tools. Five trials focused on communication with cancer patients using simulated patients. All trials found at least one statistically significant improvement for nurses' communication skills.

CONCLUSIONS

Educational interventions to enhance nurses' capacity to communicate with patients show promise. The paper reports the first systematic review of randomised controlled trials concerning the effect of communication skills training on nurses' abilities to communicate with patients, inclusive of non-cancer settings. The direct impact of educational interventions on nurses' communication skills is difficult to measure arising from non-standardised outcome measurement tools. Further research is particularly needed in acute, chronic illness, aged care and community settings.