Developing a core outcome set (COS) for Dementia with Lewy bodies (DLB)

Background: Dementia with Lewy bodies (DLB) is an important cause of dementia with a range of clinical manifestations, including motor, neuropsychiatric, and autonomic symptoms. Compared with more common forms of dementia such as Alzheimer's disease, DLB has been the focus of significantly fewer treatment studies, often with diverse outcome measures, making comparison and clinical implementation difficult. A core outcome set (COS) can address this by ensuring that data are comparable, relevant, useful, and usable for making the best healthcare decisions. Methods: Using a multi-stage approach, development of the DLB-COS will include the following stages: (1) A systematic review, following PRISMA guidelines to create an initial long list of outcomes; (2) A two-round online Delphi including clinicians, scientists, policymakers, and individuals with lived experience of DLB and their representatives; (3) An online consensus meeting to agree on the final core list of outcomes (the final DLB-COS) for use in research and clinical practice; (4) A systematic review to identify appropriate measurement instruments for the DLB-COS outcomes; (5) A final consensus meeting of the professional stakeholders who attended the online consensus meeting to agree on the instruments that should be used to measure the outcomes in the DLB-COS; and (6) Global dissemination. Discussion: This is a multi-stage project to develop a COS to be used in treatment trials for DLB. A DLB-COS will ensure the selection of relevant outcomes and will identify the instruments to be used to measure DLB globally. Keywords: Dementia, Dementia with Lewy Bodies, Core Outcome Set, Delphi, Systematic Review, Ageing, Cognition, Memory.

Developing quality indicators for cross-sectoral psycho-oncology in Germany: combining the RAND/UCLA appropriateness method with a Delphi technique

BACKGROUND

Internationally, the need for appropriately structured, high-quality care in psycho-oncology is more and more recognized and quality-oriented care is to be established. Quality indicators are becoming increasingly important for a systematic development and improvement of the quality of care. The aim of this study was to develop a set of quality indicators for a new form of care, a cross-sectoral psycho-oncological care program in the German health care system.

METHODS

The widely established RAND/UCLA Appropriateness Method was combined with a modified Delphi technique. A systematic literature review was conducted to identify existing indicators. All identified indicators were evaluated and rated in a two-round Delphi process. Expert panels embedded in the Delphi process assessed the indicators in terms of relevance, data availability and feasibility. An indicator was accepted by consensus if at least 75% of the ratings corresponded to category 4 or 5 on a five-point Likert scale.

RESULTS

Of the 88 potential indicators derived from a systematic literature review and other sources, 29 were deemed relevant in the first Delphi round. After the first expert panel, 28 of the dissented indicators were re-rated and added. Of these 57 indicators, 45 were found to be feasible in terms of data availability by the second round of expert panel. In total, 22 indicators were transferred into a quality report, implemented and tested within the care networks for participatory quality improvement. In the second Delphi round, the embedded indicators were tested for their practicability. The final set includes 16 indicators that were operationalized in care practice and rated by the expert panel as relevant, comprehensible, and suitable for care practice.

CONCLUSION

The developed set of quality indicators has proven in practical testing to be a valid quality assurance tool for internal and external quality management. The study findings could contribute to traceable high quality in cross-sectoral psycho-oncology by providing a valid and comprehensive set of quality indicators.

TRIAL REGISTRATION

"Entwicklung eines Qualitätsmanagementsystems in der integrierten, sektorenübergreifenden Psychoonkologie-AP "Qualitätsmanagement und Versorgungsmanagement" zur Studie "integrierte, sektorenübergreifende Psychoonkologie (isPO)" a sub-project of the "integrierte, sektorenübergreifende Psychoonkologie (isPO)", was registered in the German Clinical Trials Register (DRKS) (DRKS-ID: DRKS00021515) on 3rd September 2020. The main project was registered on 30th October 2018 (DRKS-ID: DRKS00015326).

Development, explanation, and presentation of the Physical Literacy Interventions Reporting Template (PLIRT)

BACKGROUND

The physical literacy (PL) concept integrates different personal (e.g., physical, cognitive, psychological/affective, social) determinants of physical activity and has received growing attention recently. Although practical efforts increasingly adopt PL as a guiding concept, latest evidence has shown that PL interventions often lack specification of important theoretical foundations and basic delivery information. Therefore, the goal of the present study was to develop an expert-based template that supports researchers and practitioners in planning and reporting PL interventions.

METHODS

The development process was informed by Moher et al.'s guidance for the development of research reporting guidelines. We composed a group of ten distinguished experts on PL. In two face-to-face meetings, the group first discussed a literature-driven draft of reporting items. In the second stage, the experts anonymously voted and commented on the items in two rounds (each leading to revisions) until consensus was reached.

RESULTS

The panel recommended that stakeholders of PL initiatives should tightly interlock interventional aspects with PL theory while ensuring consistency throughout all stages of intervention development. The Physical Literacy Interventions Reporting Template (PLIRT) encompasses a total of 14 items (two additional items for mixed-methods studies) in six different sections: title (one item), background and definition (three items), assessment (one item each for quantitative and qualitative studies), design and content (five items), evaluation (one item plus one item each for quantitative and qualitative studies), discussion and conclusion (two items).

CONCLUSION

The PLIRT was designed to facilitate improved transparency and interpretability in reports on PL interventions. The template has the potential to close gaps between theory and practice, thereby contributing to more holistic interventions for the fields of physical education, sport, and health.

Strategies and interventions for improving safety culture in Australian Emergency Departments: A modified Delphi study

BACKGROUND

Patient safety and safety culture are critical for quality healthcare delivery in general and in Emergency Departments (EDs) in particular. The aim of this study is to identify strategies that may contribute to the improvement and maintenance of patient safety culture and which are considered most feasible in the ED environment.

METHODS

A two-step modified Delphi method with 11 experts' panel was performed to establish consensus. A list of potential expert participants with a background in patient safety culture in EDs was compiled through the professional networks of the supervisory team. Snowball sampling was used to identify additional possible participants. The expert panel included key leaders in the emergency medicine community in Queensland, Australia: patient safety experts and researchers, patient safety directors, and healthcare providers in an Australian ED The study ran from September 2018 to December 2018. The tool used in Round 1 in this study was developed through triangulating the outcomes of a review of literature, results from a survey of ED staff and findings from semi-structured interviews with key stakeholders in ED. The results from Round 1 informed the development of the Round 2 tool. The responses from the Delphi Round 1 tool were analysed as both qualitative data and quantitative data. The responses from the Delphi Round 2 tool were treated as quantitative data and analysed with the SPSS software. Consensus was calculated based on more than 80% agreement in collapsed categories 1 and 2 (or 4 and 5) of the five-point Likert scale.

RESULTS

Only six strategies out of 17 (35%) achieved consensus for both importance and feasibility. These strategies may therefore be considered the most important and feasible key strategies for improving safety culture in EDs. Seven strategies (41.1%) achieved consensus for importance, but not for feasibility and four strategies (23.55%) did not achieve consensus for either importance or feasibility.

CONCLUSIONS

This study offers practical solutions for safety culture improvement in the ED context. Six key strategies were seen as both important and feasible and these grouped into three main themes; leadership through agenda setting, operational management approaches to reinforce the agenda and commitment, and systems and structures to reinforce the agenda and monitor progress.

How to specify healthcare process improvements collaboratively using rapid, remote consensus-building: a framework and a case study of its application

BACKGROUND

Practical methods for facilitating process improvement are needed to support high quality, safe care. How best to specify (identify and define) process improvements - the changes that need to be made in a healthcare process - remains a key question. Methods for doing so collaboratively, rapidly and remotely offer much potential, but are under-developed. We propose an approach for engaging diverse stakeholders remotely in a consensus-building exercise to help specify improvements in a healthcare process, and we illustrate the approach in a case study.

METHODS

Organised in a five-step framework, our proposed approach is informed by a participatory ethos, crowdsourcing and consensus-building methods: (1) define scope and objective of the process improvement; (2) produce a draft or prototype of the proposed process improvement specification; (3) identify participant recruitment strategy; (4) design and conduct a remote consensus-building exercise; (5) produce a final specification of the process improvement in light of learning from the exercise. We tested the approach in a case study that sought to specify process improvements for the management of obstetric emergencies during the COVID-19 pandemic. We used a brief video showing a process for managing a post-partum haemorrhage in women with COVID-19 to elicit recommendations on how the process could be improved. Two Delphi rounds were then conducted to reach consensus.

RESULTS

We gathered views from 105 participants, with a background in maternity care (n = 36), infection prevention and control (n = 17), or human factors (n = 52). The participants initially generated 818 recommendations for how to improve the process illustrated in the video, which we synthesised into a set of 22 recommendations. The consensus-building exercise yielded a final set of 16 recommendations. These were used to inform the specification of process improvements for managing the obstetric emergency and develop supporting resources, including an updated video.

CONCLUSIONS

The proposed methodological approach enabled the expertise and ingenuity of diverse stakeholders to be captured and mobilised to specify process improvements in an area of pressing service need. This approach has the potential to address current challenges in process improvement, but will require further evaluation.

How to agree on what is fundamental to optimal teamwork performance in a situation of postpartum hemorrhage? A multidisciplinary Delphi French study to develop the Obstetric Team Performance Assessment Scale (OTPA Scale)

INTRODUCTION

The objective of this study was to develop a new interdisciplinary teamwork scale, the Obstetric Team Performance Assessment (OTPA), for the management of the post-partum hemorrhage, through consensus agreement of obstetric caregivers. The goal is to provide a reliable tool for teaching and evaluating teams in high-fidelity simulation.

METHODS

This prospective study is based on an expert consensus, using a Delphi method. The authors developed the "OTPA» specifically related to the management of post-partum hemorrhage, using existing recommendations. For the Delphi survey, the scale was distributed to a selected group of experts. After each round of Delphi, authors quantitatively analyzed each element of the scale, based on the percentages of agreement received, and reviewed each comment. This blind examination then led to the modification of the scale. The rounds were continued until 80-100 % agreement with a median overall response score equal to or greater than 8 was obtained for at least 60 % of items. Repeated 3 times, the process led to consensus and to a final version of the OTPA scale.

RESULTS

From February to October 2018, 16 of the 33 invited experts participated in four Delphi cycles. Of the 37 items selected in the first round, only 19 (51.3 %) had an agreement of 80-100% with a median overall response score equal to or greater than 8 in the second round, and a third round was conducted. During this third round, 24 of the 37 items were validated (64.9 %) and 82 of the 88 sub-items obtained 80 %-100 % agreement (93.2 %). The fourth round consisted of proposing a weighting of the different items.

CONCLUSION

Using a structured Delphi method, we provided a new interdisciplinary teamwork scale (OTPA), for the management of the post-partum hemorrhage. Thus, this scale will be able to be used during high-fidelity scenarii to assess performances of various teams facing a scenari of PPH. Moreover, this scale, focusing some crucial aspects of interdisciplinary teamwork will be useful for teaching purpose.

Development of prescribing safety indicators related to mental health disorders and medications: Modified e-Delphi study

AIM

To develop a set of prescribing safety indicators related to mental health disorders and medications, and to estimate the risk of harm associated with each indicator.

METHOD

A modified two-stage electronic Delphi. The first stage consisted of two rounds in which 31 experts rated their agreement with a set of 101 potential mental health related prescribing safety indicators using a five-point scale and given the opportunity to suggest other indicators. Indicators that achieved 80% agreement were accepted. The second stage comprised a single round in which 29 members estimated the risk of harm for each accepted indicator by assessing the occurrence likelihood and outcome severity using two five-point scales. Indicators were considered high or extreme risk when at least 80% of participants rated each indicator as high or extreme.

RESULTS

Seventy-five indicators were accepted in the first stage. Following the second stage, 42 (56%) were considered to be high or extreme risk for patient care. The 42 indicators comprised different types of hazardous prescribing, including drug-disease interactions (n = 12), drug-drug interactions (n = 9), inadequate monitoring (n = 5), inappropriate duration (n = 4), inappropriate dose (n = 4), omissions (n = 4), potentially inappropriate medications (n = 3) and polypharmacy (n = 1). These indicators also covered different mental health related medication classes, including antipsychotics (n = 14), mood stabilisers (n = 8), antidepressants (n = 6), sedative, hypnotics and anxiolytics (n = 6), anticholinergic (n = 6) and nonspecific psychotropics (n = 2).

CONCLUSION

This study has developed the first suite of prescribing safety indicators related to mental health disorders and medications, which could inform the development of future safety improvement initiatives and interventional studies.

Pain and Inflammation Management in Older Adults: A Brazilian Consensus of Potentially Inappropriate Medication and Their Alternative Therapies

Purpose: The aim of the present study was to develop and validate a Potentially Inappropriate Medications (PIM) list and alternative therapies for treatment of pain and inflammation in older people adapted to the Brazilian context.

Methods: A preliminary PIM list suitable for the Brazilian market was developed on the basis of three published international PIM lists [Beers 2015, Screening Tool of Older People’s Potentially Inappropriate Prescriptions - 2015, European Union (7) PIM list]. We used the modified Delphi technique (two-round) to validate concerns of use and alternative therapies related to PIM for treatment of pain and inflammation in older adults ≥65 years in Brazil. The panel involved nine Brazilian experts in geriatric pharmacotherapy. All items with mean Likert scale score ≥4.0 (agree) and the lower limit of 95% confidence interval ≥4.0 were considered validated in this study.

Results: At the end of the consensus process, 94 (65.3%) items of 144 were validated. In total, consensus was reached for 33/35 (94.3%) concerns about drugs that should be avoided in older patients regardless of diagnosis, for 22/23 (95.7%) concerns about drugs that should be avoided in older patients with specific conditions or diseases, for 11/23 (47.8%) with special considerations of use, and for 28/63 (44.4%) of therapeutic alternatives.

Conclusion: Although these criteria are not designed to replace clinical judgement, PIM and alternative therapies lists can be useful to inform prescribers, pharmacists, and health care planners and may serve as a starting point for safe and effective use of medications in older people.

The IOU Consensus Recommendations for Empirical Therapy of Cystitis in Nursing Home Residents

OBJECTIVE

To establish consensus recommendations for empirical treatment of uncomplicated cystitis with anti-infectives in noncatheterized older nursing home residents to be implemented in the Improving Outcomes of UTI Management in Long-Term Care Project (IOU) funded by the Agency for Healthcare Research and Quality.

DESIGN

Two-round modified Delphi survey.

PARTICIPANTS

Expert panel of 19 clinical pharmacists.

MEASUREMENTS

Comprehensive literature search and development/review/edit of draft survey by the investigative group (one geriatric clinical pharmacist, two geriatric medicine physicians, and one infectious disease physician). The expert panel members rated their agreement with each of 31 recommendations for drugs of choice, dosing medications at various levels of renal function, drug-drug interactions to avoid, and duration of therapy by sex on a 5-point Likert scale (1 = strongly disagree to 5 = strongly agree). Consensus agreement was defined as a lower 95% confidence limit of 4.0 or higher for the recommendation-specific mean score.

RESULTS

The response rate was 95% for the first round, and three recommendations achieved consensus (dosing for nitrofurantoin and trimethoprim/sulfamethoxazole in those without chronic kidney disease, and drug-drug interaction between trimethoprim/sulfamethoxazole and warfarin). In the second round, 90% responded and reached consensus on an additional eight recommendations (two for nitrofurantoin or trimethoprim/sulfamethoxazole as initial drugs of choice, three for dosing ciprofloxacin, nitrofurantoin, and trimethoprim/sulfamethoxazole at various levels of chronic kidney disease, and three drug-drug interactions to avoid: trimethoprim/sulfamethoxazole with phenytoin and ciprofloxacin with theophylline or with tizanidine).

CONCLUSION

An expert panel of clinical pharmacists was able to reach consensus on a set of recommendations for the empirical treatment of cystitis with oral anti-infective medications in older nursing home residents. The recommendations were incorporated into a treatment algorithm for uncomplicated cystitis in noncatheterized nursing home residents and used in educational materials for health professionals in an ongoing controlled intervention study. J Am Geriatr Soc 67:539-545, 2019.

Standardizing hysteroscopy teaching: development of a curriculum using the Delphi method

BACKGROUND

Hysteroscopy is performed often and in many indications but is challenging to learn. Hands-on training in live patients faces ethical, legal, and economic obstacles. Virtual reality simulation may hold promise as a hysteroscopy training tool. No validated curriculum specific in hysteroscopy exists. The aim of this study was to develop a hysteroscopy curriculum, using the Delphi method to identify skill requirements.

METHODS

Based on a literature review using the key words "curriculum," "simulation," and "hysteroscopy," we identified five technical and non-technical areas in which skills were required. Twenty hysteroscopy experts from different French hospital departments participated in Delphi rounds to select items in these five areas. The rounds were to be continued until 80-100% agreement was obtained for at least 60% of items. A curriculum was built based on the selected items and was evaluated in residents.

RESULTS

From November 2014 to April 2015, 18 of 20 invited experts participated in three Delphi rounds. Of the 51 items selected during the first round, only 25 (49%) had 80-100% agreement during the second round, and a third round was therefore conducted. During this last round, 80-100% agreement was achieved for 31 (61%) items, which were used to create the curriculum. All 14 residents tested felt that a simulator training session was acceptable and helped them to improve their skills.

CONCLUSIONS

We describe a simulation-based hysteroscopy curriculum focusing on skill requirements identified by a Delphi procedure. Its development allows standardization of training programs offered to residents.

MAT-CAP: a novel medication assessment tool to explore adherence to clinical practice guidelines in community-acquired pneumonia

BACKGROUND/PURPOSE

Community-acquired pneumonia (CAP) is a disease with high morbidity and mortality. Adherence to clinical practice guidelines (CPGs) in treatment of CAP is associated with favourable outcome. We aimed to develop and validate a medication assessment tool (MAT) to explore adherence to CPG recommendations in patients with CAP admitted to a Norwegian hospital. The tool is named MAT-CAP.

METHOD

Sixteen quality indicators (QIs) based on local and international CPGs were developed. Content validity was explored in an expert panel using a two-round modified Delphi technique. QIs demonstrating content valdity were reformulated into review criteria forming the MAT-CAP. Feasibility and adherence to MAT-CAP were explored in a retrospective study using data from electronic patient records of CAP patients admitted to the University Hospital of North Norway Tromso during 2008. Reliability was explored using Cohen's kappa (ĸ) statistics for inter- and intra-observer agreements.

RESULTS

Content validity was demonstrated for 15 QIs covering areas as initial empirical treatment, microbiological diagnostics, pathogen specific treatment, dose adjustment according to renal function, switch from intravenous to oral treatment and treatment duration. Overall reliability was excellent with ĸ-values of 0.88 and 0.95 for inter-observer and intra-observer agreements, respectively. Overall applicability was 37.2%, and mean application times were 3.1 and 3.8 min for the two observers. Overall adherence to 812 criteria applied was 59% (range 0-100).

CONCLUSIONS

We have demonstrated content validity, feasibility and reliability of a 15-criterion MAT-CAP. Adherence results from applying MAT-CAP criteria pinpointed areas with good clinical performance and areas with improvement potentials.