The Delphi method and health research

Arthrogryposis multiplex congenita definition: Update using an international consensus-based approach

Arthrogryposis multiplex congenita (AMC) has been described and defined in thousands of articles, but the terminology used has been inconsistent. Some have described it as a diagnosis or syndrome, others as a term or clinical finding. This lack of common language can lead to confusion in clinical and research communities. The aim of this study was to develop a consensus-based definition for AMC using international expert opinion. A consensus-based definition will help harmonize research and clinical endeavors and will facilitate communication among families, clinicians, and researchers. This article describes the methodology used leading to a proposed definition of AMC. First, a literature review was conducted to identify AMC definitions used in included studies. The most commonly used words in the definitions were extracted. Second, a group of eight experts in AMC was selected to identify elements considered critically important to the definition of AMC. Third, based on these critical elements and the literature review, a definition was drafted by the research team. Fourth, a modified Delphi consensus process was conducted using electronic surveys with 25 experts in the field of AMC from eight countries. Survey results were analyzed quantitatively and qualitatively and drafts were modified accordingly. Three rounds of surveys were completed until consensus was reached on a definition of AMC. An annotation of this definition, developed by a panel of international experts, is provided in a separate manuscript in this special issue.

How to foster informed decision making about food supplements: results from an international Delphi study

Food supplement use can have beneficial and detrimental effects, making informed decisions about supplement use important. How these decisions are made and which communication strategies can stimulate informed decision making is unclear. This study identified the important characteristics of (i) informed decision making about food supplement use and (ii) important factors indicating how to communicate about food supplements to foster informed decision making. An online three-round Delphi study was conducted. International experts within the field of (risk) communication about food supplements or related fields were recruited via email. The participants' age ranged from 25 to 69 years, and sample sizes for the three rounds were 38, 89 and 51, respectively. Experts indicated that for making an informed decision about food supplement use one needs to have knowledge of their positive and negative effects, the ability to compare these effects, knowing alternatives besides supplements, feeling informed, and feeling able (self-efficacious) to make the decision and making the decision voluntarily. Important communication strategies mentioned were: provision of information about positive and negative effects and the nature of these effects including scientific evidence, ensuring information is easily accessible, well ordered, tailored and provided by a trustworthy, credible and independent source.

A healthy, sustainable and safe food system: examining the perceptions and role of the Australian policy actor using a Delphi survey

OBJECTIVE

There is an urgent need to identify and develop cross-sectoral policies which promote and support a healthy, safe and sustainable food system. To help shape the political agenda, a critical first step is a shared definition of such a system among policy makers across relevant sectors. The aim of the present study was to determine how Australian policy actors define, and contribute to, a healthy, safe and sustainable food system.

DESIGN

A Delphi survey, consisting of two rounds, was conducted. Participants were asked how they define, and contribute to, a healthy, safe and sustainable food system (Round 1) and indicate their level of agreement with summary statements (Round 2).

SETTING

This was an online Delphi survey conducted in Australia.

PARTICIPANTS

Twenty-nine and fourteen multisectoral and multilevel policy makers completed Round 1 and Round 2, respectively.

RESULTS

The definition included food processing regulation, environmentally friendly food production and access to nutritious food. All agreed that it was important for them to improve access and supply of healthy food and ensure healthy planning principles are applied.

CONCLUSIONS

There were cross-sectoral differences in definitions and contributions; however, critical consensus was achieved. The study contributes to the definition of key elements of a cross-sectoral food and nutrition policy to meet today's environmental, health, social and economic challenges; however, further research using a more representative multisectoral sample is warranted.

Core Set of Patient-reported Outcomes in Pancreatic Cancer (COPRAC): An International Delphi Study Among Patients and Health Care Providers

OBJECTIVE

To establish an international core set of patient-reported outcomes (PROs) selected by both patients and healthcare providers (HCPs) from the United States (US), Europe, and Asia.

SUMMARY BACKGROUND DATA

PROs are increasingly recognized in pancreatic cancer studies. There is no consensus on which of the many available PROs are most important.

METHODS

A multicenter Delphi study among patients with pancreatic cancer (curative- and palliative-setting) and HCPs in 6 pancreatic centers in the US (Baltimore, Boston), Europe (Amsterdam, Verona), and Asia (Mumbai, Seoul) was performed. In round 1, participants rated the importance of 56 PROs on a 1 to 9 Likert scale. PROs rated as very important (scores 7-9) by the majority (≥80%) of curative- and/or palliative-patients as well as HCPs were included in the core set. PROs not fulfilling these criteria were presented again in round 2, together with feedback on individual and group ratings. Remaining PROs were ranked based on the importance ratings.

RESULTS

In total 731 patients and HCPs were invited, 501 completed round 1, and 420 completed both rounds. This included 204 patients in curative-setting, 74 patients in palliative-setting, and 142 HCPs. After 2 rounds, 8 PROs were included in the core set: general quality of life, general health, physical ability, ability to work/do usual activities, fear of recurrence, satisfaction with services/care organization, abdominal complaints, and relationship with partner/family.

CONCLUSIONS

This international Delphi study among patients and HCPs established a core set of PROs in pancreatic cancer, which should facilitate the design of future pancreatic cancer trials and outcomes research.

Methods for exploring and eliciting patient preferences in the medical product lifecycle: a literature review

Preference studies are becoming increasingly important within the medical product decision-making context. Currently, there is limited understanding of the range of methods to gain insights into patient preferences. We developed a compendium and taxonomy of preference exploration (qualitative) and elicitation (quantitative) methods by conducting a systematic literature review to identify these methods. This review was followed by analyzing prior preference method reviews, to cross-validate our results, and consulting intercontinental experts, to confirm our outcomes. This resulted in the identification of 32 unique preference methods. The developed compendium and taxonomy can serve as an important resource for assessing these methods and helping to determine which are most appropriate for different research questions at varying points in the medical product lifecycle.

Assessing Campus Alcohol Policies: Measuring Accessibility, Clarity, and Effectiveness

BACKGROUND

Excessive alcohol consumption poses significant hazards to health and safety on college campuses. While substantial research exists regarding effective policies for preventing alcohol-related problems in the communities surrounding campuses, on-campus alcohol policies have received far less attention.

METHODS

Official campus alcohol policies (CAPs) were retrieved from the websites of the 15 member schools of the Maryland Collaborative to Reduce College Drinking and Related Problems, a voluntary statewide collaborative. CAPs were assessed for accessibility, clarity, and effectiveness. In addition to assessing whether campuses were in compliance with federal regulations for comprehensiveness of policies, a measure of likely policy effectiveness was developed through the use of 2 Delphi panels drawing on alcohol policy researchers and on-campus and community practitioners, respectively. The panels rated 35 potential policies and 13 possible sanctions; lists of policies and sanctions were compiled primarily from what was already in existence at 1 or more member schools.

RESULTS

For most campuses, the CAPs could be located within 30 seconds, but tended to be spread across multiple web pages. Language used to communicate the policies tended to be complex and above the reading level of someone with a high school education. At least half of the schools had less than half of the possible policies rated most or somewhat effective by the Delphi panels. Schools were more likely to employ the most effective sanctions, but somewhat and ineffective sanctions were also not uncommon.

CONCLUSIONS

CAPs are an important element in reducing negative consequences of alcohol consumption on college campuses. A higher level of research scrutiny is warranted to understand the extent to which CAPs are associated with excessive drinking, but this research describes an evidence- and expert-informed assessment approach that colleges can use to regularly analyze and update their CAPS.

Identifying the key features and outcomes of family navigation services for mental health and/or addictions concerns: a Delphi study

Background

Family navigation in mental health and addictions is a mode of support aimed at helping families through the complex mental health and addictions system, making well-informed service matches, and engaging with families throughout their care journeys. As family navigation services emerge and grow, understanding their unique features and impacts is essential to defining evaluation measures and driving good outcomes for families.

Methods

This Delphi study investigated the defining features of family mental health and addictions navigation, factors involved in a successful service match, and important outcomes of the process through perspectives of clients and team members of a family navigation program, as well as those of local mental health and/or addictions service providers. In the first phase, participants (n = 41), were asked to respond to a series of prompts pertaining to 1) the key features of a successful family navigation process, 2) the features of good matches between youth or families and the services to which they are navigated, and 3) the outcomes of importance in family navigation. In Phase 2, findings from Phase 1 were presented to participants (n = 32) to select and rank their top ten responses to each prompt. Responses which passed a cut-point were carried into Phase 3, in which participants (n = 20), rated the importance of the remaining items. Items rated as “very” or “extremely” important by 80% or more of participants in Phase 3 had achieved consensus. Intra-class correlation coefficients were calculated to confirm participant agreement on all items having achieved consensus.

Results

Sample items with 100% consensus were as follows: navigator determines the best fit by understanding and considering the youth and families’ needs, by collaborating with team members and service providers, and by providing individualized suggestions; navigation involves knowledge and understanding of mental health and addictions system and existing services; referred service providers are knowledgeable and up-to-date on evidence-based practice and have multidisciplinary perspectives in service. Overall ICC across all finalized statements following Phase 3 was .84.

Conclusions

Exploring the key features of successful navigation, outcomes of importance to stakeholders, and elements of successful matches can inform the development of navigation services that address families’ needs, can support service providers in ensuring well-matched services, and lend vital support to families seeking services within a complex system.

Electronic supplementary material

The online version of this article (10.1186/s12913-019-3968-6) contains supplementary material, which is available to authorized users.

Consensus statement on mandatory measurements in pancreatic cancer trials (COMM-PACT) for systemic treatment of unresectable disease

Variations in the reporting of potentially confounding variables in studies investigating systemic treatments for unresectable pancreatic cancer pose challenges in drawing accurate comparisons between findings. In this Review, we establish the first international consensus on mandatory baseline and prognostic characteristics in future trials for the treatment of unresectable pancreatic cancer. We did a systematic literature search to find phase 3 trials investigating first-line systemic treatment for locally advanced or metastatic pancreatic cancer to identify baseline characteristics and prognostic variables. We created a structured overview showing the reporting frequencies of baseline characteristics and the prognostic relevance of identified variables. We used a modified Delphi panel of two rounds involving an international panel of 23 leading medical oncologists in the field of pancreatic cancer to develop a consensus on the various variables identified. In total, 39 randomised controlled trials that had data on 15 863 patients were included, of which 32 baseline characteristics and 26 prognostic characteristics were identified. After two consensus rounds, 23 baseline characteristics and 12 prognostic characteristics were designated as mandatory for future pancreatic cancer trials. The COnsensus statement on Mandatory Measurements in unresectable PAncreatic Cancer Trials (COMM-PACT) identifies a mandatory set of baseline and prognostic characteristics to allow adequate comparison of outcomes between pancreatic cancer studies.

Convergence model for effectual prevention and control of zoonotic diseases: a health system study on 'One Health' approach in Ahmedabad, India

The complexity and increasing burden of zoonotic diseases create challenges for the health systems of developing nations. Public health systems must therefore be prepared to face existing and future disease threats at the human–animal interface. The key for this is coordinated action between the human and the animal health systems. Although some studies deal with the question of how these two systems interact during unforeseen circumstances such as outbreaks, a dearth of literature exists on how these systems interact on early detection, prevention and control of zoonotic diseases; assessing this problem from the health system perspective in a developing nation adds further complexity. Systems thinking is one of the promising approaches in understanding the factors that influence the system’s complexity and dynamics of health maintenance. Therefore, this study aims to understand the generic structure and complexity of interaction between these actors within the domain of One Health for the effectual prevention and control of zoonotic diseases in India.

The present study will be executed in Ahmedabad, located on the Western part of India, in Gujarat state, using a mixed methods approach. For the first step, zoonotic diseases will be prioritised for the local context through semi-quantitative tools. Secondly, utilising semi-structured interviews, stakeholders from the human and animal health systems will be identified and ranked. Thirdly, the identified stakeholders will be questioned regarding the current strength of interactions at various levels of the health system (i.e. managerial, provider and community level) through a quantitative network survey. Fourthly, utilising a vignette method, the ideal convergence strategies will be documented and validated through policy Delphi techniques. Finally, through a participatory workshop, the factors that influence convergence for the control and prevention of zoonotic diseases will be captured.

This study will provide a comprehensive picture of the current strength of collaboration and network depth at various levels of the health system. Further, it will assist different actors in identifying the relevance of possible One Health entry points for participation, i.e. it will not only contribute but will also develop a system convergence model for the effectual prevention and control of zoonotic diseases.

What is a research derived actionable tool, and what factors should be considered in their development? A Delphi study

BACKGROUND

Research findings should be disseminated appropriately to generate maximum impact. The development of research derived 'actionable' tools (RDAT) as research outputs may contribute to impact in health services and health systems research. However there is little agreement on what is meant by actionable tool or what can make them useful. We set out to develop a consensus definition of what is meant by a RDAT and to identify characteristics of a RDAT that would support its use across the research-practice boundary.

METHODS

A modified Delphi method was used with a panel of 33 experts comprising of researchers, research funders, policy makers and practitioners. Three rounds were administered including an initial workshop, followed by two online surveys comprising of Likert scales supplemented with open-ended questions. Consensus was defined at 75% agreement.

RESULTS

Consensus was reached for the definition and characteristics of RDATs, and on considerations that might maximize their use. The panel also agreed how RDATs could become integral to primary research methods, conduct and reporting. A typology of RDATs did not reach consensus.

CONCLUSIONS

A group of experts agreed a definition and characteristics of RDATs that are complementary to peer reviewed publications. The importance of end users shaping such tools was seen as of paramount importance. The findings have implications for research funders to resource such outputs in funding calls. The research community might consider developing and applying skills to coproduce RDATs with end users as part of the research process. Further research is needed on tracking the impact of RDATs, and defining a typology with a range of end-users.

Charcot neuroarthropathy patient education among podiatrists in Scotland: a modified Delphi approach

Background

This evaluation sought to determine current Charcot neuroarthropathy (CN) diabetes patient education practices among Scottish National Health Service (NHS) and academic podiatrists and evaluate novel visual tools and develop expert consensus for future practice.

Methods

Questionnaires collected mixed qualitative and quantitative responses, analysed concurrently within a convergence coding matrix. Delphi methodology permitted member-checking and agreement of consensus over two rounds.

Results

Fourteen participants (16.28%) completed a Round One questionnaire, leading to the generation of four themes; Experience; Person-Centred Care and the Content and Context of CN patient education. Seven consensus statements were subsequently developed and six achieved over 80% agreement among 16 participants (18.60%) with a Round Two questionnaire. Respondents agreed CN patient education should be considered for all ‘At-risk’ individuals with diabetic peripheral neuropathy (DPN). Verbal metaphors, including the ‘rocker-bottom’ foot, soft or brittle bones, collapsing, walking on honeycomb and a shattering lightbulb were frequently employed. Visual tools, including visual metaphors and The Charcot Foot Thermometer, were positively evaluated and made available online.

Conclusions

Key findings included respondent’s belief that CN education should be considered for all individuals with DPN and the frequent use of simile, analogy and metaphor in CN education. The concept of ‘remission’ proved controversial due to its potential for misinterpretation.

Electronic supplementary material

The online version of this article (10.1186/s13047-018-0296-8) contains supplementary material, which is available to authorized users.

Consensus statement on essential patient characteristics in systemic treatment trials for metastatic colorectal cancer: Supported by the ARCAD Group

BACKGROUND

Patient characteristics and stratification factors are key features influencing trial outcomes. However, there is substantial heterogeneity in reporting of patient characteristics and use of stratification factors in phase 3 trials investigating systemic treatment of metastatic colorectal cancer (mCRC). We aimed to develop a minimum set of essential baseline characteristics and stratification factors to include in such trials.

METHODS

We performed a modified, two-round Delphi survey among international experts with wide experience in the conduct and methodology of phase 3 trials of systemic treatment of mCRC.

RESULTS

Thirty mCRC experts from 15 different countries completed both consensus rounds. A total of 14 patient characteristics were included in the recommended set: age, performance status, primary tumour location, primary tumour resection, prior chemotherapy, number of metastatic sites, liver-only disease, liver involvement, surgical resection of metastases, synchronous versus metachronous metastases, (K)RAS and BRAF mutation status, microsatellite instability/mismatch repair status and number of prior treatment lines. A total of five patient characteristics were considered the most relevant stratification factors: RAS/BRAF mutation status, performance status, primary tumour sidedness and liver-only disease.

CONCLUSIONS

This survey provides a minimum set of essential baseline patient characteristics and stratification factors to include in phase 3 trials of systemic treatment of mCRC. Inclusion of these patient characteristics and strata in study protocols and final study reports will improve interpretation of trial results and facilitate cross-study comparisons.

Multi-family therapy for veteran and refugee families: a Delphi study

BACKGROUND

Research indicates that Posttraumatic stress disorder (PTSD) has an extensive impact on family relationships. Nevertheless, there is a dearth of empirically supported interventions addressing family functioning and PTSD. In the Netherlands, it is considered good clinical practice to offer multi-family therapy (MFT) to veteran and refugee families. MFT for traumatized families aims to address the dysfunctional family patterns that have evolved to address the consequences with trauma.

METHOD

The aim of this study is to generate a common framework for the practical impact and active ingredients of MFT in families confronted with trauma. The Delphi method was used to study the expert opinion of 11 therapists in Dutch expert trauma institutes.

RESULTS

The results indicate that MFT is a promising treatment for families dealing with the consequences of trauma. According to experts, positive outcomes include an increased understanding between family members, particularly visible in the de-escalation of conflicts within the family, and improved parenting. One explanation for the effectiveness of MFT with these target groups is its defining feature of therapy with several families.

CONCLUSIONS

The findings support the importance of considering family relationships and the family context in interventions for traumatized individuals.

Expert surgical consensus for prenatal counseling using the Delphi method

BACKGROUND

Pediatric surgeons frequently offer prenatal consultation for congenital pulmonary airway malformation (CPAM) and congenital diaphragmatic hernia (CDH); however, there is no evidence-based consensus to guide prenatal decision making and counseling for these conditions. Eliciting feedback from experts is integral to defining best practice regarding prenatal counseling and intervention.

METHODS

A Delphi consensus process was undertaken using a panel of pediatric surgeons identified as experts in fetal therapy to address current limitations. Areas of discrepancy in the literature on CPAM and CDH were identified and used to generate a list of content and intervention questions. Experts were invited to participate in an online Delphi survey. Items that did not reach first-round consensus were broken down into additional questions, and consensus was achieved in the second round.

RESULTS

Fifty-four surgeons (69%) responded to at least one of the two survey rounds. During round one, consensus was reached on 54 of 89 survey questions (61%), and 45 new questions were developed. During round two, consensus was reached on 53 of 60 survey questions (88%).

CONCLUSIONS

We determined expert consensus to establish guidelines regarding perinatal management of CPAM and CDH. Our results can help educate pediatric surgeons participating in perinatal care of these patients.

LEVEL OF EVIDENCE

V.

Social media for health promotion in diabetes: study protocol for a participatory public health intervention design

BACKGROUND

Participatory health approaches are increasingly drawing attention among the scientific community, and could be used for health promotion programmes on diabetes through social media. The main aim of this project is to research how to best use social media to promote healthy lifestyles with and within the Norwegian population.

METHODS

The design of the health promotion intervention (HPI) will be participatory, and will involve both a panel of healthcare experts and social media users following the Norwegian Diabetes Association. The panel of experts will agree on the contents by following the Delphi method, and social media users will participate in the definition of the HPI by expressing their opinions through an adhoc online questionnaire. The agreed contents between both parties to be used in the HPI will be posted on three social media channels (Facebook, Twitter and Instagram) along 24 months. The 3 months before starting the HPI, and the 3 months after the HPI will be used as control data. The effect of the HPI will be assessed by comparing formats, frequency, and reactions to the published HPI messages, as well as comparing potential changes in five support-intended communication behaviours expressed on social media, and variations in sentiment analysis before vs during and after the HPI. The HPI's effect on social media users' health-related lifestyles, online health behaviours, and satisfaction with the intervention will be assessed every 6 months through online questionnaires. A separate questionnaire will be used to assess the panel of experts' satisfaction and perceptions of the benefits for health professionals of a HPI as this one.

DISCUSSION

The time constraints of today's medical practice combined with the piling demand of chronic conditions such as diabetes make any additional request of extra time used by health care professionals a challenge. Social media channels provide efficient, ubiquitous and user-friendly platforms that can encourage participation, engagement and action necessary from both those who receive and provide care to make health promotion interventions successful.

A European Research Agenda for Somatic Symptom Disorders, Bodily Distress Disorders, and Functional Disorders: Results of an Estimate-Talk-Estimate Delphi Expert Study

Background: Somatic Symptom Disorders (SSD), Bodily Distress Disorders (BDD) and functional disorders (FD) are associated with high medical and societal costs and pose a substantial challenge to the population and health policy of Europe. To meet this challenge, a specific research agenda is needed as one of the cornerstones of sustainable mental health research and health policy for SSD, BDD, and FD in Europe. Aim: To identify the main challenges and research priorities concerning SSD, BDD, and FD from a European perspective. Methods: Delphi study conducted from July 2016 until October 2017 in 3 rounds with 3 workshop meetings and 3 online surveys, involving 75 experts and 21 European countries. EURONET-SOMA and the European Association of Psychosomatic Medicine (EAPM) hosted the meetings. Results: Eight research priorities were identified: (1) Assessment of diagnostic profiles relevant to course and treatment outcome. (2) Development and evaluation of new, effective interventions. (3) Validation studies on questionnaires or semi-structured interviews that assess chronic medical conditions in this context. (4) Research into patients preferences for diagnosis and treatment. (5) Development of new methodologic designs to identify and explore mediators and moderators of clinical course and treatment outcomes (6). Translational research exploring how psychological and somatic symptoms develop from somatic conditions and biological and behavioral pathogenic factors. (7) Development of new, effective interventions to personalize treatment. (8) Implementation studies of treatment interventions in different settings, such as primary care, occupational care, general hospital and specialty mental health settings. The general public and policymakers will benefit from the development of new, effective, personalized interventions for SSD, BDD, and FD, that will be enhanced by translational research, as well as from the outcomes of research into patient involvement, GP-patient communication, consultation-liaison models and implementation. Conclusion: Funding for this research agenda, targeting these challenges in coordinated research networks such as EURONET-SOMA and EAPM, and systematically allocating resources by policymakers to this critical area in mental and physical well-being is urgently needed to improve efficacy and impact for diagnosis and treatment of SSD, BDD, and FD across Europe.

Hospital preparedness and response in CBRN emergencies: TIER assessment tool

INTRODUCTION

Chemical, biological, radiological, and nuclear (CBRN) emergencies need particular hospital preparedness and resources availability. Also, specific skills and capabilities are required for efficient response to these types of events. The aim of this study was to develop an assessment tool to evaluate hospital preparedness and response performance with respect to CBRN emergencies.

METHODS

An evaluation tool was developed using the Delphi technique. A panel of experts from 10 countries, both European and non-European, with more than 5 years of experience in research or practice in CBRN emergency management was involved in this study. The study was run online, and the experts were asked to evaluate a list of items on hospital preparedness and response in CBRN emergencies. A threshold of 85% agreement level was defined as the consensus of experts in this study.

RESULTS

The first-round questionnaire was answered by 13 experts. Consensus on the preparedness section was reached for all 29 items during the first round and one item was also added by the experts. Consensus on the response performance indicators were reached in 51 out of the 59 items, during the first round, and eight items were modified and then approved in the second round by the experts.

CONCLUSION

Hospitals need a specific level of preparedness to enable an effective response to CBRN emergencies. The assessment tool, developed through experts' consensus in this study, provides a standardized method for the evaluation of hospital preparedness and response performance with respect to CBRN emergencies. The feasibility and reliability of this assessment tool could be evaluated before and during simulated exercises in a standardized manner.

Lack of preregistered analysis plans allows unacceptable data mining for and selective reporting of consensus in Delphi studies

OBJECTIVES

To empirically demonstrate how undisclosed analytic flexibility provides substantial latitude for data mining and selective reporting of consensus in Delphi processes.

STUDY DESIGN AND SETTING

Pooling data across eight online modified-Delphi panels, we first calculated the percentage of items reaching consensus according to descriptive analysis procedures commonly used in health research but selected post hoc in this article. We then examined the variability of items reaching consensus across panels.

RESULTS

Pooling all panel data, the percentage of items reaching consensus ranged from 0% to 84%, depending on the analysis procedure. Comparing data across panels, variability in the percentage of items reaching consensus for each analysis procedure ranged from 0 (i.e., all panels had the same percentage of items reaching consensus for a given analysis procedure) to 83 (i.e., panels had a range of 11% to 94% of items reaching consensus for a given analysis procedure). Of 200 total panel-by-analysis-procedure configurations, four configurations (2%) had all items and 64 (32%) had no items reaching consensus.

CONCLUSION

Undisclosed analytic flexibility makes it unacceptably easy to data mine for and selectively report consensus in Delphi processes. As a solution, we recommend prospective, complete registration of preanalysis plans for consensus-oriented Delphi processes in health research.

A Delphi study and ranking exercise to support commissioning services: future delivery of Thrombectomy services in England

BACKGROUND

Intra-arterial thrombectomy is the gold standard treatment for large artery occlusive stroke. However, the evidence of its benefits is almost entirely based on trials delivered by experienced neurointerventionists working in established teams in neuroscience centres. Those responsible for the design and prospective reconfiguration of services need access to a comprehensive and complementary array of information on which to base their decisions. This will help to ensure the demonstrated effects from trials may be realised in practice and account for regional/local variations in resources and skill-sets. One approach to elucidate the implementation preferences and considerations of key experts is a Delphi survey. In order to support commissioning decisions, we aimed using an electronic Delphi survey to establish consensus on the options for future organisation of thrombectomy services among physicians with clinical experience in managing large artery occlusive stroke.

METHODS

A Delphi survey was developed with 12 options for future organisation of thrombectomy services in England. A purposive sampling strategy established an expert panel of stroke physicians from the British Association of Stroke Physicians (BASP) Clinical Standards and/or Executive Membership that deliver 24/7 intravenous thrombolysis. Options with aggregate scores falling within the lowest quartile were removed from the subsequent Delphi round. Options reaching consensus following the two Delphi rounds were then ranked in a final exercise by both the wider BASP membership and the British Society of Neuroradiologists (BSNR).

RESULTS

Eleven stroke physicians from BASP completed the initial two Delphi rounds. Three options achieved consensus, with subsequently wider BASP (97%, n = 43) and BSNR members (86%, n = 21) assigning the highest approval rankings in the final exercise for transferring large artery occlusive stroke patients to nearest neuroscience centre for thrombectomy based on local CT/CT Angiography.

CONCLUSIONS

The initial Delphi rounds ensured optimal reduction of options by an expert panel of stroke physicians, while subsequent ranking exercises allowed remaining options to be ranked by a wider group of experts within stroke to reach consensus. The preferred implementation option for thrombectomy is investigating suspected acute stroke patients by CT/CT Angiography and secondary transfer of large artery occlusive stroke patients to the nearest neuroscience (thrombectomy) centre.

Health Literacy Competencies for European Health Care Personnel

BACKGROUND

Health literacy as a concept is gaining importance in European countries, although it is still not adequately addressed among health personnel. Health literacy supports the self-management of patients in maintaining and improving health, which could decrease the burden on health systems in Europe. However, health professionals lack adequate knowledge about health literacy and the skills to promote health literacy among their patients.

OBJECTIVE

The Health Literacy Practices and Educational Competencies for Health Professionals (a health literacy training curriculum for health professionals) was recently developed in the United States, and the study presented here aimed to refine that assessment for health personnel in European settings.

METHODS

The modified Delphi method was used and data collected online via electronic communication to achieve consensus among an expert panel. The participants were a group of 20 health literacy and health care experts from 10 professional fields representing 13 European countries. The participants rated health literacy competencies on a four-point Likert scale and provided written feedback and recommendations. If a predetermined threshold of 70% or more of the participants agreed on the competency, the consensus was defined (similar to the criteria in the Health Literacy Practices and Educational Competencies for Health Professionals intervention).

KEY RESULTS

After three rounds of ratings and modifications, consensus agreement was reached on 56 health literacy competencies (20 knowledge items, 25 skills items, 11 attitude items) and 38 practices. Eight items were removed from the original list and eight new items were added to the final list.

CONCLUSIONS

This study is the first known attempt to develop a measurable list of health literacy competencies for health personnel in Europe. Further work is needed to develop educational curricula, standard national and regional guidelines, and questionnaires for the process of implementation to maximize health literacy responsiveness in health care organizations. [Health Literacy Research and Practice. 2017;1(4):e247-e256.].

PLAIN LANGUAGE SUMMARY

The Health Literacy Practices and Educational Competencies for Health Professionals was recently developed in the United States. This study aimed to refine that assessment for health care professionals in Europe. The modified Delphi method was used and data collected online via electronic communication, and in the end, 56 health literacy competencies were included.

A study of human resource competencies required to implement community rehabilitation in less resourced settings

BACKGROUND

It is estimated that over one billion persons worldwide have some form of disability. However, there is lack of knowledge and prioritisation of how to serve the needs and provide opportunities for people with disabilities. The community-based rehabilitation (CBR) guidelines, with sufficient and sustained support, can assist in providing access to rehabilitation services, especially in less resourced settings with low resources for rehabilitation. In line with strengthening the implementation of the health-related CBR guidelines, this study aimed to determine what workforce characteristics at the community level enable quality rehabilitation services, with a focus primarily on less resourced settings.

METHODOLOGY

This was a two-phase review study using (1) a relevant literature review informed by realist synthesis methodology and (2) Delphi survey of the opinions of relevant stakeholders regarding the findings of the review. It focused on individuals (health professionals, lay health workers, community rehabilitation workers) providing services for persons with disabilities in less resourced settings.

RESULTS

Thirty-three articles were included in this review. Three Delphi iterations with 19 participants were completed. Taken together, these produced 33 recommendations for developing health-related rehabilitation services. Several general principles for configuring the community rehabilitation workforce emerged: community-based initiatives can allow services to reach more vulnerable populations; the need for supportive and structured supervision at the facility level; core skills likely include case management, social protection, monitoring and record keeping, counselling skills and mechanisms for referral; community ownership; training in CBR matrix and advocacy; a tiered/teamwork system of service delivery; and training should take a rights-based approach, include practical components, and involve persons with disabilities in the delivery and planning.

CONCLUSION

This research can contribute to implementing the WHO guidelines on the interaction between the health sector and CBR, particularly in the context of the Framework for Action for Strengthening Health Systems, in which human resources is one of six components. Realist syntheses can provide policy makers with detailed and practical information regarding complex health interventions, which may be valuable when planning and implementing programmes.

Optimizing patient and public involvement (PPI): Identifying its "essential" and "desirable" principles using a systematic review and modified Delphi methodology

Background

There is international interest in the active involvement of patients and the public. However, consensus on how best to optimize its application is currently unavailable.

Objective

To identify and assess the underlying principles of patient and public involvement (PPI) in health and social care services, research, education and regulation across medicine, dentistry and nursing.

Design

A four‐phase methodology: (i) an extensive systematic review of published and grey literature; (ii) inductive thematic analysis of review findings; (iii) development of best practice principles; and (iv) consensus testing of identified principles using a modified Delphi methodology.

Setting and participants

Twelve systematic reviews and 88 grey literature publications were reviewed leading to the unique identification of 13 principles later assessed by 18 PPI experts.

Results

Essential consensus (>75% agreement) was obtained for nine principles reviewed. Working in equal partnership and sharing information achieved the highest consensus rates: 16/17 essential 94.1%; 1/17 desirable 5.8%. The four remaining principles that failed to reach essential consensus were categorized as desirable by expert respondents. No principles were considered irrelevant. No alternatives were suggested.

Discussion

Expert respondents suggest essential principles must be achieved to optimize PPI best practice. To advance PPI practice, desirable principles should also be aspired to wherever possible.

Conclusions

This study's innovative approach advances existing knowledge by providing previously unavailable consensus about PPI best practice. Research findings hold important theoretical and practical implications for educators, regulators, researchers and practitioners looking to effectively work together.

Recommendations for the clinical management of patients receiving macitentan for pulmonary arterial hypertension (PAH): A Delphi consensus document

In patients treated with macitentan (Opsumit®, Actelion Pharmaceuticals Ltd., Basel, Switzerland) for pulmonary arterial hypertension (PAH), prevention and/or effective management of treatment-related adverse events may improve adherence. However, management of these adverse events can be challenging and the base of evidence and clinical experience for macitentan is limited. In the absence of evidence, consensus recommendations from physicians experienced in using macitentan to treat PAH may benefit patients and physicians who are using macitentan. Consensus recommendations were developed by a panel of physicians experienced with macitentan and PAH using a modified Delphi process. Over three iterations, panelists developed and refined a series of statements on the use of macitentan in PAH and rated their agreement with each statement on a Likert scale. The panel of 18 physicians participated and developed a total of 118 statements on special populations, add-on therapy, drug–drug interactions, warnings and precautions, hospitalization and functional class, and adverse event management. The resulting consensus recommendations are intended to provide practical guidance on real-world issues in using macitentan to treat patients with PAH.

Management of postoperative inflammation after cataract and complex ocular surgeries: a systematic review and Delphi survey

Prevention and management of postoperative ocular inflammation with corticosteroids and non-steroidal anti-inflammatory drugs (NSAIDs) have been evaluated in several randomised controlled trials (RCTs). However, neither consensus regarding the efficacies of different regimens nor established guidelines are currently available. This has resulted in different practice patterns throughout the world. A systematic literature review found that for the management of postcataract inflammation nepafenac produced a positive outcome in three of three RCTs (3/3), as did ketorolac (1/1), bromfenac (7/7), loteprednol (3/3) and difluprednate (6/6), but not flurbiprofen (0/1). A single study found that betamethasone produced inconclusive results after retinal detachment (RD) surgery; ketorolac was effective (1/1) after vitrectomy, but triamcinolone was ineffective (0/1) after trabeculectomy. A two-round Delphi survey asked 28 international experts to rate both the inflammatory potential of different eye surgeries and their agreement with different treatment protocols. They rated trabeculectomy, RD surgery and combined phacovitrectomy as more inflammatory than cataract surgery. Vitrectomies for macular hole or epiretinal membrane were not deemed more inflammatory than cataract surgery. For trabeculectomy, they preferred to treat longer than for cataract surgery (NSAID + corticosteroid three times a day for 2 months vs 1 month). For vitrectomy alone, RD surgery and combined phacovitrectomy, the panel preferred the same treatment as for cataract surgery (NSAID + corticosteroid three times a day for 1 month). The discrepancy between preferred treatment and perception of the eye's inflammatory status by the experts for RD and combined vitreoretinal surgeries highlights the need for RCTs to establish treatment guidelines.

Developing measures of food and nutrition security within an Australian context

Objective

To develop a measure of food and nutrition security for use among an Australian population that measures all pillars of food security and to establish its content validity.

Design

The study consisted of two phases. Phase 1 involved focus groups with experts working in the area of food security. Data were assessed using content analysis and results informed the development of a draft tool. Phase 2 consisted of a series of three online surveys using the Delphi technique. Findings from each survey were used to establish content validity and progressively modify the tool until consensus was reached for all items.

Setting

Australia.

Subjects

Phase 1 focus groups involved twenty-five experts working in the field of food security, who were attending the Dietitians Association of Australia National Conference, 2013. Phase 2 included twenty-five experts working in food security, who were recruited via email.

Results

Findings from Phase 1 supported the need for an Australian-specific tool and highlighted the failure of current tools to measure across all pillars of food security. Participants encouraged the inclusion of items to measure barriers to food acquisition and the previous single item to enable comparisons with previous data. Phase 2 findings informed the selection and modification of items for inclusion in the final tool.

Conclusions

The results led to the development of a draft tool to measure food and nutrition security, and supported its content validity. Further research is needed to validate the tool among the Australian population and to establish inter- and intra-rater reliability.

Decommissioning health care: identifying best practice through primary and secondary research – a prospective mixed-methods study

Background

Decommissioning – defined as the planned process of removing, reducing or replacing health-care services – is an important component of current reforms in the NHS. However, the evidence base on which to guide policy and practice in this area is weak.

Aim

This study aims to formulate theoretically grounded, evidence-informed guidance to support best practice in effective decommissioning of NHS services.

Design

The overall approach is a sequential, multimethod research design. The study involves (1) a literature synthesis summarising what is known about decommissioning, an international expert Delphi study, 12 interviews with national/regional bodies and seven narrative vignettes from NHS leaders; (2) a survey of Clinical Commissioning Groups (CCGs) in England (n = 56/211, 27%); (3) longitudinal, prospective case studies of four purposively sampled decommissioning projects comprising 59 semistructured interviews, 18 non-participant observations and documentary analysis; and (4) research with citizens, patient/service user representatives, carers, third-sector organisations and local community groups, including three focus groups (30 participants) and a second Delphi study (26 participants). The study took place over the period 2013–16.

Setting

The English NHS.

Results

There is a lack of robust evidence to guide decommissioning, but among experts there is a high level of consensus for the following good-practice principles: establish a strong leadership team, engage clinical leaders from an early stage and establish a clear rationale for change. The most common type of CCG decommissioning activity was ‘relocation or replacement of a service from an acute to a community setting’ (28% of all activities) and the majority of responding CCGs (77%) were planning to decommission services. Case studies demonstrate the need to (1) draw on evidence, reviews and policies to frame the problem; (2) build alliances in order to legitimise decommissioning as a solution; (3) seek wider acceptance, including among patients and community groups, of decommissioning; and (4) devise implementation plans that recognise the additional challenges of removal and replacement. Citizens, patient/service user representatives, carers, third-sector organisations and local community groups were more likely to believe that decommissioning is driven by financial and political concerns than by considerations of service quality and efficiency, and to distrust and/or resent decision-makers. Overall, the study suggests that failure rates in decommissioning are likely to be higher than in other forms of service change, suggesting the need for tailored design and implementation approaches.

Limitations

There were few opportunities for patient and public engagement in early phases of the research; however, this was mitigated by the addition of work package 4. We were unable to track outcomes of decommissioning activities within the time scales of the project and the survey response rate was lower than anticipated.

Conclusions

Decommissioning is shaped by change management and implementation, evidence and information, and relationships and politics. We propose an expanded understanding, encompassing organisational and political factors, of how avoidance of loss affects the delivery of decommissioning programmes. Future work should explore the relationships between contexts, mechanisms and outcomes in decommissioning, develop the understanding of how loss affects decisions and explore the long-term impact of decommissioning and its impact on patient care and outcomes.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

The rise (and fall?) of HR analytics

Purpose

Driven by the rapidly accelerating pace of technology-enabled developments within human resource management (HRM), human resource (HR) analytics is infiltrating the research and business agenda. As one of the first in its field, the purpose of this paper is to explore what the future of HR analytics might look like.

Design/methodology/approach

Using a sample of 20 practitioners of HR analytics, based in 11 large Dutch organizations, the authors investigated what the application, value, structure, and system support of HR analytics might look like in 2025.

Findings

The findings suggest that, by 2025, HR analytics will have become an established discipline, will have a proven impact on business outcomes, and will have a strong influence in operational and strategic decision making. Furthermore, the development of HR analytics will be characterized by integration, with data and IT infrastructure integrated across disciplines and even across organizational boundaries. Moreover, the HR analytics function may very well be subsumed in a central analytics function – transcending individual disciplines such as marketing, finance, and HRM.

Practical implications

The results of the research imply that HR analytics, as a separate function, department, or team, may very well cease to exist, even before it reaches maturity.

Originality/value

Empirical research on HR analytics is scarce, and studies on scenarios, values, and structures of expected developments in HR analytics are non-existent. This research intends to contribute to a better understanding of the development of HR analytics, to facilitate business and HR leaders in taking informed decisions on investing in the further development of the HR analytics discipline. Such investments may lead to an enhanced HR analytics capability within organizations, and cultivate the fact-based and data-driven culture that many organizations and leaders try to pursue.

Therapist competencies necessary for the delivery of compassion-focused therapy: A Delphi study

OBJECTIVES

Compassion-focused therapy (CFT) has shown promising results for a range of clinical presentations. This study explored the therapeutic competencies required to deliver CFT and organized these into a coherent framework.

DESIGN

The Delphi method was used to explore and refine competencies for delivering CFT in three rounds of data collection.

METHODS

The first round involved interviews with 12 experts in CFT. Data were analysed using template analysis to generate a draft competency framework. The main competencies were used to create a survey for rounds two and three involving CFT experts and practitioners. Data collected from the surveys were used to refine the competencies.

RESULTS

The CFT competency framework (CFT-CF) that was produced comprised 25 main competencies within six key areas of competence. The areas were as follows: competencies in creating safeness, meta-skills, non-phase-specific skills, phase-specific skills, knowledge and understanding and use of supervision. The main competencies included several subcompetencies specifying knowledge, skills and attributes needed to demonstrate the main competence. Overall, there was consensus on 14 competencies and 20 competencies exceeded an 80% agreement level.

CONCLUSIONS

Some of the CFT competencies overlapped with existing therapies, whilst others were specific to CFT. The CFT-CF provides useful guidance for clinicians, supervisors and training programmes. Further research could develop the CFT-CF into a therapist rating scale in order to measure the outcome of training and to assess treatment fidelity in clinical trials.

PRACTITIONER POINTS

The compassion-focused therapy competency framework (CFT-CF) identifies therapeutic competencies that overlap with existing treatments as well as those specific to compassion-focused therapy (CFT). The CFT-CF builds guidance for the competencies required to deliver CFT in a range of clinical settings. The CFT-CF provides guidance for those training CFT therapists. The CFT-CF could be used as a basis to develop a therapist rating scale.

Reconciling patient and provider priorities for improving the care of critically ill patients: A consensus method and qualitative analysis of decision making

Background

Providers have traditionally established priorities for quality improvement; however, patients and their family members have recently become involved in priority setting. Little is known about how to reconcile priorities of different stakeholder groups into a single prioritized list that is actionable for organizations.

Objective

To describe the decision‐making process for establishing consensus used by a diverse panel of stakeholders to reconcile two sets of quality improvement priorities (provider/decision maker priorities n=9; patient/family priorities n=19) into a single prioritized list.

Design

We employed a modified Delphi process with a diverse group of panellists to reconcile priorities for improving care of critically ill patients in the intensive care unit (ICU). Proceedings were audio‐recorded, transcribed and analysed using qualitative content analysis to explore the decision‐making process for establishing consensus.

Setting and participants

Nine panellists including three providers, three decision makers and three family members of previously critically ill patients.

Results

Panellists rated and revised 28 priorities over three rounds of review and reached consensus on the “Top 5” priorities for quality improvement: transition of patient care from ICU to hospital ward; family presence and effective communication; delirium screening and management; early mobilization; and transition of patient care between ICU providers. Four themes were identified as important for establishing consensus: storytelling (sharing personal experiences), amalgamating priorities (negotiating priority scope), considering evaluation criteria and having a priority champion.

Conclusions

Our study demonstrates the feasibility of incorporating families of patients into a multistakeholder prioritization exercise. The approach described can be used to guide consensus building and reconcile priorities of diverse stakeholder groups.

Recommendations for the use of oral treprostinil in clinical practice: a Delphi consensus project pulmonary circulation

Oral treprostinil was recently labeled for treatment of pulmonary arterial hypertension. Similar to the period immediately after parenteral treprostinil was approved, there is a significant knowledge gap for practicing physicians who might prescribe oral treprostinil. Despite its oral route of delivery, use of the drug is challenging because of the requirement for careful titration and management of drug-related adverse effects. We aimed to create a consensus document combining available evidence with expert opinion to provide guidance for use of oral treprostinil. Following a methodology commonly used in business and social sciences (the 'Delphi Process'), two investigators from the oral treprostinil (Freedom) studies created a series of statements based on available evidence and the package insert. The set of 'best practice' statements was circulated to nine other Freedom trial investigators. Their comments were incorporated into the document as new line items for further vote and comment. The subsequent document was put to vote line by line (scale of -5 to +5) and a final statement was drafted. Consensus recommendations include initial therapy with 0.125 mg for treatment naÿ patients, three times daily dosing, aggressive use of antidiarrheal medication, and a strong preference for use of the drug in combination with other approved PAH therapies. This process was particularly valuable in providing guidance for the management of adverse events (where essentially no data is available). The Delphi process was useful to codify investigator experience and subsequently develop investigator consensus about practical issues for physicians who may wish to prescribe oral treprostinil.

Working towards consensus on methods used to elicit participant-reported safety data in uncomplicated malaria clinical drug studies: a Delphi technique study

BACKGROUND

Eliciting adverse event (AE) and non-study medication data reports from clinical research participants is integral to evaluating drug safety. However, using different methods to question participants yields inconsistent results, compromising the interpretation, comparison and pooling of data across studies. This is particularly important given the widespread use of anti-malarials in vulnerable populations, and their increasing use in healthy, but at-risk individuals, as preventive treatment or to reduce malaria transmission.

METHODS

Experienced and knowledgeable anti-malarial drug clinical researchers were invited to participate in a Delphi technique study, to facilitate consensus on what are considered optimal (relevant, important and feasible) methods, tools, and approaches for detecting participant-reported AE and non-study medication data in uncomplicated malaria treatment studies.

RESULTS

Of 72 invited, 25, 16 and 10 panellists responded to the first, second and third rounds of the Delphi, respectively. Overall, 68% (68/100) of all questioning items presented for rating achieved consensus. When asking general questions about health, panellists agreed on the utility of a question/concept about any change in health, taking care to ensure that such questions/concepts do not imply causality. Eighty-nine percent (39/44) of specific signs and symptoms questions were rated as optimal. For non-study medications, a general question and most structured questioning items were considered an optimal approach. The use of mobile phones, patient diaries, rating scales as well as openly engaging with participants to discuss concerns were also considered optimal complementary data-elicitation tools.

CONCLUSIONS

This study succeeded in reaching consensus within a section of the anti-malarial drug clinical research community about using a general question concept, and structured questions for eliciting data about AEs and non-study medication reports. The concepts and items considered in this Delphi to be relevant, important and feasible should be further investigated for potential inclusion in a harmonized approach to collect participant-elicited anti-malarial drug safety data. This, in turn, should improve understanding of anti-malarial drug safety.

Feasibility and Impact of an 8-Week Integrative Yoga Program in People with Moderate Multiple Sclerosis-Related Disability: A Pilot Study

BACKGROUND

This pilot study determined the feasibility of a specifically designed 8-week yoga program for people with moderate multiple sclerosis (MS)-related disability. We explored the program's effect on quality of life (QOL) and physical and mental performance.

METHODS

We used a single-group design with repeated measurements at baseline, postintervention, and 8-week follow-up. Feasibility was examined through cost, recruitment, retention, attendance, and safety. Outcomes included the Multiple Sclerosis Quality of Life Inventory (MSQLI), 12-item Multiple Sclerosis Walking Scale (MSWS-12), Timed 25-Foot Walk test (T25FW), 6-Minute Walk Test (6MWT), Nine-Hole Peg Test (NHPT), Five-Times Sit-to-Stand Test (FTSTS), Multidirectional Reach Test (MDRT), maximum expiratory pressure, and Paced Auditory Serial Addition Test-3″ (PASAT-3″).

RESULTS

Fourteen participants completed the study. The program was feasible. There were significant main effects on the 36-item Short Form Health Status Survey Mental Component Summary (SF-36 MCS), Modified Fatigue Impact Scale (MFIS), Bladder Control Scale (BLCS), Perceived Deficits Questionnaire (PDQ), Mental Health Inventory (MHI), MSWS-12, T25FW, NHPT, PASAT-3″, 6MWT, FTSTS, and MDRT-Back. Improvements were found on the SF-36 MCS, MFIS, BLCS, PDQ, MHI, and MSWS-12 between baseline and postintervention. The effect on PDQ persisted at follow-up. Improvements were found on the T25FW, NHPT, 6MWT, FTSTS, and MDRT-Back between baseline and postintervention that persisted at follow-up. The PASAT-3″ did not change between baseline and postintervention but did between postintervention and follow-up.

CONCLUSIONS

The yoga program was safe and feasible. Improvements in certain measures of QOL and performance were seen at postintervention and follow-up.

A Checklist for the Conduct, Reporting, and Appraisal of Microcosting Studies in Health Care: Protocol Development

Background

Microcosting is a cost estimation method that requires the collection of detailed data on resources utilized, and the unit costs of those resources in order to identify actual resource use and economic costs. Microcosting findings reflect the true costs to health care systems and to society, and are able to provide transparent and consistent estimates. Many economic evaluations in health and medicine use charges, prices, or payments as a proxy for cost. However, using charges, prices, or payments rather than the true costs of resources can result in inaccurate estimates. There is currently no existing checklist or guideline for the conduct, reporting, or appraisal of microcosting studies in health care interventions.

Objective

The aim of this study is to create a checklist and guideline for the conduct, reporting, and appraisal of microcosting studies in health care interventions.

Methods

Appropriate potential domains and items will be identified through (1) a systematic review of all published microcosting studies of health and medical interventions, strategies, and programs; (2) review of published checklists and guidelines for economic evaluations of health interventions, and selection of items relevant for microcosting studies; and (3) theoretical analysis of economic concepts relevant for microcosting. Item selection, formulation, and reduction will be conducted by the research team in order to develop an initial pool of items for evaluation by an expert panel comprising individuals with expertise in microcosting and economic evaluation of health interventions. A modified Delphi process will be conducted to achieve consensus on the checklist. A pilot test will be conducted on a selection of the articles selected for the previous systematic review of published microcosting studies.

Results

The project is currently in progress.

Conclusions

Standardization of the methods used to conduct, report or appraise microcosting studies will enhance the consistency, transparency, and comparability of future microcosting studies. This will be the first checklist for microcosting studies to accomplish these goals and will be a timely and important contribution to the health economic and health policy literature. In addition to its usefulness to health economists and researchers, it will also benefit journal editors and decision-makers who require accurate cost estimates to deliver health care.

Promoting good policy for leadership and governance of health related rehabilitation: a realist synthesis

Background

Good governance may result in strengthened performance of a health system. Coherent policies are essential for good health system governance. The overall aim of this research is to provide the best available scientific evidence on principles of good policy related leadership and governance of health related rehabilitation services in less resourced settings. This research was also conducted to support development of the World Health Organization’s (WHO) Guidelines on health related rehabilitation.

Methods

An innovative study design was used, comprising two methods: a systematic search and realist synthesis of literature, and a Delphi survey of expert stakeholders to refine and triangulate findings from the realist synthesis. In accordance with Pawson and Tilley’s approach to realist synthesis, we identified context mechanism outcome pattern configurations (CMOCs) from the literature. Subsequently, these CMOCs were developed into statements for the Delphi survey, whereby 18 expert stakeholders refined these statements to achieve consensus on recommendations for policy related governance of health related rehabilitation.

Results

Several broad principles emerged throughout formulation of recommendations: participation of persons with disabilities in policy processes to improve programme responsiveness, efficiency, effectiveness, and sustainability, and to strengthen service-user self-determination and satisfaction; collection of disaggregated disability statistics to support political momentum, decision-making of policymakers, evaluation, accountability, and equitable allocation of resources; explicit promotion in policies of access to services for all subgroups of persons with disabilities and service-users to support equitable and accessible services; robust inter-sectoral coordination to cultivate coherent mandates across governmental departments regarding service provision; and ‘institutionalizing’ programmes by aligning them with preexisting Ministerial models of healthcare to support programme sustainability.

Conclusions

Alongside national policymakers, our policy recommendations are relevant for several stakeholders, including service providers and service-users. This research aims to provide broad policy recommendations, rather than a strict formula, in acknowledgement of contextual diversity and complexity. Accordingly, our study proposes general principles regarding optimal policy related governance of health related rehabilitation in less resourced settings, which may be valuable across diverse health systems and contexts.

Improving the care of older persons in Australian prisons using the Policy Delphi method

There are currently no internationally recognised and approved processes relating to the care of older persons with dementia in prison. This research aimed to develop tools and procedures related to managing the care of, including the identification and assessment of, older persons with dementia who are imprisoned in New South Wales, Australia. A modified approach to the Policy Delphi method, using both surveys and facilitated discussion groups, enabled experts to come together to discuss improving the quality of care provision for older persons with dementia in prison and achieve research aims.

Indicators for routine monitoring of effective mental healthcare coverage in low- and middle-income settings: a Delphi study

High-quality information to measure the need for, and the uptake, cost, quality and impact of care is essential in the pursuit of scaling up mental health care in low- and middle-income countries (LMIC). The aim of this study was to identify indicators for the measurement of effective coverage of mental health treatment. We conducted a two-round Delphi study (n = 93 experts from primarily LMIC countries Ethiopia, India, Nepal, Nigeria, South Africa and Uganda), in order to generate and prioritize a set of indicators. First, 52 unique indicators were generated (based on a total of 876 responses from participants). Second, the selected indicators were then scored for significance, relevance and feasibility. Mean priority scores were calculated per indicator (score range, 1-5). All 52 indicators had a weighted mean score that ranged from 3.20 for the lowest ranked to 4.27 for the highest ranked. The 15 highest ranked indicators cover the different domains of measuring effective mental health treatment coverage. This set of indicators is highly stable between the different groups of experts, as well as between the different participating countries. This study provides data on how mental health service and financial coverage can be assessed in LMIC. This is an important element in the move to scale-up mental health care.

Obstetricians' Opinions of the Optimal Caesarean Rate: A Global Survey

Background

The debate surrounding the optimal caesarean rate has been ongoing for several decades, with the WHO recommending an “acceptable” rate of 5–15% since 1997, despite a weak evidence base. Global expert opinion from obstetric care providers on the optimal caesarean rate has not been documented. The objective of this study was to examine providers’ opinions of the optimal caesarean rate worldwide, among all deliveries and within specific sub-groups of deliveries.

Methods

A global online survey of medical doctors who had performed at least one caesarean in the last five years was conducted between August 2013 and January 2014. Respondents were asked to report their opinion of the optimal caesarean rate—defined as the caesarean rate that would minimise poor maternal and perinatal outcomes—at the population level and within specific sub-groups of deliveries (including women with demographic and clinical risk factors for caesareans). Median reported optimal rates and corresponding inter-quartile ranges (IQRs) were calculated for the sample, and stratified according to national caesarean rate, institutional caesarean rate, facility level, and respondent characteristics.

Results

Responses were collected from 1,057 medical doctors from 96 countries. The median reported optimal caesarean rate was 20% (IQR: 15–30%) for all deliveries. Providers in private for-profit facilities and in facilities with high institutional rates reported optimal rates of 30% or above, while those in Europe, in public facilities and in facilities with low institutional rates reported rates of 15% or less. Reported optimal rates were lowest among low-risk deliveries and highest for Absolute Maternal Indications (AMIs), with wide IQRs observed for most categories other than AMIs.

Conclusions

Three-quarters of respondents reported an optimal caesarean rate above the WHO 15% upper threshold. There was substantial variation in responses, highlighting a lack of consensus around which women are in need of a caesarean among obstetric care providers worldwide.

Developing a core set of patient-reported outcomes in pancreatic cancer: A Delphi survey

BACKGROUND

Patient-reported outcomes (PROs) are amongst the most relevant outcome measures in pancreatic cancer care and research. However, it is unknown which out of the numerous PROs are most important to patients and health care professionals (HCPs) in this setting. The aim of this study was to identify a core set of PROs to be incorporated in a nationwide prospective multidisciplinary pancreatic cancer registry.

PATIENTS AND METHODS

We performed a two-round Delphi survey among 150 patients diagnosed with pancreatic or periampullary cancer (treated either with curative intent or in palliative setting) and 78 HCPs (surgeons, medical oncologists, gastroenterologists, radiotherapists, nurses, and dietitians) in The Netherlands. In round 1, participants were invited to rate the importance of 53 PROs, which were extracted from 17 different PRO measures and grouped into global domains, on a 1-9 Likert scale. PROs rated as very important (score 7-9) by the majority (≥ 80%) of curative and/or palliative patients as well as HCPs were considered sufficiently important to be incorporated in the core set. PROs not fulfilling these criteria in round 1 were presented again to the participants in round 2 along with individual and group feedback.

RESULTS

A total of 97 patients (94%) in curative-intent setting, 38 patients (81%) in palliative setting and 73 HCPs (94%) completed both rounds 1 and 2. After the first round, 7 PROs were included in the core set: general quality of life, general health, physical ability, satisfaction with caregivers, satisfaction with services and care organisation, coping and defecation. After the second round, 10 additional PROs were added: appetite, ability to work/do usual activities, medication use, weight changes, fatigue, negative feelings, positive feelings, fear of recurrence, relationship with partner/family, and pancreatic enzyme replacement therapy use.

CONCLUSION

This study provides a core set of PROs selected by patients and HCPs, which may be incorporated in pancreatic cancer care and research. Validation outside the Dutch context is recommended for generalisation and use in international studies.

The assessment of new drugs for asthma and COPD: a Delphi study examining the perspectives of Italian payers and clinicians

BACKGROUND

Asthma and chronic obstructive pulmonary disease (COPD) are disorders of the lungs characterized by airflow obstruction, inflammation and tissue remodeling. Management of patients with these diseases is complex and the improvement of diagnostic-therapeutic strategies represents a critical challenge for the healthcare system. In this context, investigating the criteria and information needed for an appropriate and effective evaluation of incoming treatment options is crucial to ensure that clinicians and policy-makers are provided with the best available evidence to make decisions aimed at improving patient outcomes. Therefore, the objective of this study was to investigate the degree of agreement among Health Technology Assessment (HTA) experts on issues crucial to the evaluation of new drugs for asthma and COPD and to appropriately manage the clinical pathway for patients.

METHOD

This research was conducted using an e-Delphi technique organized in three subsequent rounds and involving a panel of ten experts (six regional and local payers and four clinicians). Panelists were asked to comment in written form on a set of statements, explaining qualitatively the extent to which they agreed or disagreed with the assertions. Statements were subsequently modified and resubmitted for assessment.

RESULTS

Panelists expressed their opinions during each round and, after round III, a consensus document was finalized. The degree of consensus was high among experts and concerned five main topics: (a) the need to address current unmet needs of patients with asthma or COPD, (b) the importance of further studies and real-life information in the evaluation of treatments, (c) existing evidence and evidence needed to assess drugs, (d) critical issues in obtaining a positive evaluation from regional and local authorities for new treatments to be included in regional formularies and to have an important place in therapeutic categories, and (e) the major obstacles to the appropriate administration of drugs and management of patients.

CONCLUSION

The final document highlights that no proof of difference among drugs exists, that evidence on final endpoints (and particularly on mortality) should be strengthened and that actions regarding risk factors, appropriate diagnosis, patient staging and adherence to therapy are particularly important for a better clinical management.

Guía de práctica clínica sobre diagnóstico y tratamiento de infección de vías urinarias no complicada en mujeres adquirida en la comunidad

<p class="p1"><span class="s1">Mediante un proceso de adaptación de guías de práctica clínica se seleccionaron y evaluaron guías de infección de vías urinarias en mujeres premenopáusicas no embarazadas; se identificaron 3 de alta calidad. Con base en las evidencias y las recomendaciones aportadas por estas guías, se realizó un consenso para realizar recomendaciones para personal de salud —médicos, personal de laboratorio y enfermeros— sobre el diagnóstico de las infecciones urinarias —cistitis y pielonefritis—, sus tratamientos y prevención de la recurrencia.</span></p>

Teacher Competencies in Health Education: Results of a Delphi Study

OBJECTIVE

The aim of this research study was to identify the core competencies for health education teachers in supporting the development of health literacy among their students.

METHOD/RESULTS

A three round Delphi method was employed. Experts in health education were asked to identify core competencies for school health educators. Twenty six participants from the academic field were invited to participate in the study. Twenty participants completed the first round of the Delphi, while eighteen took part in round two and fifteen participated in the final round. Data were collected using an electronic questionnaire. The first round contained an open ended question in which participants were asked to name and define all the competencies they perceived were important. Thematic analysis was undertaken on these data. A list of 36 competencies was created from this round. This list was then returned to the same participants and they were asked to rate each competency on a 7 point semantic differential scale in terms of importance. The resulting data were then analysed. For the final round, participants were presented with a list of 33 competencies and were asked to rank them again, in order of importance.

CONCLUSION

Twelve core competencies emerged from the analysis and these competencies comprised of a mixture of knowledge, attitude and skills. The authors suggest that how these competencies are achieved and operationalised in the school context can be quite complex and multi-faceted. While the authors do not seek to generalise from the study they suggest that these competencies are an important input for all stakeholders, in order to question national and international teacher guidelines. In addition the competencies identified may provide a useful starting point for others to undertake deeper analysis of what it means to be an effective health educator in schools.

Neuropathic pain phenotyping by international consensus (NeuroPPIC) for genetic studies: a NeuPSIG systematic review, Delphi survey, and expert panel recommendations

For genetic research to contribute more fully to furthering our knowledge of neuropathic pain, we require an agreed, valid, and feasible approach to phenotyping, to allow collaboration and replication in samples of sufficient size. Results from genetic studies on neuropathic pain have been inconsistent and have met with replication difficulties, in part because of differences in phenotypes used for case ascertainment. Because there is no consensus on the nature of these phenotypes, nor on the methods of collecting them, this study aimed to provide guidelines on collecting and reporting phenotypes in cases and controls for genetic studies. Consensus was achieved through a staged approach: (1) systematic literature review to identify all neuropathic pain phenotypes used in previous genetic studies; (2) Delphi survey to identify the most useful neuropathic pain phenotypes and their validity and feasibility; and (3) meeting of experts to reach consensus on the optimal phenotype(s) to be collected from patients with neuropathic pain for genetic studies. A basic "entry level" set of phenotypes was identified for any genetic study of neuropathic pain. This set identifies cases of "possible" neuropathic pain, and controls, and includes: (1) a validated symptom-based questionnaire to determine whether any pain is likely to be neuropathic; (2) body chart or checklist to identify whether the area of pain distribution is neuroanatomically logical; and (3) details of pain history (intensity, duration, any formal diagnosis). This NeuroPPIC "entry level" set of phenotypes can be expanded by more extensive and specific measures, as determined by scientific requirements and resource availability.

Research Priorities for NCD Prevention and Climate Change: An International Delphi Survey

Climate change and non-communicable diseases (NCDs) are arguably the greatest global challenges of the 21st Century. However, the confluence between them remains under-examined and there is little evidence of a comprehensive, systematic approach to identifying research priorities to mitigate their joint impact. Consequently, we: (i) convened a workshop of academics (n = 25) from the Worldwide Universities Network to identify priority areas at the interface between NCDs and climate change; (ii) conducted a Delphi survey of international opinion leaders in public health and relevant other disciplines; and (iii) convened an expert panel to review and advise on final priorities. Three research areas (water security; transport; conceptualising NCD harms to support policy formation) were listed among the top 10 priorities by >90% of Delphi respondents, and ranked among the top 12 priorities by >60% of respondents who ranked the order of priority. A fourth area (reducing the carbon footprint of cities) was ranked highest by the same >60% of respondents. Our results are consistent with existing frameworks on health and climate change, and extends them by focusing specifically on NCDs. Researching these priorities could progress understanding of climate change and NCDs, and inform global and national policy decisions for mitigating associated harms.

Identifying the key elements of an education package to up-skill multidisciplinary adult specialist palliative care teams caring for young adults with life-limiting conditions: an online Delphi study

OBJECTIVES

To collect the views of experts to inform the development of an education package for multidisciplinary adult specialist palliative care (SPC) teams caring for young people with life-limiting conditions.

METHODS

A modified online Delphi process collated expert opinion on format, delivery and content of an education package to up-skill adult SPC teams. Round 1 participants (n=44) answered free-text questions, generating items for Round 2. In Round 2, 68 participants rated the extent to which they agreed/disagreed with the items on 5-point Likert-type scales. Median and mean scores assessed the importance of each item. IQR scores assessed level of consensus for each item; items lacking consensus were rerated by 35 participants in Round 3.

RESULTS

In the Delphi, consensus was reached on a range of suggested formats, on who should deliver the training, and on several clinical, psychosocial and practical topics.

CONCLUSIONS

Development of a continuous/rolling programme of education, tailored for content and mode of delivery and incorporated into working practice is recommended. As a direct outcome of the results of this study, a series of six linked study days has been established, focusing specifically on the issues around caring for young adults with life-limiting conditions and palliative care needs.