Applicability of Nursing Support for Patients With Terminal Cancer and Their Families: A Delphi Study

BACKGROUND

This report investigates the applicability of nursing support for patients with cancer with a prognosis of months and weeks, and their families.

OBJECTIVES

To evaluate the applicability of nursing support for five symptoms (dyspnea, pain, nausea/vomiting, constipation, and delirium) in patients with cancer during the last weeks of life, and the caregiver burden on their families.

DESIGN SETTING

A Delphi study was used to determine the applicability of nursing support for patients with terminal cancer and their families. Eight experts in symptom palliation in Japan who have direct care or research experience with these populations were included. The Delphi method was used to assess nursing support types for prognoses of months and weeks. Consensus was defined as ≥70% agreement for either "high applicability" or "low applicability" of each support type.

RESULTS

A total of 50 nursing support types for 5 symptoms were evaluated as highly applicable for 92% (n = 46) of patients with cancer with a prognosis of months. For patients with cancer with a prognosis of weeks, 78% (n = 39) of the nursing support was rated as highly applicable. For both prognosis groups, all nursing support (n = 6) for caregiver burden was highly applicable.

CONCLUSION

Applicability ratings of nursing support may be influenced by a high degree of invasiveness, accessibility of knowledge and information, and high expectations of effectiveness. Future studies are needed to verify the effectiveness of nursing support evaluated as highly applicable to patients with cancer during the last few months and weeks of life.

Development of a School Health Policy Implementation Survey: A Delphi Study

Data on school health policy implementation are limited due to the absence of a validated measurement tool. The purpose of this study was to create and pilot a school health policy implementation survey. A modified, four-round Delphi process was used to achieve consensus on content and format of the survey. The final 76-item survey was piloted in 655 schools with a return rate of 57.1% (n  =  378). Seven schools participated in environmental audits. Based on the audits, survey responses represented an accurate description of school practices for 84.2% (n  =  64) of questions. The remaining 15.8% (n  =  12) of survey items were eliminated or revised. This measurement tool begins to fill the research gap between the evaluation of written school health policy and implementation. Further, this tool may be used by school nurses in alignment with the Framework for 21st Century School Nursing Practice.

Estimating the number of people living with dementia at different stages of the condition in India: A Delphi process

INTRODUCTION

Numerous studies have previously estimated the dementia prevalence in India. However, as these estimates use different methodologies and sampling strategies, generating definitive prevalence estimates can be difficult.

METHODS

A Delphi process involving eight clinical and academic experts provided prevalence estimates of dementia within India, split by sex and age. The experts were also asked to estimate the number of people potentially living at different stages of the condition. A priori criteria were used to ascertain the point in which consensus was achieved.

RESULTS

Our consensus estimates generated a dementia prevalence of 2.8% (95% CI = 1.9 to 3.6) for those aged 60 years and above in India. Consensus was achieved across age and sex prevalence estimates, with the exception of one (females aged 60-64). Our experts estimated that 42.9% of people living with dementia in India had a mild severity.

CONCLUSIONS

The findings indicate that there could be approximately 3.9 million people living with dementia in India, of which 1.7 million could be living with dementia of mild severity. Such estimates can better help researchers and policy makers to estimate the true cost and impact of dementia in India and can inform resource allocation decisions.

Treatment for central centrifugal cicatricial alopecia-Delphi consensus recommendations

BACKGROUND

There is no established standard of care for treating central centrifugal cicatricial alopecia (CCCA), and treatment approaches vary widely.

OBJECTIVE

To develop consensus statements regarding the use of various pharmacological therapies in treating adults with CCCA.

METHODS

We invited 27 dermatologists with expertise in hair and scalp disorders to participate in a 3-round modified Delphi study between January and March 2023. Statements met strong consensus if 75% of respondents agreed or disagreed. Statements met moderate consensus if 55% or more but less than 75% agreed or disagreed.

RESULTS

In round 1, 5 of 33 (15.2%) statements met strong consensus, followed by 9 of 28 (32.1%) in round 2. After the final round 3 meeting, strong consensus was reached for 20 of 70 (28.6%) overall statements. Two statements achieved moderate consensus.

LIMITATIONS

This study included only English-speaking, US-based dermatologists and did not consider nonpharmacological therapies.

CONCLUSION

Despite varying opinions among dermatologists, consensus was reached for several statements to help clinicians manage CCCA. We also highlight areas that lack expert consensus with the goal of advancing research and therapeutic options for CCCA.

A novel approach to study multi-domain motions in JAK1's activation mechanism based on energy landscape

The family of Janus Kinases (JAKs) associated with the JAK-signal transducers and activators of transcription signaling pathway plays a vital role in the regulation of various cellular processes. The conformational change of JAKs is the fundamental steps for activation, affecting multiple intracellular signaling pathways. However, the transitional process from inactive to active kinase is still a mystery. This study is aimed at investigating the electrostatic properties and transitional states of JAK1 to a fully activation to a catalytically active enzyme. To achieve this goal, structures of the inhibited/activated full-length JAK1 were modelled and the energies of JAK1 with Tyrosine Kinase (TK) domain at different positions were calculated, and Dijkstra's method was applied to find the energetically smoothest path. Through a comparison of the energetically smoothest paths of kinase inactivating P733L and S703I mutations, an evaluation of the reasons why these mutations lead to negative or positive regulation of JAK1 are provided. Our energy analysis suggests that activation of JAK1 is thermodynamically spontaneous, with the inhibition resulting from an energy barrier at the initial steps of activation, specifically the release of the TK domain from the inhibited Four-point-one, Ezrin, Radixin, Moesin-PK cavity. Overall, this work provides insights into the potential pathway for TK translocation and the activation mechanism of JAK1.

Personalized Approach in the Management of Difficult-to-Treat and Treatment-Resistant Depression With Second-Generation Antipsychotics: A Delphi Statement

Background Major depressive disorder (MDD) has many facets including mixed or atypical depression that requires personalized care to improve treatment-related outcomes. Second-generation antipsychotics (SGAs) offer complementary mechanisms for clinical roles in difficult-to-treat depression and treatment-resistant depression cases. Aim/objective To further delineate a consensus on the clinical positioning of SGAs for MDD, mixed, or atypical depression, a Knowledge Attitude Perception (KAP)-mediated Delphi Statement was planned. Material/methods A literature review for the definition, diagnosis, and management of MDD, mixed, and atypical depression as treatment-resistant depression (TRD) or difficult-to-treat depression (DTD) was conducted by a steering committee of academic and clinical experts (n=6) while developing a validated KAP questionnaire. Scientific statements as clinical recommendations were evolved using the Delphi methodology before building a clinical expert consensus with an online survey (n=24). Results Twenty-four psychiatrists highlighted DTD to offer a multidimensional approach to assess treatment strategies involving selective serotonin reuptake inhibitors (SSRIs) or SGAs, while ensuring symptom, functional, and quality of life (QoL) domain improvement for improved outcomes and remission rates. MDD cases with anxiety, anhedonia, comorbidities, and risk traits require personalized care with early induction of SGAs for severe cases or symptom persisters with functional impairment. Early augmentation with SGAs including aripiprazole or cariprazine can provide a favorable risk-benefit profile for clinical cases of MDD with or without the antecedent of mixed depression or personality disorder.  Conclusion The literature review and KAP responses emphasize the importance of early identification for personalized care strategies with SGAs for DTD. Large-scale real-world evidence needs to evolve with due recognition of different phenotypes as TRD or DTD with partial or functional impairment to understand the impact of appropriate treatment pathways with SGAs.

Gaining consensus on expert rule statements for acute respiratory failure digital twin patient model in intensive care unit using a Delphi method

Digital twin technology is a virtual depiction of a physical product and has been utilized in many fields. Digital twin patient model in healthcare is a virtual patient that provides opportunities to test the outcomes of various interventions virtually without subjecting an actual patient to possible harm. This can serve as a decision aid in the complex environment of the intensive care unit (ICU). Our objective is to develop consensus among a multidisciplinary expert panel on statements regarding respiratory pathophysiology contributing to respiratory failure in the medical ICU. We convened a panel of 34 international critical care experts. Our group modeled elements of respiratory failure pathophysiology using directed acyclic graphs (DAGs) and derived expert statements describing associated ICU clinical practices. The experts participated in three rounds of modified Delphi to gauge agreement on 78 final questions (13 statements with 6 substatements for each) using a Likert scale. A modified Delphi process achieved agreement for 62 of the final expert rule statements. Statements with the highest degree of agreement included the physiology, and management of airway obstruction decreasing alveolar ventilation and ventilation-perfusion matching. The lowest agreement statements involved the relationship between shock and hypoxemic respiratory failure due to heightened oxygen consumption and dead space. Our study proves the utility of a modified Delphi method to generate consensus to create expert rule statements for further development of a digital twin-patient model with acute respiratory failure. A substantial majority of expert rule statements used in the digital twin design align with expert knowledge of respiratory failure in critically ill patients.

Brazilian Consensus on Sleep-Focused Speech-Language-Hearing Sciences - 2023 Brazilian Sleep Association

Introduction  This consensus aimed to develop a structured document presenting the role of sleep-focused Speech-Language-Hearing (SPH) Sciences (SPHS). The recommendations were based on the expertise of specialists and on evidence in the literature, aiming to guide the coverage of this area and the consequent improvement in the quality of the professionals' approach. Methods  A Delphi method was conducted with 49 SLH pathologists (SLHP), four sleep physicians, one dentist, one physical therapist, and one methodologist. Four Delphi panel rounds were conducted in Google Forms. The items were analyzed based on the panelists' percentage of agreement; consensuses were reached when ⅔ (66.6%) of valid responses were on a same on a same answer (either "agree" or "disagree"). Results  Participants voted on 102 items. The mean consensus rate was 89.9% ± 10.9%. The essential topics were the importance of professional training, the SLH diagnosis, and the SLH treatment of sleep disorders. It was verified that all fields of the SLHS are related to the area of sleep; that sleep-focused SLH pathologists (SLHP) are the responsible for assessing, indicating, and conducting specific orofacial myofunctional therapy for sleep-disordered breathing alone or in combination with other treatments; that SLHP are included in interdisciplinary teams in the area of sleep in public and private services. Discussion  The Brazilian consensus on sleep-focused SLHS is a landmark in this area. This consensus described the scope of action of sleep-focused SLHP and systematized recommendations being useful as a reference for the professional practice in the area of sleep.

Establishing a Chinese older hip fracture registry for older patients: a Delphi study to define the focus and key variables for this registry

A national hip fracture registry does not yet exist in China. This is the first to recommend a core variable set for the establishment of a Chinese national hip fracture registry. Thousands of Chinese hospitals will build on this and improve the quality of management for older hip fracture patients. The rapidly ageing population of China already experiences over half a million hip fractures every year. Many countries have developed national hip fracture registries to improve the quality of hip fracture management, but such a registry does not exist in China. The study is aimed at determining the core variables of a national hip fracture registry for older hip fracture patients in China. A rapid literature review was conducted to develop a preliminary pool of variables from existing global hip fracture registries. Two rounds of an e-Delphi survey were conducted with experts. The e-Delphi survey used a Likert 5-point scale and boundary value analysis to filter the preliminary pool of variables. The list of core variables was finalised following an online consensus meeting with the experts. Thirty-one experts participated. Most of the experts have senior titles and have worked in a corresponding area for more than 15 years. The response rate of the e-Delphi was 100% for both rounds. The preliminary pool of 89 variables was established after reviewing 13 national hip fracture registries. With two rounds of the e-Delphi and the expert consensus meeting, 86 core variables were recommended for inclusion in the registry. This study is the first to recommend a core variable set for the establishment of a Chinese national hip fracture registry. The further development of a registry to routinely collect data from thousands of hospitals will build on this work and improve the quality of management for older hip fracture patients in China.

Further assessment of the clinical relevance of anatomical structures through PubMed and other measures

A previous paper has demonstrated a statistically significant moderate correlation between the number of citations obtained from PubMed and a Delphi study for 251 anatomical structures of the Head and Neck region, suggesting that clinical significance is a major driver of research involving anatomical structures. This raises the possibility that these ranks could be an objective measure of clinical relevance of individual anatomical structures. In the present study, we revisited the rankings of the PubMed results from the previous paper and compared it with a Delphi study for 450 musculoskeletal structures. PubMed ranks were derived using different search parameters; a PubMed search with quotations yielded a moderate, statistically significant correlation coefficient of 0.639 with the musculoskeletal dataset. Additionally, we developed a Python tool, PDF Term Search, to calculate the frequency of anatomical terms in four authoritative textbooks, and these frequencies exhibited moderate significant correlations ranging (0.549-0.646) with our PubMed-derived ranks. We further explored strategies to improve the accuracy of our PubMed results by addressing limitations identified in the previous paper. We refined the syntax of search queries for 500 anatomical structures, resulting in marked improvement in the correlation coefficients with the musculoskeletal dataset, demonstrating clear avenues for future iterations of PubMed-derived ranks. We also created a spreadsheet of 2181 anatomical structures ranked using PubMed, published Delphi studies, and authoritative texts, providing a resource for anatomical educators who are adjusting their curricula to better train future healthcare practitioners.

Determining Critical Topics for Undergraduate Surgical Education in Rwanda: Results of a Modified Delphi Process and a Consensus Conference

Background Developing a contextually appropriate curriculum is critical to train physicians who can address surgical challenges in sub-Saharan Africa. An innovative modified Delphi process was used to identify contextually optimized curricular content to meet sub-Saharan Africa and Rwanda's surgical needs. Methods Participants were surgeons from East, Central, Southern, and West Africa and general practitioners with surgical experience. Delphi participants excluded or prioritized surgical topic areas generated from extensive grey and formal literature review. Surgical educators first screened and condensed identified topics. Round 1 screened and prioritized identified topics, with a 75% consensus cut-off based on the content validity index and a prioritization score. Topics that reached consensus were screened again in round 2 and re-prioritized, following controlled feedback. Frequencies for aggregate prioritization scores, experts in agreement, item-level content validity index, universal agreement and scale-level content validity index based on the average method (S-CVI/Ave) using proportion relevance, and intra-class correlation (ICC) (based on a mean-rating, consistency, two-way mixed-effects model) were performed. We also used arithmetic mean values and modal frequency. Cronbach's Alpha was also calculated to ascertain reliability. Results were validated through a multi-institution consensus conference attended by Rwanda-based surgical specialists, general practitioners, medical students, surgical educators, and surgical association representatives using an inclusive, participatory, collaborative, agreement-seeking, and cooperative, a priori consensus decision-making model. Results Two-hundred and sixty-seven broad surgical content areas were identified through the initial round and presented to experts. In round 2, a total of 247 (92%) content areas reached 75% consensus among 31 experts. Topics that did not achieve consensus consisted broadly of small intestinal malignancies, rare hepatobiliary pathologies, and transplantation. In the final round, 99.6% of content areas reached 75% consensus among 31 experts. The highest prioritization was on wound healing, fluid and electrolyte management, and appendicitis, followed by metabolic response, infection, preoperative preparation, antibiotics, small bowel obstruction and perforation, breast infection, acute urinary retention, testicular torsion, hemorrhoids, and surgical ethics. Overall, the consistency and average agreement between panel experts was strong. ICC was 0.856 (95% CI: 0.83-0.87). Cronbach's Alpha for round 2 was very strong (0.985, 95% CI: 0.976-0.991) and higher than round 1, demonstrating strong reliability. All 246 topics from round 4 were verbally accepted by 40 participants in open forum discussions during the consensus conference. Conclusions A modified Delphi process and consensus were able to identify essential topics to be included within a highly contextualized, locally driven surgical clerkship curriculum delivered in rural Rwanda. Other contexts can use similar processes to develop relevant curricula.

International e-Delphi Consensus Recommendations for the Assessment and Diagnosis of Circadian rest-Activity Rhythm Disorders (CARDs) in Patients with Cancer

PURPOSE

Circadian rest-Activity Rhythm Disorders (CARDs) are common in patients with cancer, particularly in advanced disease. CARDs are associated with increased symptom burden, poorer quality of life, and shorter survival. Research and reporting practices lack standardization, and formal diagnostic criteria do not exist. This electronic Delphi (e-Delphi) study aimed to formulate international recommendations for the assessment and diagnosis of CARDs in patients with cancer.

METHODS

An international e-Delphi was performed using an online platform (Welphi). Round 1 developed statements regarding circadian rest-activity rhythms, diagnostic criteria, and assessment techniques. Rounds 2 and 3 involved participants rating their level of agreement with the statements and providing comments until consensus (defined internally as 67%) and stability between rounds were achieved. Recommendations were then created and distributed to participants for comments before being finalized.

RESULTS

Sixteen participants from nine different clinical specialties and seven different countries, with 5-35 years of relevant research experience, were recruited, and thirteen participants completed all three rounds. Of the 164 generated statements, 66% achieved consensus, and responses were stable between the final two rounds.

CONCLUSIONS

The e-Delphi resulted in international recommendations for assessing and diagnosing CARDs in patients with cancer. These recommendations should ensure standardized research and reporting practices in future studies.

A Novel Mobile App to Identify Patients With Multimorbidity in the Emergency Setting: Development of an App and Feasibility Trial

BACKGROUND

Multimorbidity is associated with an increased risk of poor surgical outcomes among older adults; however, identifying multimorbidity in the clinical setting can be a challenge.

OBJECTIVE

We created the Multimorbid Patient Identifier App (MMApp) to easily identify patients with multimorbidity identified by the presence of a Qualifying Comorbidity Set and tested its feasibility for use in future clinical research, validation, and eventually to guide clinical decision-making.

METHODS

We adapted the Qualifying Comorbidity Sets' claims-based definition of multimorbidity for clinical use through a modified Delphi approach and developed MMApp. A total of 10 residents input 5 hypothetical emergency general surgery patient scenarios, common among older adults, into the MMApp and examined MMApp test characteristics for a total of 50 trials. For MMApp, comorbidities selected for each scenario were recorded, along with the number of comorbidities correctly chosen, incorrectly chosen, and missed for each scenario. The sensitivity and specificity of identifying a patient as multimorbid using MMApp were calculated using composite data from all scenarios. To assess model feasibility, we compared the mean task completion by scenario to that of the American College of Surgeons National Surgical Quality Improvement Program Surgical Risk Calculator (ACS-NSQIP-SRC) using paired t tests. Usability and satisfaction with MMApp were assessed using an 18-item questionnaire administered immediately after completing all 5 scenarios.

RESULTS

There was no significant difference in the task completion time between the MMApp and the ACS-NSQIP-SRC for scenarios A (86.3 seconds vs 74.3 seconds, P=.85) or C (58.4 seconds vs 68.9 seconds,P=.064), MMapp took less time for scenarios B (76.1 seconds vs 87.4 seconds, P=.03) and E (20.7 seconds vs 73 seconds, P<.001), and more time for scenario D (78.8 seconds vs 58.5 seconds, P=.02). The MMApp identified multimorbidity with 96.7% (29/30) sensitivity and 95% (19/20) specificity. User feedback was positive regarding MMApp's usability, efficiency, and usefulness.

CONCLUSIONS

The MMApp identified multimorbidity with high sensitivity and specificity and did not require significantly more time to complete than a commonly used web-based risk-stratification tool for most scenarios. Mean user times were well under 2 minutes. Feedback was overall positive from residents regarding the usability and usefulness of this app, even in the emergency general surgery setting. It would be feasible to use MMApp to identify patients with multimorbidity in the emergency general surgery setting for validation, research, and eventual clinical use. This type of mobile app could serve as a template for other research teams to create a tool to easily screen participants for potential enrollment.

Delphi Consensus Among International Experts on the Diagnosis, Management, and Surveillance for Lentigo Maligna

INTRODUCTION

Melanoma of the lentigo maligna (LM) type is challenging. There is lack of consensus on the optimal diagnosis, treatment, and follow-up.

OBJECTIVES

To obtain general consensus on the diagnosis, treatment, and follow-up for LM.

METHODS

A modified Delphi method was used. The invited participants were either members of the International Dermoscopy Society, academic experts, or authors of published articles relating to skin cancer and melanoma. Participants were required to respond across three rounds using a 4-point Likert scale). Consensus was defined as >75% of participants agreeing/strongly agreeing or disagreeing/strongly disagreeing.

RESULTS

Of the 31 experts invited to participate in this Delphi study, 29 participants completed Round 1 (89.9% response rate), 25/31 completed Round 2 (77.5% response rate), and 25/31 completed Round 3 (77.5% response rate). Experts agreed that LM diagnosis should be based on a clinical and dermatoscopic approach (92%) followed by a biopsy. The most appropriate primary treatment of LM was deemed to be margin-controlled surgery (83.3%), although non-surgical modalities, especially imiquimod, were commonly used either as alternative off-label primary treatment in selected patients or as adjuvant therapy following surgery; 62% participants responded life-long clinical follow-up was needed for LM.

CONCLUSIONS

Clinical and histological diagnosis of LM is challenging and should be based on macroscopic, dermatoscopic, and RCM examination followed by a biopsy. Different treatment modalities and follow-up should be carefully discussed with the patient.

Development of evidence-based indicators for the detection of drug-related problems among ovarian cancer patients

Background: Antineoplastic drugs produce serious drug-related problems and their management is challenging. DRPs are critical, for saving on therapeutic costs, particularly in resource poor settings within low-middle-income countries such as India. Indicators are clues that helps to detect DRPs within the healthcare organization and minimize overall harm from medications. Indicators enable healthcare professionals to determine the future therapeutic course. And enable healthcare professionals to take a proactive stand, and stay informed and empowered to both prevent and manage DRPs. This study aims to develop evidence-based indicators for detecting potential drug-related problems in ovarian cancer patients. Patients and Methods: A retrospective study was conducted in the Department of Oncology of a tertiary care teaching hospital in South India. Based on literature search, we developed a list of indicators, which were validated by a Delphi panel of multidisciplinary healthcare professionals (16 members). Based on 2 years of ovarian cancer data, we performed a feasibility test retrospectively and classified the DRPs according to the Pharmaceutical Care Network Europe classification of DRPs version-9.1. Results: The feasibility test identified 130 out of 200 indicators. A total of 803 pDRPs were identified under four main categories: drug selection problem, drug use problem, adverse drug reaction and drug-drug interaction The most frequently observed were ADR 381 (47.45%), DDIs 354 (44.08%), and drug selection problems 62 (7.72%). Conclusion: Indicators developed by us effectively identified pDRPs in ovarian cancer patients, which can potentially help healthcare professionals in the early detection, timely management, and attenuating severity of DRPs. Identifying the pDDIs can potentially improve interdisciplinary involvement and task sharing, including enhanced pharmacists' participation within the healthcare team.

Building the foundation for a modern patient-partnered infrastructure to study temporomandibular disorders

Background

Conflicting reports from varying stakeholders related to prognosis and outcomes following placement of temporomandibular joint (TMJ) implants gave rise to the development of the TMJ Patient-Led RoundTable initiative. Following an assessment of the current availability of data, the RoundTable concluded that a strategically Coordinated Registry Network (CRN) is needed to collect and generate accessible data on temporomandibular disorder (TMD) and its care. The aim of this study was therefore to advance the clinical understanding, usage, and adoption of a core minimum dataset for TMD patients as the first foundational step toward building the CRN.

Methods

Candidate data elements were extracted from existing data sources and included in a Delphi survey administered to 92 participants. Data elements receiving less than 75% consensus were dropped. A purposive multi-stakeholder sub-group triangulated the items across patient and clinician-based experience to remove redundancies or duplicate items and reduce the response burden for both patients and clinicians. To reliably collect the identified data elements, the identified core minimum data elements were defined in the context of technical implementation within High-performance Integrated Virtual Environment (HIVE) web-application framework. HIVE was integrated with CHIOS™, an innovative permissioned blockchain platform, to strengthen the provenance of data captured in the registry and drive metadata to record all registry transaction and create a robust consent network.

Results

A total of 59 multi-stakeholder participants responded to the Delphi survey. The completion of the Delphi surveys followed by the application of the required group consensus threshold resulted in the selection of 397 data elements (254 for patient-generated data elements and 143 for clinician generated data elements). The infrastructure development and integration of HIVE and CHIOS™ was completed showing the maintenance of all data transaction information in blockchain, flexible recording of patient consent, data cataloging, and consent validation through smart contracts.

Conclusion

The identified data elements and development of the technological platform establishes a data infrastructure that facilitates the standardization and harmonization of data as well as perform high performance analytics needed to fully leverage the captured patient-generated data, clinical evidence, and other healthcare ecosystem data within the TMJ/TMD-CRN.

Developmental Strategy and Validation of the Midwifery Interventions Classification (MIC): A Delphi Study Protocol and Results from the Developmental Phase

This study protocol aims to describe the rationale and developmental strategy of the first study in the Italian context which aimed to define a Midwifery Interventions Classification, an evidence-based, standardized taxonomy and classification of midwifery interventions. Midwifery interventions require a specific definition, developed through a consensus-building process by stakeholders to develop the Italian taxonomy of the Midwifery Interventions Classification with the potential for international transferability, implementation, and scaling up. A multi-round Delphi study was designed between June and September 2022, and data collection is planned between February 2023 and February 2024. The developmental phase of the study is based on a literature review to select meaningful midwifery interventions from the international literature, aiming to identify an evidence-based list of midwifery interventions. This phase led to including 16 articles derived from a systematic search performed on PubMed, CINAHL, and Scopus; 164 midwifery interventions were selected from the data extraction performed on the 16 included articles. Healthcare professionals, researchers, and service users will be eligible panelists for the Delphi surveys. The protocol designed a dynamic number of consultation rounds based on the ratings and interim analysis. A nine-point Likert scoring system is designed to evaluate midwifery interventions. Attrition and attrition bias will be evaluated. The results from the study designed in this protocol will inform the development of the Italian taxonomy of the Midwifery Interventions Classification. A shared classification of midwifery interventions will support audit and quality improvement, education, and comparable data collections for research, sustaining public recognition of midwifery interventions to promote optimal maternal and newborn health.

Use of Delphi in health sciences research: A narrative review

The use of the Delphi technique is prevalent across health sciences research, and it is used to identify priorities, reach consensus on issues of importance and establish clinical guidelines. Thus, as a form of expert opinion research, it can address fundamental questions present in healthcare. However, there is little guidance on how to conduct them, resulting in heterogenous Delphi studies and methodological confusion. Therefore, the purpose of this review is to introduce the use of the Delphi method, assess the application of the Delphi technique within health sciences research, discuss areas of methodological uncertainty and propose recommendations. Advantages of the use of Delphi include anonymity, controlled feedback, flexibility for the choice of statistical analysis, and the ability to gather participants from geographically diverse areas. Areas of methodological uncertainty worthy of further discussion broadly include experts and data management. For experts, the definition and number of participants remain issues of contention, while there are ongoing difficulties with expert selection and retention. For data management, there are issues with data collection, defining consensus and methods of data analysis, such as percent agreement, central tendency, measures of dispersion, and inferential statistics. Overall, the use of Delphi addresses important issues present in health sciences research, but methodological issues remain. It is likely that the aggregation of future Delphi studies will eventually pave the way for more comprehensive reporting guidelines and subsequent methodological clarity.

Determining the Research Priorities for Adult Primary Brain Tumours in Australia and New Zealand: A Delphi Study with Consumers, Health Professionals, and Researchers

The aim of this project was to determine research priorities, barriers, and enablers for adult primary brain tumour research in Australia and New Zealand. Consumers, health professionals, and researchers were invited to participate in a two-phase modified Delphi study. Phase 1 comprised an initial online survey (n = 91) and then focus groups (n = 29) which identified 60 key research topics, 26 barriers, and 32 enablers. Phase 2 comprised two online surveys to (1) reduce the list to 37 research priorities which achieved consensus (>75% 2-point agreement) and had high mean importance ratings (n = 116 participants) and (2) determine the most important priorities, barriers, and enablers (n = 90 participants). The top ten ranked research priorities for the overall sample and sub-groups (consumers, health professionals, and researchers) were identified. Priorities focused on: tumour biology, pre-clinical research, clinical and translational research, and supportive care. Variations were seen between sub-groups. The top ten barriers to conducting brain tumour research related to funding and resources, accessibility and awareness of research, collaboration, and process. The top ten research enablers were funding and resources, collaboration, and workforce. The broad list of research priorities identified by this Delphi study, together with how consumers, health professionals, and researchers prioritised items differently, and provides an evidence-based research agenda for brain tumour research that is needed across a wide range of areas.

Using a Modified Delphi Approach and Nominal Group Technique for Organisational Priority Setting of Evidence-Based Interventions That Advance Women in Healthcare Leadership

BACKGROUND

Few studies address how to prioritise organisational interventions that advance women in leadership. We report on the relevance, feasibility and importance of evidence-based interventions for a large healthcare organisation. This study supports the first stage of implementation in a large National Health and Medical Research Council funded initiative seeking to advance women in healthcare leadership.

METHODS

An expert multi-disciplinary panel comprised of health professionals and leaders from a large healthcare network in Australia participated. The initial Delphi survey was administered online and results were presented in a Nominal Group Technique workshop. Here, the group made sense of the survey results, then evaluated findings against a framework on implementation criteria. Two further consensus surveys were conducted during the workshop.

RESULTS

Five priority areas were identified. These included: 1. A committed and supportive leadership team; 2. Improved governance structures; 3. Mentoring opportunities; 4. Leadership training and development; and 5. Flexibility in working. We describe the overall priority setting process in the context of our findings.

CONCLUSIONS

With evidence and expert input, we established priorities for advancing women in healthcare leadership with a partnering healthcare organisation. This approach can be adapted in other settings, seeking to advance women in leadership.

La gestione del trattamento del paziente con diagnosi di Lupus Eritematoso Sistemico: un’analisi di consenso Delphi

Background:

Systemic lupus erythematosus (SLE) is associated with clinical burden for the patient and organ damage. The development of therapies for SLE has been constrained by clinical and biologic heterogeneity. These represent challenges in clinical trial design and endpoint selection.

Objective:

To identify the most relevant descriptors for efficacy, endpoints, disease activity, organ damage, quality of life (QoL), and Patient Reported Outcome Measures (PROMs) in the treatment of SLE.

Methods:

A Delphi study was conducted using a national expert panel of clinicians in the treatment of SLE. A steering committee composed of 3 opinion leaders with deep expertise in SLE treatment was defined. The steering committee analyzed and appraised the evidence, designed the Delphi study, defined the statements, and analyzed the expert panel responses. A 2-round Delphi survey was conducted. Participants were asked to rate the statements using a five-point Likert scale.

Results:

Nine experts participated in the Delphi survey. After the two rounds, the consensus was reached on 18 of the 23 statements: 2 statements were included in the “efficacy” domain, 2 in the “glucocorticoid-sparing” domain, 2 in the “endpoint evaluation” domain, 4 in the “score” domain, 1 in the “disease activity” domain, 1 in the “organ damage” domain, 1 in the “QoL” domain, 2 in the “PROMs” domain, 1 in the “AIFA monitoring” domain and 2 in the “extra” domain. No statements reached consensus within the “onset” domain.

Conclusion:

In this Delphi study, 18 statements across 11 domains were agreed upon for the treatment of SLE.

Development of melanoma clinical quality indicators for the Australian melanoma clinical outcomes registry (MelCOR): A modified Delphi study

BACKGROUND

Clinical quality registries aim to identify significant variations in care and provide anonymised feedback to institutions to improve patient outcomes. Thirty-six Australian organisations with an interest in melanoma, raised funds through three consecutive Melanoma Marches, organised by Melanoma Institute Australia, to create a national Melanoma Clinical Outcomes Registry (MelCOR). This study aimed to formally develop valid clinical quality indicators for the diagnosis and early management of cutaneous melanoma as an important step in creating the registry.

METHODS

Potential clinical quality indicators were identified by examining the literature, including Australian and international melanoma guidelines, and by consulting with key melanoma and registry opinion leaders. A modified two-round Delphi survey method was used, with participants invited from relevant health professions routinely managing melanoma as well as relevant consumer organisations.

RESULTS

Nineteen participants completed at least one round of the Delphi process. 12 of 13 proposed clinical quality indictors met the validity criteria. The clinical quality indicators included acceptable biopsy method, appropriate excision margins, standardised pathology reporting, indications for sentinel lymph node biopsy, and involvement of multidisciplinary care and referrals.

CONCLUSION

This study provides a multi-stakeholder consensus for important clinical quality indicators that define optimal practice that will now be used in the Australian Melanoma Clinical Outcomes Registry (MelCOR).

Computational Study on the Function of Palmitoylation on the Envelope Protein in SARS-CoV-2

SARS-CoV-2 that caused COVID-19 has spread since the end of 2019. Its major effects resulted in over four million deaths around the whole world by August 2021. Therefore, understanding virulence mechanisms is important to prevent future outbreaks and for COVID-19 drug development. The envelope (E) protein is an important structural protein, affecting virus assembly and budding. The E protein pentamer is a viroporin, serving as an ion transferring channel in cells. In this work, we applied molecular dynamic simulations and topological and electrostatic analyses to study the effects of palmitoylation on the E protein pentamer. The results indicate that the cation transferring direction is more from the lumen to the cytosol. The structure of the palmitoylated E protein pentamer is more stable while the loss of palmitoylation caused the pore radius to reduce and even collapse. The electrostatic forces on the two sides of the palmitoylated E protein pentamer are more beneficial to attract cations in the lumen and to release cations into the cytosol. The results indicate the importance of palmitoylation, which can help the drug design for the treatment of COVID-19.

The Med-NKQ: A Reliable Mediterranean Diet Nutrition Knowledge Questionnaire for Cardiovascular Disease

The Mediterranean diet (MD) has significant benefits for cardiovascular disease (CVD), yet clinicians lack reliable tools to measure patient knowledge. This study aimed to develop a short tool to test knowledge of MD related to cardiac health. Themes included foods to reduce CVD risk factors, quantification of servings, and common MD dietary patterns; a maximum score of 42 was determined for correct responses. Content validity was assessed through expert consensus in a Delphi survey. A 70% level of agreement was set for each domain tested. Repeatability was assessed via a test-retest protocol in a sample with self-reported CVD, advertised through social media and administered online. Ten and six of twenty-five invited experts responded to round one and two of the Delphi survey respectively. All items achieved greater than 70% consensus. Twenty people completed the repeatability study. A paired t-test found no significant difference in mean scores between the two test periods (Test one, 28 (standard deviation (SD) 5.4). Test two 29.5, (SD 5.5), p = 0.174) and a Bland-Altman Plot indicated no bias between the two surveys. The Med-NKQ demonstrated good content validity and reliability in people with CVD, and is short and easy to administer, making it practical in clinical and research settings.

Establishing a critical pathway for Korean medical management of lumbar disc herniation: A modified Delphi consensus process

A modified Delphi method was used to establish a consensus. Stakeholders and experts were invited to participate in the expert panel. Best practice statements and decision-making questionnaires were distributed to the panel. Panel members were asked to mark "Strongly disagree" to "Strongly agree" after a series of statements over several rounds until either a consensus was reached or the decision-making method was deemed unsuitable for reaching a consensus.The most common cause of lumbar pain is intervertebral degeneration, which leads to degenerative disc disease and lumbar disc herniation. There is a lack of unanimity regarding appropriate patient protocols and rehabilitation expectations for Korean medical care. The long-term viability of Korean medical treatment, further adoption in the institutional setting, and specific patient outcomes are contingent on the existence of appropriate Korean medical programs.A Korean medical expert panel of 17 practitioners employed a modified Delphi method to achieve consensus on Korean medical care for lumbar disc herniation. The panel first reviewed the literature and guidelines relevant to Korean medical treatment for lumbar disc herniation. The panel members considered questionnaires intended to determine "standardized" Korean medical care recommendations for patients with a wide range of symptoms of lumbar disc herniation. Each panel member participated in a round of voting, which was followed by an opinion-collecting session online. Consensus was defined as a ≥75% agreement among the respondents.In the first round, 144 questionnaires across 5 domains were administered to the expert panels. After reviewing the responses and open-ended comments collected in the first round, the authors modified the questionnaires to 53 items and proceeded. In round 2, consensus was achieved in all 53 survey questions. The final treatment pathway comprised a standardized and comprehensive care approach for lumbar disc herniations in 4 types of medical institutions.This study identified a core set of evidence- and consensus-based principles that are essential to a comprehensive model of care, incorporating identification, referral, and management of patients with lumbar disc herniation.

International Delphi Expert Consensus on Safe Return to Surgical and Endoscopic Practice: From the Coronavirus Global Surgical Collaborative

OBJECTIVE

The aim of this work is to formulate recommendations based on global expert consensus to guide the surgical community on the safe resumption of surgical and endoscopic activities.

BACKGROUND

The COVID-19 pandemic has caused marked disruptions in the delivery of surgical care worldwide. A thoughtful, structured approach to resuming surgical services is necessary as the impact of COVID-19 becomes better controlled. The Coronavirus Global Surgical Collaborative sought to formulate, through rigorous scientific methodology, consensus-based recommendations in collaboration with a multidisciplinary group of international experts and policymakers.

METHODS

Recommendations were developed following a Delphi process. Domain topics were formulated and subsequently subdivided into questions pertinent to different aspects of surgical care in the COVID-19 crisis. Forty-four experts from 15 countries across 4 continents drafted statements based on the specific questions. Anonymous Delphi voting on the statements was performed in 2 rounds, as well as in a telepresence meeting.

RESULTS

One hundred statements were formulated across 10 domains. The statements addressed terminology, impact on procedural services, patient/staff safety, managing a backlog of surgeries, methods to restart and sustain surgical services, education, and research. Eighty-three of the statements were approved during the first round of Delphi voting, and 11 during the second round. A final telepresence meeting and discussion yielded acceptance of 5 other statements.

CONCLUSIONS

The Delphi process resulted in 99 recommendations. These consensus statements provide expert guidance, based on scientific methodology, for the safe resumption of surgical activities during the COVID-19 pandemic.

Adjunct therapies after botulinum toxin injections in spastic adults: systematic review and SOFMER recommendations

BACKGROUND

Adjunct therapies (ATs) may further improve outcomes after botulinum toxin injections in spastic patients, but evidence was unclear in previous systematic reviews.

OBJECTIVE

To assess the efficacy of non-pharmacological ATs in spastic adults according to the International Classification of Functioning, Disability and Health and build an expert consensus based on a Delphi process.

METHODS

Four electronic databases were searched up to May 2020 for reports of comparative trials of non-pharmacologic ATs after botulinum toxin injections in spastic adults. Then 25 French experts participated in a two-round Delphi process to build recommendations on the use of ATs.

RESULTS

We included 32 studies (1202 participants, median 32/study) evaluating the effects of physical agents (n=9), joint posture procedures (JPPs, n=11), and active ATs (n=14), mainly after stroke. The average quality of articles was good for randomised controlled trials (median [interquartile range] PEDro score = 7 [6-8]) but moderate (n=2) or poor (n=2) for non-randomised controlled trials (Downs & Black checklist). Meta-analysis was precluded owing to the heterogeneity of ATs, control groups and outcome measures. There is evidence for the use of JPPs except low-dose manual stretching and soft posture techniques. Continuous postures (by taping or casting) are recommended; discontinuous postures (by orthosis) may be preferred in patients with active function. Device-free or device-assisted active ATs may be beneficial in the mid-term (> 3 months after botulinum toxin injections), particularly when performed at a high intensity (>3 hr/week) as in constraint-induced movement therapy. Self-rehabilitation remains understudied after a focal treatment, but its interest is highlighted by the experts. The use of physical agents is not recommended.

CONCLUSIONS

JPPs and active ATs (device-assisted or device-free) may further improve impairments and activities after botulinum toxin injections. Further studies are needed to better define the best strategies for ATs as a function of the individual treatment goals, participation and quality of life. Review Registration. PROSPERO (CRD42018105856).

Evaluation of clinical trials for natural products used in diabetes: An evidence-based systemic literature review

BACKGROUND RELEVANCE

A plethora of literature is available regarding the clinical trials for natural products however; no information is available for critical assessments of the quality of these clinical trials.

AIM OF STUDY

This is a first time report to critically evaluate the efficacy, safety and large scale applications of up-to-date clinical trials for diabetes, based on the three scales of Jadad, Delphi, and Cochrane.

METHODOLOGY

An in-depth and extensive literature review was performed using various databases, journals, and books. The keywords searched included, "clinical trials," "clinical trial in diabetes," "diabetes," "natural products in diabetes," "ethnopharmacological relevance of natural products in diabetes," etc.

RESULTS

Based on eligibility criteria, 16 plants with 74 clinical trials were found and evaluated. Major drawbacks observed were; "non-randomization and blindness of the studies," "non-blindness of patients/healthcare/outcome assessors," "lack of patient compliance and co-intervention reports," "missing information regarding drop-out/withdrawal procedures," and "inappropriate baseline characteristics." Principal component analysis and Pearson correlation revealed four components with %variability; PC1: 23.12, PC2: 15.83, PC3: 13.11, and PC4: 11.38 (P ≤ .000). According to descriptive statistics, "non-blinding of outcome assessors" was the major drawback (82%) whereas, "not mentioning the timing of outcome assessment" was observed lowest (6.8%). An in-house quality grading (scale 0-24) classified these clinical trials as; poor (67.6%), acceptable (19.9%), and good quality trials (13.5%).

CONCLUSION

Proper measures in terms of more strict regulations with pharmacovigilance of plants are utmost needed in order to achieve quality compliance of clinical trials.

Identification and Ranking of Core Values in Family Medicine: A Mixed Methods Study From Ukraine

Introduction/Context: The term core value (CV) can be defined as fundamental beliefs or principles, guiding one's behavior in a social context. Though core competencies of family medicine (FM) have been clearly defined by WONCA, there has been an ongoing debate on what the CVs are for family doctors (FDs). Ukraine is a developing country in the middle of Europe with a population of 43 million inhabitants, gained independence from the Soviet Union in 1991. Ukraine is a low-income country, developing a modern European healthcare system, especially regarding FM. To implement WONCA standards, it is mandatory to assess the ongoing understanding of CVs in clinical daily practice among active FDs, working in different countries of Europe including Ukraine.

Research questions: How do Ukrainian FDs (Delphi group experts) define the CVs of FM in Ukraine and how important are these CVs to a wider population of Ukrainian FDs in their everyday practice?

Methods: A mixed method study was conducted in two steps during August and September 2020 in Ukraine. The first part was a qualitative Delphi round (three rounds) design among 20 Ukrainian FDs who were familiar with teaching and terms like CV. A consensus list of six CVs has emerged from the Delphi round study. The second part was a quantitative survey among Ukrainian FDs, who were not specially used to discussing CVs. The consensus list of those six CVs was then submitted to 2000 FDs (randomly selected) who were not involved in the Delphi team, to rank those values from one to nine, according to the importance from their personal point of view. Demographic characteristics have been assessed for all the participants of the Delphi round and quantitative survey.

Results: Twenty FDs were involved as experts in the first Delphi round, whereas only five experts continued their participation in the second and the third rounds of the survey. The following six CVs emerged from the Delphi round: comprehensive approach, care coordination, first recourse, continuity of care, integrated approach, and patient and family centered care. The final sample consisted of 375 FDs (19% response rate). There were 323 (88.7%) female and 34 (9.3%) male FDs in the sample. The mean age of the participants was 44.6±13.5 years.

Discussion/Conclusion: Defining CVs for FM by Ukrainian FDs in a given socio-economical and historical-cultural setting is crucial to optimize primary medical care and to guarantee an appropriate and successful implementation of WONCA standards as well as CVs in different countries including those where reformation of the health system is ongoing.

SPIRALS: An Approach to Non-Linear Thinking for Medical Students in the Emergency Department

Context

We lack guidelines to inform the necessary components of an emergency medicine undergraduate rotation. Traditionally, clinical reasoning has been taught using linear thought processes likely not ideal for diagnostic and management decisions made in the emergency department. 

Methods

We used the Delphi method to obtain consensus on a set of competencies for undergraduate emergency medicine that illustrate the non-linear concepts we believe are necessary for learners. Competencies were informed by a naturalistic observational study of emergency physicians. A survey outlining these competencies was subsequently circulated to emergency physicians who rated their relative importance.

Results

Eleven competencies were included in Round 1, all rated within the “for consideration” for inclusion range. This was reduced to 10 competencies in Round 2, which was only marginally more definitive with respondents rating one competency in the “definite inclusion range” and the remaining in the “for consideration” range. 

Conclusions

This study was conducted to address a gap in the current undergraduate emergency medicine curriculum. Consensus on the relative importance of each competency was not achieved, though we believe that the competencies that arose from this study will help medical students develop the non-linear thinking processes necessary to succeed in emergency medicine. 

Capturing the Effects of Explicit Waters in Implicit Electrostatics Modeling: Qualitative Justification of Gaussian-Based Dielectric Models in DelPhi

Our group has implemented a smooth Gaussian-based dielectric function in DelPhi (J. Chem. Theory Comput. 2013, 9 (4), 2126-2136) which models the solute as an object with inhomogeneous dielectric permittivity and provides a smooth transition of dielectric permittivity from surface-bound water to bulk solvent. Although it is well-understood that the protein hydrophobic core is less polarizable than the hydrophilic protein surface, less attention is paid to the polarizability of water molecules inside the solute and on its surface. Here, we apply explicit water simulations to study the behavior of water molecules buried inside a protein and on the surface of that protein and contrast it with the behavior of the bulk water. We selected a protein that is experimentally shown to have five cavities, most of which are occupied by water molecules. We demonstrate through molecular dynamics (MD) simulations that the behavior of water in the cavity is drastically different from that in the bulk. These observations were made by comparing the mean residence times, dipole orientation relaxation times, and average dipole moment fluctuations. We also show that the bulk region has a nonuniform distribution of these tempo-spatial properties. From the perspective of continuum electrostatics, we argue that the dielectric "constant" in water-filled cavities of proteins and the space close to the molecular surface should differ from that assigned to the bulk water. This provides support for the Gaussian-based smooth dielectric model for solving electrostatics in the Poisson-Boltzmann equation framework. Furthermore, we demonstrate that using a well-parametrized Gaussian-based model with a single energy-minimized configuration of a protein can also reproduce its ensemble-averaged polar solvation energy. Thus, we argue that the Gaussian-based smooth dielectric model not only captures accurate physics but also provides an efficient way of computing ensemble-averaged quantities.

Delphi method to identify expert opinion to support children's cancer referral guidelines

BACKGROUND

The National Institute for Health and Care Excellence (NICE) guidance for referral of children with suspected cancer was first published in 2005 and updated in 2015. The updated version relied on sparse primary care evidence and published without input from key stakeholders, for example, acute general paediatricians and paediatric haematologists/oncologists. This led to a document that fell short as a practical guide for referring physicians managing children with potentially life-threatening conditions. Following discussions between the Children's Cancer and Leukaemia Group (CCLG, the UK multidisciplinary professional body for healthcare professionals caring for children with cancer) and NICE, it was agreed that a practical supplement should be produced for the 2015 guidance. A prerequisite was evidence gathering from tertiary care to balance the existing primary care evidence, and a Delphi consensus method was therefore convened.

METHODS

A CCLG NICE Guidance Committee formulated 25 draft statements for review. The CCLG emailed its paediatric haematologist/oncologist membership (n=179) and 88 responded (49%). To achieve consensus, statements required ≥70% agreement from ≥60% of actual respondents, from the denominator (n=88).

RESULTS

Fifteen of 25 original statements were accepted at the first round of voting. Three of 25 statements where >50% did not support were rejected outright. One statement could not be revised without replicating a previously accepted statement. The six remaining statements were revised and a second round of voting undertaken; all six revised statements were accepted. Overall, 21 of 25 statements (84%) met consensus criteria.

CONCLUSIONS

This expert opinion should help streamline suspected cancer referral in children and help optimise subsequent outcomes.

Emerging Innovations and Professional Skills Needed Within Pharmacy Curricula

To ensure students are prepared for the rapidly evolving world of health care, curricula must be aligned with emerging innovations, as well as professional skills likely to influence students' abilities to be successful. At the 2019 annual meeting of PharmAlliance institutions, we asked experts to identify innovations and professional skills necessary for the future of pharmacy practice. Experts identified a wide range of topics, including personalized and precision medicine, digital health, interprofessional collaboration, clinical decision making, and overcoming complexity and ambiguity. While these findings are useful for informing curriculum content, we must also commit to ensuring our pharmacy curricula are emerging, forward thinking, and effective at preparing students for the challenges in health care.

Development of core outcome sets for vision screening and assessment in stroke: a Delphi and consensus study

OBJECTIVES

Visual impairment following stroke is common with a reported incidence of visual impairment in 60% of stroke survivors. Screening for visual impairment is neither routine nor standardised. This results in a health inequality where some stroke survivors receive comprehensive vision assessment to identify any existent visual problems while others receive no vision assessment leaving them with unmet needs from undiagnosed visual problems. The aim of this study was to define two core outcome sets (COS), one for vision screening and one for full visual assessment of stroke survivors.

DESIGN

A list of potentially relevant visual assessments was created from a review of the literature. The consensus process consisted of an online 3-round Delphi survey followed by a consensus meeting of the key stakeholders.

PARTICIPANTS

Stakeholders included orthoptists, occupational therapists, ophthalmologists, stroke survivors and COS users such as researchers, journal editors and guideline developers.

SETTING

University.

OUTCOME MEASURES

COS.

RESULTS

Following the consensus process we recommend the following nine assessments for vision screening: case history, clinical observations of visual signs, visual acuity, eye alignment position, eye movement assessment, visual field assessment, visual neglect assessment, functional vision assessment and reading assessment. We recommend the following 11 assessments for full vision assessment: case history, observations, visual acuity, eye alignment position, eye movement assessment, binocular vision assessment, eye position measurement, visual field assessment, visual neglect assessment, functional vision assessment, reading assessment and quality of life questionnaires.

CONCLUSIONS

COS are defined for vision screening and full vision assessment for stroke survivors. There is potential for their use in reducing heterogeneity in routine clinical practice and for improving standardisation and accuracy of vision assessment. Future research is required to evaluate the use of these COS and for further exploration of core outcome measures.

Primary care financing: a systematic assessment of research priorities in low- and middle-income countries

INTRODUCTION

Financing of primary healthcare (PHC) is the key to the provision of equitable universal care. We aimed to identify and prioritise the perceived needs of PHC practitioners and researchers for new research in low- and middle-income countries (LMIC) about financing of PHC.

METHODS

Three-round expert panel consultation using web-based surveys of LMIC PHC practitioners, academics and policy-makers sampled from global networks. Iterative literature review conducted in parallel. First round (Pre-Delphi survey) elicited possible research questions to address knowledge gaps about financing. Responses were independently coded, collapsed and synthesised to two lists of questions. Round 2 (Delphi Round 1) invited panellists to rate importance of each question. In Round 3 (Delphi Round 2), panellists ranked questions in order of importance.

RESULTS

A diverse range of PHC practitioners, academics and policy-makers in LMIC representing all global regions identified 479 knowledge gaps as potentially critical to improving PHC financing. Round 2 provided 31 synthesised questions on financing for rating. The top 16 were ranked in Round 3e to produce four prioritised research questions.

CONCLUSIONS

This novel exercise created an expansive and prioritised list of critical knowledge gaps in PHC financing research questions. This offers valuable guidance to global supporters of primary care evaluation and implementation, including research funders and academics seeking research priorities. The source and context specificity of this research, informed by LMIC practitioners and academics on a global and local basis, should increase the likelihood of local relevance and eventual success in implementing the findings.

Research gaps in the organisation of primary healthcare in low-income and middle-income countries and ways to address them: a mixed-methods approach

Introduction

Since the Alma-Ata Declaration 40 years ago, primary healthcare (PHC) has made great advances, but there is insufficient research on models of care and outcomes—particularly for low-income and middle-income countries (LMICs). Systematic efforts to identify these gaps and develop evidence-based strategies for improvement in LMICs has been lacking. We report on a global effort to identify and prioritise the knowledge needs of PHC practitioners and researchers in LMICs about PHC organisation.

Methods

Three-round modified Delphi using web-based surveys. PHC practitioners and academics and policy-makers from LMICs sampled from global networks. First round (pre-Delphi survey) collated possible research questions to address knowledge gaps about organisation. Responses were independently coded, collapsed and synthesised. Round 2 (Delphi round 1) invited panellists to rate importance of each question. In round 3 (Delphi round 2), panellists ranked questions into final order of importance. Literature review conducted on 36 questions and gap map generated.

Results

Diverse range of practitioners and academics in LMICs from all global regions generated 744 questions for PHC organisation. In round 2, 36 synthesised questions on organisation were rated. In round 3, the top 16 questions were ranked to yield four prioritised questions in each area. Literature reviews confirmed gap in evidence on prioritised questions in LMICs.

Conclusion

In line with the 2018 Astana Declaration, this mixed-methods study has produced a unique list of essential gaps in our knowledge of how best to organise PHC, priority-ordered by LMIC expert informants capable of shaping their mitigation. Research teams in LMIC have developed implementation plans to answer the top four ranked research questions.

Establishing a core outcome set for treatment of uncomplicated appendicitis in children: study protocol for an international Delphi survey

INTRODUCTION

Appendicitis is a global disease affecting roughly 1 in every 12 people in the world, with the highest incidence between ages 10 and 19 years. To date, a wide variety of health outcomes have been reported in randomised controlled trials and meta-analyses evaluating treatments for appendicitis. This is especially the case in studies comparing non-operative treatment with operative treatment. A set of standard outcomes, to be reported in all future trials, is needed to allow for adequate comparison and interpretation of clinical trial results and to make data pooling possible. This protocol describes the development of such a global core outcome set (COS) to allow unified reporting of treatment interventions in children with acute uncomplicated appendicitis.

METHODS AND ANALYSIS

We use current international standard methodology for the development and reporting of this COS. Its development consists of three phases: (1) an update of the most recent systematic review on outcomes reported in uncomplicated paediatric appendicitis research to identify additional outcomes, (2) a three-step global Delphi study to identify a set of core outcomes for which there is consensus between parents and (paediatric) surgeons and (3) an expert meeting to finalise the COS and its definitions. Children and young people will be involved through their parents during phase 2 and will be engaged directly using a customised face-to-face approach.

ETHICS AND DISSEMINATION

The medical research ethics committee of the Academic Medical Center Amsterdam has approved the study. Each participating country/research group will ascertain ethics board approval. Electronic informed consent will be obtained from all participants. Results will be presented in peer-reviewed academic journals and at (international) conferences.

TRIAL REGISTRATION NUMBER

COMET registration: 1119.

A new understanding of health related empowerment in the context of an active and healthy ageing

BACKGROUND

Recently, several initiatives have focused on how to create true person-centred health services. This calls for a new understanding of health-related empowerment in relation to people living with one or more chronic conditions. We report on a Delphi investigation among participants in the European Innovation Partnership on Active and Healthy Ageing that has led to a new understanding of health-related empowerment.

METHODS

The Delphi process was conducted in three sequential rounds. In the first round, we presented a suggested first version for a definition of "health-related empowerment" divided into nine statements. One hundred and twenty-two experts were then asked if they agreed or not with each individual statement, and in the case they disagreed, to state the reasons for their disagreement. After revisions, the experts who had replied to the first version were asked again, if they agreed or not with each individual statement of the second version and to elaborate on disagreements. Finally, in the third round the experts were asked to provide comments to the final proposed definition in general and not by each statement.

RESULTS

A total of 33 experts responded to the first version. The following revision included a merging of two statements, and the addition of health literacy as part of the understanding. The second version was sent out to the 33 experts and a total of 19 experts commented with moderate consensus. Changes included removal of "self-esteem" and change of "self-confidence" to confidence. Third version was sent out to all 122 experts with 16 respondents. Strong consensus was obtained for this third version, and is with one minor change presented as the final version.

CONCLUSION

We propose a new understanding of the concept health-related empowerment, by focusing on the individual as a co-manager with freedom to choose and focus on their own well-being.

Development of a core outcome set for behavioural weight management programmes for adults with overweight and obesity: protocol for obtaining expert consensus using Delphi methodology

INTRODUCTION

Weight management interventions in research studies and in clinical practice differ in length, advice, frequency of meetings, staff and cost. Very few real-world programmes have published patient-related outcomes, and those that have published used different ways of reporting the information, making it impossible to compare interventions and further develop the evidence base. Developing a core outcome set for behavioural weight management programmes (BWMPs) for adults with overweight and obesity will allow different BWMPs to be compared and reveal which interventions work best for which members of the population.

METHODS AND ANALYSIS

An expert group, comprised of 40 people who work in, refer to, or attend BWMPs for adults with overweight and obesity, will be asked to decide which outcomes services should report. An online Delphi process will be employed to help the group reach consensus as to which outcomes should be measured and reported, and which definitions/instruments should be used in order to do so. The first stage of the Delphi process (three rounds of questionnaires) will focus on outcomes while the second stage (three additional rounds of questionnaires) will focus on definition/instrument selection.

ETHICS AND DISSEMINATION

Ethical approval for this study has been received from the University of Glasgow College of Medical, Veterinary and Life Sciences Ethics Committee. With regard to disseminating results, a report will be submitted to our funding body, the Chief Scientist Office of the Scottish Government Health Department. In addition, early findings will be shared with Public Health England and Health Scotland, and results communicated via conference presentations, peer review publication and our institutions' social media platforms.

Identifying priorities for cancer caregiver interventions: protocol for a three-round modified Delphi study

INTRODUCTION

Cancer is often considered a chronic disease, and most people with cancer have a caregiver, often a family member or friend who provides a significant amount of care during the illness trajectory. Caregivers are frequently in need of support, and a range of interventions have been trialled to improve outcomes. Consensus for optimal ways to support caregivers is not known. The aim of this protocol paper is to describe procedures for a modified Delphi study to explore expert consensus about important factors when developing caregiver interventions.

METHODS AND ANALYSIS

Online modified Delphi methodology will be used to establish consensus for important caregiver intervention factors incorporating the Patient problem, Intervention, Comparison and Outcome framework. Round 1 will comprise a free-text questionnaire and invite the panel to contribute factors they deem important in the development and evaluation of caregiver interventions. Round 2 is designed to determine preliminary consensus of the importance of factors generated in round 1. The panel will be asked to rate each factor using a 4-point Likert-type scale. The option for panellists to state reasoning for their rating will be provided. Descriptive statistics (median scores and IQR) will be calculated to determine each item's relative importance. Levels of consensus will be assessed based on a predefined consensus rating matrix. In round 3, factors will be recirculated including aggregate group responses (statistics and comment summaries) and panellists' own round 2 scores. Panellists will be invited to reconsider their judgements and resubmit ratings using the same rating system as in round 2. This will result in priority lists based on the panel's total rating scores.

ETHICS AND DISSEMINATION

Ethics for this study has been gained from the Deakin University Human Ethics Advisory Group. It is anticipated that the results will be published in peer-reviewed journals and presented in a variety of forums.

Development of a global health bachelor curriculum in China: a Delphi study

OBJECTIVE

This study aimed to establish the first global health bachelor curriculum in China.

DESIGN

The Delphi methodology was used to determine expert consensus on which courses should be included in the global health bachelor curriculum. A literature review and a workshop proceeding were performed to generate courses. Then a two-round Delphi process was conducted with 28 invited experts from universities, health administrative departments and non-governmental organisations to rate courses using a 5-point Likert scale. Additionally, the experts could alter, add or delete courses as appropriate. Consensus was predefined as a mean score of 4 or above and the percent agreement (proportion of panel members scoring 'very important' or 'important') no less than 75%.

RESULTS

The responses in the two-round Delphi process were 85.7% and 70.8%, respectively. In the first round, 12 courses did not meet the inclusion criteria and were removed. Based on the participants' comments, 32 courses were included in round 2. In the second round, the consensus was reached on 31 courses which were selected as the final curriculum. These courses were categorised into five modules, including General Knowledge, Methodology, Global Health Issues, Intercultural Communication, and Health Policy and Programme Management.

CONCLUSION

This study established the first global health bachelor curriculum in China. It will provide guidance for other educational institutions to develop similar programmes or curricula in the future.

Establishing an Operational Definition of Sarcopenia in Australia and New Zealand: Delphi Method Based Consensus Statement

BACKGROUND

Globally there are several operational definitions for sarcopenia, complicating clinical and research applications.

OBJECTIVE

The objective of the Australian and New Zealand Society for Sarcopenia and Frailty Research (ANZSSFR) Task Force on Diagnostic Criteria for Sarcopenia was to reach consensus on the operational definition of sarcopenia for regional use by clinicians and researchers.

METHOD

A four-Phase modified Delphi process was undertaken in which 24 individuals with expertise or a recognised interest in sarcopenia from different fields across Australia and New Zealand were invited to be Task Force members. An initial face-to-face meeting was held in Adelaide, South Australia, in November 2017, followed by two subsequent online Phases conducted by electronic surveys. A final Phase was used to approve the final statements. Responses were analysed using a pre-specified strategy. The level of agreement required for consensus was 80%.

RESULTS

In Phase 2, 94.1% of Task Force respondents voted in favour of adopting an existing operational definition of sarcopenia. In Phase 3, 94.4% of respondents voted in favour of adopting the European Working Group on Sarcopenia in Older People (EWGSOP) definition as the operational definition for sarcopenia in Australia and New Zealand.

CONCLUSION

With consensus achieved, the ANZSSFR will adopt, promote and validate the EWGSOP operational definition of sarcopenia for use by clinicians and researchers in Australia and New Zealand.

Diagnosis and follow-up of patients with Hunter syndrome in Spain: A Delphi consensus

Hunter syndrome or mucopolysaccharidosis type II (MPSII) is a progressive multisystem X-linked lysosomal storage disease caused by mutations in the IDS gene that shows a wide spectrum of clinical symptoms and severity. Idursulfase, a specific enzyme replacement therapy (ERT) for MPSII, has been available since 2007. ERT, along with symptomatic management of patients, is fundamental for improving patient prognosis and quality of life. The aims of this study were to investigate whether Spanish pediatricians who are experts in managing the disease agreed with current international guidelines regarding MPSII patient diagnosis and follow-up; and to reach a consensus regarding which items are essential for the diagnosis, follow-up, and treatment of these patients in Spain.An advisory panel of 5 experts from the Hunter Spanish Working Group reviewed key studies, developed a questionnaire based on a modified Delphi method, sent the questionnaire to selected experts, and reviewed the responses. The final questionnaire had 83 items in the following categories: diagnosis, ERT considerations after diagnosis, Periodic assessments, and ERT considerations during follow-up. A total of 85 experts were invited to participate; 28 (35%) responded and showed a strong consensus for most items. The advisory panel decided not to perform a second Delphi round. There was strong agreement (>3.1 median value; range, 1 to 4) for 43/56 items in Diagnosis, for 4/6 items in "ERT considerations after diagnosis," for 6/16 items in "Periodic assessments," and for 3/5 items in "ERT considerations during follow-up." Most responses were in agreement with international guidelines, and controversial items were discussed by the advisory panel. Based on the results, on the key studies, and on clinical experience and opinions, the panel developed and scheduled recommendations for the diagnosis and follow-up of patients with MPSII.An expert 5-person panel oversaw a Delphi survey of 28 pediatricians and reached a consensus on recommendations for the diagnosis and follow-up of MPSII patients. This document will help guide clinicians involved in the diagnosis, management, and treatment of MPSII.

Core outcome research measures in anal cancer (CORMAC): protocol for systematic review, qualitative interviews and Delphi survey to develop a core outcome set in anal cancer

INTRODUCTION

The incidence of anal squamous cell carcinoma (ASCC) has increased threefold in the last 30 years. Initial treatment is chemoradiotherapy, associated with short-term and long-term side effects. Future therapy innovations aim to reduce morbidity in treatment of early tumours while maintaining treatment efficacy, and to escalate treatment intensity in locally advanced tumours with acceptable quality of life (QoL). However, all phase III randomised controlled trials to-date have utilised different primary outcomes, which hinders evidence synthesis and presents challenges to the selection of optimal outcomes in future trials. No trial comprehensively assessed long-term side effects and QoL, suggesting outcomes reflecting issues important to patients are under-represented. This project aims to determine the priority outcomes for all stakeholders and reach agreement on a standardised core set of outcomes to be measured and reported on in all future ASCC trials.

METHODS AND ANALYSIS

A systematic review will identify all outcomes reported in trials and observational studies of chemoradiotherapy as primary treatment for ASCC. Outcomes of importance to patients will be identified through patient interviews. The long list of outcomes generated from the systematic review and interviews will be used to create a two-round Delphi process, including key stakeholders (patients and healthcare professionals). The results of the Delphi will be discussed at a face-to-face consensus meeting. Discussion will focus on outcomes that did not achieve consensus through the Delphi process and conclude with anonymous voting to ratify the final core outcome set (COS).

ETHICS AND DISSEMINATION

The final COS will feed directly into the PersonaLising Anal cancer radioTherapy dOse (PLATO) national anal cancer trials and the Association of coloproctologists of Great Britain and Ireland (ACPGBI) supported national anal cancer database. Utilisation of the COS will increase the relevance of research output to all stakeholders and increase the capacity for data synthesis between trials. This study has ethical approval and is registered with the Core Outcome Measures in Effectiveness Trials (COMET) initiative.

TRIAL REGISTRATION NUMBER

PROSPERO registration ID: CRD42016036540.

Core Outcome Sets in Miscarriage Trials (COSMisT) study: a study protocol

INTRODUCTION

'Core outcome sets' are an agreed, standardised set of outcomes based on what key stakeholders (clinicians, patients, their partners, researchers, service developers, funding organisations and so on) consider the important outcomes in the management or prevention of a condition. This paper describes the rationale and design for the development of Core Outcome Sets for Miscarriage Trials.

METHODS AND ANALYSIS

Systematic reviews, interviews and focus groups with patients and their partners will be conducted to identify potential core outcomes that will be introduced into a modified Delphi survey. To ensure all key stakeholders are included, patients, partners, clinicians, charities and researchers will be invited to take part in the modified Delphi survey. There will be three rounds of scoring and rescoring during the Delphi survey to reach consensus regarding outcomes to be included in the core set, which will be subsequently refined through face-to-face consensus discussions.

ETHICS AND DISSEMINATION

The use of core outcome sets allows results from different studies to be compared and combined, thereby reducing inconsistency and aiding interpretation of study findings. It also means research is more likely to report relevant outcomes and so can reduce reporting bias. Understanding which outcomes are important to patients has the potential to act as a driver to improve both the quality and cost-effectiveness of miscarriage services.

Reaching consensus on reporting patient and public involvement (PPI) in research: methods and lessons learned from the development of reporting guidelines

INTRODUCTION

Patient and public involvement (PPI) is inconsistently reported in health and social care research. Improving the quality of how PPI is reported is critical in developing a higher quality evidence base to gain a better insight into the methods and impact of PPI. This paper describes the methods used to develop and gain consensus on guidelines for reporting PPI in research studies (updated version of the Guidance for Reporting Patient and Public Involvement (GRIPP2)).

METHODS

There were three key stages in the development of GRIPP2: identification of key items for the guideline from systematic review evidence of the impact of PPI on health research and health services, a three-phase online Delphi survey with a diverse sample of experts in PPI to gain consensus on included items and a face-to-face consensus meeting to finalise and reach definitive agreement on GRIPP2. Challenges and lessons learnt during the development of the reporting guidelines are reported.

DISCUSSION

The process of reaching consensus is vital within the development of guidelines and policy directions, although debate around how best to reach consensus is still needed. This paper discusses the critical stages of consensus development as applied to the development of consensus for GRIPP2 and discusses the benefits and challenges of consensus development.

Optimizing patient and public involvement (PPI): Identifying its "essential" and "desirable" principles using a systematic review and modified Delphi methodology

Background

There is international interest in the active involvement of patients and the public. However, consensus on how best to optimize its application is currently unavailable.

Objective

To identify and assess the underlying principles of patient and public involvement (PPI) in health and social care services, research, education and regulation across medicine, dentistry and nursing.

Design

A four‐phase methodology: (i) an extensive systematic review of published and grey literature; (ii) inductive thematic analysis of review findings; (iii) development of best practice principles; and (iv) consensus testing of identified principles using a modified Delphi methodology.

Setting and participants

Twelve systematic reviews and 88 grey literature publications were reviewed leading to the unique identification of 13 principles later assessed by 18 PPI experts.

Results

Essential consensus (>75% agreement) was obtained for nine principles reviewed. Working in equal partnership and sharing information achieved the highest consensus rates: 16/17 essential 94.1%; 1/17 desirable 5.8%. The four remaining principles that failed to reach essential consensus were categorized as desirable by expert respondents. No principles were considered irrelevant. No alternatives were suggested.

Discussion

Expert respondents suggest essential principles must be achieved to optimize PPI best practice. To advance PPI practice, desirable principles should also be aspired to wherever possible.

Conclusions

This study's innovative approach advances existing knowledge by providing previously unavailable consensus about PPI best practice. Research findings hold important theoretical and practical implications for educators, regulators, researchers and practitioners looking to effectively work together.

Prioritizing novel and existing ambulance performance measures through expert and lay consensus: A three-stage multimethod consensus study

Background

Current ambulance quality and performance measures, such as response times, do not reflect the wider scope of care that services now provide. Using a three‐stage consensus process, we aimed to identify new ways of measuring ambulance service quality and performance that represent service provider and public perspectives.

Design

A multistakeholder consensus event, modified Delphi study, and patient and public consensus workshop.

Setting and participants

Representatives from ambulance services, patient and public involvement (PPI) groups, emergency care clinical academics, commissioners and policymakers.

Results

Nine measures/principles were highly prioritized by >75% of consensus event participants, including measures relating to pain, patient experience, accuracy of dispatch decisions and patient safety. Twenty experts participated in two Delphi rounds to further refine and prioritize measures; 20 measures in three domains scored ≥8/9, indicating good consensus, including proportion of calls correctly prioritized, time to definitive care and measures related to pain. Eighteen patient/public representatives attended a consensus workshop, and six measures were identified as important. These include time to definitive care, response time, reduction in pain scores, calls correctly prioritized to appropriate levels of response and survival to hospital discharge for treatable emergency conditions.

Conclusions

Using consensus methods, we identified a shortlist of ambulance outcome and performance measures that are important to ambulance clinicians and service providers, service users, commissioners, and clinical academics, reflecting current pre‐hospital ambulance care and services. The measures can potentially be used to assess pre‐hospital quality or performance over time, with most calculated using routinely available data.

Development of quality indicators for transition from pediatric to adult care in sickle cell disease: A modified Delphi survey of adult providers

BACKGROUND

Transition from pediatric to adult care is a vulnerable time for young adults with sickle cell disease (SCD); however, improvements in transition are limited by a lack of quality indicators. The purpose of this study was to establish quality indicators for transition in SCD and to determine the optimal timing between the final pediatric visit and the first adult provider visit.

PROCEDURE

We conducted a modified Delphi survey to reach a consensus on which quality indicators are most important for a successful transition. Our expert panel consisted of members of the Sickle Cell Adult Provider Network. In the first round, the participants ranked a list of quality indicators by importance. In the second round, the participants chose their "top 5" quality indicators in terms of importance and also ranked them on feasibility.

RESULTS

The response rates for the two rounds were 68 and 96%, respectively. Nine quality indicators were chosen as "top 5" by a majority of respondents, including communication between pediatric and adult providers, timing of first adult visit, patient self-efficacy, quality of life, and trust with their adult provider. Based on the comments from round 1, respondents were also asked for the optimal timing between leaving pediatric care and entering adult care. Most recommended a first adult visit within 2 months of the final pediatric visit.

CONCLUSIONS

By using these quality indicators chosen by the majority of respondents, we can better develop and evaluate transition programs for young adults with SCD and improve health outcomes for these vulnerable patients.