A critical review of the Delphi technique as a research methodology for nursing

Enhancing routine immunization efforts for older adults and frail individuals: Good practices during the SARS-CoV-2 pandemic in Italy

Infectious diseases pose a significant burden on the general population, particularly older adults who are more susceptible to severe complications. Immunization plays a crucial role in preventing infections and securing a healthier aging, but actual vaccination rates among older adults and frail individuals (OAFs) remains far from recommended targets. This study aims to collect and share good practices implemented in several Italian local health districts during the SARS-CoV-2 pandemic to ease routine immunization for OAFs. A 28-items questionnaire has been developed to collect information on organization aspect of immunization services and local good practices implemented before and during the SARS-CoV-2 pandemic. Twelve Public Health managers representative of 9 Italian Regions were further interviewed between January and March 2021. Despite literature suggests several effective interventions to increase vaccine demand, improve vaccine access, and enhance healthcare providers' performance, our survey highlighted substantial heterogeneity in their implementation at local level. Seven good local practices have been identified and described: mass vaccination centers; vaccination mobile units; drive-through vaccination; co-administration; tailored pathways; cooperation among providers involved in vaccination; digitization. Our survey pointed out valuable strategies for enhancing routine immunization for OAFs. Providers should combine effective interventions adequate to their specific context and share good practices.

Defining practices suitable for care via teleconsultation in gynaecological and obstetrical care: a French Delphi survey

OBJECTIVE

Delineate the scope of teleconsultation services that can be effectively performed to provide women with comprehensive gynaecological and obstetrical care.

DESIGN

Based on the literature and experts' insights, we identified a list of gynaecological and obstetrical care practices suitable for teleconsultation. A three-round Delphi consensus survey was then conducted online among a panel of French experts. Experts using a 9-point Likert scale assessed the relevance of each teleconsultation practice in four key domains: prevention, gynaecology and antenatal and postnatal care. Consensus was determined by applying a dual-criteria approach: the median score on a 9-point Likert scale and the percentage of votes either below 5 or 5 and higher.

SETTING

The study was conducted at a national level in France and involved multiple healthcare centres and professionals from various geographical locations.

PARTICIPANTS

The panel comprised 22 French experts with 19 healthcare professionals, including 12 midwives, 3 obstetricians-gynaecologists, 4 general practitioners and 3 healthcare system users. Participants were selected to include diverse practice settings encompassing hospital and private practices in both rural and urban areas.

PRIMARY AND SECONDARY OUTCOME MEASURES

The study's primary outcome was the identification of gynaecological and obstetrical care practices suitable for teleconsultation. Secondary outcomes included the level of professional consensus on these practices.

RESULTS

In total, 71 practices were included in the Delphi survey. The practices approved for teleconsultation were distributed as follows: 92% in prevention (n=12/13), 55% in gynaecology (n=18/33), 31% in prenatal care (n=5/16) and 12% in postnatal care (n=1/9). Lastly, 10 practices remained under discussion: 7 in gynaecology, 2 in prenatal care and 1 in postnatal care.

CONCLUSIONS

Our consensus survey highlights both the advantages and limitations of teleconsultations for women's gynaecological and obstetrical care, emphasising the need for careful consideration and tailored implementation.

Nurses' roles and responsibilities in cardiac advanced life support: A single-site eDelphi study

BACKGROUND

Nurses are often the first responders to in-hospital cardiac arrest in postoperative cardiac surgical patients. Poor clarity about role expectations and responsibilities can hinder nurses' performance during cardiac advanced life support (CALS) procedures.

AIM

To seek expert consensus on nurses' roles and responsibilities in CALS for patients in postoperative cardiac surgical patients.

STUDY DESIGN

A two-round modified eDelphi survey. Delphi items were informed by guideline literature, an audit of resuscitation records and expert interviews. Panellists, drawn from a single site of a large tertiary health service in metropolitan Melbourne, included nurses, doctors and surgeons familiar with the management of cardiac arrest in post-operative cardiac surgical patients.

RESULTS

The two rounds of the modified eDelphi generated 55 responses. A consensus of >80% agreement was reached for 24 of the 41 statements in Round 2. All items related to nurses' roles and responsibilities during nurses pre- and post-arrest phases reached consensus. In contrast, only 29% (n = 4/14) of items related to peri-arrest, and 36% of those related to nurse scope of practise in CALS arrest (n = 4/11) reached consensus.

CONCLUSION

The study's aim was only partially achieved. Findings indicate high agreement about nurses' roles and responsibilities before and immediately after a cardiac arrest, but limited clarity about nurses' roles when implementing the CALS protocol, such as resternotomy and internal cardiac massage. There is an urgent need to address uncertainty about nurses' roles and scope of practice in CALS, which is essential to the recognition of nurses' contribution to the cardiac specialty workforce.

RELEVANCE TO CLINICAL PRACTISE

Uncertainty about nurses 'roles and responsibilities when implementing the CALS protocol may hinder their performance to their full scope of practice, leading to poor patient outcomes.

Defining Medical AI Competencies for Medical School Graduates: Outcomes of a Delphi Survey and Medical Student/Educator Questionnaire of South Korean Medical Schools

PURPOSE

Given the increasing significance and potential impact of artificial intelligence (AI) technology on health care delivery, there is an increasing demand to integrate AI into medical school curricula. This study aimed to define medical AI competencies and identify the essential competencies for medical graduates in South Korea.

METHOD

An initial Delphi survey conducted in 2022 involving 4 groups of medical AI experts (n = 28) yielded 42 competency items. Subsequently, an online questionnaire survey was carried out with 1,955 participants (1,174 students and 781 professors) from medical schools across South Korea, utilizing the list of 42 competencies developed from the first Delphi round. A subsequent Delphi survey was conducted with 33 medical educators from 21 medical schools to differentiate the essential AI competencies from the optional ones.

RESULTS

The study identified 6 domains encompassing 36 AI competencies essential for medical graduates: (1) understanding digital health and changes driven by AI; (2) fundamental knowledge and skills in medical AI; (3) ethics and legal aspects in the use of medical AI; (4) medical AI application in clinical practice; (5) processing, analyzing, and evaluating medical data; and (6) research and development of medical AI, as well as subcompetencies within each domain. While numerous competencies within the first 4 domains were deemed essential, a higher percentage of experts indicated responses in the last 2 domains, data science and medical AI research and development, were optional.

CONCLUSIONS

This medical AI framework of 6 competencies and their subcompetencies for medical graduates exhibits promising potential for guiding the integration of AI into medical curricula. Further studies conducted in diverse contexts and countries are necessary to validate and confirm the applicability of these findings. Additional research is imperative for developing specific and feasible educational models to integrate these proposed competencies into pre-existing curricula.

Assessing the safety of physical rehabilitation in critically ill patients: a Delphi study

BACKGROUND

Physical rehabilitation of critically ill patients is implemented to improve physical outcomes from an intensive care stay. However, before rehabilitation is implemented, a risk assessment is essential, based on robust safety data. To develop this information, a uniform definition of relevant adverse events is required. The assessment of cardiovascular stability is particularly relevant before physical activity as there is uncertainty over when it is safe to start rehabilitation with patients receiving vasoactive drugs.

METHODS

A three-stage Delphi study was carried out to (a) define adverse events for a general ICU cohort, and (b) to define which risks should be assessed before physical rehabilitation of patients receiving vasoactive drugs. An international group of intensive care clinicians and clinician researchers took part. Former ICU patients and their family members/carers were involved in generating consensus for the definition of adverse events. Round one was an open round where participants gave their suggestions of what to include. In round two, participants rated their agreements with these suggestions using a five-point Likert scale; a 70% consensus agreement threshold was used. Round three was used to re-rate suggestions that had not reached consensus, whilst viewing anonymous feedback of participant ratings from round two.

RESULTS

Twenty-four multi-professional ICU clinicians and clinician researchers from 10 countries across five continents were recruited. Average duration of ICU experience was 18 years (standard deviation 8) and 61% had publications related to ICU rehabilitation. For the adverse event definition, five former ICU patients and one patient relative were recruited. The Delphi process had a 97% response rate. Firstly, 54 adverse events reached consensus; an adverse event tool was created and informed by these events. Secondly, 50 risk factors requiring assessment before physical rehabilitation of patients receiving vasoactive drugs reached consensus. A second tool was created, informed by these suggestions.

CONCLUSIONS

The adverse event tool can be used in studies of physical rehabilitation to ensure uniform measurement of safety. The risk assessment tool can be used to inform clinical practise when risk assessing when to start rehabilitation with patients receiving vasoactive drugs. Trial registration This study protocol was retrospectively registered on https://www.researchregistry.com/ (researchregistry2991).

Development of a trigger tool to identify harmful incidents, no harm incidents, and near misses in prehospital emergency care

BACKGROUND

Emergency Medical Services (EMS) are a unique setting because care for the chief complaint is given across all ages in a complex and high-risk environment that may pose a threat to patient safety. Traditionally, a reporting system is commonly used to raise awareness of adverse events (AEs); however, it could fail to detect an AE. Several methods are needed to evaluate patient safety in EMS. In this light, this study was conducted to (1) develop a national ambulance trigger tool (ATT) with a guide containing descriptions of triggers, examples of use, and categorization of near misses (NMs), no harm incidents (NHIs), and harmful incidents (HIs) and (2) use the ATT on randomly selected ambulance records.

METHODS

The ambulance trigger tool was developed in a stepwise manner through (1) a literature review; (2) three sessions of structured group discussions with an expert panel having knowledge of emergency medical service, patient safety, and development of trigger tools; (3) a retrospective record review of 900 randomly selected journals with three review teams from different geographical locations; and (4) inter-rater reliability testing between reviewers.

RESULTS

From the literature review, 34 triggers were derived. After removing clinically irrelevant ones and combining others through three sessions of structured discussions, 19 remained. The most common triggers identified in the 900 randomly selected records were deviation from treatment guidelines (30.4%), the patient is non conveyed after EMS assessment (20.8%), and incomplete documentation (14.4%). The positive triggers were categorized as a near miss (40.9%), no harm (3.7%), and harmful incident (0.2%). Inter-rater reliability testing showed good agreement in both sessions.

CONCLUSION

This study shows that a trigger tool together with a retrospective record review can be used as a method to measure the frequency of harmful incidents, no harm incidents, and near misses in the EMS, thus complementing the traditional reporting system to realize increased patient safety.

Building consensus on common features and interoperability use cases for community health information systems: a Delphi study

INTRODUCTION

Information systems for community health have become increasingly sophisticated and evidence-based in the last decade and they are now the most widely used health information systems in many low-income and middle-income countries. This study aimed to establish consensus regarding key features and interoperability priorities for community health information systems (CHISs).

METHODS

A Delphi study was conducted among a systematically selected panel of CHIS experts. This impressive pool of experts represented a range of leading global health institutions, with gender and regional balance as well as diversity in their areas of expertise. Through five rounds of iterative surveys and follow-up interviews, the experts established a high degree of consensus. We supplemented the Delphi study findings with a series of focus group discussions with 10 community health worker (CHW) leaders.

RESULTS

CHISs today are expected to adapt to a wide range of local contextual requirements and to support and improve care delivery. While once associated with a single role type (CHWs), these systems are now expected to engage other end users, including patients, supervisors, clinicians and data managers. Of 30 WHO-classified digital health interventions for care providers, experts identified 23 (77%) as being important for CHISs. Case management and care coordination features accounted for more than one-third (14 of 37, 38%) of the core features expected of CHISs today, a higher proportion than any other category. The highest priority use cases for interoperability include CHIS to health management information system monthly reporting and CHIS to electronic medical record referrals.

CONCLUSION

CHISs today are expected to be feature-rich, to support a range of user roles in community health systems, and to be highly adaptable to local contextual requirements. Future interoperability efforts, such as CHISs in general, are expected not only to move data efficiently but to strengthen community health systems in ways that measurably improve care.

Standardizing eligibility and patient selection for Pressurized Intraperitoneal Aerosol Chemotherapy: A Delphi consensus statement

INTRODUCTION

Pressurized Intraperitoneal Aerosol Chemotherapy (PIPAC) is a procedure for minimally invasive drug administration in patients with peritoneal metastasis. Previous studies have emphasized the importance of uniformity in treatment protocols and standardization of this practice. This study aimed to reach a consensus on eligibility, patient selection, and choice of chemotherapy for PIPAC.

METHODS

A three-round modified Delphi study was conducted. A steering group formulated a list of baseline statements, addressing the objectives. The steering group consisted of seven expert surgical and medical oncologists. Available evidence and published key opinions were critically reviewed. An international expert panel scored those statements on a 4-point Likert scale. The statements were submitted electronically and anonymously. Consensus was reached if the agreement rate was ≥75%. A minimum Cronbach's alpha of >0.8 was set.

RESULTS

Forty-five (45/58; 77.6%) experts participated and completed all rounds. Experts were digestive surgeons (n = 28), surgical oncologists (n = 7), gynecologists (n = 5), medical oncologists (n = 4), and one clinical researcher. Their assessment of 81 preliminary statements in the first round resulted in 41 consolidated statements. In round two, consensus was reached on 40 statements (40/41; 97.6%) with a consensus of ≥80% for each individual statement. In the third round, 40 statements were unanimously approved as definitive. The choice of first- and second-line chemotherapy remained controversial and could not reach consensus.

CONCLUSIONS

This International Delphi study provides practical guidance on eligibility and patient selection for PIPAC. Ongoing trial data and long-term results that could contribute to the further standardization of PIPAC are eagerly awaited.

Global Assessment of Palliative Care Need: Serious Health-Related Suffering Measurement Methodology

CONTEXT

Inequities and gaps in palliative care access are a serious impediment to health systems especially in low- and middle-income countries and the accurate measurement of need across health conditions is a critical step to understanding and addressing the issue. Serious Health-related Suffering (SHS) is a novel methodology to measure the palliative care need and was originally developed by The Lancet Commission on Global Access to Palliative Care and Pain Relief. In 2015, the first iteration - SHS 1.0 - was estimated at over 61 million people worldwide experiencing at least 6 billion days of SHS annually as a result of life-limiting and life-threatening conditions.

OBJECTIVES

In this paper, an updated methodology - SHS 2.0 - is presented building on the work of the Lancet Commission and detailing calculations, data requirements, limitations, and assumptions.

METHODS AND RESULTS

The updates to the original methodology focus on measuring the number of people who die with (decedents) or live with (non-decedents) SHS in a given year to assess the number of people in need of palliative care across health conditions and populations. Detail on the methodology for measuring the number of days of SHS that was pioneered by the Lancet Commission, is also shared, as this second measure is essential for determining the health system responses that are necessary to address palliative care need and must be a priority for future methodological work on SHS.

CONCLUSIONS

The methodology encompasses opportunities for applying SHS to future policy making assessment of future research priorities particularly in light of the dearth of data from low- and middle-income countries, and sharing of directions for future work to develop SHS 3.0.

International perspectives on measuring national digital public health system maturity through a multidisciplinary Delphi study

Unlocking the full potential of digital public health (DiPH) systems requires a comprehensive tool to assess their maturity. While the World Health Organization and the International Telecommunication Union released a toolkit in 2012 covering various aspects of digitalizing national healthcare systems, a holistic maturity assessment tool has been lacking ever since. To bridge this gap, we conducted a pioneering Delphi study, to which 54 experts from diverse continents and academic fields actively contributed to at least one of three rounds. 54 experts participated in developing and rating multidisciplinary quality indicators to measure the maturity of national digital public health systems. Participants established consensus on these indicators with a threshold of 70% agreement on indicator importance. Eventually, 96 indicators were identified and agreed upon by experts. Notably, 48% of these indicators were found to align with existing validated tools, highlighting their relevance and reliability. However, further investigation is required to assess the suitability and applicability of all the suggestions put forward by our participants. Nevertheless, this Delphi study is an essential initial stride toward a comprehensive measurement tool for DiPH system maturity. By working towards a standardized assessment of DiPH system maturity, we aim to empower decision-makers to make informed choices, optimize resource allocation, and drive innovation in healthcare delivery. The results of this study mark a significant milestone in advancing DiPH on a global scale.

Establishing consensus on principles and competencies for the use of play in clinical practice in hospitals: An international Delphi study

Although play has existed in paediatric hospitals for decades, a shared understanding of why and how healthcare professionals use play in clinical practice is lacking. This study aims to reach consensus on a common set of principles and competencies for play interventions and practices in hospitals. We conducted a three-round Delphi study that included healthcare professionals selected by hospital management. The first round comprised open-ended questions on the use of play in clinical practice. Principles and competencies, including learning objectives, were established using content analysis through an iterative process. Participants rated the importance of each principle and learning objective in the second and third rounds. Among the 66 participants, 45 (68%) responded in round 1 and 41 (62%) in rounds 2 and 3. The participants represented ten countries and nine different health professions. After the three rounds, we identified 33 principles and six overall competencies: building trusting relationships; delivering information and increasing understanding; promoting cooperation and participation; reducing procedure-related anxiety and pain; supporting coping and development; and ensuring a professional approach to play, which comprised 20 learning objectives.  Conclusion: According to healthcare professionals, play in clinical practice can be used to communicate and build relationships with paediatric patients and thus potentially help provide patient-centred care. Our findings may help guide and prioritize future research initiatives and operationalize play interventions and practices in hospitals. What is Known: • Evidence suggests that using play in clinical practice can help paediatric patients during hospitals stays. • Despite the evidence supporting the use of play, a shared understanding of why and how paediatric healthcare professionals use play is needed. What is New: • This international Delphi study contributes to a shared interprofessional understanding of the principles, competencies and learning objectives for the use of play in clinical practice. • The findings have the potential to aid initiatives in developing training programmes for healthcare professionals in using play to provide care with a patient-centred approach.

Developing a reporting item checklist for studies of HIV drug resistance prevalence or incidence: a mixed methods study

BACKGROUND

Adequate surveillance of HIV drug resistance prevalence is challenged by heterogenous and inadequate data reporting. To address this issue, we recently published reporting guidance documentation for studies of HIV drug resistance prevalence and incidence.

OBJECTIVES

In this study, we describe the methods used to develop this reporting guidance.

DESIGN

We used a mixed-methods sequential explanatory design involving authors and users of studies of HIV drug resistance prevalence. In the quantitative phase, we conducted a cross-sectional electronic survey (n=51). Survey participants rated various reporting items on whether they are essential to report. Validity ratios were computed to determine the items to discuss in the qualitative phase. In the qualitative phase, two focus group discussions (n=9 in total) discussed this draft item checklist, providing a justification and examples for each item. We conducted a descriptive qualitative analysis of the group discussions to identify emergent themes regarding the qualities of an essential reporting item.

RESULTS

We identified 38 potential reporting items that better characterise the study participants, improve the interpretability of study results and clarify the methods used for HIV resistance testing. These items were synthesised to create the reporting item checklist. Qualitative insights formed the basis of the explanation, elaboration, and rationale components of the guidance document.

CONCLUSIONS

We generated a list of reporting items for studies on the incidence or prevalence of HIV drug resistance along with an explanation of why researchers believe these items are important. Mixed methods allowed for the simultaneous generation and integration of the item list and qualitative insights. The integrated findings were then further developed to become the subsequently published reporting guidance.

Four-Step Co-Designing of the Reablement Strategies Targeting Sarcopenia (ReStart-S): An Exercise-Based Multicomponent Program for Older Adults Residing in Long-Term Care Settings

Background

The prevalence of sarcopenia is concerningly high in long-term care settings (LTCS); yet, no exercise programs specifically targeting older adults living in residential care are available.

Objective

The goal of the present study was to co-design and validate a program named Reablement Strategies targeting Sarcopenia (ReStart-S) for older long-term care residents.

Design

Cross-sectional study with an exploratory phase.

Settings

LTCS in Udupi, Karnataka, India.

Participants

Sarcopenic older adults diagnosed using Asian Working Group for Sarcopenia 2019 criteria.

Material and Methods

The program was designed using a four-step intervention mapping technique involving systematic progression after completing each step. The steps included 1) identifying the appropriate exercise-based intervention for sarcopenia, 2) determining objectives and expected outcomes, 3) seeking expert views through a Delphi consensus approach, and 4) assessing the feasibility of ReStart-S program among older adults living in LTCS.

Results

A comprehensive literature review appraised existing exercise programs for managing sarcopenia. A workshop held with six older adults and one caretaker, decided on morning exercise sessions, recommended 2-7 days/week. The results of the review and workshop were compiled for the Delphi process that had seven experts from 5 countries, achieving a 71% response rate after four rounds. In the last step, a pilot study on eight LTCS residents, two males and six females with a mean age of 78.3 ± 8.3 years, was conducted and the program was found to be feasible.

Conclusion

The ReStart-S program for managing sarcopenia among older adults residing in LTCS incorporates evidence from the literature and the engagement of older adults, caregivers, and experts, making it a contextually appropriate intervention. Our study also provides researchers and healthcare professionals insight into co-designing an intervention program for vulnerable older adults. Finally, the program evaluation indicates that a full-scale trial testing the efficacy of the ReStart-S program is feasible.

'Towards a conceptualization of nurses' support of hospitalised patients' self-management-A modified Delphi study'

AIM

To determine patients', nurses' and researchers' opinions on the appropriateness and completeness of the proposed conceptualization of nurses' support of hospitalised patients' self-management.

DESIGN

A modified Delphi study.

METHODS

We conducted a two-round Delphi survey. The panel group consisted of patients, nurses and researchers. The conceptualization of nurses' support of hospitalised patients' self-management presented in the first Delphi round was based on previous research, including a scoping review of the literature. Data was analysed between both rounds and after the second round. Results are reported in accordance with the guidance on Conducting and Reporting Delphi Studies (CREDES).

RESULTS

In the first round all activities of the proposed conceptualization were considered appropriate to support the patients' self-management. Panel members' comments led to the textual adjustment of 19 activities, the development of 15 new activities, and three general questions related to self-management support during hospitalisation. In the second round the modified and the newly added activities were also deemed appropriate. The clarification statements raised in the first Delphi round were accepted, although questions remained about the wording of the activities and about what is and what is not self-management support.

CONCLUSION

After textual adjustments and the addition of some activities, the proposed conceptualization of nurses' support in patients' self-management while hospitalised have been considered appropriate and complete. Nevertheless, questions about the scope of this concept still remains. The results provide a starting point for further discussion and the development of self-management programs aimed at the hospitalised patient.

IMPLICATION FOR THE PROFESSION AND/OR PATIENT CARE

The results can be considered as a starting point for practice to discuss the concept of nurses' support for hospitalised patients' self-management and develop, implement and research self-management programs specific for their patient population.

REPORTING METHOD

Results are reported in accordance with the guidance on Conducting and Reporting Delphi Studies (CREDES).

PATIENT OR PUBLIC CONTRIBUTION

Patients were involved as expert panellist in this Delphi study. Impact statement What problem did the study address? Self-management support during hospitalisation is understudied, which undermines the development of evidence-based interventions. What were the main findings? A panel, consisting of patients, nurses and researchers, agreed on the appropriateness of a conceptualization of nurses' support of inpatients' self-management, and identified some points for discussion, mainly related to the boundaries of the concept self-management. Where and on whom will the research have an impact? This study is crucial for generating conceptual understanding of how nurses support patients' self-management during hospitalisation. This is necessary for policy, clinical practice, education, and research on this topic.

Assessment of the effectiveness of the BOPPPS model combined with case-based learning on nursing residency education for newly recruited nurses in China: a mixed methods study

BACKGROUND

Expanding new nurse training and education is a priority for nursing educators as well as a critical initiative to stabilize the nursing workforce. Given that there is currently no standardized program for the training of new nurses in China, we investigated the effectiveness of the bridge-in, objective, pre-assessment, participatory learning, post-assessment, and summary model combined with case-based learning ((BOPPPS-CBL) for the standardized training of new nurses.

METHODS

The mixed method approach with explanatory sequential (quantitative-qualitative) method was used. A questionnaire was used to compare the impact of the BOPPPS-CBL model and the Traditional Learning Model (TLM) on the core competencies of 185 new nurses for two years of standardized training. Quantitative data were analyzed using SPSS 22.0. Focus group interviews were used with four groups of new nurses and perceptions of BOPPPS-CBL training were recorded. Qualitative data were analyzed thematically.

RESULTS

According to the quantitative data, more new nurses agreed that the BOPPPS-CBL model stimulated their learning and improved their core nursing competencies than the TLM. The BOPPPS-CBL group outperformed the TLM group on theoretical knowledge tests. Qualitative data revealed that 87.5% of new nurses agreed on the value of BOPPPS-CBL training, and three themes were extracted: (1) role promotion; (2) formation of new thinking to solve clinical problems; and (3) suggestions for improvement.

CONCLUSION

BOPPPS-CBL training had a significant impact on improving new nurses' core competencies and promoting the transition of new nurses to clinical practice nurses in China. The study recommends BOPPPS-CBL training as an effective teaching model for the standardized training and education of new nurses.

Finnish experts' perceptions of digital healthcare forms in 2035 and the anticipated healthcare workforce impacts: a Delphi study

PURPOSE

To explore Finnish experts' perceptions of the forms of digital healthcare that are anticipated to be the most utilised in healthcare in the medium-term future (year 2035) and anticipated healthcare workforce impacts those forms will have.

DESIGN/METHODOLOGY/APPROACH

A total of 17 experts representing relevant interest groups participated in a biphasic online Delphi study. The results for each round were analysed using descriptive statistical methods and inductive content analysis.

FINDINGS

The forms of digital healthcare that the experts perceived as most likely to be utilised were those enabling patient participation, efficient organisation of services and automated data collection and analysis. The main impacts on the healthcare workforce were seen as being the redirection of workforce needs within the healthcare sector and need for new skills and new professions. The decrease in the need for a healthcare workforce was seen as less likely. The impacts were perceived as being constructed through three means: impacts within healthcare organisations, impacts on healthcare professions and impacts via patients.

RESEARCH LIMITATIONS/IMPLICATIONS

The results are not necessarily transferable to other contexts because the experts anticipated local futures. Patients' views were also excluded from the study.

ORIGINALITY/VALUE

Healthcare organisations function in complex systems where drivers, such as regional demographics, legislation and financial constraints, dictate how digital healthcare is utilised. Anticipating the workforce effects of digital healthcare utilisation has received limited attention; the study adds to this discussion.

Conducting and reporting the Delphi method in traditional Chinese medicine syndrome diagnosis research: A cross-sectional analysis

Background

The Delphi method has been extensively used to reach a consensus in traditional Chinese medicine (TCM) syndrome diagnosis research when subjective judgment is not uniform and objective evidence is lacking. The conduct and reporting of the Delphi method in TCM syndrome diagnosis research have never been critiqued. Our study aims to explore the consistency of using this technique and assess the reporting quality.

Methods

A cross-sectional study was employed to scope articles reporting the conduct of the Delphi method in TCM syndrome diagnosis research. We searched the PubMed, Web of Science, CNKI, VIP, Wanfang and SinoMed databases with the restriction of Chinese and English language from their inception to March 25, 2023. A standardized extraction form was designed to collect demographics and methodological processes reflecting the rigor and transparency in TCM syndrome diagnosis research.

Results

A total of 1832 studies were screened, and 50 were included. The median number of panels was 30 (IQR 20-34.5) and only 12 (24.0 %) studies were with a heterogeneous sample of panels. Two rounds was most common (37/50; 74.0 %), followed by three (7/50; 14.0 %), and only 13 (26.0 %) studies determined the number of rounds a priori. The reporting quality varied, with 18.0 % (9/50) reporting anonymity, 30.0 % (15/50) describing the controlled feedback, 20.0 % (10/50) reporting the procedure duration (7.14 ± 3.29 months) and 26.0 % (13/50) predefining the consensus.

Conclusion

The Delphi method is inconsistently conducted and nontransparently reported in TCM syndrome diagnosis research. Standardized criteria are urgently needed for best practices in future research.

A Delphi method investigation to prioritize activity-related determinants thought to affect mental health in adolescent populations

INTRODUCTION

Emergent mental illness during adolescence affects daily functioning, causing disruption to daily activities, routines, and patterns. Multiple inter-related personal, social and environmental determinants influence the onset, nature and subsequent course of those difficulties. Research suggests a bi-directional relationship exists between mental health and activity choices. Activity-focused interventions such as occupational therapy may improve adolescent mental health related outcomes. In this study, we identify and select which activity-related determinants should be prioritized in the development of an occupation therapy-based intervention for adolescents with emerging mental health difficulties using expert consensus.

METHOD

A modified two-round Delphi survey method was conducted with occupational therapists and researchers to ascertain a consensus opinion on the prioritization of specific activity-related determinants that influence 16- to 17-year-olds'.

RESULTS

Eighty-nine determinants were identified and prioritized. Fourteen of these were personal activity-related determinants including 'types of activity' in which young people engage, the 'balance of activities' in which they engage, their 'over and under consumptions of activities', and their 'underdeveloped occupation-based coping skills'. The expert panel prioritized 'personal self-confidence', 'values', and 'perception of confidence' in relation to the activities adolescents do.

CONCLUSIONS

This study generated a detailed picture of the activity-related determinants that are important in adolescence, and aligns with the adolescent model of occupational choice. Our findings have potential to inform activity-related intervention development and policy. Further research is needed, particularly to understand young people's perspectives on these determinants and to investigate the determinants that would benefit from further empirical research.

Consensus Statements on the Definition, Classification, and Diagnostic Tests for Tinnitus: A Delphi Study Conducted by the Korean Tinnitus Study Group

BACKGROUND

Tinnitus is a bothersome condition associated with various symptoms. However, the mechanisms of tinnitus are still uncertain, and a standardized assessment of the diagnostic criteria for tinnitus is required. We aimed to reach a consensus on diagnosing tinnitus with professional experts by conducting a Delphi study with systematic review of the literature.

METHODS

Twenty-six experts in managing tinnitus in Korea were recruited, and a two-round modified Delphi study was performed online. The experts evaluated the level of agreement of potential criteria for tinnitus using a scale of 1-9. After the survey, a consensus meeting was held to establish agreement on the results obtained from the Delphi process. Consensus was defined when over 70% of the participants scored 7-9 (agreement) and fewer than 15% scored 1-3 (disagreement). To analyze the responses of the Delphi survey, the content validity ratio and Kendall's coefficient of concordance were evaluated.

RESULTS

Consensus was reached for 22 of the 38 statements. For the definition of tinnitus, 10 out of 17 statements reached consensus, with three statements achieving complete agreement including; 1) Tinnitus is a conscious perception of an auditory sensation in the absence of a corresponding external stimulus, 2) Tinnitus can affect one's quality of life, and 3) Tinnitus can be associated with hearing disorders including sensorineural hearing loss, vestibular schwannoma, Meniere's disease, otosclerosis, and others. For the classification of tinnitus, 11 out of 18 statements reached consensus. The participants highly agreed with statements such as; 1) Vascular origin is expected in pulse-synchronous tinnitus, and 2) Tinnitus can be divided into acute or chronic tinnitus. Among three statements on the diagnostic tests for tinnitus only Statement 3, "There are no reliable biomarkers for sensory or emotional factors of tinnitus." reached consensus. All participants agreed to perform pure-tone audiometry and tinnitus questionnaires, including the Tinnitus Handicap Inventory and Tinnitus Questionnaire.

CONCLUSION

We used a modified Delphi method to establish a consensus-based definition, a classification, and diagnostic tests for tinnitus. The expert panel reached agreement for several statements, with a high level of consensus. This may provide practical information for clinicians in managing tinnitus.

[Supporting rehabilitation facilities in implementing diversity-sensitive care: Development of the DiversityKAT manual]

BACKGROUND

Expectations regarding health care including rehabilitation differ depending on age, gender, and also the migration history of the patient population. To meet the diverse expectations, health care needs to be diversity-sensitive, which can have a positive effect on the utilization and outcomes of care. Diversity-sensitive care, however, should take into consideration not only the expectations of diverse patient groups but also the opportunities and challenges offered by diversity of staff. Managers of health care facilities and health care staff in Germany are well aware of the need for diversity-sensitive care, but corresponding measures, so far, have been applied rarely and only unsystematically. The aim of the study was to develop a manual consisting of a catalogue of instruments and a guideline that can support rehabilitation facilities in implementing diversity-sensitive care.

METHODS

A mixed methods approach was used for the study. Based on a scoping review, suitable instruments (n=34) were identified that can be used for the implementation of diversity-sensitive health care. Consensus on a draft of the manual was then reached in seven focus group discussions with health care staff (n=44) and a discussion circle consisting of n=5 representatives of the rehabilitation providers.

RESULTS

The DiversityKAT manual, which was developed in a participatory manner, presents diversity-sensitive tools, including instructions, questionnaires, checklists and concepts that can be used to take into account the diversity of needs and expectations in everyday health care. In line with the feedback from health care staff, the manual includes information that can be used as a step-by-step guide to select and implement appropriate tools. At the request of the staff and the rehabilitation providers, exemplary case descriptions were added to present the use of selected instruments in specific situations. A matrix was developed for purposes of quick orientation and pre-selection of suitable instruments.

DISCUSSION

Through practice-oriented advice and low-threshold guidance, the DiversityKAT-manual can increase user orientation in rehabilitation but needs to be further examined in future evaluation studies.

A postpartum functional assessment tool for women based on the international classification of functioning, disability and health

BACKGROUND

Postpartum dysfunctions and complications can occur in women. However, functional assessment should be conducted to make treatment plans before any intervention is implemented. In this context, the International Classification of Functioning, Disability and Health (ICF) may be a useful tool for women postpartum to document functional data and set rehabilitation goals. The purpose of this study was to determine the corresponding domains that should be considered in the evaluation of women's postpartum functioning based on the International Classification of Functioning, Disability and Health (ICF) model using the Delphi method.

METHODS

Fifteen domestic experts were invited to conduct two rounds of expert consensus survey on the ICF-based postpartum functional assessment category pool obtained through literature retrieval, clinical investigation, and reference to relevant literature. The sample was medical staff with professional knowledge of women's health. The opinions of experts were summarized, and the positive coefficient, authority coefficient and coordination degree of experts were calculated.

RESULTS

A total of 15 domestic experts participated in this expert consensus. Through two rounds of a questionnaire survey, 69 items were finally selected to form the ICF-based postpartum functional assessment tool for women. The items included 32 items of body function, 12 items of body structure, 17 items of activity and participation, and 8 items of environmental factors. In addition, we identified 8 items of personal factors. The expert positive coefficients of the two rounds of expert consensus were both 100%, the authority coefficient was 0.789, and the coefficient of variation was between 0.09 to 0.31.

CONCLUSION

A postpartum functional assessment tool for women based on the ICF model was constructed based on the Delphi method, which can provide more comprehensive health management and life intervention for postpartum women.

TRIAL REGISTRATION

The Registration number of the Chinese Clinical Trial Registry is ChiCTR2200066163, 25/11/2022.

Development of a patient-reported outcome measure of digital health literacy for chronic patients: results of a French international online Delphi study

BACKGROUND

A psychometrically robust patient-reported outcome measure (PROM) to assess digital health literacy for chronic patients is needed in the context of digital health. We defined measurement constructs for a new PROM in previous studies using a systematic review, a qualitative description of constructs from patients, health professionals and an item pool identification process. This study aimed to evaluate the content validity of a digital health literacy PROM for chronic patients using an e-Delphi technique.

METHODS

An international three-round online Delphi (e-Delphi) study was conducted among a francophone expert panel gathering academics, clinicians and patient partners. These experts rated the relevance, improvability, and self-ratability of each construct (n = 5) and items (n = 14) of the preliminary version of the PROM on a 5-point Likert scale. Consensus attainment was defined as strong if ≥ 70% panelists agree or strongly agree. A qualitative analysis of comments was carried out to describe personal coping strategies in healthcare expressed by the panel. Qualitative results were presented using a conceptually clustered matrix.

RESULTS

Thirty-four experts completed the study (with 10% attrition at the second round and 5% at the third round). The panel included mostly nurses working in clinical practice and academics from nursing science, medicine, public health background and patient partners. Five items were excluded, and one question was added during the consensus attainment process. Qualitative comments describing the panel view of coping strategies in healthcare were analysed. Results showed two important themes that underpin most of personal coping strategies related to using information and communications technologies: 1) questionable patient capacity to assess digital health literacy, 2) digital devices as a factor influencing patient and care.

CONCLUSION

Consensus was reached on the relevance, improvability, and self-ratability of 5 constructs and 11 items for a digital health literacy PROM. Evaluation of e-health programs requires validated measurement of digital health literacy including the empowerment construct. This new PROM appears as a relevant tool, but requires further validation.

Validating a framework to guide the implementation of high-quality virtual primary care: an international eDelphi study protocol

BACKGROUND

There is an urgent need to support primary care organisations in implementing safe and high-quality virtual consultations. We have previously performed qualitative research to capture the views of 1600 primary care physicians across 20 countries on the main benefits and challenges of using virtual consultations. Subsequently, a prototype of a framework to guide the implementation of high-quality virtual primary care was developed.

AIM

To explore general practitioners' perspectives on the appropriateness and relevance of each component of the framework's prototype, to further refine it and optimise its practical use in primary care facilities.

METHODS AND ANALYSIS

Participants will be primary care physicians with active experience providing virtual care, recruited through convenience and snowball sampling. This study will use a systematic and iterative online Delphi research approach (eDelphi), with a minimum of three rounds. A pre-round will be used to circulate items for initial feedback and adjustment. In subsequent rounds, participants will be asked to rate the relevance of the framework's components. Consensus will be defined as >70% of participants agreeing/strongly agreeing or disagreeing/strongly disagreeing with a component. Data will be collected using structured online questionnaires. The primary outcome of the study will be a list of the essential components to be incorporated in the final version of the framework.

ETHICS AND DISSEMINATION

The study has received ethical approval conceded by the Imperial College London Science, Engineering and Technology Research Ethics Committee (SETREC) (reference no .6559176/2023). Anonymous results will be made available to the public, academic organisations and policymakers.

Nursing Recommendations in the Management of Systemic Lupus Erythematosus: A Delphi Consensus

Introduction: Nurses' role in the management of people with systemic lupus erythematosus (SLE) is essential. Specific guidelines for nurses have not been previously developed in Spain. This project aimed to try to develop comprehensive and validated recommendations for nurses regarding the management of people with SLE. Method: A Delphi questionnaire with 90 general and specific recommendations was designed by the scientific committee and underwent two rounds of participation. Results: Panellists reached a consensus on "agreement" for 85 recommendations during the first round and for 87 recommendations after the second and final rounds. Panellists agreed that people with SLE should be managed within a multidisciplinary team, and that this team should include specialized nurses. Panellists stated that most of the services lack specialized nurses. Experts identified lack of specific training programs targeted to nurses as the main barrier for application of recommendations. Panellists recommended an extended role for nurses in the management of people with SLE, including diagnosis, patient education, treatment monitoring and administration, and follow-up. Conclusions: This study is the first consensus that provides nursing recommendations from experts on the management of people with SLE in Europe. Design of standardized training programs targeted to nurses would facilitate the application of the recommendations.

Development and validation of frailty and malnutrition knowledge assessment scale for community-dwelling older adults

There is a lack of reliable tools to assess the knowledge of frailty and malnutrition in community-dwelling older adults. To develop and validate reliable frailty and malnutrition knowledge assessment scales for this population, two scales were developed and validated through five phases. Phase 1: the item pools were constructed through a literature review and research panel based on the symptom interpretation model. Phase 2: the expert consultation was performed to select the items. Phase 3: a pilot survey was conducted to assess the clarity of the items and further revise the scales. Phase 4: 242 older adults were surveyed to finalize the items. Phase 5: 241 older adults were surveyed to test the psychometric properties. The two scales each comprise 3 dimensions (symptoms, risk factors, and management strategies) and 11 items. They had good construct validity, with all indicators of correlation analysis and confirmatory factor analysis meeting their specific criteria. The reliability of the frailty and malnutrition knowledge assessment scales was good, with composite reliability coefficients all >0.60, Cronbach's alpha being 0.81 and 0.83, and the Spearman-Brown coefficient being 0.74 and 0.80, respectively. Their acceptability was good, with both having a completion rate of 92.18% and an average completion time of 3 min. The two scales are reliable tools to assess the knowledge of frailty and malnutrition among community-dwelling older adults, especially for large-scale surveys. They can help identify knowledge gaps in older adults and provide a basis for developing targeted educational interventions.

Identifying Research Priorities to Promote the Well-Being of Family Caregivers of Canadians with Intellectual and/or Developmental Disabilities: A Pilot Delphi Study

Current programming and resources aimed at supporting the well-being of family caregivers often fail to address considerations unique to those caring for people with intellectual and/or developmental disabilities (IDDs). As a result, many caregivers of people with IDD feel isolated, stressed, and burnt out. A targeted research agenda informed by key stakeholders is needed and would allow research teams to coordinate resources, talents, and efforts to progress family caregiver well-being research in this area quickly and effectively. To address this aim, this pilot study used a Delphi design based on 2 rounds of questionnaires. In round 1, 19 stakeholders (18 females, 1 male), including 12 family caregivers, 3 rehabilitation providers, 2 researchers, and 2 organizational representatives, identified broad areas for caregiver well-being research. After collating the responses from round 1, stakeholders were asked to rank whether each area was considered a research priority in round 2. Data were analyzed using descriptive statistics and conventional content analysis. Eighteen stakeholders completed the round 2 survey (1 caregiver did not complete the round 2 survey), after which a consensus was reached. Stakeholders identified nine broad priorities, including system-level programs and services, models of care, health promotion, social inclusion, equity and diversity, capacity building, care planning along the lifespan, and balancing formal and natural community-based supports. Although preliminary in nature, the research priorities generated using an inclusive and systematic process may inform future efforts to promote the well-being of caregivers of Canadians with IDD.

The MoXFo Initiative: Using consensus methodology to move forward towards internationally shared vocabulary in multiple sclerosis exercise research

BACKGROUND

Multiple sclerosis (MS) exercise terminology lacks consistency across disciplines, hindering research synthesis.

OBJECTIVE

The 'Moving exercise research in MS forward initiative' (MoXFo) aims to establish agreed definitions for key MS exercise terms.

METHODS

The Lexicon development methodology was employed. A three-step process identified key exercise terminology for people with multiple sclerosis (pwMS): (1) consensus and systematic review, (2) Delphi round 1 and consideration of existing definitions and (3) Delphi round 2 for consensus among MoXFo steering group and exercise experts. Final definitions and style harmonisation were agreed upon.

RESULTS

The two-stage Delphi process resulted in the selection and scoring of 30 terminology definitions. The agreement was 100% for resistance exercise, balance and physical activity. Most terms had agreement >75%, but 'posture' (60%) and 'exercise' (65%) had a lower agreement.

CONCLUSION

This study identified key terms and obtained agreement on definitions for 30 terms. The variability in agreement for some terms supports the need for clearly referencing or defining terminology within publications to enable clear communication across disciplines and to support precise synthesis and accurate interpretation of research.

Identifying and prioritizing sustainability indicators for China's assessing demolition waste management using modified Delphi-analytic hierarchy process method

Addressing the sustainability issues arising from construction and demolition waste management (DWM) has gained little traction due to the lack of incentives, stringent regulations, and systematic guidance. This study aims to empower systematic decision-making concerning DWM alternative selection by developing a sustainability assessment framework by coupling a modified Delphi method with the multicriteria decision analysis technique. First, the study identifies a comprehensive inventory of indicators across three dimensions of sustainability in the context of DWM. Next, the study combines a modified Delphi method with the analytic hierarchy process to validate and prioritize the selected sustainability indicators. For the first time, insights regarding the DWM sustainability indicators from China's construction industry practitioners' perspectives are elicited using a mixed method comprising online semistructured interviews and two rounds of questionnaire surveys. Experts participating in the research are mostly based in Guangzhou and Shenzhen, where local governments exhaust all efforts in promoting carbon-neutral and sustainable development. The findings reveal that eight sustainability indicators were regarded as the determinants for the sustainability performance of DWM, with the global warming potential (32%), energy efficiency (16.1%) and land use (13.5%) receiving the highest preference scores (weights) based on the experts' judgment. Notably, the economic factors like the total cost (6.54%) appeared not highly prioritized by the local experts as typically did in the previous studies from developing countries.

Achieving international consensus on the concept of woman-centred care: A Delphi study

PROBLEM

There is no internationally-informed understanding of how midwives perceive woman-centred care and use it in practice.

BACKGROUND

Woman-centred care is integral to the role of the midwife and to determining standards of practice. Few empirical studies have explored the meaning of woman-centred care, and those that have are limited to country specific research.

AIM

To gain an in-depth understanding and consensus on the concept of woman-centred care from an international perspective.

METHODS

A three round Delphi study was conducted, with surveys distributed online to a group of international expert midwives to draw consensus on the topic of woman-centred care.

FINDINGS

A panel of 59 expert midwives representing 22 countries participated. Fifty-nine statements about woman-centred care, of which 63% of statements reached the 75% a priori agreement level, were developed and categorised under four emergent themes: defining characteristics of woman-centred care (n = 17), the role of the midwife in woman-centred care (n = 19), woman-centred care and systems of care (n = 18), woman-centred care in education and research (n = 5).

DISCUSSION

Participants agreed that woman-centred care should be provided by any health care professional in any health care setting. Systems of maternity care should provide holistic care tailored for the individual woman rather than subject her to routine practices and policies. Although continuity of care is important to midwifery practice, it was not reported as a core characteristic of woman-centred care.

CONCLUSION

This is the first study to investigate the concept of woman-centred care as it is experienced globally by midwives. The findings of this study will be used to contribute to the development of an internationally informed evidence-based definition of woman-centred care.

Establishing the core elements of a frailty at the front door model of care using a modified real-time Delphi technique

BACKGROUND

Innovations in models of care for older adults living with frailty presenting to the emergency department (ED) have become a key priority for clinicians, researchers and policymakers due to the deleterious outcomes older adults experience due to prolonged exposure to such an environment. This study aimed to develop a set of expert consensus-based statements underpinning operational design, outcome measurement and evaluation of a Frailty at the Front Door (FFD) model of care for older adults within an Irish context.

METHODS

A modified real-time Delphi method was used. Facilitation of World Café focus groups with an expert panel of 86 members and seperate advisory groups with a Public and Patient Involvement panel of older adults and members of the Irish Association of Emergency Medicine generated a series of statements on the core elements of the FFD model of care. Statements were analysed thematically and incorporated into a real-time Delphi survey, which was emailed to members of the expert panel. Members were asked to rank 70 statements across nine domains using a 9-point Likert scale. Consensus criteria were defined a priori and guided by previous research using 9-point rating scales.

RESULTS

Fifty members responded to the survey representing an overall response rate of 58%. Following analyses of the survey responses, the research team reviewed statements for content overlap and refined a final list of statements across the following domains: aims and objectives of the FFD model of care; target population; screening and assessment; interventions; technology; integration of care; evaluation and metrics; and research.

CONCLUSION

Development of a consensus derived FFD model of care represents an important step in generating national standards, implementation of a service model as intended and enhances opportunities for scientific impact. Future research should focus on the development of a core outcome set for studies involving older adults in the ED.

Development of a foot and ankle strengthening program for the treatment of plantar heel pain: a Delphi consensus study

BACKGROUND

People with plantar heel pain (PHP) have reduced foot and ankle muscle function, strength and size, which is frequently treated by muscle strengthening exercises. However, there has been little investigation of what exercises are used and there is no sound evidence base to guide practice. This study aimed to develop a consensus-driven progressive muscle strengthening program for PHP.

METHODS

Thirty-eight experts were invited to participate in the study over three rounds. Round 1 was an open-ended questionnaire that provided the core characteristics of progressive strengthening programs designed for three different adult patient types with PHP (younger athletic, overweight middle-aged, older), which were presented as vignettes. In Round 2, experts indicated their agreement to the proposed exercises and training variables. In Round 3, experts were presented with amendments to the exercises based on responses from Round 2 and indicated their agreement to those changes. Consensus was achieved when > 70% of experts agreed.

RESULTS

Two experts were ineligible and 12 declined, leaving 24 (67%) who participated in Round 1. Eighteen (75%) completed all three rounds. From Round 1, progressive strengthening programs were developed for the three vignettes, which included 10 different exercises and three training variables (sets / repetitions, weight, and frequency). In Round 2, 68% (n = 17) of exercises and 96% (n = 72) of training variables reached consensus. In Round 3, only exercise changes were presented and 100% of exercises reached consensus.

CONCLUSIONS

This study provides three progressive strengthening programs agreed to by experts that can be used in future clinical trials to determine the effectiveness of muscle strengthening for PHP. In addition, clinicians could use the programs as part of a rehabilitation strategy with the caveat that they may change as more research is conducted.

Clinicians' Perspectives on Healthcare Cybersecurity and Cyber Threats

INTRODUCTION

In today's world, healthcare systems face various risks, including data breaches, theft, and damage. This is where cybersecurity comes in, as it helps protect sensitive personal and financial data, such as electronic health records. This study delved into the perspectives of clinicians on cybersecurity in healthcare, exploring how it impacts patient safety and the functioning of organizations. The study also identified challenges associated with implementing cybersecurity measures and the risks of not doing so.

METHOD

This is a qualitative study in which clinical informaticians from different health science backgrounds were asked to share their opinions using the Delphi technique, with 48 participants engaging in all three rounds.

RESULTS

The study highlighted that 96% of participants deemed cybersecurity in healthcare critical for protecting data. Compliance with regulations (91.7%), reduced disruptions (69%), improved patient care (65%), trust (58.3%), and reputation (54%) were additional advantages. However, the study also identified top challenges to cybersecurity implementation, such as time/resource constraints (65%) and disruption to workflows/services (60.4%). Staff resistance, insider threats, and legacy system issues were also anticipated obstacles. Neglecting to implement cybersecurity measures in healthcare could lead to a higher risk of data breaches (96%), financial/legal penalties for hospitals (79%), and concerns about patient safety (65%).

CONCLUSION

It is imperative to prioritize cybersecurity in the healthcare industry to mitigate these risks and ensure patient confidence, health system stability, and, ultimately, save lives. A unified approach is required to enforce policies, modify behaviors, and adopt innovative practices to combat cyberattacks effectively.

Construction of an evaluation index system of core competencies for critical care blood purification nurses in China: A Delphi study

AIM

The purpose of this study was to construct a core competencies evaluation index system for critical care blood purification nurses in China.

BACKGROUND

While nursing is an integral part of critical care blood purification treatment, there are no established indicators to evaluate the core competencies of critical care blood purification nurses.

DESIGN

A Delphi study.

METHODS

An initial draft of the competencies evaluation index system for critical care blood purification nurses was developed through a literature review and semi-structured interviews. From February 2023 to March 2023, a two-round Delphi survey was conducted to consult with 18 experts in the field of critical care blood purification from eight provinces in China to rate the importance of each item and propose modifications to the evaluation index system.

RESULTS

The effective questionnaire recovery rates in two rounds of expert consultation were 94.4 % and 94.1 % and the average expert authority coefficients were 0.88 in both rounds. The core competencies evaluation index system of critical care blood purification nurses consisted of 39 items in five domains, namely theoretical knowledge, practical skills, professional development capability, critical thinking ability and personal qualities and attributes. The Kendall's W coefficients for the first- and second-level indicators were.21 and.20 in the first round and.23 and.25, respectively, in the second round of consultations (p < .01).

CONCLUSION

The core competencies evaluation index system of critical care blood purification nurses is scientific and reliable and can provide references for the recruitment, training and management of critical care blood purification nurses.

The development of a safe opioid use agreement for surgical care using a modified Delphi method

BACKGROUND

Opioids prescribed to treat postsurgical pain have contributed to the ongoing opioid epidemic. While opioid prescribing practices have improved, most patients do not use all their pills and do not safely dispose of leftovers, which creates a risk for unsafe use and diversion. We aimed to generate consensus on the content of a "safe opioid use agreement" for the perioperative settings to improve patients' safe use, storage, and disposal of opioids.

METHODS

We conducted a modified three-round Delphi study with clinicians across surgical specialties, quality improvement (QI) experts, and patients. In Round 1, participants completed a survey rating the importance and comprehensibility of 10 items on a 5-point Likert scale and provided comments. In Round 2, a sub-sample of participants attended a focus group to discuss items with the lowest agreement. In Round 3, the survey was repeated with the updated items. Quantitative values from the Likert scale and qualitative responses were summarized.

RESULTS

Thirty-six experts (26 clinicians, seven patients/patient advocates, and three QI experts) participated in the study. In Round 1, >75% of respondents rated at least four out of five on the importance of nine items and on the comprehensibility of six items. In Round 2, participants provided feedback on the comprehensibility, formatting, importance, and purpose of the agreement, including a desire for more specificity and patient education. In Round 3, >75% of respondents rated at least four out of five for comprehensibility and importance of all 10 updated item. The final agreement included seven items on safe use, two items on safe storage, and one item on safe disposal.

CONCLUSION

The expert panel reached consensus on the importance and comprehensibility of the content for an opioid use agreement and identified additional patient education needs. The agreement should be used as a tool to supplement rather than replace existing, tailored education.

The core epistemic responsibilities of universities: Results from a Delphi study

Epistemic responsibilities (ERs) of universities concern equipping and empowering its researchers, educators and students to attain, produce, exchange and disseminate knowledge. ERs can potentially guide universities in improving education, research and in service to society. Building on earlier philosophical work, we applied empirical methods to identify core ERs of universities and their constituting elements. We used a three-round Delphi survey, alternating between closed questions to gain consensus, and open questions to let panelists motivate their answers. 46 panelists participated in our study. We reached consensus on six ERs: 1) to foster research integrity, 2) to stimulate the development of intellectual virtues, 3) to address the big questions of life, 4) to cultivate the diversity of the disciplinary fields, 5) to serve and engage with society at large, and 6) to cultivate and safeguard academic freedom. Together the six ERs contain 27 elements. Consensus rates ranged from 73%-100% for both the ERs and their elements. Participants' detailed responses led to substantial improvements in the accompanying descriptions of the ERs. Our findings can inform the debate about the roles and responsibilities of universities, and inform researchers and policy makers to emphasize epistemic tasks of universities.

An overview of facilitators and barriers in the development of eHealth interventions for people of low socioeconomic position: A Delphi study

OBJECTIVE

eHealth interventions can improve the health outcomes of people with a low socioeconomic position (SEP) by promoting healthy lifestyle behaviours. However, developing and implementing these interventions among the target group can be challenging for professionals. To facilitate the uptake of effective interventions, this study aimed to identify the barriers and facilitators anticipated or experienced by professionals in the development, reach, adherence, implementation and evaluation phases of eHealth interventions for people with a low SEP.

METHOD

We used a Delphi method, consisting of two online questionnaires, to determine the consensus on barriers and facilitators anticipated or experienced during eHealth intervention phases and their importance. Participants provided open-ended responses in the first round and rated statements in the second round. The interquartile range was used to calculate consensus, and the (totally) agree ratings were used to assess importance.

RESULTS

Twenty-seven professionals participated in the first round, and 19 (70.4%) completed the second round. We found a consensus for 34.8% of the 46 items related to highly important rated barriers, such as the lack of involvement of low-SEP people in the development phase, lack of knowledge among professionals about reaching the target group, and lack of knowledge among lower-SEP groups about using eHealth interventions. Additionally, we identified a consensus for 80% of the 60 items related to highly important rated facilitators, such as rewarding people with a low SEP for their involvement in the development phase and connecting eHealth interventions to the everyday lives of lower-SEP groups to enhance reach.

CONCLUSION

Our study provides valuable insights into the barriers and facilitators of developing eHealth interventions for people with a low SEP by examining current practices and offering recommendations for future improvements. Strengthening facilitators can help overcome these barriers. To achieve this, we recommend defining the roles of professionals and lower-SEP groups in each phase of eHealth intervention and disseminating this study's findings to professionals to optimize the impact of eHealth interventions for this group.

The development of a Cannabis Knowledge Assessment Tool (CKAT)

BACKGROUND

Misconceptions about the health risks of cannabis remain prevalent, indicating the need to improve public health messaging and determine the effectiveness of educational programming. Our objective was to develop a standardized questionnaire to measure knowledge about cannabis in the context of cannabis legalization.

METHODS

A Cannabis Knowledge Assessment Tool (CKAT) was created using the Delphi method. A purposive sample of healthcare professionals, policymakers, academics, patients, and students served as the content and development experts. Principal component analysis from the codes identified from open-ended feedback guided the item development. Upon completion, the CKAT was administered as a pre- and post-test in four schools (7th and 9th Grade) in Canada. The data were analysed to determine whether knowledge scores changed after participating in a cannabis education program.

RESULTS

Twenty-four experts initially participated in the Delphi process and 18 (75% retention) continued throughout. Principal component analysis identified 3 domains: 1) effects of cannabis on the individual, 2) general information about cannabis, and 3) cannabis harm reduction. The final questionnaire consisted of 16 multiple-true-false questions (64 items) and received a Flesch-Kincaid Grade Level of 6.3, and a SMOG index score of 7.6. The CKAT was completed by 132 students; seventy-three 7th grade and fifty-nine 9th grade students. The baseline mean CKAT score was 46.2 (SD:5.5), which increased to 50.7 (SD:4.6) after the cannabis educational program (p<0.05).

CONCLUSIONS

A novel tool to measure knowledge of cannabis was developed and piloted in 7th grade and 9th grade students. Future studies are required to test usability and validity of the CKAT in other contexts.

Delphi: A Democratic and Cost-Effective Method of Consensus Generation in Transplantation

The Thrombotic Microangiopathy Banff Working Group (TMA-BWG) was formed in 2015 to survey current practices and develop minimum diagnostic criteria (MDC) for renal transplant TMA (Tx-TMA). To generate consensus among pathologists and nephrologists, the TMA BWG designed a 3-Phase study. Phase I of the study is presented here. Using the Delphi methodology, 23 panelists with >3 years of diagnostic experience with Tx-TMA pathology listed their MDC suggesting light, immunofluorescence, and electron microscopy lesions, clinical and laboratory information, and differential diagnoses. Nine rounds (R) of consensus resulted in MDC validated during two Rs using online evaluation of whole slide digital images of 37 biopsies (28 TMA, 9 non-TMA). Starting with 338 criteria the process resulted in 24 criteria and 8 differential diagnoses including 18 pathologic, 2 clinical, and 4 laboratory criteria. Results show that 3/4 of the panelists agreed on the diagnosis of 3/4 of cases. The process also allowed definition refinement for 4 light and 4 electron microscopy lesions. For the first time in Banff classification, the Delphi methodology was used to generate consensus. The study shows that Delphi is a democratic and cost-effective method allowing rapid consensus generation among numerous physicians dealing with large number of criteria in transplantation.

Consensus Competencies for Postgraduate Fellowship Training in Global Neurology

BACKGROUND AND OBJECTIVES

Use a modified Delphi approach to develop competencies for neurologists completing ≥1 year of advanced global neurology training.

METHODS

An expert panel of 19 United States-based neurologists involved in global health was recruited from the American Academy of Neurology Global Health Section and the American Neurological Association International Outreach Committee. An extensive list of global health competencies was generated from review of global health curricula and adapted for global neurology training. Using a modified Delphi method, United States-based neurologists participated in 3 rounds of voting on a survey with potential competencies rated on a 4-point Likert scale. A final group discussion was held to reach consensus. Proposed competencies were then subjected to a formal review from a group of 7 neurologists from low- and middle-income countries (LMICs) with experience working with neurology trainees from high-income countries (HICs) who commented on potential gaps, feasibility, and local implementation challenges of the proposed competencies. This feedback was used to modify and finalize competencies.

RESULTS

Three rounds of surveys, a conference call with United States-based experts, and a semistructured questionnaire and focus group discussion with LMIC experts were used to discuss and reach consensus on the final competencies. This resulted in a competency framework consisting of 47 competencies across 8 domains: (1) cultural context, social determinants of health and access to care; (2) clinical and teaching skills and neurologic medical knowledge; (3) team-based practice; (4) developing global neurology partnerships; (5) ethics; (6) approach to clinical care; (7) community neurologic health; (8) health care systems and multinational health care organizations.

DISCUSSION

These proposed competencies can serve as a foundation on which future global neurology training programs can be built and trainees evaluated. It may also serve as a model for global health training programs in other medical specialties as well as a framework to expand the number of neurologists from HICs trained in global neurology.

Rating versus ranking in a Delphi survey: a randomized controlled trial

BACKGROUND

The Delphi technique has steeply grown in popularity in health research as a structured approach to group communication process. Rating and ranking are two different procedures commonly used to quantify participants' opinions in Delphi surveys. We explored the influence of using a rating or ranking approach on item prioritization (main outcome), questionnaire completion time, and evaluation of task difficulty in a Delphi survey aimed at identifying priorities for the organization of primary cardiovascular care.

METHODS

A randomized controlled parallel group trial was embedded in a three-round online Delphi survey. After an "open" first round, primary care patients, trained patient partners, and primary care clinicians from seven primary care practices were allocated 1:1 to a rating or ranking assessment group for the remainder of the study by stratified permuted block randomization, with strata based on participants' gender and status. Agreement on item prioritization between the experimental groups was measured by calculating Krippendorff's alpha reliability coefficient on the aggregate rank order of items in each group after the final round. Self-reported ease or difficulty with the assessment task was measured with the Single Ease Question.

RESULTS

Thirty-six panelists (13 clinic patients, 7 patient partners, 16 clinicians; 60% females) were randomized to the rating (n = 18) or ranking (n = 18) group, with 30 (83%) completing all rounds. Both groups identified the same highest priorities from a set of 41 items, but significant discrepancies were found as early as the seventh top item. There was moderately strong agreement between the priority ordering of top items common to both groups (Krippendorff's alpha = 0.811, 95% CI = 0.669-0.920). A 9-min mean difference to complete the third-round questionnaire in favor of the rating group failed to achieve statistical significance (p = 0.053). Ranking was perceived as more difficult (p < 0.001).

CONCLUSIONS

A rating or ranking procedure led to modestly similar item prioritization in a Delphi survey, but ranking was more difficult. This study should be replicated with a larger number of participants and with variations in the ranking and rating procedures.

TRIAL REGISTRATION

Not applicable.

Evaluating user experience with immersive technology in simulation-based education: A modified Delphi study with qualitative analysis

BACKGROUND

Immersive technology is becoming more widespread in simulation-based medical education with applications that both supplement and replace traditional teaching methods. There is a lack of validated measures that capture user experience to inform of the technology utility. We aimed to establish a consensus of items and domains that different simulation experts would include in a measure for immersive technology use.

METHODS

A 3-stage modified Delphi using online software was conducted to support the conceptual framework for the proposed measure. The first round was informed by prior work on immersive technology in simulation. In the first round, participants were asked to describe what we could measure in simulation-based education and technology. Thematic analysis generated key themes that were presented to the participants in the second round. Ranking of importance in round 2 was determined by mean rank scores. The final round was an online meeting for final consensus discussion and most important domains by experts were considered.

RESULTS

A total of 16 simulation experts participated in the study. A consensus was reached on the ideal measure in immersive technology simulation that would be a user questionnaire and domains of interest would be: what was learnt, the degree of immersion experienced, fidelity provided, debrief, psychological safety and patient safety. No consensus was reached with the barriers that this technology introduces in education.

CONCLUSIONS

There is varied opinion on what we should prioritise in measuring the experience in simulation practice. Importantly, this study identified key areas that aids our understanding on how we can measure new technology in educational settings. Synthesising these results in to a multidomain instrument requires a systematic approach to testing in future research.

Using the Behaviour Change Wheel and modified Delphi method to identify behavioural change techniques for improving adherence to smoking cessation medications

BACKGROUND

Medication adherence is a crucial component of the pharmacological treatment of smoking. Previous interventions targeted to improve adherence to smoking cessation medications (SCMs) were designed using pragmatic approaches. This study aims to develop a comprehensive intervention strategy to improve adherence to SCMs using the Behaviour Change Wheel (BCW) and a modified Delphi method.

METHODS

Recommendations for the design of intervention strategies were based on the BCW guide and six studies conducted by the research team. Factors related to healthcare providers and consumers (person making a quit attempt) that showed associations with adherence were mapped into the Capability, Opportunity, Motivation, Behaviour (COM-B) model, and corresponding intervention functions and policy categories. Interventions were then represented using the Behaviour Change Technique Taxonomy. Finally, a modified Delphi study using 17 experts was conducted to evaluate the nominated strategies using the Acceptability, Practicability, Effectiveness, Affordability, Side-effects, and Equity (APEASE) criteria.

RESULTS

Following a stepped approach, an adherence support wheel was designed to guide implementation strategies and programmes. Thirteen intervention strategies were selected. The selected interventions include providing detailed instructions on how to use SCMs; establishing realistic expectations from SCMs; and providing training for healthcare providers regarding comprehensive smoking cessation care with specifics on the provision of adherence support.

CONCLUSION

The BCW guide and a modified Delphi were applied successfully to design interventions tailored to improve adherence to SCMs. Improving adherence to SCMs requires a comprehensive intervention approach involving various stakeholders. Future research is needed to assess the effectiveness of the nominated intervention strategies.

Investigating the national implementation of SMS and mobile messaging in population screening (The SIPS study)

BACKGROUND

The increasing use of mobile messaging within healthcare, poses challenges for screening programmes, which involve communicating with large, diverse populations. This modified Delphi study aimed to create guidance regarding the use of mobile messaging for screening programmes, to facilitate greater, and equitable screening uptake.

METHODS

Initial recommendations were derived from a literature review, expert scoping questionnaire, public consultation, and discussion with relevant national organisations. Experts from the fields of public health, screening commissioning, industry and academia voted upon the importance and feasibility of these recommendations across two consensus rounds, using a 5-point Likert scale. Items reaching consensus, defined a priori at 70%, on importance and feasibility formed 'core' recommendations. Those reaching this threshold on importance only, were labelled 'desirable'. All items were subsequently discussed at an expert meeting to confirm suitability.

FINDINGS

Of the initial 101 items, 23 reached consensus regarding importance and feasibility. These 'core' items were divided across six domains: message content, timing, delivery, evaluation, security, and research considerations. 'Core' items such as explicitly specifying the sender and the role of patient involvement in development of screening message research had the highest agreement. A further 17 'desirable' items reached consensus regarding importance, but not feasibility, including the integration into GP services to enable telephone verification.

INTERPRETATION

These findings forming national guidance for services, will enable programmes to overcome implementation challenges and facilitate uptake of screening invitations. By providing a list of desirable items, this study provides areas for future consideration, as technological innovation in messaging continues to grow.

FUNDING

NIHR Imperial Patient Safety Translational Research Centre.

Development and assessment of a vaccine administration training course for medical students

BACKGROUND

Vaccine administration skills are very important for physicians, especially in the era of global pandemics. However, medical students have reported that practical sessions to develop these skills are insufficient. Therefore, the aim of our study was to develop a vaccination training course for medical students. We also examined its educational effectiveness.

METHODS

5th- and 6th-year medical students at the University of Tokyo were recruited to attend the vaccine administration training course in 2021. These students were our study participants. Our course consisted of an orientation part, which included a lecture on the indications, adverse events, and vaccination techniques of flu vaccines and practice on a simulator, and a main part in which the staff of the University of Tokyo Hospital were actually vaccinated. Before and after the main part of the course, study participants completed an online questionnaire that assessed their confidence in vaccine administration technique through a five-point Likert scale. We also surveyed their feedback about the course content and process. At the beginning and end of the main part, their technical competence in vaccination was assessed by two independent doctors. These doctors used a validated checklist scale (ranging from 16 to 80) and a global rating scale (ranging from 0 to 10). We used their mean scores for analysis. The quantitative data were analyzed through the Wilcoxon signed-rank test. For the qualitative data of the questionnaire, thematic analysis was conducted.

RESULTS

All 48 course participants participated in our study. Participants' confidence in vaccination technique (Z = -5.244, p < 0.05) and vaccination skill significantly improved (checklist rating: Z = -5.852, p < 0.05; global rating: Z = -5.868, p < 0.05). All participants rated the course as, "overall educational." Our thematic analysis identified four emerging themes: interest in medical procedures, efficacy of supervision and feedback, efficacy of "near-peer" learning, and very instructive course.

CONCLUSIONS

In our study, we developed a vaccine administration course for medical students, assessed their vaccination techniques and confidence in those techniques, and investigated their perceptions of the course. Students' vaccination skills and confidence improved significantly after the course, and they positively evaluated the course based on a variety of factors. Our course will be effective in educating medical students about vaccination techniques.

How to reach agreement: the impact of different analytical approaches to Delphi process results in core outcomes set development

BACKGROUND

Core outcomes sets are increasingly used to define research outcomes that are most important for a condition. Different consensus methods are used in the development of core outcomes sets; the most common is the Delphi process. Delphi methodology is increasingly standardised for core outcomes set development, but uncertainties remain. We aimed to empirically test how the use of different summary statistics and consensus criteria impact Delphi process results.

METHODS

Results from two unrelated child health Delphi processes were analysed. Outcomes were ranked by mean, median, or rate of exceedance, and then pairwise comparisons were undertaken to analyse whether the rankings were similar. The correlation coefficient for each comparison was calculated, and Bland-Altman plots produced. Youden's index was used to assess how well the outcomes ranked highest by each summary statistic matched the final core outcomes sets. Consensus criteria identified in a review of published Delphi processes were applied to the results of the two child-health Delphi processes. The size of the consensus sets produced by different criteria was compared, and Youden's index was used to assess how well the outcomes that met different criteria matched the final core outcomes sets.

RESULTS

Pairwise comparisons of different summary statistics produced similar correlation coefficients. Bland-Altman plots showed that comparisons involving ranked medians had wider variation in the ranking. No difference in Youden's index for the summary statistics was found. Different consensus criteria produced widely different sets of consensus outcomes (range: 5-44 included outcomes). They also showed differing abilities to identify core outcomes (Youden's index range: 0.32-0.92). The choice of consensus criteria had a large impact on Delphi results.

DISCUSSION

The use of different summary statistics is unlikely to affect how outcomes are ranked during a Delphi process: mean, median, and rates of exceedance produce similar results. Different consensus criteria have a large impact on resultant consensus outcomes and potentially on subsequent core outcomes sets: our results confirm the importance of adhering to pre-specified consensus criteria.

Eligibility Criteria of Participants in Randomized Controlled Trials Assessing Conservative Management of Cervical Radiculopathy: A Systematic Review

STUDY DESIGN

Systematic review.

OBJECTIVE

The aim of this study was to evaluate the inclusion and exclusion criteria for participants in randomized control trials (RCTs) assessing conservative management for cervical radiculopathy (CR), to determine if any consensus exists within the literature.

SUMMARY OF BACKGROUND DATA

A 2012 systematic review identified a lack of uniformity for the eligibility criteria of participants in RCTs evaluating conservative interventions for CR. Since then, a large number of RCTs have been published, signaling the need for an updated evaluation of this topic.

MATERIALS AND METHODS

We electronically searched MEDLINE, CENTRAL, CINAHL, Embase, and PsycINFO from inception to June 15, 2022, to identify RCTs assessing conservative management of CR. Information extracted was analyzed to determine the level of homogeneity and/or heterogeneity of the inclusion and exclusion criteria across studies.

RESULTS

Seventy-six RCTs met our inclusion criteria with 68 distinct trials identified. The inclusion of arm pain with or without another symptom ( i.e. numbness, paresthesia, or weakness) was required in 69.12% of trials, 50% of trials required participants to exhibit neck symptoms, and 73.53% of studies required some form of clinical examination findings, but inconsistencies existed for the number and type of tests used. Furthermore, 41.18% of trials included imaging, with 33.82% of trials requiring magnetic resonance imaging findings. The most common exclusion criteria included were the presence of red flags and cervical myelopathy in 66.18% and 58.82% of trials, respectively.

CONCLUSIONS

Overall, there is still a lack of uniformity for the inclusion/exclusion criteria of trials assessing the conservative management of CR, with some improvements noted compared with the 2012 review. Based on the current literature assessing the diagnostic utility of clinical symptoms and confirmatory tests, we proposed inclusion criteria for trials assessing conservative interventions. Future research should aim to develop standardized classification criteria to improve consistency among studies.

Development and validation of knowledge assessment scales on sarcopenia and fall for Chinese community-dwelling older adults

AIM

This study aimed to develop and validate sarcopenia and fall knowledge assessment scales for community-dwelling older adults.

METHODS

A five-phase, systematic and standardized process was used. Phase 1: item pools were constructed based on the Symptom Interpretation Model. Phase 2: the Delphi expert consultation was carried out for items selection and revision. Phase 3: a pilot survey was carried out to further select and revise the items. Phase 4: older adults were surveyed to finalize the items. Phase 5: older adults were surveyed to test the psychometric properties of the two developed scales, including construct validity, reliability and acceptability.

RESULTS

Both scales comprise three dimensions (symptom, risk factor and management strategy), with 10 items for the sarcopenia knowledge assessment scale and 14 items for the fall knowledge assessment scale. They had acceptable construct validity, with all indicators meeting their specific criteria. Their reliability was acceptable, with the Cronbach's α coefficients being 0.82 for both scales, the value of spilt-half reliability being 0.86 for the sarcopenia knowledge assessment scale and 0.85 for the fall knowledge assessment scale. Their acceptability was good, with both scales having a completion rate of 94.35% and an average completion time of 5 min.

DISCUSSION

Two Chinese knowledge assessment scales with acceptable validity, reliability and acceptability have been developed, which will facilitate the assessment of the knowledge on sarcopenia and fall among community-dwelling older adults, especially for large-scale surveys. Geriatr Gerontol Int 2023; ••: ••-••.

Developing strategies "SATIA": How to manage dysphagia in older people? A Delphi panel consensus

AIM

To develop a set of evidence-informed strategies to assist older people to improve swallowing functions and prevent further damage from complications.

DESIGN

A two-round Delphi survey.

METHODS

An initial set of dysphagia care strategies with 74 relevant items for older people was formed based on a literature review by seven researchers. An online survey was conducted by 21 panellists, and data of experts' opinions were collected and analysed by improved Delphi method.

RESULTS

The positive coefficients in the two rounds of expert consultation were 85.71% and 83.33%, respectively. Consensus was reached with 53 items included and was allocated into the following five sections: (1) screening, (2) assessment, (3) training, (4) interventions and (5) management. These strategies were named with the acronym of each section-"SATIA". The management strategy can be applied to guide the management of older people with dysphagia.

Research priorities relating to the delivery of cardiovascular prevention and rehabilitation programmes: results of a modified Delphi process

OBJECTIVE

The purpose of this British Association for Cardiovascular Prevention and Rehabilitation (BACPR) research priority setting project (PSP) was to identify a top 10 list of priority research questions for cardiovascular prevention and rehabilitation (CVPR).

METHODS

The PSP was facilitated by the BACPR clinical study group (CSG), which integrates as part of the British Heart Foundation Clinical Research Collaborative. Following a literature review to identify unanswered research questions, modified Delphi methods were used to engage CVPR-informed expert stakeholders, patients, partners and conference delegates in ranking the relevance of research questions during three rounds of an anonymous e-survey. In the first survey, unanswered questions from the literature review were ranked and respondents proposed additional questions. In the second survey, these new questions were ranked. Prioritised questions from surveys 1 and 2 were incorporated in a third/final e-survey used to identify the top 10 list.

RESULTS

From 459 responses across the global CVPR community, a final top 10 list of questions were distilled from an overall bank of 76 (61 from the current evidence base and a further 15 from respondents). These were grouped across five broad categories: access and remote delivery, exercise and physical activity, optimising programme outcomes, psychosocial health and impact of the pandemic.

CONCLUSIONS

This PSP used a modified Delphi methodology to engage the international CVPR community to generate a top 10 list of research priorities within the field. These prioritised questions will directly inform future national and international CVPR research supported by the BACPR CSG.