Measures for Persons with Spinal Cord Injury to Monitor Their Transitions in Care, Health, Function, and Quality of Life Experiences and Needs: A Protocol for Co-Developing a Self-Evaluation Tool

Evaluating the experiences of persons with spinal cord injury (PwSCI) regarding their transitions in care and changes in health, function, and quality of life is complex, fragmented, and involves multiple tools and measures. A staged protocol was implemented with PwSCI and relevant expert stakeholders initially exploring and selecting existing measures or tools through a modified Delphi process, followed by choosing one of two options. The options were to either support the use of the 10 selected tools from the Delphi method or to co-develop one unique condensed tool with relevant measures to evaluate all four domains. The stakeholders chose to co-develop one tool to be used by persons with SCI to monitor their transition experiences across settings and care providers. This includes any issues with care or support they needed to address at the time of discharge from acute care or rehabilitation and in the community at 3, 6, and 12 months or longer post-discharge. Once developed, the tool was made available online for the final stage of the protocol, which proposes that the tool be reliability tested prior to its launch, followed by validation testing by PwSCI.

Technical guideline for intra-prepontine cisternal drug delivery via spinal puncture through subarachnoid catheterization

OBJECTIVES

The distribution characteristics of intrathecal drugs and the limitation of current catheterization techniques make traditional intrathecal analgesic treatment nearly useless for refractory craniofacial pain, such as trigemina neuralgia. This technical guideline aims to promote the widespread and standardize the application of intra-prepontine cisternal drug delivery via spinal puncture and catheterization.

METHODS

A modified Delphi approach was used to work for this guideline. On the issues related to the intra-prepontine cisternal targeted drug delivery technique, the working group consulted 10 experts from the field with 3 rounds of email feedback and 3 rounds of conference discussion.

RESULTS

For the efficacy and safety of the intra-prepontine cisternal targeted drug delivery technique, a consensus was formed on 7 topics (with an agreement rate of more than 80%), including the principles of the technique, indications and contraindications, patient preparation, surgical specifications for intra-prepontine cisternal catheter placement, analgesic dosage coordination, analgesic management, and prevention and treatment of complications.

CONCLUSIONS

Utilizing the intra-prepontine cisternal drug infusion system to manage refractory craniofacial pain could provide advantages in terms of minimally invasive, secure, and effective treatment. This application can not only alleviate the suffering of individuals experiencing the prolonged pain but also support the maintenance of quality of life and dignity in their final moments, justifiing its widespread dissemination and standardized adoption in domestic and international professional fields.

Evaluating Functional Performance Tests in those with Non-arthritic Intra-articular Hip Pain: An International Consensus Statement

Background

Non-arthritic intra-articular hip pain, caused by various pathologies, leads to impairments in range of motion, strength, balance, and neuromuscular control. Although functional performance tests offer valuable insights in evaluating these patients, no clear consensus exists regarding the optimal tests for this patient population.

Purpose

This study aimed to establish expert consensus on the application and selection of functional performance tests in individuals presenting with non-arthritic intra-articular hip pain.

Study Design

A modified Delphi technique was used with fourteen physical therapy experts, all members of the International Society for Hip Arthroscopy (ISHA). The panelists participated in three rounds of questions and related discussions to reach full consensus on the application and selection of functional performance tests.

Results

The panel agreed that functional performance tests should be utilized at initial evaluation, re-evaluations, and discharge, as well as criterion for assessing readiness for returning to sports. Tests should be as part of a multimodal assessment of neuromuscular control, strength, range of motion, and balance, applied in a graded fashion depending on the patient's characteristics. Clinicians should select functional performance tests with objective scoring criteria and prioritize the use of tests with supporting psychometric evidence. A list of recommended functional performance tests with varying intensity levels is provided. Low-intensity functional performance tests encompass controlled speed in a single plane with no impact. Medium-intensity functional performance tests involve controlled speed in multiple planes with low impact. High-intensity functional performance tests include higher speeds in multiple planes with higher impact and agility requirements. Sport-specific movement tests should mimic the patient's particular activity or sport.

Conclusion

This international consensus statement provides recommendations for clinicians regarding selection and utilization of functional performance tests for those with non-arthritic intra-articular hip pain. These recommendations will encourage greater consistency and standardization among clinicians during a physical therapy assessment.

Expert Consensus on the Long-Term Effectiveness of Medical Nutrition Therapy and Its Impact on the Outcomes of Adults with Phenylketonuria

Many adults with phenylketonuria (PKU) rely on medical nutrition therapy (MNT; low phenylalanine (Phe) diet with protein substitutes/medical foods) to maintain blood Phe concentrations within recommended ranges and prevent PKU-associated comorbidities. Despite disease detection through newborn screening and introduction of MNT as early as birth, adherence to MNT often deteriorates from childhood onwards, complicating the assessment of its effectiveness in the long term. Via a modified Delphi process, consensus (≥70% agreement) was sought on 19 statements among an international, multidisciplinary 13-member expert panel. After three iterative voting rounds, the panel achieved consensus on 17 statements related to the limitations of the long-term effectiveness of MNT (7), the burden of long-term reliance on MNT (4), and its potential long-term detrimental health effects (6). According to the expert panel, the effectiveness of MNT is limited in the long term, is associated with a high treatment burden, and demonstrates that adults with PKU are often unable to achieve metabolic control through dietary management alone, creating an unmet need in the adult PKU population.

Establishing a Standardized Clinical Consensus for Reporting Complications Following Lateral Lumbar Interbody Fusion

Background and Objectives: Mitigating post-operative complications is a key metric of success following interbody fusion. LLIF is associated with a unique complication profile when compared to other approaches, and while numerous studies have attempted to report the incidence of post-operative complications, there is currently no consensus regarding their definitions or reporting structure. The aim of this study was to standardize the classification of complications specific to lateral lumbar interbody fusion (LLIF). Materials and Methods: A search algorithm was employed to identify all the articles that described complications following LLIF. A modified Delphi technique was then used to perform three rounds of consensus among twenty-six anonymized experts across seven countries. Published complications were classified as major, minor, or non-complications using a 60% agreement threshold for consensus. Results: A total of 23 articles were extracted, describing 52 individual complications associated with LLIF. In Round 1, forty-one of the fifty-two events were identified as a complication, while seven were considered to be approach-related occurrences. In Round 2, 36 of the 41 events with complication consensus were classified as major or minor. In Round 3, forty-nine of the fifty-two events were ultimately classified into major or minor complications with consensus, while three events remained without agreement. Vascular injuries, long-term neurologic deficits, and return to the operating room for various etiologies were identified as important consensus complications following LLIF. Non-union did not reach significance and was not classified as a complication. Conclusions: These data provide the first, systematic classification scheme of complications following LLIF. These findings may improve the consistency in the future reporting and analysis of surgical outcomes following LLIF.

Thoracic UltrasONOgraphy Reporting: The TUONO Consensus

The widespread use of the lung ultrasound (LUS) has not been followed by the development of a comprehensive standardized tool for its reporting in the intensive care unit (ICU) which could be useful to promote consistency and reproducibility during clinical examination. This work aims to define the essential features to be included in a standardized reporting tool and provides a structured model form to fully express the diagnostic potential of LUS and facilitate intensivists in the use of a LUS in everyday clinical ICU examination. We conducted a modified Delphi process to build consensus on the items to be integrated in a standardized report form and on its structure. A committee of 19 critical care physicians from 19 participating ICUs in Italy was formed, including intensivists experienced in ultrasound from both teaching hospitals and referral hospitals, and internationally renowned experts on the LUS. The consensus for 31 statements out of 33 was reached at the third Delphi round. A structured model form was developed based on the approved statements. The development of a standardized model as a backbone to report a LUS may facilitate the guidelines' application in clinical practice and increase inter-operator agreement. Further studies are needed to evaluate the effects of standardized reports in critically ill patients.

Defining new roles and competencies for administrative staff and faculty in the age of competency-based medical education

PURPOSE

These authors sought to define the new roles and competencies required of administrative staff and faculty in the age of CBME.

METHOD

A modified Delphi process was used to define the new CBME roles and competencies needed by faculty and administrative staff. We invited international experts in CBME (volunteers from the ICBME Collaborative email list), as well as faculty members and trainees identified via social media to help us determine the new competencies required of faculty and administrative staff in the CBME era.

RESULTS

Thirteen new roles were identified. The faculty-specific roles were: National Leader/Facilitator in CBME; Institutional/University lead for CBME; Assessment Process & Systems Designer; Local CBME Leads; CBME-specific Faculty Developers or Trainers; Competence Committee Chair; Competence Committee Faculty Member; Faculty Academic Coach/Advisor or Support Person; Frontline Assessor; Frontline Coach. The staff-specific roles were: Information Technology Lead; CBME Analytics/Data Support; Competence Committee Administrative Assistant.

CONCLUSIONS

The authors present a new set of faculty and staff roles that are relevant to the CBME context. While some of these new roles may be incorporated into existing roles, it may be prudent to examine how best to ensure that all of them are supported within all CBME contexts in some manner.

Developing a research agenda on exercise and physical activity for people with limb loss in Canada

PURPOSE

There is a lack of high-quality evidence about the effects of exercise or physical activity interventions for adults with lower limb amputations (LLAs). A planning meeting involving stakeholders (i.e., people with LLA, community advocates, health care providers, researchers) was organized to identify key research priorities related to exercise and physical activity for people with LLAs.

METHODS

We used a collaborative prioritized planning process with a pre-meeting survey and 2-day virtual meeting that included: identification and prioritization of challenges or gaps; identification and consolidation of solutions; and action planning. This process integrated a modified Delphi approach, including anonymous feedback in two surveys.

RESULTS

Thirty-five stakeholders participated. Six challenges related to exercise and physical activity for people with LLA were prioritized. One solution was prioritized for each challenge. After consolidation of solutions, participants developed five research action plans for research including: developing an on-line interface; developing and evaluating peer-support programs to support physical activity; examining integration of people with LLA into cardiac rehabilitation; development and evaluation of health provider education; and determining priority outcomes related to physical activity and exercise.

CONCLUSIONS

This collaborative process resulted in an action plan for amputation research and fostered collaborations to move identified priorities into action.IMPLICATIONS FOR REHABILITATIONLower limb amputations impact mobility leading to lower levels of physical activity.There are research gaps in our understanding of the effects of exercise or physical activity interventions for adults with lower limb amputations.Through a collaborative planning process, participants prioritized research directions on physical activity and exercise for people with LLA to advance research in the field.Action plans for research focused on developing online resources, peer support, cardiac rehabilitation for people with LLA, health provider education and determining priority outcomes related to physical activity and exercise.

A National Modified Delphi Consensus Process to Prioritize Experiences and Interventions for Antipsychotic Medication Deprescribing Among Adult Patients With Critical Illness

Antipsychotic medications are frequently prescribed to critically ill patients leading to their continuation at transitions of care thereafter. The aim of this study was to generate evidence-informed consensus statements with key stakeholders on antipsychotic minimization and deprescribing for ICU patients.

DESIGN

We completed three rounds of surveys in a National modified Delphi consensus process. During rounds 1 and 2, participants used a 9-point Likert scale (1-strongly disagree, 9-strongly agree) to rate perceptions related to antipsychotic prescribing (i.e., experiences regarding delivery of patient care), knowledge and frequency of antipsychotic use, knowledge surrounding antipsychotic guideline recommendations, and strategies (i.e., interventions addressing current antipsychotic prescribing practices) for antipsychotic minimization and deprescribing. Consensus was defined as a median score of 1-3 or 7-9. During round 3, participants ranked statements on antipsychotic minimization and deprescribing strategies that achieved consensus (median score 7-9) using a weighted ranking scale (0-100 points) to determine priority.

SETTING

Online surveys distributed across Canada.

SUBJECTS

Fifty-seven stakeholders (physicians, nurses, pharmacists) who work with ICU patients.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

Participants prioritized six consensus statements on strategies for consideration when developing and implementing interventions to guide antipsychotic minimization and deprescribing. Statements focused on limiting antipsychotic prescribing to patients: 1) with hyperactive delirium, 2) at risk to themselves, their family, and/or staff due to agitation, and 3) whose care and treatment are being impacted due to agitation or delirium, and prioritizing 4) communication among staff about antipsychotic effectiveness, 5) direct and efficient communication tools on antipsychotic deprescribing at transitions of care, and 6) medication reconciliation at transitions of care.

CONCLUSIONS

We engaged diverse stakeholders to generate evidence-informed consensus statements regarding antipsychotic prescribing perceptions and practices that can be used to implement interventions to promote antipsychotic minimization and deprescribing strategies for ICU patients with and following critical illness.

Distal femoral extension osteotomy and patellar tendon advancement or shortening in ambulatory children with cerebral palsy: A modified Delphi consensus study and literature review

PURPOSE

In children with cerebral palsy, flexion deformities of the knee can be treated with a distal femoral extension osteotomy combined with either patellar tendon advancement or patellar tendon shortening. The purpose of this study was to establish a consensus through expert orthopedic opinion, using a modified Delphi process to describe the surgical indications for distal femoral extension osteotomy and patellar tendon advancement/patellar tendon shortening. A literature review was also conducted to summarize the recent literature on distal femoral extension osteotomy and patellar tendon shortening/patellar tendon advancement.

METHOD

A group of 16 pediatric orthopedic surgeons, with more than 10 years of experience in the surgical management of children with cerebral palsy, was established. The group used a 5-level Likert-type scale to record agreement or disagreement with statements regarding distal femoral extension osteotomy and patellar tendon advancement/patellar tendon shortening. Consensus for the surgical indications for distal femoral extension osteotomy and patellar tendon advancement/patellar tendon shortening was achieved through a modified Delphi process. The literature review, summarized studies of clinical outcomes of distal femoral extension osteotomy/patellar tendon shortening/patellar tendon advancement, published between 2008 and 2022.

RESULTS

There was a high level of agreement with consensus for 31 out of 44 (70%) statements on distal femoral extension osteotomy. Agreement was lower for patellar tendon advancement/patellar tendon shortening with consensus reached for 8 of 21 (38%) of statements. The literature review included 25 studies which revealed variation in operative technique for distal femoral extension osteotomy, patellar tendon advancement, and patellar tendon shortening. Distal femoral extension osteotomy and patellar tendon advancement/patellar tendon shortening were generally effective in correcting knee flexion deformities and extensor lag, but there was marked variation in outcomes and complication rates.

CONCLUSION

The results from this study will provide guidelines for surgeons who care for children with cerebral palsy and point to unresolved questions for further research.

LEVEL OF EVIDENCE

level V.

Optimal Urine Culture Diagnostic Stewardship Practice- Results from an Expert Modified-Delphi Procedure

BACKGROUND

Urine cultures are nonspecific for infection and often lead to misdiagnosis of urinary tract infection and unnecessary antibiotics. Diagnostic stewardship is a set of procedures that modifies test ordering, processing, and reporting in order to optimize diagnosis and downstream treatment. This study aimed to develop expert guidance on best practices for urine culture diagnostic stewardship.

METHODS

A RAND-modified Delphi approach with a multidisciplinary expert panel was used to ascertain diagnostic stewardship best practices. Clinical questions to guide recommendations were grouped in three thematic areas (ordering, processing, reporting) in practice settings of emergency department, inpatient, ambulatory, and long-term care. Fifteen experts ranked recommendations on a 9-point Likert scale. Recommendations on which the panel did not reach agreement were discussed in a virtual meeting, and a then second round of ranking by email was completed. After secondary review of results and panel discussion, a series of guidance statements was developed.

RESULTS

165 questions were reviewed with the panel reaching agreement on 104, leading to 18 overarching guidance statements. The following strategies were recommended to optimize ordering urine cultures: requiring documentation of symptoms, alerts to discourage ordering in the absence of symptoms, and cancelling repeat cultures. For urine culture processing, conditional reflex urine cultures and urine white blood cell as criteria were supported. For urine culture reporting, appropriate practices included nudges to discourage treatment under specific conditions and selective reporting of antibiotics to guide therapy decisions.

CONCLUSIONS

These 18 guidance statements can optimize use of the imperfect urine culture for better patient outcomes.

A modified Delphi approach to enhance nurturing of professionalism in postgraduate medical education in Singapore

INTRODUCTION

Nurturing professional identities instils behavioural standards of physicians, in turn facilitating consistent professional attitudes, practice, and patient care. Identities are socioculturally constructed efforts, thus we must account for the social, cultural, and local healthcare factors that shape physicians' roles, responsibilities and expectations. This study aims to forward a program to nurture professionalism amongst physicians in Singapore.

METHODS

A 3-phased-evidenced-based-approach was used. First, a systematic scoping review (SSR) was conducted to identify professionalism elements. Second, a questionnaire was created drawing from the SS's findings. Third, a modified Delphi involving local experts identifying socioculturally appropriate elements to nurture professionalism was conducted.

RESULTS

The 124 included articles in the SSR revealed definitions, knowledge, skills, and approaches to nurturing professionalism. The modified Delphi identified professional traits, virtues, communication, ethical, self-care, teaching and assessment methods, and support mechanisms.

CONCLUSION

Results formed the basis to a holistic and longitudinal program focused on instilling professional traits and competencies over time through personalised and holistic support of physicians. Findings will be of interest to medical communities in the region and beyond.

Quality measures for end-of-life care for children with cancer: A modified Delphi approach

BACKGROUND

The quality of adult end-of-life (EOL) cancer care has benefited from quality measures, but corresponding pediatric measures are lacking. Therefore, the authors used a validated expert panel method to recommend EOL quality measures for pediatric oncology.

METHODS

The authors used the modified Delphi method to assess potential quality measures. Panelists were selected on the basis of professional organization nominations and expert qualifications. Pediatric and adult oncology, pediatric palliative care, social work, nursing, and hospice were represented. The authors provided the panel with a literature review on 20 proposed measures derived from adult measures and bereaved family interviews. The panel first scored the importance of each measure on a 9-point scale and then discussed the measures via a conference call. The panel then rescored the measures. According to a priori standards, measures with median scores ≥ 7 with at least 7 of 9 experts ranking it as ≥4 were endorsed.

RESULTS

The 16 endorsed measures included measures related to avoidance of medically intense care (eg, intensive care unit death and intubation in the last 14 days of life), death location (eg, death in the preferred location), hospital policies/programs (eg, the removal of visitor restrictions at EOL and the presence of a bereavement program), and supportive care services (eg, pediatric palliative care involvement and sibling needs assessment). Unendorsed measures included avoidance of chemotherapy at EOL and home death.

CONCLUSIONS

Expert panel-endorsed quality measures have been developed for EOL care in pediatric oncology. The measures need validation with bereaved families and further refinement before they are ready for real-world application as a tool for standardizing EOL care in pediatric oncology.

LAY SUMMARY

Quality measures for end-of-life care for children with cancer lag behind adult quality measures. Therefore, the authors have conducted an expert panel to develop an endorsed list of quality measures for end-of-life care for children with cancer. The 16 endorsed measures include measures related to avoidance of medically intense care (eg, intensive care unit death and intubation in the last 14 days of life), location of death (eg, death in the preferred location), hospital policies/programs (eg, the removal of visitor restrictions at the end of life and the presence of a bereavement program), and supportive care services (eg, pediatric palliative care involvement and sibling needs assessment).

Prioritizing a Research Agenda of Transitional Care Interventions for Childhood-Onset Disabilities

Transitional care interventions have the potential to optimize continuity of care, improve health outcomes and enhance quality of life for adolescents and young adults living with chronic childhood-onset disabilities, including neurodevelopmental disorders, as they transition to adult health and social care services. The paucity of research in this area poses challenges in identifying and implementing interventions for research, evaluation and implementation. The purpose of this project was to advance this research agenda by identifying the transitional care interventions from the scientific literature and prioritize interventions for study. A modified-Delphi approach involving two rounds of online surveys followed by a face-to-face consensus meeting with knowledge users, researchers and clinician experts in transitional care (n = 19) was used. A subsequent virtual meeting concluded the formulation of next steps. Experts rated 16 categories of interventions, derived from a systematic review, on importance, impact, and feasibility. Seven of the 16 interventions categories received a mean score rating of ≥7 (out of 10) on all three rating categories. Participants then rank ordered the reduced list of seven interventions in order of priority and the top four ranked interventions advanced for further discussion at a consensus meeting. Using the Template for Intervention Description and Replication (TIDieR) checklist as a guide, the participants identified that a study of a peer system navigator was worthy of future evaluation. This study highlighted that transitional care interventions are complex and multifaceted. However, the presence of a peer to support system navigation, advocacy and individual and family education was considered the most ideal intervention addressing the current gap in care. Future research, which aims to engage patients and families in a co-design approach, is recommended to further develop this intervention.

Primary care electronic medical records can be used to predict risk and identify potentially modifiable factors for early and late death in adult onset epilepsy

OBJECTIVE

To use clinically informed machine learning to derive prediction models for early and late premature death in epilepsy.

METHODS

This was a population-based primary care observational cohort study. All patients meeting a case definition for incident epilepsy in the Health Improvement Network database for inclusive years 2000-2012 were included. A modified Delphi process identified 30 potential risk factors. Outcome was early (within 4 years of epilepsy diagnosis) and late (4 years or more from diagnosis) mortality. We used regularized logistic regression, support vector machines, Gaussian naive Bayes, and random forest classifiers to predict outcomes. We assessed model calibration, discrimination, and generalizability using the Brier score, mean area under the receiver operating characteristic curve (AUC) derived from stratified fivefold cross-validation, plotted calibration curves, and extracted measures of association where possible.

RESULTS

We identified 10 499 presumed incident cases from 11 194 182 patients. All models performed comparably well following stratified fivefold cross-validation, with AUCs ranging from 0.73 to 0.81 and from 0.71 to 0.79 for early and late death, respectively. In addition to comorbid disease, social habits (alcoholism odds ratio [OR] for early death = 1.54, 95% confidence interval [CI] = 1.12-2.11 and OR for late death = 2.62, 95% CI = 1.66-4.16) and treatment patterns (OR for early death when no antiseizure medication [ASM] was prescribed at baseline = 1.33, 95% CI = 1.07-1.64 and OR for late death after receipt of enzyme-inducing ASM at baseline = 1.32, 95% CI = 1.04-1.66) were significantly associated with increased risk of premature death. Baseline ASM polytherapy (OR = 0.55, 95% CI = 0.36-0.85) was associated with reduced risk of early death.

SIGNIFICANCE

Clinically informed models using routine electronic medical records can be used to predict early and late mortality in epilepsy, with moderate to high accuracy and evidence of generalizability. Medical, social, and treatment-related risk factors, such as delayed ASM prescription and baseline prescription of enzyme-inducing ASMs, were important predictors.

Development of Learning Objectives to Guide Enhancement of Chronic Disease Prevention and Management Curricula in Undergraduate Medical Education

Phenomenon: Chronic disease is a leading cause of death and disability in the United States. With an increase in the demand for healthcare and rising costs related to chronic care, physicians need to be better trained to address chronic disease at various stages of illness in a collaborative and cost-effective manner. Specific and measurable learning objectives are key to the design and evaluation of effective training, but there has been no consensus on chronic disease learning objectives appropriate to medical student education. Approach: Wagner's Chronic Care Model (CCM) was selected as a theoretical framework to guide development of an enhanced chronic disease prevention and management (CDPM) curriculum. Findings of a literature review of CDPM competencies, objectives, and topical statements were mapped to each of the six domains of the CCM to understand the breadth of existing learning topics within each domain. At an in-person meeting, medical educators prepared a survey for the modified Delphi approach. Attendees identified 51 possible learning objectives from the literature review mapping, rephrased the CCM domains as competencies, constructed possible CDPM learning objectives for each competency with the goal of reaching multi-institutional consensus on a limited number of CDPM learning objectives that would be feasible for institutions to use to guide enhancement of medical student curricula related to CDPM. After the meeting, the group developed a survey which included 39 learning objectives. In the study phase of the modified Delphi approach, 32 physician CDPM experts and educators completed an online survey to prioritize the top 20 objectives. The next step occurred at a CDPM interest group in-person meeting with the goal of identifying the top 10 objectives. Findings: The CCM domains were reframed as the following competencies for medical student education: patient self-care management, decision support, clinical information systems, community resources, delivery systems and teams, and health system practice and improvement. Eleven CDPM learning objectives were identified within the six competencies that were most important in developing curriculum for medical students. Insights: These learning objectives cut across education on the prevention and management of individual chronic diseases and frame chronic disease care as requiring the health system science competencies identified in the CCM. They are intended to be used in combination with traditional disease-specific pathophysiology and treatment objectives. Additional efforts are needed to identify specific curricular strategies and assessment tools for each learning objective.

Development of a Screening Scale for Community-dwelling Older Adults with Multiple Care Needs

Objectives: To develop a screening scale for community-dwelling older adults with multiple care needs.Methods: A modified Delphi was employed; 10 experts were invited to evaluate the relevancy, clarity, and suitability of the scale. A descriptive evaluation survey was tested on the screening scale users who were community volunteers to evaluate the clarity, relevance, and usefulness of the scale using a 10-point rating system. Confirmatory factor analysis was applied to determine the suitability of the factorial structure of the HCOASS. The internal consistency was examined using Kuder-Richardson Formula 20. A suitable cutoff point was developed using receiver operating characteristic analysis.Results: In the first round of the modified Delphi, the item-level content validity index (I-CVI) on the content relevance, item clarity, and suitability of the scale were all higher than .90, .80, and .80, respectively. In the second round, the scores for content relevancy, item clarity, and suitability were all 1.0. Community volunteers rated highly on the scale. The result of the confirmatory factor analysis indicated a good fit. The internal consistency reliability was satisfactory. The area under curve (AUC), sensitivity, and specificity for cutoff score of 6/7 were .91, 88%, and 81%, respectively.Conclusions: The screening scale demonstrated adequate reliability, content validity, and discriminant validity.Clinical Implications: The screening scale would serve as a reference for community volunteers in the identification of community-dwelling older adults with multiple care needs.

Expert Recommendations on Frequency of Utilization of Common Laboratory Tests in Medical Inpatients: a Canadian Consensus Study

BACKGROUND

Repetitive inpatient laboratory testing in the face of clinical stability is a marker of low-value care. However, for commonly encountered clinical scenarios on medical units, there are no guidelines defining appropriate use criteria for laboratory tests.

OBJECTIVE

This study seeks to establish consensus-based recommendations for the utilization of common laboratory tests in medical inpatients.

DESIGN

This study uses a modified Delphi method. Participants completed two rounds of an online survey to determine appropriate testing frequencies for selected laboratory tests in commonly encountered clinical scenarios. Consensus was defined as agreement by at least 80% of participants.

PARTICIPANTS

Participants were 36 experts in internal medicine across Canada defined as internists in independent practice for ≥ 5 years with experience in medical education, quality improvement, or both. Experts represented 8 of the 10 Canadian provinces and 13 of 17 academic institutions.

MAIN MEASURES

Laboratory tests and clinical scenarios included were those that were considered common on medical units. The final survey contained a total of 45 clinical scenarios looking at the utilization of six laboratory tests (complete blood count, electrolytes, creatinine, urea, international normalized ratio, and partial thromboplastin time). The possible frequency choices were every 2-4 h, 6-8 h, twice a day, daily, every 2-3 days, weekly, or none unless there was specific diagnostic suspicion. These scenarios were reviewed by two internists with training in quality improvement and survey methods.

KEY RESULTS

Of the 45 initial clinical scenarios included, we reached consensus on 17 scenarios. We reached weak consensus on an additional 19 scenarios by combining two adjacent frequency categories.

CONCLUSIONS

A Canadian expert panel of internists has provided frequency recommendations on the utilization of six common laboratory tests in medical inpatients. These recommendations need validation in prospective studies to assess whether restrictive versus liberal laboratory test ordering impacts patient outcomes.

Implementation of government-directed policy in the hospital setting: a modified Delphi study

Background

In the last 20 years governments have sought to introduce policy that improves the quality of care provided in hospitals, yet little research has been done to understand how these policies are implemented, factors that affect the implementation process or what should be considered by decision-makers during policy development or implementation planning. Experts with real-life experience in the introduction and implementation of policy are best placed to provide valuable insight into practical issues that affect implementation and the associated outcomes of these policies.

Methods

A modified Delphi study of experts in hospital policy development and implementation was undertaken to investigate factors influencing the implementation of government-directed policy in the hospital setting. This study built on the findings of two previous studies — a qualitative study of clinician perspectives of policy implementation and a systematic review and meta-synthesis, in which common contextual factors and policy characteristics associated with policy implementation were ascertained. International experts with extensive experience in government-directed policy implementation at global, national, corporate, jurisdictional and organisational levels were asked to provide opinions on predetermined factors and the feasibility of considering these in policy development and implementation planning. Survey design and analysis was guided by the Consolidated Framework for Implementation Research.

Results

Eleven experts from four countries and with different health system perspectives participated in the study. Consensus was reached on the importance of all predetermined factors in the first survey round with additional factors for investigation highlighted by participants for examination in subsequent rounds. On study completion, expert consensus was reached on 24 factors of importance; only 20 of these factors reached consensus for feasibility.

Conclusions

Study findings indicated that, whilst there are multiple factors of importance in policy implementation across all Consolidated Framework for Implementation Research domains, some factors, such as establishment of roles and responsibilities for implementation and organisational lines of accountability, are feasible for consideration at a hospital level only. In addition, four factors did not reach consensus in terms of feasibility, indicating that it may not be practical to consider all factors of importance when implementing policy; this has important implications for implementation planning and resource allocation.

Consensus-Derived Quality Performance Indicators for Neuroendocrine Tumour Care

Quality performance indicators (QPIs) are used to monitor the delivery of cancer care. Neuroendocrine tumours (NETs) are a family of individually uncommon cancers that derive from neuroendocrine cells or their precursors, and can occur in most organs. There are currently no QPIs available for NETs and their heterogeneity makes QPI development difficult. CommNETs is a collaboration between NET clinicians, researchers and advocates in Canada, Australia and New Zealand. We created QPIs for NETs using a three-step consensus process. First, a multidisciplinary team used the nominal group technique to create candidates (n = 133) which were then curated into appropriateness statements (62 statements, 44 sub-statements). A two-stage modified RAND/UCLA Delphi consensus process was conducted: an online survey rated the statement appropriateness then the top-ranked statements (n = 20) were assessed in a face-to-face meeting. Finally, 10 QPIs met consensus criteria; documentation of primary site, proliferative index, differentiation, tumour board review, use of a structured pathology report, presence of distant metastasis, 5- and 10-year disease-free and overall survival. These NET QPIs will be trialed as a method to monitor and improve care for people with NETs and to facilitate international comparison.

Arthrogryposis multiplex congenita definition: Update using an international consensus-based approach

Arthrogryposis multiplex congenita (AMC) has been described and defined in thousands of articles, but the terminology used has been inconsistent. Some have described it as a diagnosis or syndrome, others as a term or clinical finding. This lack of common language can lead to confusion in clinical and research communities. The aim of this study was to develop a consensus-based definition for AMC using international expert opinion. A consensus-based definition will help harmonize research and clinical endeavors and will facilitate communication among families, clinicians, and researchers. This article describes the methodology used leading to a proposed definition of AMC. First, a literature review was conducted to identify AMC definitions used in included studies. The most commonly used words in the definitions were extracted. Second, a group of eight experts in AMC was selected to identify elements considered critically important to the definition of AMC. Third, based on these critical elements and the literature review, a definition was drafted by the research team. Fourth, a modified Delphi consensus process was conducted using electronic surveys with 25 experts in the field of AMC from eight countries. Survey results were analyzed quantitatively and qualitatively and drafts were modified accordingly. Three rounds of surveys were completed until consensus was reached on a definition of AMC. An annotation of this definition, developed by a panel of international experts, is provided in a separate manuscript in this special issue.

Defining antimicrobial stewardship competencies for undergraduate health professional education in the United Kingdom: A study protocol

Multi-drug resistant infections have been identified as one of the greatest threats to human health. Healthcare professionals are involved in an array of patient care activities for which an understanding of antimicrobial stewardship is important. Although antimicrobial prescribing and stewardship competencies have been developed for healthcare professionals who adopt the role of a prescriber, competencies do not exist for other medicine-related stewardship activities. Undergraduate education provides an ideal opportunity to prepare healthcare professionals for these roles and activities. This report presents a protocol for a study designed to provide national consensus on antimicrobial stewardship competencies appropriate for undergraduate healthcare professional education. A modified Delphi process will be used in which a panel of Experts, comprising members from across the United Kingdom, with expertise in prescribing and medicines management with regard to the education and practice of healthcare professionals, and antimicrobial prescribing and stewardship, will be invited to take part in two survey rounds. The competencies developed will be applicable to all undergraduate healthcare professional education programmes. They will help to standardise curricula content and enhance the impact of antimicrobial stewardship education.

Establishing priorities on the range of conditions managed by UK community practitioner nurse prescribers: A modified Delphi consensus study

AIM

To provide national consensus on the range of conditions community practitioner nurse prescribers manage and for which it is considered important that they can prescribe.

BACKGROUND

Around 35,000 community practitioner nurse prescribers in the United Kingdom are able to prescribe from a limited formulary. Although prescribing is a key role for these nurses, there has been a decline in the numbers of community practitioner nurse prescribers who prescribe. It is evident that changing patterns of client and service delivery, changes the role of community nurses and the conditions they manage, however, little is known about the conditions community practitioner nurse prescribers manage.

DESIGN AND METHODS

A modified Delphi approach comprising three on-line surveys delivered to a national Expert Panel of 89 qualified community practitioner prescribers. Data collection took place between January-March 2017.

RESULTS

Panelists reached a consensus, with consistent high levels of agreement reached, on nineteen conditions for which it is believed community practitioner nurse prescribers should be able to prescribe. Conditions identified by school nurses (N = 12) and health visitors (N = 7) were mainly acutely focused, whereas those identified by district nurses (N = 9) and community staff nurses (N = 6) included both long-term and acute conditions.

CONCLUSION

Given the high degree of consensus, this list of conditions should influence any decisions about the items community and public health nurses should be able to prescribe. The findings should also influence the education and training of these nurses.

Derivation of a Performance Checklist for Ultrasound-Guided Arthrocentesis Using the Modified Delphi Method

OBJECTIVES

Arthrocentesis is an important skill for physicians in multiple specialties. Recent studies indicate a superior safety and performance profile for this procedure using ultrasound guidance for needle placement, and improving quality of care requires a valid measurement of competency using this modality.

METHODS

We endeavored to create a validated tool to assess the performance of this procedure using the modified Delphi technique and experts in multiple disciplines across the United States.

RESULTS

We derived a 22-item checklist designed to assess competency for the completion of ultrasound-guided arthrocentesis, which demonstrated a Cronbach's alpha of 0.89, indicating an excellent degree of internal consistency.

CONCLUSIONS

Although we were able to demonstrate content validity for this tool, further validity evidence should be acquired after the tool is used and studied in clinical and simulated contexts.

Development of an active behavioural physiotherapy intervention (ABPI) for acute whiplash-associated disorder (WAD) II management: a modified Delphi study

OBJECTIVE

To develop an active behavioural physiotherapy intervention (ABPI) for managing acute whiplash-associated disorder (WAD) II using a modified Delphi method to develop consensus for the basic features of the ABPI.

DESIGN

Modified Delphi study. Our systematic review and meta-analysis evaluating conservative management for acute WADII found that a combined ABPI may be a useful intervention to prevent patients progressing to chronicity. No previous research has considered a combined behavioural approach and active physiotherapy in the management of acute WADII patients. The ABPI was therefore developed using a rigorous consensus method using international research and local clinical whiplash experts. Descriptive statistics were used to assess consensus in each round.

SETTING

Online international survey.

PARTICIPANTS

A purposive sample of 97 potential participants (aiming to recruit n=30) consisting of international research whiplash experts, UK private physiotherapists and UK postgraduate musculoskeletal physiotherapy students were invited to participate via electronic mail with an attached participant information sheet and consent form.

RESULTS

36 individuals signed and returned the consent form. In round 1, 32/36 participants (response rate=89%, mean age±SD=36.03±13.22 years) across 8 countries (Australia, Finland, Greece, India, Netherlands, Norway, Sweden and UK) contributed to round 1 questionnaire. Response rates were 78% and 75% for rounds 2 and 3, respectively. Following round 3, 12 underlying principles (eg, return to normal function as soon as possible, pain management, encouragement of self-management, reduce fear avoidance and anxiety) achieved consensus. The treatment components reaching consensus included behavioural (eg, education, reassurance, self-management) and physiotherapy components (eg, exercises for stability and mobility). No passive intervention achieved consensus.

CONCLUSIONS

Experts suggested and agreed the underlying principles and treatment components of the ABPI for the management of acute WADII. The ABPI was underpinned by social cognitive theory focusing on self-efficacy enhancement prior to conducting a phase II trial.

Patient engagement in the process of planning and designing outpatient care improvements at the Veterans Administration Health-care System: findings from an online expert panel

CONTEXT

There is a strong interest in the Veterans Administration (VA) Health-care System in promoting patient engagement to improve patient care.

METHODS

We solicited expert opinion using an online expert panel system with a modified Delphi structure called ExpertLens^™ . Experts reviewed, rated and discussed eight scenarios, representing four patient engagement roles in designing and improving VA outpatient care (consultant, implementation advisor, equal stakeholder and lead stakeholder) and two VA levels (local and regional). Rating criteria included desirability, feasibility, patient ability, physician/staff acceptance and impact on patient-centredness and care quality. Data were analysed using the RAND/UCLA Appropriateness Method for determining consensus.

FINDINGS

Experts rated consulting with patients at the local level as the most desirable and feasible patient engagement approach. Engagement at the local level was considered more desirable than engagement at the regional level. Being an equal stakeholder at the local level received the highest ratings on the patient-centredness and health-care quality criteria.

CONCLUSIONS

Our findings illustrate expert opinion about different approaches to patient engagement and highlight the benefits and challenges posed by each. Although experts rated local consultations with patients on an as-needed basis as most desirable and feasible, they rated being an equal stakeholder at the local level as having the highest potential impact on patient-centredness and care quality. This result highlights a perceived discrepancy between what is most desirable and what is potentially most effective, but suggests that routine local engagement of patients as equal stakeholders may be a desirable first step for promoting high-quality, patient-centred care.