Developing consensus in Histopathology: the role of the Delphi method

Variation in cystectomy pathology reporting practice-results from an international survey of 212 pathologists

The pathological assessment of cystectomy specimens is important for accurate prognostic information and to inform adjuvant therapy decisions. However, there is limited evidence regarding the best approach to fixation, dissection, block selection and microscopic assessment of cystectomies. We report the results of an international survey of 212 pathologists and their approach to cystectomy pathology. There is variation at all stages of the specimen journey including in fixation and dissection techniques, and in the approach to evaluating residual tumour. This is particularly evident in the post-neoadjuvant chemotherapy setting where there is variable use of response scoring systems and differing approaches to sampling. We also find variation in the use of digital and molecular pathology in cystectomy specimens. Finally, we have suggested areas for future research in cystectomy pathological assessment.

Delphi studies in social and health sciences-Recommendations for an interdisciplinary standardized reporting (DELPHISTAR). Results of a Delphi study

BACKGROUND

While different proposals exist for a guideline on reporting Delphi studies, none of them has yet established itself in the health and social sciences and across the range of Delphi variants. This seems critical because empirical studies demonstrate a diversity of modifications in the conduction of Delphi studies and sometimes even errors in the reporting. The aim of the present study is to close this gap and formulate a general reporting guideline.

METHOD

In an international Delphi procedure, Delphi experts were surveyed online in three rounds to find consensus on a reporting guideline for Delphi studies in the health and social sciences. The respondents were selected via publications of Delphi studies. The preliminary reporting guideline, containing 65 items on five topics and presented for evaluation, had been developed based on a systematic review of the practice of Delphi studies and a systematic review of existing reporting guidelines for Delphi studies. Starting in the second Delphi round, the experts received feedback in the form of mean values, measures of dispersion, a summary of the open-ended responses and their own response in the previous round. The final draft of the reporting guideline contains the items on which at least 75% of the respondents agreed by assigning scale points 6 and 7 on a 7-point Likert scale.

RESULTS

1,072 experts were invited to participate. A total of 91 experts completed the first Delphi round, 69 experts the second round, and 56 experts the third round. Of the 65 items in the first draft of the reporting guideline, consensus was ultimately reached for 38 items addressing the five topics: Title and Abstract (n = 3), Context (n = 7), Method (n = 20), Results (n = 4) and Discussion (n = 4). Items focusing on theoretical research and on dissemination were either rejected or remained subjects of dissent.

DISCUSSION

We assume a high level of acceptance and interdisciplinary suitability regarding the reporting guideline presented here and referred to as the "Delphi studies in social and health sciences-recommendations for an interdisciplinary standardized reporting" (DELPHISTAR). Use of this reporting guideline can substantially improve the ability to compare and evaluate Delphi studies.

Recommendations for Post-Operative RadioTherapy After Complete Resection of Thymoma-a French DELPHI Consensus Initiative

INTRODUCTION

Thymomas are rare intrathoracic malignancies that can relapse after surgery. Whether or not Post-Operative RadioTherapy (PORT) should be delivered after surgery remains a major issue. RADIORYTHMIC is an ongoing, multicenter, randomized phase 3 trial addressing this question in patients with completely R0 resected Masaoka-Koga stage IIb/III thymoma. Experts in the field met to develop recommendations for PORT.

METHODS

A scientific committee from the RYTHMIC network identified key issues regarding the modalities of PORT in completely resected thymoma. A DELPHI method was used to question 24 national experts, with 115 questions regarding the following: (1) imaging techniques, (2) clinical target volume (CTV) and margins, (3) dose constraints to organs at risk, (4) dose and fractionation, and (5) follow-up and records. Consensus was defined when opinions reached more than or equal to 80% agreement.

RESULTS

We established the following recommendations: preoperative contrast-enhanced computed tomography (CT) scan is recommended (94% agreement); optimization of radiation delivery includes either a four-dimensional CT-based planning (82% agreement), a breath-holding inspiration breath-hold-based planning, or daily control CT imaging (81% agreement); imaging fusion based on cardiovascular structures of preoperative and planning CT scan is recommended (82% agreement); right coronary and left anterior descending coronary arteries should be delineated as cardiac substructures (88% agreement); rotational RCMI/volumetric modulated arc therapy is recommended (88% agreement); total dose is 50 Gy (81% agreement) with 1.8 to 2 Gy per fraction (94% agreement); cardiac evaluation and follow-up for patients with history of cardiovascular disease are recommended (88% agreement) with electrocardiogram and evaluation of left ventricular ejection fraction at 5 years and 10 years.

CONCLUSION

This is the first consensus for PORT in thymoma. Implementation will help to harmonize practices.

Histopathology reporting of temporal artery biopsy specimens for giant cell arteritis: results of a modified Delphi study

The temporal artery biopsy (TAB) is regarded as the gold-standard test in the diagnosis of giant cell arteritis (GCA). There is a lack of agreement among experienced pathologists regarding the diagnostic features and classification of inflammation observed in TAB sections in the diagnosis of GCA.

AIMS

The aim of this research study was to establish consensus on the key parameters which should be included in a standardised reporting proforma for TAB specimens. We specifically investigated factors pertaining to clinical information, specimen handling and microscopic pathological features.

METHODS

A modified Delphi process, comprising three survey rounds and three virtual consensus group meetings, was undertaken by 13 UK-based pathology or ophthalmology consultants, with a 100% response rate across the three rounds. Initial statements were formulated after a literature review and participants were asked to rate their agreement using a nine-point Likert scale. Consensus was defined a priori as an agreement of ≥70% and individual feedback was provided after each round, together with data on the distribution of group responses.

RESULTS

Overall, 67 statements reached consensus and 17 statements did not. The participants agreed on the core microscopic features to be included in a pathology report and felt that a proforma would facilitate consistent reporting practices.

CONCLUSIONS

Our work revealed uncertainty surrounding the correlation between clinical parameters (eg, laboratory markers of inflammation and steroid therapy duration) and microscopic findings, and we propose areas for future research.

Development of entrustable professional activities for emergency medicine medical education fellowships: A modified Delphi study

Background

It is essential that medical education (MedEd) fellows achieve desired outcomes prior to graduation. Despite the increase in postgraduate MedEd fellowships in emergency medicine (EM), there is no consistently applied competency framework. We sought to develop entrustable professional activities (EPAs) for EM MedEd fellows.

Methods

From 2021 to 2022, we used a modified Delphi method to achieve consensus for EPAs. EM education experts generated an initial list of 173 EPAs after literature review. In each Delphi round, panelists were asked to make a binary choice of whether to include the EPA. We determined an inclusion threshold of 70% agreement a priori. After the first round, given the large number of EPAs meeting inclusion threshold, panelists were instructed to vote whether each EPA should be included in the "20 most important" EPAs for a MedEd fellowship. Modifications were made between rounds based on expert feedback. We calculated descriptive statistics.

Results

Seventeen experts completed four Delphi rounds each with 100% response. After Round 1, 87 EPAs were eliminated and two were combined. Following Round 2, 46 EPAs were eliminated, seven were combined, and three were included in the final list. After the third round, one EPA was eliminated and 13 were included. After the fourth round, 11 EPAs were eliminated. The final list consisted of 16 EPAs in domains of career development, education theory and methods, research and scholarship, and educational program administration.

Conclusions

We developed a list of 16 EPAs for EM MedEd fellowships, the first step in implementing competency-based MedEd.

Consensus based recommendations for the diagnosis of serous tubal intraepithelial carcinoma: an international Delphi study

AIM

Reliably diagnosing or safely excluding serous tubal intraepithelial carcinoma (STIC), a precursor lesion of tubo-ovarian high-grade serous carcinoma (HGSC), is crucial for individual patient care, for better understanding the oncogenesis of HGSC, and for safely investigating novel strategies to prevent tubo-ovarian carcinoma. To optimize STIC diagnosis and increase its reproducibility, we set up a three-round Delphi study.

METHODS AND RESULTS

In round 1, an international expert panel of 34 gynecologic pathologists, from 11 countries, was assembled to provide input regarding STIC diagnosis, which was used to develop a set of statements. In round 2, the panel rated their level of agreement with those statements on a 9-point Likert scale. In round 3, statements without previous consensus were rated again by the panel while anonymously disclosing the responses of the other panel members. Finally, each expert was asked to approve or disapprove the complete set of consensus statements. The panel indicated their level of agreement with 64 statements. A total of 27 statements (42%) reached consensus after three rounds. These statements reflect the entire diagnostic work-up for pathologists, regarding processing and macroscopy (three statements); microscopy (eight statements); immunohistochemistry (nine statements); interpretation and reporting (four statements); and miscellaneous (three statements). The final set of consensus statements was approved by 85%.

CONCLUSION

This study provides an overview of current clinical practice regarding STIC diagnosis amongst expert gynecopathologists. The experts' consensus statements form the basis for a set of recommendations, which may help towards more consistent STIC diagnosis.

The Evaluation of Rural Outdoor Dining Environment from Consumer Perspective

The quality of the environment should be measured by the satisfaction of the public and guided by the issues of public concern. With the development of the internet, social media as the main platform for people to exchange information has become a data source for planning and management analysis. Nowadays, the rural catering industry is becoming increasingly competitive, especially after the pandemic. How to further enhance the competitiveness of the rural catering industry has become a hot topic in the industry. From the perspective of consumers, we explored consumers' preferences in a rural outdoor dining environment through social media data. The research analyzed the social media data through manual collection and object detection, divided the landscape of the rural outdoor dining environment into eight categories with 35 landscape elements, and then used BP (Back Propagation) neural network nonlinear fitting and least square linear fitting to analyze the 11,410 effective review pictures from eight rural restaurants' social media comments in Chengdu. We derived the degree of consumer preference for the landscape quality of the rural outdoor dining environment and analyzed the differences in preference among three different groups (regular customers, customers with children, and customers with the elderly). The study found that agricultural resources are an important factor in the competitiveness of rural restaurant environments; that children's emotions when using activity facilities can positively influence consumers' dining experiences; that safety and hygiene environment are important factors influencing the decisions of parent-child dining; and that older people are more interested in outdoor nature, etc. The research results provide suggestions and knowledge for rural restaurant managers and designers through human-oriented needs from the perspective of consumers, and clarify the preferences and expectations of different consumer groups for rural restaurant landscapes while achieving the goal of rural landscape protection.

Establishment of Thoracic Surgical Difficulty Assessment Scale based on Delphi method

OBJECTIVES

The difficulty of surgery, which is related to surgical safety, has only been mentioned as a subjective perception for a long time. There are few studies to quantitatively and systematically evaluate the difficulty of thoracic surgery. This study aims to establish a quantitative evaluation index system for thoracic surgical difficulty, and to evaluate its reliability and validity.

METHODS

During the 2 national thoracic surgery academic conferences, the factors that may affect the difficulty of thoracic surgery were evaluated by the thoracic surgeons via semi open questionnaires, and then the evaluation item pool of thoracic surgery difficulty was established. The importance of each indicator in the evaluation item pool was graded by 2 rounds of Delphi method. The average score, full score rate and coefficient of variation of each index were calculated, and the composite index method was used to decide whether to delete the indicator.Finally, the difficulty evaluation scale of thoracic surgery was constructed. The surgical data of patients with thoracic tumors were collected. The scale was used to evaluate the difficulty of thoracic surgery for lung, esophageal, and mediastinal tumors. The reliability and validity of the scale were evaluated by the commonly used difficulty evaluation indexes: Operation time, intraoperative estimated blood loss, Visual Analog Scale (VAS), side injury rate, and blood transfusion rate as standards.

RESULTS

A total of 230 questionnaires were distributed in the 2 rounds of survey, and 149 valid questionnaires were collected after eliminating duplicate questionnaires. Through 2 rounds of Delphi consultation with 20 experts, the difficulty evaluation indexes were scored and screened, and the difficulty evaluation scale of thoracic surgery was established. It included 5 main indexes (surgical decision-making, operation space, separation interface, reconstruction method, and surgical materials) and 16 secondary indexes [American Society of Anesthesiologists (ASA) classification, surgical trauma, operator experience, space size, space depth, space source, space adjacent, interface content, anatomical gap, visual field, interface size, reconstruction complexity, reconstruction scope, autologous materials, artificial biomaterials and instruments]. After weighting, the total score of Thoracic Surgery Difficulty Evaluation Scale was from 1 to 3. A Score at 1 standed for simplicity, and score at 3 standed for difficulty. Further data were collected for 127 cases of thoracic tumor surgery. The difficulty scores of surgery for lung, esophageal, and mediastinal tumor were 1.69±0.26, 1.86±0.18, and 1.56±0.31, respectively, and the Cronbach's α coefficients of the scale in 3 tumor surgeries were 0.993, 0.974, and 0.989, repectively, and the Spearman Brown coefficients were 0.996, 0.984, and 0.996, respectively. The Spearman correlation coefficients of operation difficulty score with operation time, estimated blood loss, and VAS were 0.360 and 0.634, 0.632 and 0.578, 0.696 and 0.875, respectively (all P<0.05). The incidence of postoperative complications in the difficult operation group (difficulty score >1.85) was higher than that in the non-difficult operation group (P=0.02).

CONCLUSIONS

The quantitative Thoracic Surgical Difficulty Assessment Scale has been successfully established, which shows good reliability and validity in thoracic tumor surgery. The Thoracic Surgical Difficulty Assessment Scale has broad application prospects in reducing the difficulty of the surgery, controlling surgical complications, and training surgeons.