Inter- and Intraobserver Variation in the Assessment of Preoperative Colostograms in Male Anorectal Malformations: An ARM-Net Consortium Survey

Concordance in Intraoperative Surgeons' Opinion in the Diagnosis and Management of Acute Appendicitis: The Role of Training

OBJECTIVE

Acute appendicitis is a wide spectrum disease, from simple inflammation to evident intestinal perforation. The correct interpretation of the degree of inflammation is crucial to guarantee appropriate treatment and adherence to protocols and guidelines. In order to investigate this concordance, the authors compared the definition of appendicitis and the predicted treatment among all surgeons affiliated to a single Pediatric Surgery School (consisting of 8 different centers).

DESIGN

Twenty-two short recordings of intra-operative manipulation of appendices were shown to 56 surgeons, blindly to clinical information. Four items were collected and analyzed: classification of appendicitis, type and length of predicted antibiotic therapy, day of re-alimentation. Data were analyzed to identify the concordance kappa coefficient, stratified according to expertise of the responding surgeon.

RESULTS

The 1232 evaluations obtained in all valued items low overall concordance. Subgroup analysis identified a good agreement between younger surgeons only in the choice of antibiotic (k 0.47). However, if the centers were divided between University and non-University Hospitals, a strong agreement was found in the former both for classification (k 0.45 vs 0.32) and type of antibiotic (k 0.42 vs 0.24).

CONCLUSIONS

The overall concordance between surgeons in different centers in the diagnostic classification and predicted treatment of appendicitis is quite low. University Hospital have a highest concordance in both items at all levels of expertise; it might be postulated that teaching to younger surgeon increase the comparison between experts and finally the concordance and adherence to protocols within the center.

A Quality Assessment of the ARM-Net Registry Design and Data Collection

BACKGROUND

Registries are important in rare disease research. The Anorectal Malformation Network (ARM-Net) registry is a well-established European patient registry collecting demographic, clinical, and functional outcome data. We assessed the quality of this registry through review of the structure, data elements, collected data, and user experience.

MATERIAL AND METHODS

Design and data elements were assessed for completeness, consistency, usefulness, accuracy, validity, and comparability. An intra- and inter-user variability study was conducted through monitoring and re-registration of patients. User experience was assessed via a questionnaire on registration, design of registry, and satisfaction.

RESULTS

We evaluated 119 data elements, of which 107 were utilized and comprised 42 string and 65 numeric elements. A minority (37.0%) of the 2278 included records had complete data, though this improved to 83.5% when follow-up elements were excluded. Intra-observer variability demonstrated 11.7% incongruence, while inter-observer variability was 14.7%. Users were predominantly pediatric surgeons and typically registered patients within 11-30 min. Users did not experience any significant difficulties with data entry and were generally satisfied with the registry, but preferred more longitudinal data and patient-reported outcomes.

CONCLUSIONS

The ARM-Net registry presents one of the largest ARM cohorts. Although its collected data are valuable, they are susceptible to error and user variability. Continuous evaluations are required to maintain relevant and high-quality data and to achieve long-term sustainability. With the recommendations resulting from this study, we call for rare disease patient registries to take example and aim to continuously improve their data quality to enhance the small, but impactful, field of rare disease research.

LEVEL OF EVIDENCE

V.

Labeling male anorectal malformations: objective evaluation of radiologic imaging before surgery

Purpose

Prone cross-table lateral x-ray (CTLxR) and colostogram aid surgical planning for anorectal malformations (ARMs) without perineal fistulas. We suggest objective imaging tools to classify ARMs.

Methods

Three observers prospectively evaluated CTLxR and colostograms of male ARM patients (2012-2022) without perineal fistulas. The level of the rectal pouch was estimated with pubococcygeal (PC) and ischiatic (I) lines. On CTLxR, we described the "pigeon sign", defined as the rectal pouch ending with a beak-like image, suspicious for a rectourinary fistula. ARM was defined as rectobulbar when the rectal pouch was below the I line, rectoprostatic when between PC and I lines, and rectovesical when above the PC line. Concordance was assessed with Fleiss' kappa. Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of the "pigeon sign" were calculated.

Results

Thirteen patients were included in this study. The interobserver agreement on CTLxR was 69.2% (k = 0.54) on pouch ending, 84.6% (k = 0.69) on the "pigeon sign", and 76.9% (k = 0.69) on diagnosis; concordance between observers and intraoperative diagnosis was 66.6% (k = 0.56). The "pigeon sign" had 75% sensitivity, 100% specificity, 100% PPV, and 50% NPV. The interobserver agreement on colostograms was 84.6% (k = 0.77) on pouch ending and 89.7% (k = 0.86) on diagnosis; concordance between observers and intraoperative diagnosis was 92.3% (k = 0.90).

Conclusion

PC and I lines and the "pigeon sign" are useful tools in examining CTLxR and colostograms. Adequate CTLxR interpretation may modify surgical strategy.

Accuracy of pre-operative fistula diagnostics in anorectal malformations

Background

Surgical safety during posterior sagittal anorectal plasty (PSARP) for anorectal malformations (ARM) depends on accurate pre-operative fistula localization. This study aimed to evaluate accuracy of pre-operative fistula diagnostics.

Methods

Ethical approval was obtained. Diagnostic accuracy of pre-PSARP symptoms (stool in urine, urine in passive ostomy, urinary tract infection) and examination modalities (voiding cystourethrogram (VCUG), high-pressure colostogram, cystoscopy and ostomy endoscopy) were compared to final intra-operative ARM-type classification in all male neonates born with ARM without a perineal fistula treated at a tertiary pediatric surgery center during 2001–2020.

Results

The 38 included neonates underwent reconstruction surgery through PSARP with diverted ostomy. Thirty-one (82%) had a recto-urinary tract fistula and seven (18%) no fistula. Ostomy endoscopy yielded the highest diagnostic accuracy for fistula presence (22 correctly classified/24 examined cases; 92%), and pre-operative symptoms the lowest (21/38; 55%). For pre-operative fistula level determination, cystoscopy yielded the highest diagnostic accuracy (14/20; 70%), followed by colostogram (23/35; 66%), and VCUG (21/36; 58%). No modality proved to be statistically superior to any other.

Conclusions

Ostomy endoscopy has the highest diagnostic accuracy for fistula presence, and cystoscopy and high-pressure colostogram for fistula level determination. Correct pre-operative ARM-typing reached a maximum of 60–70%.