Quality of reporting of diagnostic accuracy studies on pelvic floor three-dimensional transperineal ultrasound: a systematic review

Study on the Consistency Between Automatic Measurement Based on Convolutional Neural Network Technology and Manual Visual Evaluation in Intracavitary Ultrasonic Cine of Anterior Pelvic

OBJECTIVES

This study was to evaluate the application of automatic measurement based on convolutional neural network (CNN) technology in intracavitary ultrasound cine of anterior pelvic.

METHODS

A total of 500 patients who underwent pelvic floor ultrasound examination at Peking University Shenzhen Hospital from July 2021 to February 2022 were retrospectively retrieved by the picture archiving and communication system (PACS) system, and 300 cases were used as a training set. The training set was labeled by three experienced ultrasound physicians to train CNN models and develop an automatic measurement software. The remaining 200 cases were used as a test set. Automatic measurement software identified relevant anatomical structures frame by frame and determined the two frames with the greatest difference, calculated the bladder neck descent (BND), urethral rotation angle (URA), and retrovesical angle (RA). Meanwhile, two experienced ultrasound physicians evaluated the resting frame and the maximum Valsalva frame on the cines by manual visual evaluation, labeled the anatomical structures in the corresponding frame, such as the inferoposterior margin of pubic symphysis, the mid-axis of pubic symphysis, bladder contour, and urethra in the front, and calculated BND, URA, and RA. Considering that the residual urine volume (RUV) in the bladder may affect the results, enrolled patients were grouped according to the RUV (10-50 mL, 50-100 mL, and >100 mL). The consistency of the results by automatic measurement and manual visual evaluation was evaluated using the intraclass correlation coefficient (ICC) and the Bland-Altman graph.

RESULTS

Of the 200 cases in the test set, 120 cases were successfully identified by the CNN automatic software with a 60% recognition rate. In the case of successful identification, the ICC of manual visual evaluation measurement and automatic measurement was 0.936 (BND), 0.911 (URA), 0.756 (RA in rest), and 0.877 (RA at maximum Valsalva), respectively. In addition, the RUV had a negligible effect on the consistency. The Bland-Altman plot shows the proportion of samples outside the limit was below 5%.

CONCLUSIONS

CNN-based automatic measurement software exhibited high reliability in anterior pelvic measurement, which results in a significantly enhanced measurement efficiency.

Changes in sexual function and vaginal topography using transperineal ultrasound after vaginal laser treatment for women with stress urinary incontinence

We aim to assess the changes in sexual function and vaginal topography using 3-D transperineal ultrasound in stress-incontinent women treated with Er:YAG vaginal laser. Two hundred and twenty women with stress urinary incontinence (SUI) treated with Er:YAG laser were recruited. Assessment before and 6 months after the treatment included vaginal topography using 3-D transperineal ultrasound and sexual function using female sexual function index questionnaire (FSFI). A total of 50 women with complete data showed that the symptomatic improvement was noted in 37 (74%) women. After Er:YAG vaginal laser treatment, significantly decreased width and cross-sectional area in proximal, middle, and distal vagina were found in women with SUI. Nearly all of the domains of FSFI improved significantly after the vaginal laser treatment, except sexual desire. In conclusion, 3-D transperineal ultrasound can be used to conduct vaginal topography. After Er:YAG vaginal laser treatment, the anatomical changes of vaginal shrinkage and the improvement of female sexual function were both noted. The favorable outcome of sexual function partly related to the tightening of vagina, as evidenced by the measurements of the 3-D transperineal ultrasound.

Scoping review on interventions to improve adherence to reporting guidelines in health research

OBJECTIVES

The goal of this study is to identify, analyse and classify interventions to improve adherence to reporting guidelines in order to obtain a wide picture of how the problem of enhancing the completeness of reporting of biomedical literature has been tackled so far.

DESIGN

Scoping review.

SEARCH STRATEGY

We searched the MEDLINE, EMBASE and Cochrane Library databases and conducted a grey literature search for (1) studies evaluating interventions to improve adherence to reporting guidelines in health research and (2) other types of references describing interventions that have been performed or suggested but never evaluated. The characteristics and effect of the evaluated interventions were analysed. Moreover, we explored the rationale of the interventions identified and determined the existing gaps in research on the evaluation of interventions to improve adherence to reporting guidelines.

RESULTS

109 references containing 31 interventions (11 evaluated) were included. These were grouped into five categories: (1) training on the use of reporting guidelines, (2) improving understanding, (3) encouraging adherence, (4) checking adherence and providing feedback, and (5) involvement of experts. Additionally, we identified lack of evaluated interventions (1) on training on the use of reporting guidelines and improving their understanding, (2) at early stages of research and (3) after the final acceptance of the manuscript.

CONCLUSIONS

This scoping review identified a wide range of strategies to improve adherence to reporting guidelines that can be taken by different stakeholders. Additional research is needed to assess the effectiveness of many of these interventions.

Selection and Reporting of Statistical Methods to Assess Reliability of a Diagnostic Test: Conformity to Recommended Methods in a Peer-Reviewed Journal

Objective

To evaluate the frequency and adequacy of statistical analyses in a general radiology journal when reporting a reliability analysis for a diagnostic test.

Materials and Methods

Sixty-three studies of diagnostic test accuracy (DTA) and 36 studies reporting reliability analyses published in the Korean Journal of Radiology between 2012 and 2016 were analyzed. Studies were judged using the methodological guidelines of the Radiological Society of North America-Quantitative Imaging Biomarkers Alliance (RSNA-QIBA), and COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) initiative. DTA studies were evaluated by nine editorial board members of the journal. Reliability studies were evaluated by study reviewers experienced with reliability analysis.

Results

Thirty-one (49.2%) of the 63 DTA studies did not include a reliability analysis when deemed necessary. Among the 36 reliability studies, proper statistical methods were used in all (5/5) studies dealing with dichotomous/nominal data, 46.7% (7/15) of studies dealing with ordinal data, and 95.2% (20/21) of studies dealing with continuous data. Statistical methods were described in sufficient detail regarding weighted kappa in 28.6% (2/7) of studies and regarding the model and assumptions of intraclass correlation coefficient in 35.3% (6/17) and 29.4% (5/17) of studies, respectively. Reliability parameters were used as if they were agreement parameters in 23.1% (3/13) of studies. Reproducibility and repeatability were used incorrectly in 20% (3/15) of studies.

Conclusion

Greater attention to the importance of reporting reliability, thorough description of the related statistical methods, efforts not to neglect agreement parameters, and better use of relevant terminology is necessary.