Quality of Reporting Noninferiority/Similarity in Research Studies of Diagnostic Imaging

Radiology Residents' Independent Diagnosis of Appendicitis Using 2-mSv Computed Tomography: A Secondary Analysis of a Large Pragmatic Randomized Trial

OBJECTIVE

To compare the diagnostic performance and clinical outcomes of 2-mSv computed tomography (CT) and conventional-dose CT (CDCT), following radiology residents' interpretation of CT examinations for suspected appendicitis.

MATERIALS AND METHODS

Altogether, 3074 patients with suspected appendicitis aged 15-44 years (28 ± 9 years, 1672 females) from 20 hospitals were randomly assigned to the 2-mSv CT (n = 1535) or CDCT (n = 1539) groups in a pragmatic trial from December 2013 and August 2016. Overall, 107 radiology residents participated in the trial as readers in the form of daily practice after online training for 2-mSv CT. They made preliminary CT reports, which were later finalized by attending radiologists via addendum reports, for 640 and 657 patients in the 2-mSv CT and CDCT groups, respectively. We compared the diagnostic performance of the residents, discrepancies between preliminary and addendum reports, and clinical outcomes between the two groups.

RESULTS

Patient characteristics were similar between the 640 and 657 patients. Residents' diagnostic performance was not significantly different between the 2-mSv CT and CDCT groups, with a sensitivity of 96.0% and 97.1%, respectively (difference [95% confidence interval {CI}], -1.1% [-4.9%, 2.6%]; P = 0.69) and specificity of 93.2% and 93.1%, respectively (0.1% [-3.6%, 3.7%]; P > 0.99). The 2-mSv CT and CDCT groups did not significantly differ in discrepancies between the preliminary and addendum reports regarding the presence of appendicitis (3.3% vs. 5.2%; -1.9% [-4.2%, 0.4%]; P = 0.12) and alternative diagnosis (5.5% vs. 6.4%; -0.9% [-3.6%, 1.8%]; P = 0.56). The rates of perforated appendicitis (12.0% vs. 12.6%; -0.6% [-4.3%, 3.1%]; P = 0.81) and negative appendectomies (1.9% vs. 1.1%; 0.8% [-0.7%, 2.3%]; P = 0.33) were not significantly different between the two groups.

CONCLUSION

Diagnostic performance and clinical outcomes were not significantly different between the 2-mSv CT and CDCT groups following radiology residents' CT readings for suspected appendicitis.

Conventional-Dose CT Versus 2-mSv CT for Right Colonic Diverticulitis as an Alternate Diagnosis of Appendicitis: Secondary Analysis of Large Pragmatic Randomized Trial Data

BACKGROUND. Adoption of low-dose CT for the diagnosis of appendicitis has been slow in children and in adults, partly because of concern about missing alternative diagnoses including right colonic diverticulitis. OBJECTIVE. The purpose of our study was to retrospectively compare the diagnostic performance of IV contrast-enhanced 2-mSv and conventional-dose CT (CDCT) for the diagnosis of right colonic diverticulitis in adolescents and young adults with suspected appendicitis. METHODS. This posthoc analysis of a prospective randomized controlled trial included 3074 patients (1672 female patients and 1402 male patients) ranging in age from 15 to 44 years old (mean ± SD, 28 ± 9 years) from 20 hospitals. From December 2013 to August 2016, patients were randomized to either the 2-mSv CT group (n = 1535 patients) or the CDCT (median, 7 mSv) group (n = 1539 patients). A total of 161 radiologists prospectively issued CT reports in which they suggested alternative diagnoses for 976 (2-mSV CT) and 924 (CDCT) patients. Seven independent assessors adjudicated final diagnoses on the basis of clinical and CT findings. Endpoints of test-positives, test-negatives, sensitivity, and specificity for right colonic diverticulitis were compared using chi-square and Mann-Whitney U tests. Characteristics and disposition of patients with test-positive results were assessed. Four readers retrospectively reviewed CT images of 400 patients selected from the trial (113 and 108 patients with diverticulitis from 2-mSv CT and CDCT groups, respectively) to evaluate interobserver agreement for right colonic diverticulitis in terms of Gwet coefficients. RESULTS. Between-group differences were minute for most endpoints related to right colonic diverticulitis: test-positives (difference, 0.2% [95% CI, -1.8% to 2.1%]; 7.8% [119/1535 patients] vs 7.6% [117/1539 patients]; p = .93), test-negatives (0.5% [95% CI, -1.5% to 2.5%]; 91.7% [1407/1535] vs 91.2% [1403/1539]; p = .67), sensitivity (0% [95% CI, -6% to 6%]; 95% [110/116] vs 95% [105/111]; p > .99), and specificity (0.3% [95% CI, -0.5% to 0.9%]; 99.4% [1401/1410] vs 99.1% [1397/1409]; p = .66). The characteristics and disposition of test-positive patients were similar between the two groups. Gwet coefficients were high and comparable between the two groups (2-mSv CT vs CDCT, 0.849 vs 0.889; p = .20). CONCLUSION. Two-millisievert CT is comparable to conventional-dose CT for the diagnosis of right colonic diverticulitis. CLINICAL IMPACT. By mitigating concern about a missed diagnosis of right colonic diverticulitis, the results further support the use of low-dose CT in patients with suspected appendicitis. TRIAL REGISTRATION. ClinicalTrials.gov NCT01925014.

A multiyear systematic survey of the quality of reporting for randomised trials in dentistry, neurology and geriatrics published in journals of Spain and Latin America

BACKGROUND

The Iberoamerican Cochrane Network is currently developing an extensive project to identify Spanish-language journals that publish original clinical research in Spain and Latin America. The project is called BADERI (Database of Iberoamerican Essays and Journal) and feeds the research articles, mainly randomised clinical trials (RCTs), into CENTRAL (Cochrane Collaboration Central Register of Controlled Trials). This study aims to assess the quality of reporting of RCTs published in Spanish and Latin American journals for three clinical fields and assess changes over time.

METHODS

We did a systematic survey with time trend analysis of RCTs for dentistry, geriatrics, and neurology. These fields were chosen for pragmatic reasons as they had not yet been completed in BADERI. After screening RCTs from 1990 to 2018 for randomised or quasi-randomised clinical trials, we extracted data for 23 CONSORT items. The primary outcome was the total score of the 23 predefined CONSORT 2010 items for each RCT (score range from 0 to 34). The secondary outcome measure was the score for each one of these 23 items.

RESULTS

A total of 392 articles from 1990 to 2018 were included as follows: dentistry (282), neurology (80), and geriatrics (30). We found that the overall compliance score for the CONSORT items included in this study for all 392 RCTs analysed was 12.6 on a scale with a maximum score of 34. With time, the quality of reporting improved slightly for all RCTs. None of the articles achieved the complete individual CONSORT item compliance score. The lowest overall compliance percentage was for item 10 (Randomisation implementation) and item 24 (Protocol registration), with a dismal 1% compliance across all included RCTs, regardless of country.

CONCLUSIONS

CONSORT compliance is very poor in the 392 analysed RCTs. The impact of the CONSORT statement on improving the completeness of RCT reporting in Latin America and Spain is not clear. Iberoamerican journals should become more involved in endorsing and enforcing adherence to the CONSORT guidelines.

Reduced-iodine-dose dual-energy coronary CT angiography: qualitative and quantitative comparison between virtual monochromatic and polychromatic CT images

Objectives

To quantitatively evaluate the impact of virtual monochromatic images (VMI) on reduced-iodine-dose dual-energy coronary computed tomography angiography (CCTA) in terms of coronary lumen segmentation in vitro, and secondly to assess the image quality in vivo, compared with conventional CT obtained with regular iodine dose.

Materials and methods

A phantom simulating regular and reduced iodine injection was used to determine the accuracy and precision of lumen area segmentation for various VMI energy levels. We retrospectively included 203 patients from December 2017 to August 2018 (mean age, 51.7 ± 16.8 years) who underwent CCTA using either standard (group A, n = 103) or reduced (group B, n = 100) iodine doses. Conventional images (group A) were qualitatively and quantitatively compared with 55-keV VMI (group B). We recorded the location of venous catheters.

Results

In vitro, VMI outperformed conventional CT, with a segmentation accuracy of 0.998 vs. 1.684 mm², respectively (p < 0.001), and a precision of 0.982 vs. 1.229 mm², respectively (p < 0.001), in simulated overweight adult subjects. In vivo, the rate of diagnostic CCTA in groups A and B was 88.4% (n = 91/103) vs. 89% (n = 89/100), respectively, and noninferiority of protocol B was inferred. Contrast-to-noise ratios (CNR) of lumen versus fat and muscle were higher in group B (p < 0.001) and comparable for lumen versus calcium (p = 0.423). Venous catheters were more often placed on the forearm or hand in group B (p < 0.001).

Conclusion

In vitro, low-keV VMI improve vessel area segmentation. In vivo, low-keV VMI allows for a 40% iodine dose and injection rate reduction while maintaining diagnostic image quality and improves the CNR between lumen versus fat and muscle.

Key Points

• Dual-energy coronary CT angiography is becoming increasingly available and might help improve patient management.

• Compared with regular-iodine-dose coronary CT angiography, reduced-iodine-dose dual-energy CT with low-keV monochromatic image reconstructions performed better in phantom-based vessel cross-sectional segmentation and proved to be noninferior in vivo.

• Patients receiving reduced-iodine-dose dual-energy coronary CT angiography often had the venous catheter placed on the forearm or wrist without compromising image quality.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00330-021-07809-w.

Comparison of standard-dose and half-dose dual-source abdominopelvic CT scans for evaluation of acute abdominal pain

Background

With the increasing number of computed tomography (CT) scans used for evaluation of acute abdominal pain, patient radiation exposure has increased rapidly.

Purpose

To determine whether the diagnostic performance of half-dose abdominopelvic CT is non-inferior to that of standard-dose CT for patients with acute abdominal pain.

Material and Methods

Ninety-eight patients with acute abdominal pain underwent dual-source abdominopelvic CT. Three sets of CT images were reconstructed: standard-dose filtered back projection (FBP); half-dose FBP; and half-dose sinogram-affirmed iterative reconstruction (SAFIRE3). Diagnostic performance of the standard-dose scan was compared with that of the half-dose scans by using a non-inferiority test with a 10% margin. The overall image quality was subjectively measured.

Results

Diagnostic performance for overall disease diagnosis with half-dose scans (area under the receiver operating characteristic curve [AUC] = 0.835 for FBP, 0.881 for SAFIRE3) was non-inferior to that of standard-dose FBP (AUC = 0.891) (95% confidence interval lower limit difference = −5.6% [half-dose FBP], −1.2% [half-dose SAFIRE3]). The diagnostic sensitivity for detection of neoplastic disease was lower with half-dose (75.0%) than with standard-dose FBP (91.7%). Effective dose and dose-length product with standard-dose imaging were 7.99 ± 2.55 mSv and 533.1 ± 170.3 mGy·cm, respectively; those of half-dose imaging were 3.99 ± 1.28 mSv and 266.6 ± 85.2 mGy·cm, respectively. The image quality was lower with half-dose than with standard-dose FBP scans ( P < 0.01).

Conclusion

Diagnostic performance of half-dose CT is non-inferior to that of standard-dose scan for evaluation of acute abdominal pain, despite inferior image quality.

Unfounded conclusions of equivalence in diagnostic accuracy studies: a pervasive fallacy of inference in pediatric radiology scientific abstracts

BACKGROUND

In studies of diagnostic performance that fail to detect a statistically significant difference between compared techniques, investigators often declare evidence of equivalence or similarity without having actually tested that assertion due to incorrect methodology or insufficient statistical power.

OBJECTIVE

The purpose of our investigation is to measure the prevalence of unfounded assertions of equivalence or similarity in comparison studies presented at the International Pediatric Radiology (IPR) meeting of 2016 and promote awareness of this fallacy of inference to the pediatric radiology community.

MATERIALS AND METHODS

Two pediatric radiologists independently reviewed the methodology and reporting quality of the 194 scientific paper abstracts from the 2016 IPR meeting. All comparison studies were identified and those failing to detect a statistically significance difference and making a claim of equivalence or similarity in the results or conclusion were assessed for a description of the study design type, statistical power and sample size estimator calculation.

RESULTS

Of 194 scientific paper abstracts, 112 (58%) were comparison studies. Of these, 36/112 (32%) made unfounded inferences of equivalence or similarity in diagnostic imaging performance. No study had an equivalence or non-inferiority design. No abstract specified the statistical power of the study, and only one abstract acknowledged a small sample size as a limitation in detecting a statistically significant difference.

CONCLUSION

Inadequate reporting and unfounded inferences of equivalence or similarity were common in diagnostic performance comparison studies presented at IPR 2016. Failure to recognize these limitations could have adverse consequences by leading to the adoption of unvalidated imaging techniques.

Decision making about healthcare-related tests and diagnostic test strategies. Paper 5: a qualitative study with experts suggests that test accuracy data alone is rarely sufficient for decision making

OBJECTIVES

The objective of the study was to identify the critical factors that determine recommendations and other decisions about healthcare-related tests and diagnostic strategies (HCTDS).

METHODS

We used a qualitative descriptive approach and conducted semi-structured in-depth interviews with 24 international experts (informants) in evidence and decisions about HCTDS.

RESULTS

Although test accuracy (TA) was the factor most commonly considered by organizations when developing recommendations about HCTDS, informants agreed that TA is necessary but rarely, if ever, sufficient and may be misleading when solely considered. The informants identified factors that are important for developing recommendations about HCTDS. Informants largely agreed that laying out the potential care pathways based on the test result is an essential early step but is rarely done in developing recommendations about HCTDS. Most informants also agreed that decision analysis could be useful for organizing the clinical, cost, and preference data relevant to the use of tests in the absence of direct evidence. However, they noted that using models is limited by the lack of resources and expertise required.

CONCLUSION

Developing guidelines about HCTDS requires consideration of factors beyond TA, but implementing this may be challenging. Further development and testing of "frameworks" that can guide this process is a priority for decision makers.

MR Enterography for the Evaluation of Small-Bowel Inflammation in Crohn Disease by Using Diffusion-weighted Imaging without Intravenous Contrast Material: A Prospective Noninferiority Study

PURPOSE

To determine whether magnetic resonance (MR) enterography performed with diffusion-weighted imaging (DWI) without intravenous contrast material is noninferior to contrast material-enhanced (CE) MR enterography for the evaluation of small-bowel inflammation in Crohn disease.

MATERIALS AND METHODS

Institutional review board approval and informed consent were obtained for this prospective noninferiority study. Fifty consecutive adults suspected of having Crohn disease underwent clinical assessment, MR enterography, and ileocolonoscopy within 1 week. MR enterography included conventional imaging and DWI (b = 900 sec/mm(2)). In 44 patients with Crohn disease, 171 small-bowel segments that were generally well distended and showed a wide range of findings, from normalcy to severe inflammation (34 men, 10 women; mean age ± standard deviation, 26.9 years ± 6.1), were selected for analysis. Image sets consisting of (a) T2-weighted sequences with DWI and (b) T2-weighted sequences with CE T1-weighted sequences were reviewed by using a crossover design with blinding and randomization. Statistical analyses included noninferiority testing regarding proportional agreement between DWI and CE MR enterography for the identification of bowel inflammation with a noninferiority margin of 80%, correlation between DWI and CE MR enterography scores of bowel inflammation severity, and comparison of accuracy between DWI and CE MR enterography for the diagnosis of terminal ileal inflammation by using endoscopic findings as the reference standard.

RESULTS

The agreement between DWI and CE MR enterography for the identification of bowel inflammation was 91.8% (157 of 171 segments; one-sided 95% confidence interval: ≥88.4%). The correlation coefficient between DWI and CE MR enterography scores was 0.937 (P < .001). DWI and CE MR enterography did not differ significantly regarding the sensitivity and specificity for the diagnosis of terminal ileal inflammation (P > .999). DWI and CE MR enterography concurred in the diagnosis of penetrating complications in five of eight segments.

CONCLUSION

DWI MR enterography was noninferior to CE MR enterography for the evaluation of inflammation in Crohn disease in generally well-distended small bowel, except for the diagnosis of penetration.