Guidance for deriving and presenting percentage study weights in meta-analysis of test accuracy studies

No Evidence for the Superiority of 3-T Magnetic Resonance Imaging Over 1.5-T Magnetic Resonance Imaging for Diagnosing Wrist Ligamentous Lesions: A Systematic Review and Meta-analysis

PURPOSE

To determine the diagnostic accuracy of native magnetic resonance imaging (MRI) regarding different ligamentous lesions of the wrist and to analyze the influence of technical characteristics, such as field strength, application of fat saturation, 3-dimensional sequences, and wrist coils.

METHODS

A systematic search was performed using MEDLINE, Embase, and Cochrane Central Register of Controlled Trials databases. Studies that were published before February 12, 2024, were included. All studies comparing the diagnostic accuracy of native wrist MRI with that of wrist arthroscopy for suspected ligamentous lesions were included. Results were analyzed by anatomic localization and technical aspects of the MRI. To assess the quality of included studies, we used the revised Quality Assessment of Diagnostic Accuracy Studies tool.

RESULTS

The systematic search revealed 5,181 articles. Thirty-seven studies, reporting 3,893 ligamentous lesions, were eligible for inclusion. The studies displayed heterogeneity in terms of technical conditions, such as field strength, the use of wrist coils, the application of 3-dimensional sequences, and fat saturation. Research methods also varied. Overall sensitivity and specificity were 0.78 (0.66-0.86) and 0.81 (0.70-0.89) for 1.5-T MRI, whereas sensitivity was 0.73 (0.68-0.78) and specificity was 0.90 (0.59-0.98) for 3-T MRI. There was no significant difference between the 2 subgroups (P = .3807 and P = .4248). Sensitivity was 0.82 (0.75-0.87) for triangular fibrocartilage complex lesions, 0.63 (0.50-0.74) for scapholunate ligament tears, and 0.41 (0.25-0.60) for lunotriquetral ligament lesions. Specificity for triangular fibrocartilage complex lesions was 0.82 (0.73-0.89), for scapholunate ligament tears was 0.86 (0.73-0.93), and for lunotriquetral ligament lesions was 0.93 (0.81-0.98).

CONCLUSIONS

The sensitivity and specificity of MRI are influenced by the anatomic location of the lesion and technical conditions. In terms of diagnostic accuracy, no significant difference was found between 1.5-T and 3-T MRI.

LEVEL OF EVIDENCE

Level III, systematic review of Level II-III studies.

The histologic fetal inflammatory response and neonatal outcomes: systematic review and meta-analysis

OBJECTIVE

This study aimed to investigate the prognostic role of concomitant histological fetal inflammatory response with chorioamnionitis on neonatal outcomes through a systematic review and meta-analysis of existing literature.

DATA SOURCES

The primary search was conducted on October 17, 2021, and it was updated on May 26, 2023, across 4 separate databases (MEDLINE, the Cochrane Central Register of Controlled Trials, Embase, and Scopus) without using any filters.

STUDY ELIGIBILITY CRITERIA

Observational studies reporting obstetrical and neonatal outcomes of infant-mother dyads with histological chorioamnionitis and histological fetal inflammatory response vs infant-mother dyads with histological chorioamnionitis alone were eligible. Studies that enrolled only preterm neonates, studies on neonates born before 37 weeks of gestation, or studies on neonates with very low birthweight (birthweight <1500 g) were included. The protocol was registered with the International Prospective Register of Systematic Reviews (registration number: CRD42021283448).

METHODS

The records were selected by title, abstract, and full text, and disagreements were resolved by consensus. Random-effect model-based pooled odds ratios with corresponding 95% confidence intervals were calculated for dichotomous outcomes.

RESULTS

Overall, 50 studies were identified. A quantitative analysis of 14 outcomes was performed. Subgroup analysis using the mean gestational age of the studies was performed, and a cutoff of 28 weeks of gestation was implemented. Among neonates with lower gestational ages, early-onset sepsis (pooled odds ratio, 2.23; 95% confidence interval, 1.76-2.84) and bronchopulmonary dysplasia (pooled odds ratio, 1.30; 95% confidence interval, 1.02-1.66) were associated with histological fetal inflammatory response. Our analysis showed that preterm neonates with a concomitant histological fetal inflammatory response are more likely to develop intraventricular hemorrhage (pooled odds ratio, 1.54; 95% confidence interval, 1.18-2.02) and retinopathy of prematurity (pooled odds ratio, 1.37; 95% confidence interval, 1.03-1.82). The odds of clinical chorioamnionitis were almost 3-fold higher among infant-mother dyads with histological fetal inflammatory response than among infant-mother dyads with histological chorioamnionitis alone (pooled odds ratio, 2.99; 95% confidence interval, 1.96-4.55).

CONCLUSION

This study investigated multiple neonatal outcomes and found association in the case of 4 major morbidities: early-onset sepsis, bronchopulmonary dysplasia, intraventricular hemorrhage, and retinopathy of prematurity.

The accuracy of ultrasound scan in diagnosing retained products of conception: a systematic review and meta-analysis

OBJECTIVE

This study aimed to analyze and summarize the evidence on the accuracy of different ultrasound methods in the diagnosis of retained products of conception.

DATA SOURCES

We searched Ovid SP, the Cumulative Register to Nursing & Allied Health Literature, EBSCO, and grey literature including Core, Trip, Networked Digital Library of Theses and Dissertations Global ETD search, BMJ Best Practice, PubMed, GreyLit report website (http://www.greylit.org/), Cochrane Central Register of Controlled Trials, and Google scholar (https://scholar.google.com/).

STUDY ELIGIBILITY CRITERIA

We included prospective and retrospective cross-sectional or Cohort studies that evaluated both ultrasound findings (before management of retained products of conception) and histopathologic results of retained products of conception at all gestational ages.

METHODS

We used Covidence for data extraction from the studies and quality assessment. The meta-analysis was performed using RevMan 5.4 (forest plot), MetaDTA version 2.01, and Meta-DiSc 2.0 online software.

RESULTS

In total, 11 studies were eligible for data extraction and meta-analysis. The total number of study participants from these 11 studies were 1567. Of these, 9 studies were included to test the accuracy of an echogenic mass, 4 studies analyzed the accuracy of endometrial thickness, and 5 studies analyzed the accuracy of color Doppler flow to predict retained products of conception. We found that echogenic mass had the highest sensitivity, specificity, and diagnostic odds ratio for predicting retained products of conception. The sensitivity, specificity, and diagnostic odds ratio were 0.915 (95% confidence interval, 0.844-0.955), 0.843 (95% confidence interval, 0.615-0.947), and 57.787 (95% confidence interval, 15.171-220.112), respectively. The diagnostic threshold for endometrial thickness was set at 10 mm with a sensitivity, specificity, and diagnostic odds ratio of 0.667 (95% confidence interval, 0.072-0.981), 0.866 (95% confidence interval, 0.375-0.986), and 12.927 (95% confidence interval, 0.23-726.582). The sensitivity, specificity, and diagnostic odds ratio of color Doppler flow were 0.850 (95% confidence interval, 0.756-0.913), 0.406 (95% confidence interval, 0.198-0.655), and 3.893 (95% confidence interval, 1.005-15.081).

CONCLUSION

Our review concluded that an echogenic mass is the most sensitive and specific predictor of retained products of conception after any pregnancy event. The most important limitation of our review is that the design of the studies included led to significant statistical heterogeneity.

Diagnostic Accuracy of Transvaginal Ultrasound and Magnetic Resonance Imaging for the Detection of Myometrial Infiltration in Endometrial Cancer: A Systematic Review and Meta-Analysis

In endometrial cancer (EC), deep myometrial invasion (DMI) is a prognostic factor that can be evaluated by various imaging methods; however, the best method of choice is uncertain. We aimed to compare the diagnostic performance of two-dimensional transvaginal ultrasound (TVS) and magnetic resonance imaging (MRI) in the preoperative detection of DMI in patients with EC. Pubmed, Embase and Cochrane Library were systematically searched in May 2023. We included original articles that compared TVS to MRI on the same cohort of patients, with final histopathological confirmation of DMI as reference standard. Several subgroup analyses were performed. Eighteen studies comprising 1548 patients were included. Pooled sensitivity and specificity were 76.6% (95% confidence interval (CI), 70.9-81.4%) and 87.4% (95% CI, 80.6-92%) for TVS. The corresponding values for MRI were 81.1% (95% CI, 74.9-85.9%) and 83.8% (95% CI, 79.2-87.5%). No significant difference was observed (sensitivity: p = 0.116, specificity: p = 0.707). A non-significant difference between TVS and MRI was observed when no-myometrium infiltration vs. myometrium infiltration was considered. However, when only low-grade EC patients were evaluated, the specificity of MRI was significantly better (p = 0.044). Both TVS and MRI demonstrated comparable sensitivity and specificity. Further studies are needed to assess the presence of myometrium infiltration in patients with fertility-sparing wishes.

Comparison of cardiac magnetic resonance imaging and fluorodeoxyglucose positron emission tomography in the assessment of myocardial viability: meta-analysis and systematic review

AIM

Contrast-enhanced cardiac magnetic resonance (Ce-CMR) and Fluorine-18 fluorodeoxyglucose positron emission tomography (FDG-PET) are frequently utilized in clinical practice to assess myocardial viability. However, studies evaluating direct comparison between Ce-CMR and FDG-PET have a smaller sample size, and no clear distinction between the two imaging modalities has been defined. To address this gap, we conducted a meta-analysis of studies comparing Ce-CMR and FDG-PET for the assessment of myocardial viability.

METHODS

We searched PubMed, EMBASE, Scopus, and Web of Science databases from their inception to 4/20/2022 with search terms "viability" AND "heart diseases" AND "cardiac magnetic resonance imaging" AND "positron-emission tomography." We extracted patient characteristics, segment level viability assessment according to Ce-CMR and FDG-PET, and change in regional wall motion abnormalities (RWMA) at follow-up.

RESULTS

We included four studies in the meta-analysis which provided viability assessment with Ce-CMR and FDG-PET in all patients and change in RWMA at follow-up. There were 82 patients among the four included studies, and 585 segments were compared for viability assessment. There were 59 (72%) males, and mean age was 65 years. The sensitivity (95% confidence interval-CI) and specificity (CI) of Ce-CMR for predicting myocardial recovery were 0.88 (0.66-0.96) and 0.64 (0.49-0.77), respectively. The sensitivity (CI) and specificity (CI) of FDG-PET for predicting myocardial recovery were 0.91 (0.63-0.99) and 0.67 (0.49-0.81), respectively.

CONCLUSION

FDG-PET and Ce-CMR have comparable diagnostic parameters in myocardial viability assessment and are consistent with prior research.

Teledentistry: A Future Solution in the Diagnosis of Oral Lesions: Diagnostic Meta-Analysis and Systematic Review

Introduction: Teledentistry (TD) can offer a wide range of possibilities in the field of oral medicine. Oral potentially malignant disorders (OPMDs) are hard to detect, and even harder to diagnose correctly. With the help of TD, OPMDs can be detected and diagnosed by a remote specialist. Our aim was to investigate whether TD could provide a reliable diagnostic method compared with clinical oral examination (COE) in the diagnosis of OPMDs. Methods: A systematic search was conducted in three databases (Medline, EMBASE, CENTRAL) until November 2021. We included studies that compared telediagnosis and COE, both made by experts. Pooled specificity and sensitivity were calculated and visualized on a two-dimensional plot. Risk of bias was assessed using the QUADAS-2 tool, and the level of evidence is shown with the Grades of Recommendation, Assessment, Development and Evaluation (GRADE) tool. Results: Of the 7,608 studies, 13 were included in the qualitative and 9 in the quantitative synthesis. Using TD tools in the detection of oral lesions (OLs) showed high specificity (0.92 confidence interval [95% CI] = 0.59-0.99) and sensitivity (0.93 95% CI = 0.17-1.00). In the differential diagnosis of lesions, we found high sensitivity and specificity (0.942 95% CI = 0.826-0.982 and 0.982 95% CI = 0.913-0.997), respectively. We summarized the available data on time-effectiveness, screening person, referral decision, and technical settings. Conclusion: Detecting OLs with TD tools might lead to earlier diagnosis, treatment, and stricter follow-up of OPMD. TD may offer a great substitution for COE in the diagnosis of OLs, and thus, fewer referrals could be made to special care, resulting in a greater number of treated OPMDs.

Serological diagnosis of fasciolosis (Fasciola hepatica) in humans, cattle, and sheep: a meta-analysis

Fasciola hepatica can cause problems in both animals and humans. Fasciolosis can be diagnosed through the indirect ELISA immunodiagnostic test. Serological diagnosis of Fasciola is based on recombinant antigens secreted by this worm. We used PubMed and Google Scholar databases to review the published literature on 'antigens with immunogenic potential' used in serological tests to identify antibodies against F. hepatica in humans, cattle, and sheep. Studies that investigated diagnostic tests with common reference standards were included in the sensitivity and/or specificity bivariate meta-analysis. In the quality and susceptibility to bias analysis of the 33 included studies, 26 fulfilled at least six (75%) of the eight QUADAS criteria and were considered good-quality papers. We found that most of the studies used native excretory-secretory antigens and recombinant cathepsin in ELISA tests for serological diagnosis of fascioliasis in humans, cattle, and sheep. The meta-analysis revealed that all antigens demonstrated good accuracy. The best results in terms of sensitivity [0.931-2.5% confidence interval (CI) and 0.985-97.5% CI] and specificity (0.959-2.5% CI and 0.997-97.5% CI) were found in human FhES. FhrCL-1, FhES, and FhrSAP-2 antigens gave the best results for the serum diagnosis of human and animal fasciolosis.

MetaBayesDTA: codeless Bayesian meta-analysis of test accuracy, with or without a gold standard

BACKGROUND

The statistical models developed for meta-analysis of diagnostic test accuracy studies require specialised knowledge to implement. This is especially true since recent guidelines, such as those in Version 2 of the Cochrane Handbook of Systematic Reviews of Diagnostic Test Accuracy, advocate more sophisticated methods than previously. This paper describes a web-based application - MetaBayesDTA - that makes many advanced analysis methods in this area more accessible.

RESULTS

We created the app using R, the Shiny package and Stan. It allows for a broad array of analyses based on the bivariate model including extensions for subgroup analysis, meta-regression and comparative test accuracy evaluation. It also conducts analyses not assuming a perfect reference standard, including allowing for the use of different reference tests.

CONCLUSIONS

Due to its user-friendliness and broad array of features, MetaBayesDTA should appeal to researchers with varying levels of expertise. We anticipate that the application will encourage higher levels of uptake of more advanced methods, which ultimately should improve the quality of test accuracy reviews.

Resting-state functional connectivity predictors of treatment response in schizophrenia - A systematic review and meta-analysis

We aimed to systematically synthesize and quantify the utility of pre-treatment resting-state functional magnetic resonance imaging (rs-fMRI) in predicting antipsychotic response in schizophrenia. We searched the PubMed/MEDLINE database for studies that examined the magnitude of association between baseline rs-fMRI assessment and subsequent response to antipsychotic treatment in persons with schizophrenia. We also performed meta-analyses for quantifying the magnitude and accuracy of predicting response defined continuously and categorically. Data from 22 datasets examining 1280 individuals identified striatal and default mode network functional segregation and integration metrics as consistent determinants of treatment response. The pooled correlation coefficient for predicting improvement in total symptoms measured continuously was ~0.47 (12 datasets; 95% CI: 0.35 to 0.59). The pooled odds ratio of predicting categorically defined treatment response was 12.66 (nine datasets; 95% CI: 7.91-20.29), with 81% sensitivity and 76% specificity. rs-fMRI holds promise as a predictive biomarker of antipsychotic treatment response in schizophrenia. Future efforts need to focus on refining feature characterization to improve prediction accuracy, validate prediction models, and evaluate their implementation in clinical practice.

Application of weighting methods for presenting risk-of-bias assessments in systematic reviews of diagnostic test accuracy studies

BACKGROUND

An assessment of the validity of individual diagnostic accuracy studies in systematic reviews is necessary to guide the analysis and the interpretation of results. Such an assessment is performed for each included study and typically reported at the study level. As studies may differ in sample size and disease prevalence, with larger studies contributing more to the meta-analysis, such a study-level report does not always reflect the risk of bias in the total body of evidence. We aimed to develop improved methods of presenting the risk of bias in the available evidence on diagnostic accuracy of medical tests in systematic reviews, reflecting the relative contribution of the study to the body of evidence in the review.

METHODS

We applied alternative methods to represent evaluations with the Quality Assessment of Diagnostic Accuracy Studies tool (QUADAS-2), weighting studies according to their relative contribution to the total sample size or their relative effective sample size. We used these methods in four existing systematic reviews of diagnostic accuracy studies, including 9, 13, 22, and 32 studies, respectively.

RESULTS

The risk-of-bias summaries for each domain of the QUADAS-2 checklist changed in all four sets of studies after replacing unit weights for the studies with relative sample sizes or with the relative effective sample size. As an example, the risk of bias was high in the patient selection domain in 31% of the studies in one review, unclear in 23% and low in 46% of studies. Weighting studies according to the relative sample size changed the corresponding proportions to 4%, 4%, and 92%, respectively. The difference between the two weighting methods was small and more noticeable when the reviews included a smaller number of studies with wider range of sample size.

CONCLUSIONS

We present an alternative way of presenting the results of risk-of-bias assessments in systematic reviews of diagnostic accuracy studies. Weighting studies according to their relative sample size or their relative effective sample size can be used as more informative summaries of the risk of bias in the total body of available evidence.

SYSTEMATIC REVIEW REGISTRATIONS

Not applicable.

Graphical enhancements to summary receiver operating characteristic plots to facilitate the analysis and reporting of meta-analysis of diagnostic test accuracy data

Diagnostic test accuracy (DTA) systematic reviews are conducted to summarize evidence on the accuracy of a diagnostic test including a critical evaluation of the primary studies. Where appropriate, the evidence is meta-analyzed to obtain pooled estimates of effectiveness.In this study, we reviewed and critiqued three DTA guidance documents with respect to the graphical presentation of DTA meta-analysis results. All three documents recommended the use of two forms of graphical presentation: (a) forest plots displaying meta-analysis results for sensitivity (ie, the true positive rate) and specificity (ie, true negative rate) separately, and (b) Summary Receiver Operating Characteristic (SROC) curve to provide a global summary of test performance. Two primary shortcomings were identified: (a) lack of incorporation of quality assessment results into the main analysis and; (b) ambiguity with which the contribution of individual studies is represented on SROC curves. In response, two alternative graphical approaches were developed: A quality assessment enhanced SROC plot which displays the results from individual studies in the meta-analysis with multiple indicators of quality assessed using QUADAS-2; and A percentage study weights enhanced SROC plot which accurately portrays the percentage contribution each study makes to the meta-analysis. The proposed enhanced SROC curves facilitate the exploration of DTA data, leading to a deeper understanding of the primary studies included in a DTA meta-analysis including identifying reasons for between study heterogeneity and why specific study results may be divergent. Both plots can easily be produced in the free online interactive application, MetaDTA (https://crsu.shinyapps.io/dta_ma/).

Diagnostic accuracy of circulating-free DNA for the determination of MYCN amplification status in advanced-stage neuroblastoma: a systematic review and meta-analysis

Background

MYCN amplification (MNA) is the strongest indicator of poor prognosis in neuroblastoma (NB). This meta-analysis aims to determine the diagnostic accuracy of MNA analysis in circulating-free DNA (cfDNA) from advanced-stage NB patients.

Methods

A systematic review of electronic databases was conducted to identify studies exploring the detection of MNA in plasma/serum cfDNA from NB patients at diagnosis using PCR methodology. Pooled estimates for sensitivity, specificity and diagnostic odds ratio (DOR) were calculated by conducting a bivariate/HSROC random-effects meta-analysis.

Results

Seven studies, with a total of 529 advanced-stage patients, were eligible. The pooled sensitivity of cfDNA-based MNA analysis was 0.908 (95% CI, 0.818–0.956), the pooled specificity was 0.976 (0.940–0.991) and the DOR was 410.0 (−103.6 to 923.7). Sub-grouped by INSS stage, the sensitivity for stage 3 and 4 patients was 0.832 (0.677–0.921) and 0.930 (0.834–0.972), respectively. The specificity was 0.999 (0.109–1.000) and 0.974 (0.937–0.990), respectively, and the DOR was 7855.2 (−66267.0 to 81977.4) and 508.7 (−85.8 to 1103.2), respectively.

Conclusions

MNA analysis in cfDNA using PCR methodology represents a non-invasive approach to rapidly and accurately determine MNA status in patients with advanced-stage NB. Standardised methodology must be developed before this diagnostic test can enter the clinic.