Variation of a test's sensitivity and specificity with disease prevalence

A prospective cross-sectional-comparative analysis of nutrition screening and assessment tools in chinese nasopharyngeal carcinoma inpatients undergoing radiotherapy using Global Leadership Initiative on Malnutrition criteria as the gold standard

OBJECTIVES

The aim was to assess the diagnostic accuracy of four different nutrition screening and evaluation instruments in nasopharyngeal carcinoma patients, benchmarked against Global Leadership Initiative on Malnutrition (GLIM) criteria.

METHODS AND STUDY DESIGN

An observational, single-institution study was conducted between June 2022 and May 2023. Nutrition status was assessed using Nutritional Risk Screening 2002 (NRS-2002), Malnutrition Universal Screening Tool (MUST), Malnutrition Screening Tool (MST), Patient-Generated Subjective Global Assessment (PG-SGA), and GLIM criteria at two time points: postadmission and predischarge. Metrics such as sensitivity, specificity, concordance, and Kappa coefficient were computed.

RESULTS

For the trial, 140 participants were enrolled. Based on GLIM criteria, the rate of undernutrition was 22.9% before radiation and 73.6% after it ended. NRS-2002 (k = 0.721) demonstrated substantial concordance with GLIM criteria at admission, followed by MUST (k = 0.604) and MST (k = 0.378). Kappa coefficients were reduced at discharge (NRS-2002: k = 0.696; MUST: k = 0.690; MST: k = 0.496). GLIM criteria were moderately consistent with PG-SGA at admission (k = 0.453) and slightly consistent at discharge (k = 0.136).

CONCLUSIONS

NRS-2002 demonstrated greater concordance with GLIM criteria than MUST and MST. Therefore, NRS-2002 could be a more appropriate choice for initial nutrition screening in the diagnostic framework of GLIM for individuals afflicted with nasopharyngeal cancer, both before and after radiotherapy. The alignment of GLIM criteria with PG-SGA in identifying undernourished patients varied from slight to moderate.

Diagnostic accuracy of late iodine enhancement on cardiac CT for myocardial tissue characterization: a systematic review and meta-analysis

PURPOSE

to evaluate the diagnostic accuracy of late iodine enhancement (LIE) in cardiac computed tomography (CCT) compared to late gadolinium enhancement (LGE) in cardiac magnetic resonance (CMR) for myocardial tissue characterization.

MATERIALS AND METHODS

EMBASE, PubMed/MEDLINE, and CENTRAL were searched for studies reporting the accuracy of LIE with LGE as the gold standard of reference. QUADAS-2 tool was used to assess the risk of bias. A bivariate random-effects model was used to analyze, pool, and plot the diagnostic performance measurements across studies. Pooled sensitivity, specificity, positive (+LR) and negative (-LR) likelihood ratio, diagnostic odds ratio (DOR), and hierarchical summary ROC curve (HSROC) were computed. Prospero registration number: CRD42023484045.

RESULTS

Fourteen studies involving 526 patients and 5758 myocardial segments were included. At the patient level, LIE in CCT showed a pooled sensitivity of 0.96 (95% CI: 0.88-0.99), specificity of 0.95 (95% CI: 0.88-0.98) and the HSROC AUC of 0.98 (95% CI: 0.97-0.99). The +LR was 20.97 (95% CI: 7.54-58.38) and the -LR was 0.04 (95% CI: 0.01-0.13), resulting in a DOR of 535 (95% CI: 94-3024). At the segment level, sensitivity was 0.86 (95% CI: 0.79-0.91), specificity was 0.98 (95% CI: 0.96-0.99), and the HSROC AUC was 0.97 (95% CI:0.95-0.98). The +LR was 55.08 (95% CI: 19.94-152.16) and the -LR was 0.14 (95% CI: 0.09-0.22) with a DOR of 388 (95% CI: 113-1333). Dual-energy CCT improved segment-level sensitivity to 0.93 (95% CI: 0.88-0.96).

CONCLUSION

LIE in CCT shows excellent diagnostic accuracy when compared to LGE in CMR for myocardial tissue characterization, suggesting its potential as a promising alternative to CMR.

KEY POINTS

Question How does myocardial tissue characterization by late iodine enhancement (LIE) on cardiac CT (CCT) compare to late gadolinium enhancement (LGE) on cardiac magnetic resonance (CMR)? Findings LIE in CCT demonstrates excellent diagnostic accuracy, with high sensitivity and specificity at both patient and segment levels, using LGE in CMR as the reference. Clinical relevance LIE in CCT provides a reliable alternative to LGE in CMR, especially for patients for whom CMR is not available or feasible or is contraindicated, thus improving access to myocardial tissue characterization.

The Ability of Clinical Decision Rules to Detect Peripheral Arterial Disease: A Narrative Review

Peripheral arterial disease (PAD) is a common cause of lower extremity wound. Consequently, PAD leads to a cause of leg amputation nowadays, especially in diabetic patients. In general practice (GP), confrontation with PAD prevention is a challenge. In general, ankle-brachial index (ABI) measurement can be used as a PAD diagnostic tool, but this takes some time. The tool is not generally available and this need to train healthcare workers to perform. Multiple independent predictors developed the diagnostic prediction model known as clinical decision rules (CDRs) to identify patients with high-risk PAD. This might therefore limit the number of patients (only high-risk patients) to refer for ABI evaluation. This narrative review summarized existing CDRs for PAD.

Glycated haemoglobin versus fasting plasma glucose for type 2 diabetes point of care screening: a decision model cost-effectiveness analysis

INTRODUCTION

Whereas fasting plasma glucose (FPG) is cheaper, the glycated haemoglobin (HBA1c) test, which does not require fasting, is more convenient for diabetes screening and could be available to patients throughout the day. In this study, we compared the cost effectiveness of the HBA1c test to that of the FPG test when used for point-of-care (POC) screening of type 2 diabetes in a low-resource setting in Uganda.

METHODS

A cost-effectiveness analysis from a societal perspective was conducted for a single screening cycle of 1659 adults aged 35-70 years receiving care at the outpatient department of a general hospital. We constructed a decision analysis model using TreeAge Pro Healthcare v2023, with the cost estimated using an ingredient approach and the effectiveness measured based on the proportion of patients correctly diagnosed with diabetes.

RESULTS

The unit cost was US$ 6.48 for the HBA1c test and US$ 8.39 for the FPG test. However, a marginally greater percentage of patients were correctly diagnosed according to the FPG test (96.3%) than the HBA1c test (96.2%). The cost-effectiveness ratio was $6.74 for the HBA1c test and $8.39 for the FPG test. The incremental cost effectiveness ratio was $989.06 per additional patient correctly diagnosed with diabetes.

CONCLUSION

HBA1c POC testing could be a more cost-effective alternative to the FPG POC test for the screening of diabetes in under-served outpatient populations in Uganda and similar contexts.

Safety, Efficiency, and Cost Conflicts in Emergency Department Point of Care Troponin Testing

BACKGROUND AND OBJECTIVES

Assessment of acute coronary syndrome (ACS) has pressured rapid diagnostic evaluation through point of care troponins (POCT-Tns). However, POCT-Tns have demonstrated inconsistent accuracy compared to laboratory (LABT)-Tn. A POCT-Tn used inappropriately to "rule-out" ACS can lead to premature diagnostic closure. We aimed to minimize indiscriminate POCT-Tn testing, while balancing test turnaround time (TAT), institutional cost, and impact on patient time to disposition (TTD).

METHODS

A quality improvement (QI) initiative from 2018 to 2022 included educational interventions and electronic health record (EHR) adaptations. We evaluated test characteristics, trended test frequency, TATs, cost, and TTD. We used statistical process control charts to evaluate changes in test frequency over time. We used the Mann-Whitney U and Wilcoxon Signed-Rank Sum test to analyze changes in TAT, TTD, and cost.

RESULTS

POCT-Tn had high discordance with LAB-Tn (9.7%) and low sensitivity (52.5%). SPCs showed a significant decrease in POCT-Tn tests performed over time. LABT-Tn TATs were longer than POCT-Tn (54 vs 21 min; P < .001). Total Tn testing costs decreased by $668 827.83 annually. Compared to pre-initiative, arrival to disposition was 20 min longer for patients receiving a LABT-Tn (P < .001) and 37 min shorter for patients receiving a POCT with reflex to LABT-Tn (P < .001).

CONCLUSION

POCT-Tn test characteristics may place patients at risk for missed ACS. A combined approach using education and EHR adaptations decreased use of indiscriminate POCT-Tn tests, decreased health care costs, and resulted in clinically appropriate changes in disposition times for this large cohort of ED patients.

Variation in sensitivity and specificity of diverse diagnostic tests across health-care settings: a meta-epidemiological study

OBJECTIVES

Diagnostic test accuracy (DTA) may vary among health-care settings, which among other reasons may be due to referral from primary to secondary care. The true magnitude and direction of any difference is not certain. We analyzed the results of meta-analyses of DTA to compare sensitivity and specificity between patients in nonreferred and referred care settings.

STUDY DESIGN AND SETTING

We systematically searched EBSCOhost MEDLINE for systematic reviews that included at least ten original studies of the same diagnostic test, with at least three studies each performed in nonreferred and referred care. Random-effects models, with setting as a binary covariate, were used to calculate pooled sensitivity and specificity estimates per test. Sensitivity analyses were conducted limiting the analyses to studies from countries with gatekeeping systems only.

RESULTS

In total, nine systematic reviews evaluating thirteen diagnostic tests were included. For signs and symptoms (seven tests), the differences in sensitivity and specificity ranged from +0.03 to +0.30 and from -0.12 to +0.03, respectively; for biomarkers (four tests) differences in sensitivity ranged from -0.11 to +0.21 and specificity from -0.01 to -0.19. Differences in sensitivity and specificity for one questionnaire test were +0.1 and -0.07 respectively and for one imaging test were -0.22 and -0.07. Sensitivity analyses limited to countries with gatekeeping health care systems produced similar results.

CONCLUSION

Sensitivity and specificity vary in both direction and magnitude between nonreferred and referred settings, depending on the test and target condition, with no universal patterns governing performance differences.

PLAIN LANGUAGE SUMMARY

Doctors use diagnostic tests to help assess the likelihood if a patient has a certain condition. However, the accuracy of these tests may vary depending on where they are used-such as in primary care (where patients first seek help) or in specialist care (after being referred by a doctor). We wanted to find out how much test accuracy changes between these settings. To do this, we analyzed previous studies that reviewed the accuracy of different diagnostic tests. We compared how well these tests worked in patients who had not yet been referred to a specialist vs those who had. Our analysis included results from thirteen different diagnostic tests, covering symptoms, biomarkers (such as blood tests), a questionnaire, and an imaging test. We found that test accuracy varied depending on the type of test and the condition being diagnosed. Some tests had higher sensitivity (correctly identifying patients with the disease) or specificity (correctly identifying healthy individuals) in primary care, while in specialist care, the same test could perform better, worse, or similarly. There was no clear pattern that applied to all tests. This suggests that researchers should consider how test accuracy may differ across health-care settings when conducting and interpreting diagnostic test accuracy studies.

Diagnostic accuracy and trajectories of referrals for gout to rheumatology

OBJECTIVES

To evaluate diagnostic accuracy and trajectories of gout referrals to rheumatology including factors associated with an accurate diagnosis.

METHODS

We performed a retrospective cohort study of referrals at 4 rheumatology clinics in Brampton, Canada from December 2019 to January 2023. We assessed gout diagnostic accuracy referenced to the rheumatologist's "gold standard" diagnosis, describing alternative final diagnoses. Using multivariable logistic regression, we identified factors associated with an accurate gout diagnosis.

RESULTS

Among 4315 patients, 216 were diagnosed with gout. Of 191 gout referrals (mean (SD) age 58.4 (15.4) years; 77.0% male), the diagnosis was unchanged in 159 (83.2%) patients with alternative diagnoses comprising osteoarthritis, autoimmune inflammatory arthritis and calcium pyrophosphate deposition disease. Referring physicians had moderate-to-high sensitivity (73.6%, 95% CI: 67.2-79.4), specificity (99.2%, 95% CI: 98.9-99.5), positive predictive value (83.2%, 95% CI: 77.2-88.2), negative predictive value (98.6%, 95% CI: 98.2-99.0) and inter-rater reliability (Cohen's kappa: 0.77, 95% CI: 0.72-0.82). Accuracy was highest amongst internists and emergency room physicians. Male sex (OR 14.32, 95% CI: 4.44-46.17), serum urate ≥500μmol/L (OR 9.10, 95% CI: 2.19-7.78), lower extremity monoarthritis (OR 5.08, 95% CI: 1.59-16.27) and symptom duration ≤2weeks (OR 3.87, 95% CI 1.23-12.21) were predictive of a final gout diagnosis.

CONCLUSIONS

Referring providers had reasonably high accuracy in diagnosing gout. Traditional risk factors were associated with concordance with the consultant rheumatologist. Suboptimal gout care likely does not stem at point-of-diagnosis and quality improvement efforts should be focused on mitigating treatment-associated care gaps.

Computing lifetime incidence of esophageal adenocarcinoma and age-specific prevalence of Barrett's esophagus

Barrett's esophagus is the precursor to esophageal adenocarcinoma. Esophageal adenocarcinoma detected from endoscopic surveillance programs accounts for <10% of all cases, suggesting majority of patients with Barrett's esophagus are likely unaccounted for. Previous observational studies have estimated the observed prevalence of Barrett's esophagus to be approximately 1%, but others suggest may be an underestimate. The aim of this study was twofold: (i) calculate lifetime risk of esophageal adenocarcinoma and (ii) estimate overall and age-specific prevalence of Barrett's esophagus. A tree cohort model was created for progression to esophageal adenocarcinoma from birth to death (100 years) for USA and Australian population. Lifetime risk of esophageal cancer and adenocarcinoma were necessary for calculating Barrett's esophagus prevalence. The model incorporated age- and sex-specific incidence data from national cancer registries: the Australian Institute of Health and Welfare and the Surveillance, Epidemiology, and End Results database for the USA. The model was calibrated using an optimization algorithm, which matched progression rates from Barrett's esophagus to esophageal adenocarcinoma with known national cancer data. A Monte Carlo simulation, with 10,000 iterations, was conducted to derive error margins. Estimates of age-specific and overall prevalence of Barrett's esophagus in the population were generated through a similar process. Results: The lifetime risk of esophageal cancer and adenocarcinoma in USA non-Hispanic White population was 0.56% and 0.36%, respectively, while it was somewhat higher at 0.81% and 0.61% (range 0.57%-0.65%) in the Australian population. Estimated overall prevalence of Barrett's esophagus was ~3% (±0.3%) and ~ 5.4% (±0.6%) in USA White and Australian populations (male and female). Prevalence for age brackets was estimated at 0.06% (±0.02%), 1.6% (±0.7%), 3.2% (±1.3%), 8% (±3%), and 12% (±4%) for USA, and 0.05% (±0.02%), 0.9% (±0.5%), 2.8% (±1.2%), 7% (±3%), and 12% (±4%) for Australian population for ages 0-29, 30-44, 45-59, 60-74, and 75+, respectively. Observed estimates of Barrett's esophagus prevalence are likely lower than projected overall prevalence. This study also presents age-specific prevalence estimates of Barrett's esophagus, which are key in developing screening programs for esophageal adenocarcinoma.

Diagnostic Accuracy of Self-Reported Tools for Frailty Assessment in Older Adults With Cancer: A Diagnostic Meta-Analysis

INTRODUCTION

Questionnaires are commonly used for rapid frailty assessment. However, which scale is most appropriate for the identification of frailty in older adults with cancer remains unclear.

OBJECTIVE

A diagnostic meta-analysis was conducted to examine the sensitivity and specificity of questionnaire-based assessment tools in detecting frailty among older adults with cancer.

METHODS

Five databases were searched for eligible studies from inception to January 26, 2025. Study quality was evaluated using the revised Quality Assessment of Diagnostic Accuracy Studies tool. The pooled sensitivity and specificity of the frailty assessment tools were assessed through a bivariate random-effects model. Factors influencing the heterogeneity of sensitivity and specificity values were assessed through moderator analysis, which comprised a subgroup analysis and metaregression.

RESULTS

Five questionnaire-based tools (i.e., the Edmonton Frailty Scale, FRAIL scale, Groningen Frailty Indikator [GFI], Tilburg Frailty Indikator, and Vulnerable Elders Survey-13 [VES-13]) for assessing frailty in older adults with cancer were identified in the literature; the most commonly used were the GFI and VES-13. The sensitivity and specificity of the GFI (67% and 81%, respectively) and VES-13 (65% and 81%) were calculated. Studies with a high proportion of male participants had poorer GFI sensitivity. Older patient samples were associated with lower VES-13 sensitivity, and a high prevalence of frailty or patients having stage III-IV cancer was associated with higher sensitivity.

CONCLUSION

The GFI and VES-13 demonstrated high specificity but low sensitivity for frailty assessment in older adults with cancer. Frequent assessment with the GFI or VES-13 is recommended to improve frailty detection.

IMPLICATIONS FOR PRACTICE

Health-care professionals, including oncology nurses, care managers, and oncologists, can incorporate the GFI and VES-13 into cancer care settings to improve early frailty detection and management. Pre-Registration: The study protocol was registered at PROSPERO (CRD42024505836).

Is this test fit-for-purpose? Principles and a checklist for evaluating the clinical performance of a test in the new era of in vitro diagnostic (IVD) regulation

Recent changes in the regulatory assessment of in vitro medical tests reflect a growing recognition of the need for more stringent clinical evidence requirements to protect patient safety and health. Under current regulations in the United States and Europe, when needed for regulatory approval, clinical performance reports must provide clinical evidence tailored to the intended purpose of the test and allow assessment of whether the test will achieve the intended clinical benefit. The quality of evidence must be proportionate to the risk for the patient and/or public health. These requirements now cover both commercial and laboratory developed tests (LDT) and demand a sound understanding of the fundamentals of clinical performance measures and study design to develop and appraise the study plan and interpret the study results. However, there is a lack of harmonized guidance for the laboratory profession, industry, regulatory agencies and notified bodies on how the clinical performance of tests should be measured. The Working Group on Test Evaluation (WG-TE) of the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) is a multidisciplinary group of laboratory professionals, clinical epidemiologists, health technology assessment experts, and representatives of the in vitro diagnostic (IVD) industry. This guidance paper aims to promote a shared understanding of the principles of clinical performance measures and study design. Measures of classification performance, also referred to as discrimination, such as sensitivity and specificity are firmly established as the primary measures for evaluating the clinical performance for screening and diagnostic tests. We explain these measures are just as relevant for other purposes of testing. We outline the importance of defining the most clinically meaningful classification of disease so the clinical benefits of testing can be explicitly inferred for those correctly classified, and harm for those incorrectly classified. We introduce the key principles and a checklist for formulating the research objective and study design to estimate clinical performance: (1) the purpose of a test e.g. diagnosis, screening, risk stratification, prognosis, prediction of treatment benefit, and corresponding research objective for assessing clinical performance; (2) the target condition for clinically meaningful classification; (3) clinical performance measures to assess whether the test is fit-for-purpose; and (4) study design types. Laboratory professionals, industry, and researchers can use this checklist to help identify relevant published studies and primary datasets, and to liaise with clinicians and methodologists when developing a study plan for evaluating clinical performance, where needed, to apply for regulatory approval.

Methods for Diagnosing Proteinuria-When to Use Which Test and Why: A Review

Proteinuria plays a central role in the diagnosis of kidney disease and has a high prognostic value. The test methods used differ considerably regarding their impact on test accuracy, sensitivity, and specificity. Therefore, knowledge of the methodology is crucial for the interpretation of the results. In addition to the distinction between semiquantitative and quantitative tests, there are also relevant differences within the 2 methods. In general, semiquantitative tests are easy to handle but have limitations such as incomplete quantification, a lack of specificity regarding the type of proteinuria, and a high rate of false-positive results that require retesting with a quantitative method for verification. In contrast, quantitative methods, especially immunoassays, have the advantages of high test accuracy and the possibility of targeted detection of specific protein molecules in addition to albumin. However, these methods are more expensive and require access to a laboratory or an electronic point-of-care device. In this Review, the different types of tests for proteinuria and their underlying methodologies and strengths and weaknesses are discussed in detail to allow a rational decision of use and the correct interpretation of the results depending on the clinical context.

Clinical and Epidemiological Information Required for Lyme Disease Surveillance in a Low-Incidence State, California 2011-2017

Background: Between January 1, 2011, and December 31, 2017, over 12,000 case reports of Lyme disease (LD) were submitted to the California Reportable Disease Information Exchange for further investigation. The number of case reports has tripled compared to previous years, emphasizing the need for efficient estimation and classification methods. We evaluated whether estimation procedures can be implemented in a low-incidence state such as California to correctly classify a case of LD, similar to those procedures used in high-incidence states. Objective: The purpose of this study was to identify whether a minimum number of variables was sufficient to reliably classify cases in California and potentially reduce workload while maintaining the ability to track LD trends in California. Methods: To determine the relative value of diagnostic information, we compared five candidate logistic regression models that were used to classify cases based on information that varied in its degree of difficulty for collection. Results: Our results using California's surveillance data showed that automatically reported data were not sufficient, additional information such as, a patient's clinical presentation and travel history were necessary in a low-incidence state to improve the overall sensitivity of the models. Conclusion: This study may help inform public health surveillance efforts by demonstrating that both clinical and travel information are required to accurately classify a case of LD in a low-incidence state.

Diagnostic tests performance indices: an overview

Diagnostic tests are important means in clinical practice. To assess the performance of a diagnostic test, we commonly need to compare its results to those obtained from a gold standard test. The test sensitivity is the probability of having a positive test in a diseased-patient; the specificity, a negative test result in a disease-free person. However, none of these indices are useful for clinicians who are looking for the inverse probabilities, i.e., the probabilities of the presence and absence of the disease in a person with a positive and negative test result, respectively, the so-called positive and negative predictive values. Likelihood ratios are other performance indices, which are not readily comprehensible to clinicians. There is another index proposed that looks more comprehensible to practicing physicians - the number needed to misdiagnose. It is the number of people who need to be tested in order to find one misdiagnosed (a false positive or a false negative result). For tests with continuous results, it is necessary to set a cut-off point, the choice of which affects the test performance. To arrive at a correct estimation of test performance indices, it is important to use a properly designed study and to consider various aspects that could potentially compromise the validity of the study, including the choice of the gold standard and the population study, among other things. Finally, it may be possible to derive the performance indices of a test solely based on the shape of the distribution of its results in a given group of people.

Accuracy and clinical effectiveness of risk prediction tools for pressure injury occurrence: An umbrella review

BACKGROUND

Pressure injuries (PIs) pose a substantial healthcare burden and incur significant costs worldwide. Several risk prediction tools to allow timely implementation of preventive measures and a subsequent reduction in healthcare system burden are available and in use. The ability of risk prediction tools to correctly identify those at high risk of PI (prognostic accuracy) and to have a clinically significant impact on patient management and outcomes (effectiveness) is not clear. We aimed to evaluate the prognostic accuracy and clinical effectiveness of risk prediction tools for PI and to identify gaps in the literature.

METHODS AND FINDINGS

The umbrella review was conducted according to Cochrane guidance. Systematic reviews (SRs) evaluating the accuracy or clinical effectiveness of adult PI risk prediction tools in any clinical settings were eligible. Studies on paediatric tools, sensor-only tools, or staging/diagnosis of existing PIs were excluded. MEDLINE, Embase, CINAHL, and EPISTEMONIKOS were searched (inception to June 2024) to identify relevant SRs, as well as Google Scholar (2013 to 2024) and reference lists. Methodological quality was assessed using adapted AMSTAR-2 criteria. Results were described narratively. We identified 26 SRs meeting all eligibility criteria with 19 SRs assessing prognostic accuracy and 11 assessing clinical effectiveness of risk prediction tools for PI (4 SRs assessed both aspects). The 19 SRs of prognostic accuracy evaluated 70 tools (39 scales and 31 machine learning (ML) models), with the Braden, Norton, Waterlow, Cubbin-Jackson scales (and modifications thereof) the most evaluated tools. Meta-analyses from a focused set of included SRs showed that the scales had sensitivities and specificities ranging from 53% to 97% and 46% to 84%, respectively. Only 2/19 (11%) SRs performed appropriate statistical synthesis and quality assessment. Two SRs assessing machine learning-based algorithms reported high prognostic accuracy estimates, but some of which were sourced from the same data within which the models were developed, leading to potentially overoptimistic results. Two randomised trials assessing the effect of PI risk assessment tools (within the full test-intervention-outcome pathway) on the incidence of PIs were identified from the 11 SRs of clinical effectiveness; both were included in a Cochrane SR and assessed as high risk of bias. Both trials found no evidence of an effect on PI incidence. Limitations included the use of the AMSTAR-2 criteria, which may have overly focused on reporting quality rather than methodological quality, compounded by the poor reporting quality of included SRs and that SRs were not excluded based on low AMSTAR-2 ratings (in order to provide a comprehensive overview). Additionally, diagnostic test accuracy principles, rather than prognostic modelling approaches were heavily relied upon, which do not account for the temporal nature of prediction.

CONCLUSIONS

Available systematic reviews suggest a lack of high-quality evidence for the accuracy of risk prediction tools for PI and limited reliable evidence for their use leading to a reduction in incidence of PI. Further research is needed to establish the clinical effectiveness of appropriately developed and validated risk prediction tools for PI.

Bayesian estimation of diagnostic accuracy of fecal smears, fecal PCR and serum ELISA for detecting Mycobacterium avium subsp. paratuberculosis infections in four domestic ruminant species in Saudi Arabia

Paratuberculosis, a chronic wasting disease affecting domestic and wild ruminants worldwide, is caused by Mycobacterium avium subsp. paratuberculosis (MAP). Various diagnostic tests exist for detecting MAP infection; however, none of them possess perfect accuracy to be qualified as a reference standard test, particularly due to their notably low sensitivity. Therefore, we used Bayesian latent class models (BLCMs) to estimate diagnostic accuracy of fecal smears (FS), fecal PCR and serum ELISA for detecting MAP infections in sheep, goats, cattle, and camels older than 2 years in Saudi Arabia. Data from a cross-sectional study conducted in the Eastern Province of Saudi Arabia on 31 different farms with a history of MAP infection were analyzed. Fecal and blood samples from all animals older than 2 years in each farm were collected, resulting in a total of 220 sheep, 123 goats, 66 cattle, and 240 camels sampled. FS and IS900-PCR were performed on fecal samples to detect acid-fast bacilli and MAP DNA, respectively. The IDEXX ELISA kit was used to detect MAP antibodies in serum samples. For each ruminant species population, a BLCM was fitted to obtain posterior estimates [medians and 95 % Bayesian credible intervals (95 % BCI)] for sensitivity (Se) and specificity (Sp) of the three tests. We assumed FS and PCR to be conditionally dependent on the true animal MAP status. Prior distributions for test accuracy were used if available. FS had the highest Se among all tests and across all species with median values around 80 % in sheep, goats and camels, and near 50 % in cattle. Median Sp estimates of ELISA and PCR were higher than 90 % for all species. FS yielded the lowest Sp of the study when applied in camels, sheep, and goats. Using the prevalence observed in this study, median positive predictive value (PPV) was higher for PCR and ELISA than FS for camels, sheep, and goats. In cattle, PPV of all tests was similar with median estimates > 95 %. In camels, sheep, and goats, median negative predicative value (NPV) of all tests were > 60 %. The lowest median NPV for all tests were observed in cattle (< 30 %). Our results suggest that ELISA is a suitable option to identify MAP infected animals in farms with previous history of MAP in the Eastern region of Saudi Arabia.

Validating the RISE Communication Play Protocol as a Diagnostic Tool for Autism in Early Childhood: A Pilot Study

There are few validated remote tools that can be used to assess for autism and to capture subtle changes in children's social communication over time. Recently, user-centered design principles were applied to develop a parent-mediated remote assessment, the Reciprocal Imitation and Social Engagement Child Play Protocol (RISE CPP) to enable researchers to capture micro-level behaviors in children, while promoting useability for researchers and families, reducing caregiver burden, and maintaining reliability. This paper describes a pilot study to validate the RISE CPP as a tool to support clinician diagnosis of autism. Thirty-eight caregiver-child dyads (24-41 months, M = 34, SD = 4; 86% male) completed a remote parent-mediated assessment at home (RISE CPP) and an in-lab clinician-led assessment (Autism Diagnostic Observation Schedule; ADOS-2). Independent clinician diagnosis based on observations across the remote and in-lab assessments showed agreement for all but one child (K = .89). Clinicians completing in-person and remote assessments reported similar levels of confidence in their diagnoses, t(37) = 0.93, p = .36, d = .15. Mixed-methods analysis revealed unique benefits and challenges to the remote and in-person assessments and suggested that both assessments were acceptable to caregivers. Results provide preliminary support for the RISE CPP as a diagnostic tool. The remote administration may increase equity for clinical and research diagnostic assessments among families who are traditionally underserved and underrepresented in research.

Comparison of Four Chimeric Antigens and Commercial Serological Assays for the Diagnosis of Trypanosoma cruzi Infection

Chagas disease (CD), a neglected tropical disease caused by Trypanosoma cruzi, is a significant public health issue particularly in Latin America, affecting millions worldwide. Diagnosis is a challenge owing to the genetic diversity of T. cruzi and the complexities involved in selecting antigens for the detection of anti-T. cruzi antibodies. This study evaluated four chimeric recombinant antigens (IBMP-8.1, IBMP-8.2, IBMP-8.3, and IBMP-8.4) designed to enhance diagnostic accuracy by addressing assay variability. We compared the diagnostic performance of these chimeric antigens using indirect ELISA as a diagnostic platform, with three commercial serological assays in Brazil, analyzing 100 serum samples from individuals with confirmed CD and 86 from non-infected controls. The results revealed that all assays and antigens demonstrated an area under the receiver operating characteristic curve of 100%, signifying their exceptional ability to distinguish between CD-positive and CD-negative samples. Notably, the chimeric antigens achieved 100% sensitivity, specificity, accuracy, and kappa index, equaling or surpassing the commercial assays. This research highlights the efficacy of IBMP chimeric antigens as reliable diagnostic tools for CD, suggesting their potential integration into commercial diagnostic platforms to enhance the accuracy and reliability of CD detection.

Performance of the Vetscan Imagyst in point-of-care detection of Giardia duodenalis in canine fecal samples

Giardia duodenalis is a common parasite of the gastrointestinal tract of dogs, with an especially high prevalence in dogs <1-y-old. Methods for detecting G. duodenalis are point-of-care (POC) tests such as lateral-flow tests or fecal flotation. The Vetscan Imagyst (Zoetis) is a new POC device for the detection of G. duodenalis in fecal samples using zinc sulfate flotation, automated slide scanning, and image recognition with artificial intelligence. Vetscan results are the number of Giardia cysts per coverslip. We compared the performance of the Vetscan and another POC test (SNAP Giardia test; Idexx) with a direct immunofluorescence assay (IFA) performed in a specialized parasitology laboratory as the reference test. We included 164 dogs <19-mo-old. We used pooled fecal samples from 3 defecations gained within 2-3 d and tested the repeatability of the Vetscan by triplicate measurement. Compared to IFA, Vetscan had a diagnostic sensitivity of 88.4% and specificity of 98.1%; SNAP had a diagnostic sensitivity of 74.4% and specificity of 98.1%. A variation coefficient of 67.0% was determined for the Vetscan results. The performance of the Vetscan is acceptable for the qualitative evaluation of fecal samples (Giardia positive or negative), and the device can be used by untrained personnel. Given its high variation coefficient, we do not recommend the Vetscan for monitoring the number of cysts.

Design-related bias in studies investigating diagnostic tests for venous thromboembolic diseases: a systematic review and meta-analysis

Background

Early detection and diagnosis of venous thromboembolism are vital for effective treatment. To what extent methodological shortcomings exist in studies of diagnostic tests and whether this affects published test performance is unknown.

Objectives

We aimed to assess the methodological quality of studies evaluating diagnostic tests for venous thromboembolic diseases and quantify the direction and impact of design characteristics on diagnostic performance.

Methods

We conducted a literature search using Medline and Embase databases for systematic reviews summarizing diagnostic accuracy studies for five target disorders associated with venous thromboembolism. The following data were extracted for each primary study: methodological characteristics, the risk of bias scored by the QUADAS QUADAS-2 instrument, and numbers of true-positives, true-negatives, false-positives, and false-negatives. In a meta-analysis, we compared diagnostic accuracy measures from studies unlikely to be biased with those likely to be biased.

Results

Eighty-five systematic reviews comprising 1'818 primary studies were included. Adequate quality assessment tools were used in 43 systematic reviews only (51%). The risk of bias was estimated to be low for all items in 23% of the primary studies. A high or unclear risk of bias in particular domains of the QUADAS/QUADAS-2 tool was associated with marked differences in the reported sensitivity and specificity.

Conclusions

Significant limitations in the methodological quality of studies assessing diagnostic tests for venous thromboembolic disorders exist, and studies at risk of bias are unlikely to report valid estimates of test performance. Established guidelines for evaluation of diagnostic tests should be more systematically adopted.

Systematic Review Registration

PROSPERO (CRD 42021264912).

Xpert MTB/RIF Ultra as a diagnostic tool for pleural tuberculosis: a study at Indian tertiary care centre

Despite the advent of Xpert MTB/RIF, pleural tuberculosis (TB) diagnosis in pleural fluid is still difficult. Hence, we assessed the diagnostic efficacy of its advanced version, Xpert MTB/RIF Ultra, for pleural TB diagnosis using pleural fluid as a sample. Tuberculosis pleuritis (TBP) suspects (n = 261) were enrolled in the study, of which 29 were excluded. The remaining patients (n = 232) were categorized into definite TBP (n = 31), probable TBP (n = 28), and non-TB controls (n = 173) based on the composite reference standard consisting of smear, culture, histopathology, and Xpert MTB/RIF as well as follow-up/clinical response to anti-TB therapy. Among the TBP suspects, 59 were diagnosed as TBP patients. The sensitivity of Xpert MTB/RIF Ultra (52.5%) using pleural fluid for TBP diagnosis was higher than sensitivity obtained with smear (22.4%), culture (17.6%), and Xpert MTB/RIF (25%) alone, carried out using either pleural fluid or pleural biopsy or both the samples. In cases of probable TBP, where none of the laboratory tests were positive, Xpert MTB/RIF Ultra use led to an increased diagnostic percentage of definite TBP from 52.5% to 69.4%. Overall, Xpert MTB/RIF Ultra showed promising results for a definitive diagnosis of TBP in pleural fluid samples.

A scoping review of scores or grading systems for pelvic venous disorders

BACKGROUND

Pelvic venous disorders (PeVD) encompass a variety of conditions linked to chronic pelvic pain in women. However, PeVD remain underdiagnosed due to the absence of universally accepted diagnostic criteria. The complexity of PeVD classifications across specialties leads to delays in treatment. This scoping review aims to fill a gap in PeVD diagnosis and management by identifying all existing scoring or grading systems to lay the foundation for standardized clinical scoring tools for PeVD.

METHODS

This scoping review was undertaken according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping reviews. Online databases were searched up to April 2023. Studies implementing a scoring or grading system for patients with confirmed or suspected PeVD were included. Scores or grading systems were classified into four main categories based on their use in the study: screening, diagnosis, measure of disease severity, and measure of response to treatment.

RESULTS

Of the 2976 unique records identified, 82 were reviewed in full, and 20 were included in this study. The publication dates ranged from 1984 to 2023 (median, 2018; interquartile range, 2003-2022). A total of 21 scores and/or grading systems were identified. Of these 21 scores, 10 (47.6%) were clinical scores, and 10 (47.6%) were scores based on radiological findings; one study included a score that used both clinical and radiological findings. The identified scores were used in various settings. Of the 21 scores, 2 (9.52%) were used for screening in a tertiary care setting; 3 (14.3%) were used to establish the PeVD diagnosis; 8 (38.1%) were used to assess disease severity; and 8 (38.1%) were used as measures of response to treatment. Of the eight scores assessing disease severity, four (50.0%) assessed the degree of dilatation of pelvic veins and four (50%) assessed the severity of reflux. Only three of the scores were validated.

CONCLUSIONS

This scoping review identified a range of scoring and grading systems for PeVD. We note a lack of a validated scoring system, both clinical and radiological, for screening and assessment of disease severity. This is an important first step in developing validated disease-specific scoring systems for patient screening, appropriate referral, assessment of symptom severity, and assessment of the response to treatment.

Laboratory-based molecular test alternatives to RT-PCR for the diagnosis of SARS-CoV-2 infection

BACKGROUND

Diagnosing people with a SARS-CoV-2 infection played a critical role in managing the COVID-19 pandemic and remains a priority for the transition to long-term management of COVID-19. Initial shortages of extraction and reverse transcription polymerase chain reaction (RT-PCR) reagents impaired the desired upscaling of testing in many countries, which led to the search for alternatives to RNA extraction/purification and RT-PCR testing. Reference standard methods for diagnosing the presence of SARS-CoV-2 infection rely primarily on real-time reverse transcription-polymerase chain reaction (RT-PCR). Alternatives to RT-PCR could, if sufficiently accurate, have a positive impact by expanding the range of diagnostic tools available for the timely identification of people infected by SARS-CoV-2, access to testing and the use of resources.

OBJECTIVES

To assess the diagnostic accuracy of alternative (to RT-PCR assays) laboratory-based molecular tests for diagnosing SARS-CoV-2 infection.

SEARCH METHODS

We searched the COVID-19 Open Access Project living evidence database from the University of Bern until 30 September 2020 and the WHO COVID-19 Research Database until 31 October 2022. We did not apply language restrictions.

SELECTION CRITERIA

We included studies of people with suspected or known SARS-CoV-2 infection, or where tests were used to screen for infection, and studies evaluating commercially developed laboratory-based molecular tests for the diagnosis of SARS-CoV-2 infection considered as alternatives to RT-PCR testing. We also included all reference standards to define the presence or absence of SARS-CoV-2, including RT-PCR tests and established clinical diagnostic criteria.

DATA COLLECTION AND ANALYSIS

Two authors independently screened studies and resolved disagreements by discussing them with a third author. Two authors independently extracted data and assessed the risk of bias and applicability of the studies using the QUADAS-2 tool. We presented sensitivity and specificity, with 95% confidence intervals (CIs), for each test using paired forest plots and summarised results using average sensitivity and specificity using a bivariate random-effects meta-analysis. We illustrated the findings per index test category and assay brand compared to the WHO's acceptable sensitivity and specificity threshold for diagnosing SARS-CoV-2 infection using nucleic acid tests.

MAIN RESULTS

We included data from 64 studies reporting 94 cohorts of participants and 105 index test evaluations, with 74,753 samples and 7517 confirmed SARS-CoV-2 cases. We did not identify any published or preprint reports of accuracy for a considerable number of commercially produced NAAT assays. Most cohorts were judged at unclear or high risk of bias in more than three QUADAS-2 domains. Around half of the cohorts were considered at high risk of selection bias because of recruitment based on COVID status. Three quarters of 94 cohorts were at high risk of bias in the reference standard domain because of reliance on a single RT-PCR result to determine the absence of SARS-CoV-2 infection or were at unclear risk of bias due to a lack of clarity about the time interval between the index test assessment and the reference standard, the number of missing results, or the absence of a participant flow diagram. For index tests categories with four or more evaluations and when summary estimations were possible, we found that: a) For RT-PCR assays designed to omit/adapt RNA extraction/purification, the average sensitivity was 95.1% (95% CI 91.1% to 97.3%), and the average specificity was 99.7% (95% CI 98.5% to 99.9%; based on 27 evaluations, 2834 samples and 1178 SARS-CoV-2 cases); b) For RT-LAMP assays, the average sensitivity was 88.4% (95% CI 83.1% to 92.2%), and the average specificity was 99.7% (95% CI 98.7% to 99.9%; 24 evaluations, 29,496 samples and 2255 SARS-CoV-2 cases); c) for TMA assays, the average sensitivity was 97.6% (95% CI 95.2% to 98.8%), and the average specificity was 99.4% (95% CI 94.9% to 99.9%; 14 evaluations, 2196 samples and 942 SARS-CoV-2 cases); d) for digital PCR assays, the average sensitivity was 98.5% (95% CI 95.2% to 99.5%), and the average specificity was 91.4% (95% CI 60.4% to 98.7%; five evaluations, 703 samples and 354 SARS-CoV-2 cases); e) for RT-LAMP assays omitting/adapting RNA extraction, the average sensitivity was 73.1% (95% CI 58.4% to 84%), and the average specificity was 100% (95% CI 98% to 100%; 24 evaluations, 14,342 samples and 1502 SARS-CoV-2 cases). Only two index test categories fulfil the WHO-acceptable sensitivity and specificity requirements for SARS-CoV-2 nucleic acid tests: RT-PCR assays designed to omit/adapt RNA extraction/purification and TMA assays. In addition, WHO-acceptable performance criteria were met for two assays out of 35 when tests were used according to manufacturer instructions. At 5% prevalence using a cohort of 1000 people suspected of SARS-CoV-2 infection, the positive predictive value of RT-PCR assays omitting/adapting RNA extraction/purification will be 94%, with three in 51 positive results being false positives, and around two missed cases. For TMA assays, the positive predictive value of RT-PCR assays will be 89%, with 6 in 55 positive results being false positives, and around one missed case.

AUTHORS' CONCLUSIONS

Alternative laboratory-based molecular tests aim to enhance testing capacity in different ways, such as reducing the time, steps and resources needed to obtain valid results. Several index test technologies with these potential advantages have not been evaluated or have been assessed by only a few studies of limited methodological quality, so the performance of these kits was undetermined. Only two index test categories with enough evaluations for meta-analysis fulfil the WHO set of acceptable accuracy standards for SARS-CoV-2 nucleic acid tests: RT-PCR assays designed to omit/adapt RNA extraction/purification and TMA assays. These assays might prove to be suitable alternatives to RT-PCR for identifying people infected by SARS-CoV-2, especially when the alternative would be not having access to testing. However, these findings need to be interpreted and used with caution because of several limitations in the evidence, including reliance on retrospective samples without information about the symptom status of participants and the timing of assessment. No extrapolation of found accuracy data for these two alternatives to any test brands using the same techniques can be made as, for both groups, one test brand with high accuracy was overrepresented with 21/26 and 12/14 included studies, respectively. Although we used a comprehensive search and had broad eligibility criteria to include a wide range of tests that could be alternatives to RT-PCR methods, further research is needed to assess the performance of alternative COVID-19 tests and their role in pandemic management.

The Japanese Esophageal Society classification for prediction of superficial esophageal squamous cell neoplasia invasion depth: Validation in a Western population

BACKGROUND

The Japan Esophageal Society proposed the JES microvessel classification to assess eligibility of early esophageal squamous cell neoplasia (ESCN) for endoscopic resection based on intrapapillary capillary loop assessment. We aimed to assess its diagnostic reproducibility and accuracy in Western ESCN patients.

METHODS

Intrapapillary capillary loops on endoscopic images of Western ESCN lesions (n = 113) collected between 2010 and 2022 were assessed by nine endoscopists, including three Japanese expert endoscopists, three Western expert endoscopists, and three residents-in-training, and graded according to the JES microvessel classification where microvessel type A corresponds with normality or low-grade intraepithelial neoplasia, and microvessel types B1, B2, and B3 correspond with high-grade intraepithelial neoplasia or invasion into the lamina propria, muscularis mucosae or superficial submucosa, and deep submucosa, respectively. Outcomes included overall accuracy in predicting ESCN invasion depth and interobserver agreement.

RESULTS

Good interobserver agreement was observed among expert endoscopists (Krippendorf's alpha 0.64, 95% CI 0.57-0.70), while agreement was moderate among residents-in-training (Krippendorf's alpha 0.58, 95% CI 0.52-0.72). Overall accuracy of the JES microvessel classification was 53% (95% CI 42-63), 52% (95% CI 41-62), and 44% (95% CI 34-55) for Japanese endoscopists, Western endoscopists, and residents-in-training, respectively. Sensitivity and specificity for vessel type A, B1, B2, and B3 across assessors were 0%-50% and 89%-100%, 55%-64% and 66%-77%, 42%-71% and 60%-76%, and 10%-24% and 92%-97%, respectively. Negative predictive value ranged between 80% and 85% for B3 vessels.

CONCLUSION

Overall accuracy of the JES microvessel classification in Western ESCN patients is low, though absence of B3 vessels as assessed by experienced endoscopists may predict superficial ESCN amenable to endoscopic resection.

TRIAL REGISTRY

www.trialregister.nl; NL8897 (6-9-2020).

Performance of post-mortem diagnostic tests for tuberculosis in wild ungulates at low and high prevalence assessed using Bayesian latent class models

Animal tuberculosis (TB) is often maintained by multi-host communities, including livestock and wildlife. Quantitative studies of such communities require estimating the true prevalence of TB, correcting the apparent prevalence by the diagnostic sensitivity (Se) and specificity (Sp) of the test. The goal of this study was to lay the foundations for estimating the true prevalence of TB in wild ungulate populations (wild boar and two cervids: red deer and fallow deer). We used Bayesian latent class models to assess the Se and Sp of gross pathology, IS6110 real-time PCR in tissues, bacteriological culture, and P22 indirect ELISA. We analyzed 308 harvested wild ungulates (211 wild boar and 97 cervids: 92 red deer and 5 fallow deer). The Se of bacteriological culture (80.4%, CI95 61.0-96.3%) and gross pathology (87.9%, CI95 69.5-99.9%) was reasonably good in wild boar. These tests showed lower Se in cervids: 60.2% (CI95 38.3-82.3%) for bacteriological culture and 81.5% (CI95 63.6-96.2%) for gross pathology. The Se of the real-time PCR was low (50.7% in wild boar and 53.0% in cervids). These tests showed Sp between 95.2 and 99.1% in both taxa. The P22 ELISA performed reasonably well in wild boar (Se = 71.9%, CI95 59.2-83.4%; Sp = 98.8%, CI95 96.9-99.9%) but lacked Sp in cervids (Se = 77.1%, CI95 62.9-89.7%; Sp = 74.5%, CI95 65.7-83.3%). The real-time PCR in wild boar and cervids and bacteriological culture in cervids tended to show higher Se in low-prevalence populations, possibly due to a higher proportion of early-stage TB lesions. In cervids, the parallel interpretation of gross pathology and bacteriological culture significantly improved the diagnostic performance (Se = 93.1%, CI95 84.7-98.9%; Sp = 92.9%, CI95 86.0-98.3%). Our results allow the estimation of true prevalence from the results of a single diagnostic test applied to harvested wild boar, red deer, and fallow deer, paving the way for more precise quantitative ecological studies of the multi-host TB maintenance community.

External validation of the preHEART score and comparison with current clinical risk scores for prehospital risk assessment in patients with suspected NSTE-ACS

BACKGROUND

Emergency Medical Services (EMS) studies have shown that prehospital risk stratification and triage decisions in patients with suspected non-ST-elevation acute coronary syndrome (NSTE-ACS) can be improved using clinical risk scores with point-of-care (POC) troponin. In current EMS studies, three different clinical risk scores are used in patients suspected of NSTE-ACS: the prehospital History, ECG, Age, Risk and Troponin (preHEART) score, History, ECG, Age, Risk and Troponin (HEART) score and Troponin-only Manchester Acute Coronary Syndromes (T-MACS). The preHEART score lacks external validation and there exists no prospective comparative analysis of the different risk scores within the prehospital setting. The aim of this analysis is to externally validate the preHEART score and compare the diagnostic performance of the these three clinical risk scores and POC-troponin.

METHODS

Prespecified analysis from a prospective, multicentre, cohort study in patients with suspected NSTE-ACS who were transported to an ED between April 2021 and December 2022 in the Netherlands. Risk stratification is performed by EMS personnel using preHEART, HEART, T-MACS and POC-troponin. The primary end point was the hospital diagnosis of NSTE-ACS. The diagnostic performance was expressed as area under the receiver operating characteristic (AUROC), sensitivity, specificity, negative predictive value (NPV) and positive predictive value (PPV).

RESULTS

A total of 823 patients were included for external validation of the preHEART score, final hospital diagnosis of NSTE-ACS was made in 29% (n=235). The preHEART score classified 27% as low risk, with a sensitivity of 92.8% (95% CI 88.7 to 95.7) and NPV of 92.3% (95% CI 88.3 to 95.1). The preHEART classified 9% of the patients as high risk, with a specificity of 98.5% (95% CI 97.1 to 99.3) and PPV of 87.7% (95% CI 78.3 to 93.4). Data for comparing clinical risk scores and POC-troponin were available in 316 patients. No difference was found between the preHEART score and HEART score (AUROC 0.83 (95% CI 0.78 to 0.87) vs AUROC 0.80 (95% CI 0.74 to 0.85), p=0.19), and both were superior compared with T-MACS (AUROC 0.72 (95% CI 0.66 to 0.79), p≤0.001 and p=0.03, respectively) and POC-troponin measurement alone (AUROC 0.71 (95% CI 0.64 to 0.78), p<0.001 and p=0.01, respectively).

CONCLUSION

On external validation, the preHEART demonstrates good overall diagnostic performance as a prehospital risk stratification tool. Both the preHEART and HEART scores have better overall diagnostic performance compared with T-MACS and sole POC-troponin measurement. These data support the implementation of clinical risk scores in prehospital clinical pathways.

TRIAL REGISTRATION NUMBER

NCT05243485.

A Comparative Analysis of Two Commonly Used FDA-Approved Immunoassays for Fentanyl Detection

BACKGROUND

Given the opioid epidemic, fentanyl screening in urine has become increasingly important. Immunoassays remain the most common screening methodology due to the high throughput and ease of integration into automated chemistry systems. The fentanyl ARK II from Ark Diagnostics is a widely used immunoassay, while a novel fentanyl assay called FEN2 by Lin-Zhi has become available on the Roche platform. Here, we evaluate and compare their performance.

METHODS

Four hundred and thirty-four urine samples were analyzed for fentanyl across the Lin-Zhi FEN2 and ARK II assays on the Cobas c502 platform. Samples were analyzed immediately upon request for drug of abuse screening or frozen for subsequent analysis. For confirmation testing, a liquid chromatography-tandem mass spectrometry (LC-MS/MS) method with a limit of detection of 1 ng/mL for fentanyl/norfentanyl was used. Any sample with either fentanyl or norfentanyl above the LC-MS/MS cutoff was deemed positive.

RESULTS

The ARK II had 11 false negatives and 7 false positives, while the Lin-Zhi FEN2 had 12 false negatives and 2 false positives. This resulted in ARK II having a sensitivity and specificity of 90.4% and 97.8% respectively, while Lin-Zhi FEN2 had a sensitivity and specificity of 89.5% and 99.4%.

CONCLUSIONS

Both the ARK II and Lin-Zhi FEN2 immunoassays detected fentanyl well. Overall, the Lin-Zhi assay had slightly better specificity than ARK II, in our data set. While some discrepant results were observed between the 2 immunoassay systems, most occurred near the immunoassay detection cutoffs.

A Real-World Assessment of Stage I Lung Cancer Through Electronic Nose Technology

INTRODUCTION

Electronic nose (E-nose) technology has reported excellent sensitivity and specificity in the setting of lung cancer screening. However, the performance of E-nose specifically for early-stage tumors remains unclear. Therefore, the aim of our study was to assess the diagnostic performance of E-nose technology in clinical stage I lung cancer.

METHODS

This phase IIc trial (NCT04734145) included patients diagnosed with a single greater than or equal to 50% solid stage I nodule. Exhalates were prospectively collected from January 2020 to August 2023. Blinded bioengineers analyzed the exhalates, using E-nose technology to determine the probability of malignancy. Patients were stratified into three risk groups (low-risk, [<0.2]; moderate-risk, [≥0.2-0.7]; high-risk, [≥0.7]). The primary outcome was the diagnostic performance of E-nose versus histopathology (accuracy and F1 score). The secondary outcome was the clinical performance of the E-nose versus clinicoradiological prediction models.

RESULTS

Based on the predefined cutoff (<0.20), E-nose agreed with histopathologic results in 86% of cases, achieving an F1 score of 92.5%, based on 86 true positives, two false negatives, and 12 false positives (n = 100). E-nose would refer fewer patients with malignant nodules to observation (low-risk: 2 versus 9 and 11, respectively; p = 0.028 and p = 0.011) than would the Swensen and Brock models and more patients with malignant nodules to treatment without biopsy (high-risk: 27 versus 19 and 6, respectively; p = 0.057 and p < 0.001).

CONCLUSIONS

In the setting of clinical stage I lung cancer, E-nose agrees well with histopathology. Accordingly, E-nose technology can be used in addition to imaging or as part of a "multiomics" platform.

Identifying and predicting heat stress events for grazing dairy cows using rumen temperature boluses

Heat stress events in dairy cows are associated with behavioral and physiological changes such as seeking shade, increased respiration rate and body temperature, reduced milk production, and psychological distress. Knowledge of the relationship between weather and animal responses to heat stress enables automated alerts using forecast weather, aiding early provision of shade or other mitigation practices. While numerous heat stress indices for cattle have been developed, these have limitations for cows exposed to wind and solar radiation (i.e., predominantly grazing outdoors or managed on pasture). To develop a predictive model for heat stress events in pasture-based dairy systems, rumen temperature data from smaXtec (smaXtec animal care GmbH, Graz, Austria) rumen boluses in 443 cows on 3 dairy farms in Northland, New Zealand, were used to identify heat stress events and these were matched with automated weather station data collected on or near the farm. Heat stress rate (HSR) was defined as the percentage of cows within an age-breed group having a rumen temperature greater than 3 standard deviations above an individual cow's mean and heat stress events were defined as HSR >25%. Single and multiple linear regression models, including published heat stress indices, were generally able to predict a high proportion of heat stress events (sensitivity 34%-68%), but were insufficiently discriminating, predicting also a high number of false positives (precision only 9%-27%). A machine learning algorithm, cubist, was the best performing model, predicting 79% of heat stress events with a precision of 52% for this dataset. Our proof-of-concept study demonstrates the potential of this approach, using climate data to predict and forecast heat stress events in pasture-based dairy systems. Further work should test the cubist model using independent data, refine dataset construction, investigate the value of including known animal variables such as cow age or breed, and incorporate other measures of heat stress such as respiration rate.

Ultrasound screening of paediatric non-alcoholic fatty liver disease (NAFLD): A critical literature review

INTRODUCTION

Paediatric NAFLD is an increasing global health concern, which can be effectively managed with early detection. Screening, using accurate, affordable, and accessible tests is recommended, however, there is currently no consensus on the most appropriate tests. Although ultrasound techniques are widely used, their performance against reference tests have not been fully assessed.

METHODS

A literature search of related databases for peer-reviewed original articles published from January 2010-March 2024 was conducted. Appropriate tools were used to systematise and document the search results and selected studies were quality assessed and critically appraised. Extracted data was subjected to thematic analysis and narrative synthesis.

RESULTS

Eighteen articles met the inclusion criteria. B-mode and Quantitative ultrasound techniques were compared against MR spectroscopy, MRI-PDFF and Liver biopsy.

CONCLUSION

Liver echogenicity and Steato-scores were the B-mode methods used. The former was less effective, with a maximum reported sensitivity of 70%. The latter reached up to 100% sensitivity, and >80% specificity. Ultrasound performed better with moderate-severe steatosis. There was not enough evidence to support steatosis grading, possibly due to small sample sizes and lack of established cut-off values. QUS (Quantitative Ultrasound)) methods including Continuous Attenuation Parameter (CAP), Attenuation Coefficient (AC), Ultrasound derived fat fraction (UDFF), Tissue Scatter Imaging (TSI) Hepato-Renal Index (HRI), Heterogeneity Index (HIA), Computer Assisted Ultrasound (CAUS) and Picture Archiving and Communication System (PACS-based Image analysis performed better than B-mode methods. Although QUS demonstrated excellent performance, with sensitivity and specificity of up to 100%, this will require further verification before implementation in practice.

PRACTICE IMPLICATIONS

Ultrasound techniques can effectively be used for paediatric NAFLD screening, especially in higher-risk subjects. The steato-scores method is currently recommendable for this, with excellent potential for the use of QUS, after cut-off values and validation requirements have been addressed.

Outcome-based analytical performance specifications: current status and future challenges

Analytical performance specifications (APS) based on outcomes refer to how 'good' the analytical performance of a test needs to be to do more good than harm to the patient. Analytical performance of a measurand affects its clinical performance. Without first setting clinical performance requirements, it is difficult to define how good analytically the test needs to be to meet medical needs. As testing is indirectly linked to health outcomes through clinical decisions on patient management, often simulation-based studies are used to assess the impact of analytical performance on the probability of clinical outcomes which is then translated to Model 1b APS according to the Milan consensus. This paper discusses the related key definitions, concepts and considerations that should assist in finding the most appropriate methods for deriving Model 1b APS. We review the advantages and limitations of published methods and discuss the criteria for transferability of Model 1b APS to different settings. We consider that the definition of the clinically acceptable misclassification rate is central to Model 1b APS. We provide some examples and guidance on a more systematic approach for first defining the clinical performance requirements for tests and we also highlight a few ideas to tackle the future challenges associated with providing outcome-based APS for laboratory testing.

Test accuracy of rapid diagnostic tests and reverse-transcription polymerase chain reaction against virus isolation in cell culture for assessing SARS-CoV-2 infectivity: Systematic review and meta-analysis

We aimed to assess the performance of Ag-RDT and RT-qPCR with regard to detecting infectious SARS-CoV-2 in cell cultures, as their diagnostic test accuracy (DTA) compared to virus isolation remains largely unknown. We searched three databases up to 15 December 2021 for DTA studies. The bivariate model was used to synthesise the estimates. Risk of bias was assessed using QUADAS-2/C. Twenty studies (2605 respiratory samples) using cell culture and at least one molecular test were identified. All studies were at high or unclear risk of bias in at least one domain. Three comparative DTA studies reported results on Ag-RDT and RT-qPCR against cell culture. Two studies evaluated RT-qPCR against cell culture only. Fifteen studies evaluated Ag-RDT against cell culture as reference standard in RT-qPCR-positive samples. For Ag-RDT, summary sensitivity was 93% (95% CI 78; 98%) and specificity 87% (95% CI 70; 95%). For RT-qPCR, summary sensitivity (continuity-corrected) was 98% (95% CI 95; 99%) and specificity 45% (95% CI 28; 63%). In studies relying on RT-qPCR-positive subsamples (n = 15), the summary sensitivity of Ag-RDT was 93% (95% CI 92; 93%) and specificity 63% (95% CI 63; 63%). Ag-RDT show moderately high sensitivity, detecting most but not all samples demonstrated to be infectious based on virus isolation. Although RT-qPCR exhibits high sensitivity across studies, its low specificity to indicate infectivity raises the question of its general superiority in all clinical settings. Study findings should be interpreted with caution due to the risk of bias, heterogeneity and the imperfect reference standard for infectivity.

Comment on "Does the 5-2-1 criteria identify patients with advanced Parkinson's disease? Real-world screening accuracy and burden of 5-2-1-positive patients in 7 countries"

The 5-2-1 criteria are intended to help general neurologists identify patients with advanced Parkinson's disease who may benefit from treatment optimisation, such as with a device-aided therapy. Although the 5-2-1 criteria claim to address an unmet need, we urge readers to cautiously interpret the results of this validation study.

Comparison of six screening methods for sarcopenia among rural community-dwelling older adults: a diagnostic accuracy study

OBJECTIVE

The objective of this analysis was to determine the diagnostic efficacy of the Ishii test, SarSA-Mod, SARC-F, SARC-Calf, SARC-F+AC, and SARC-Calf+AC for screening for sarcopenia among rural community-dwelling older adults.

METHODS

The AWGS 2019 diagnostic criteria was a diagnostic reference for sarcopenia. There were six screening tools whose accuracy was determined through the use of metrics, including specificity, sensitivity, negative and positive predictive values, and the receiver operating characteristic (ROC) curve.

RESULTS

The study included 551 participants (304 women, age 70.9 ± 4.9 years). The prevalence of sarcopenia was 44.5% in men and 39.1% in women. In males, the sensitivity/specificity of the Ishii test, SarSA-Mod, SARC-F, SARC-Calf, SARC-F+AC, and SARC-Calf+AC screening sarcopenia were 87.3%/65.7%, 98.2%/21.9%, 6.4%/98.5%, 28.2%/91.2%, 33.6%/83.9%, and 84.6%/43.8%, and in females, they were 68.1%/82.2, 100%/23.2%, 16.0%/90.3%, 35.3%/84.3%, 58.8%/61.1%, and 89.9%/42.2%, respectively. In males, the area under the curves of the Ishii test, SarSA-Mod, SARC-F, SARC-Calf, SARC-F+AC, and SARC-Calf+AC were 0.846 (95% CI 0.795-0.889), 0.800 (95% CI 0.745-0.848), 0.581 (95% CI 0.516-0.643), 0.706 (95% CI 0.645-0.762), 0.612 (95% CI 0.548-0.673), and 0.707 (95% CI 0.646-0.763), respectively, and in females, they were 0.824 (95% CI 0.776-0.865), 0.845 (95% CI 0.799-0.883), 0.581 (95% CI 0.524-0.637), 0.720 (95% CI 0.666-0.770), 0.632 (95% CI 0.575-0.686), and 0.715 (95% CI 0.661-0.765), respectively.

CONCLUSION

Our findings demonstrate that the overall accuracy of the Ishii test was best among the six screening tools for sarcopenia screening in rural community-dwelling older adults.

Association of Contrast Sensitivity With Eye Disease and Vision-Related Quality of Life

PURPOSE

To investigate contrast sensitivity (CS) as a screening tool to detect eye disease and assess its association with both eye disease and vision-related quality of life.

DESIGN

Cross-sectional study.

METHODS

Setting and population: Adults receiving care from a free clinic and a Federally Qualified Health Center in Michigan.

MAIN OUTCOME MEASURES

Screening positive for eye disease and Visual Function Questionnaire (VFQ) score.

OBSERVATION

Participants received a vision exam reviewed via telemedicine for disease, completed a demographic survey, and the 9-item VFQ. The ability of CS to predict eye disease was explored and area under the curve (AUC) is reported. Logistic and linear regression were used to investigate the continuous effect of CS on the probability of screening positive for eye disease and VFQ score, respectively, adjusting for age and visual acuity.

RESULTS

1159 included participants were, on average, 54.9 ± 14.5 years old, 62% identified as female, 34% as White, 54% as Black, 10% as Hispanic/Latino, and reported mean VFQ score of 79.7 ± 15.3. CS ranged from 0.00 to 1.95 log units (mean = 1.54 ± 0.24), 21% of eyes had glaucoma, 19% cataract, 6% DR, and 2% AMD. AUCs were 0.53 to 0.73. A 0.3 log unit decrease in better eye CS was associated with increased odds of glaucoma (odds ratio [OR] = 1.35, confidence interval [CI] = 1.09-1.67), cataract (OR = 1.35, CI = 1.05-1.72), DR (OR = 2.05, CI = 1.51-2.77), and AMD (OR = 2.08, CI = 1.10-3.91). A 0.3 log unit increase in better eye CS was associated with a 5.9 unit increase in VFQ.

CONCLUSION

While CS alone is not sufficient to identify people with eye disease, it is an important measure of visual function that can add value to comprehensive eye screening.

External Validation of the 2023 Duke-International Society for Cardiovascular Infectious Diseases Diagnostic Criteria for Infective Endocarditis

BACKGROUND

The 2023 Duke-International Society of Cardiovascular Infectious Diseases (ISCVID) criteria for infective endocarditis (IE) were introduced to improve classification of IE for research and clinical purposes. External validation studies are required.

METHODS

We studied consecutive patients with suspected IE referred to the IE team of Amsterdam University Medical Center (from October 2016 to March 2021). An international expert panel independently reviewed case summaries and assigned a final diagnosis of "IE" or "not IE," which served as the reference standard, to which the "definite" Duke-ISCVID classifications were compared. We also evaluated accuracy when excluding cardiac surgical and pathologic data ("clinical" criteria). Finally, we compared the 2023 Duke-ISCVID with the 2000 modified Duke criteria and the 2015 and 2023 European Society of Cardiology (ESC) criteria.

RESULTS

A total of 595 consecutive patients with suspected IE were included: 399 (67%) were adjudicated as having IE; 111 (19%) had prosthetic valve IE, and 48 (8%) had a cardiac implantable electronic device IE. The 2023 Duke-ISCVID criteria were more sensitive than either the modified Duke or 2015 ESC criteria (84.2% vs 74.9% and 80%, respectively; P < .001) without significant loss of specificity. The 2023 Duke-ISCVID criteria were similarly sensitive but more specific than the 2023 ESC criteria (94% vs 82%; P < .001). The same pattern was seen for the clinical criteria (excluding surgical/pathologic results). New modifications in the 2023 Duke-ISCVID criteria related to "major microbiological" and "imaging" criteria had the most impact.

CONCLUSIONS

The 2023 Duke-ISCVID criteria represent a significant advance in the diagnostic classification of patients with suspected IE.

The efficacy of modified contrast-enhanced ultrasound Liver Imaging Reporting and Data System (CEUS LI-RADS) using Sonazoid in diagnosis of hepatocellular carcinoma: a systematic review and meta-analysis

Background

The contrast-enhanced ultrasound Liver Imaging Reporting and Data System (CEUS LI-RADS) is an algorithm for the diagnosis of hepatocellular carcinoma (HCC) in high-risk populations. Previous studies have shown the algorithm to have high specificity and moderate sensitivity. Nevertheless, it is designated for utilization solely with blood pool contrast agents. Sonazoid, a contrast agent that combines blood pools and Kupffer cells properties, has recently gained approval for marketing in an increased number of countries. Enhanced sensitivity in diagnosing HCC may be achieved through the distinctive Kupffer phase (KP) exhibited by Sonazoid. Certain academics have suggested the modified CEUS LI-RADS using Sonazoid. The main criteria of mild and late (≥60 seconds) washout in CEUS LI-RADS LR-5 were replaced by KP (>10 minutes) defects as the primary criteria. The purpose of this research was to evaluate the effectiveness of the modified CEUS LI-RADS using Sonazoid in diagnosing HCC.

Methods

Original studies on Sonazoid and CEUS LI-RADS were searched in the PubMed, Embase, Cochrane Library, and Web of Science databases until 13 July 2023, with no restrictions on language. We enrolled studies that applied Sonazoid for CEUS in patients at high risk of HCC and modified CEUS LI-RADS for the diagnosis of intrahepatic nodules. Meta-analyses, evaluations, case studies, correspondences, remarks, and summaries of conferences were excluded. Additionally, studies that fell outside the scope of this study and contained data on the same patients were also excluded. We evaluated the quality of research by employing the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool. A bivariate mixed effects model was utilized to conduct a meta-analysis, summarizing the sensitivity and specificity in the diagnosis of HCC. The investigation of potential factors contributing to study heterogeneity was conducted using meta-regression analysis.

Results

Out of the 103 studies screened, 6 studies (835 lesions) were included in the final results. Modified CEUS LR-5 exhibited a sensitivity of 0.77 [95% confidence interval (CI): 0.70-0.82; I2=71.98%; P=0.00] and a specificity of 0.88 (95% CI: 0.83-0.92; I2=0.00; P=0.47) for HCC diagnosis, with heterogeneity in sensitivity. The presence of heterogeneity in the study was found to have a significant association with factors such as the study design, the number of image reviewers, the proportion of cirrhosis, the proportion of other non-HCC malignancies (OM) cases, and the type of reference standard (P≤0.05).

Conclusions

The modified CEUS LI-RADS LR-5 categorization demonstrates a reasonable level of sensitivity 0.77, but an insufficient level of specificity 0.88 when diagnosing HCC. KP defects cannot be used as a primary feature in the diagnosis of HCC by CEUS LI-RADS, perhaps as an ancillary feature.

Association between early lactate-related variables and 6-month neurological outcome in out-of-hospital cardiac arrest patients

INTRODUCTION

The role of lactate measurement in out-of-hospital cardiac arrest (OHCA) survivors remains controversial. We assessed the association between early lactate-related variables, OHCA characteristics, and long-term neurological outcome.

METHODS

In OHCA patients who received targeted temperature management, lactate levels were measured at 0, 12, and 24 h after the return of spontaneous circulation. We calculated lactate clearance and time-weighted cumulative lactate (TWCL), which represent the area under the time-lactate curve. The area under the receiver operating characteristic curve (AUC) and the adjusted odds ratios (AORs) of lactate-related variables for predicting 6-month poor outcome (Cerebral Performance Category 3-5) were evaluated. Interactions between lactate variables and characteristics of OHCA were evaluated by a multivariable logistic model with interaction terms and subgroup analysis.

RESULTS

A total of 347 OHCA patients were included. After adjustment, higher lactate levels at the three time points were associated with a poor outcome (AOR 1.10 [95% CI, 1.03-1.18], AOR 1.15 [95% CI, 1.02-1.29], and AOR 1.36 [95% CI, 1.15-1.60], respectively), while TWCL was the only lactate kinetics variable associated with a poor outcome (AOR 1.29 [95% CI, 1.12-1.49]). We identified several interactions between lactate-related variables and OHCA characteristics. In particular, the AUC of TWCL was excellent in cases of noncardiac etiology (AUC 0.92 [95% CI, 0.86-0.96] but only moderate in cardiac etiology (AUC 0.69 [95% CI, 0.62-0.75]).

CONCLUSIONS

Early lactate levels, especially at 24 h, and TWCL were independent predictors of neurologic outcome in these patients, whereas lactate clearance was not. The prognostic ability of lactate-related variables varied depending on the OHCA characteristics.

Analysis of agreement between measures of subjective cognitive impairment and probable dementia in the National Health and Aging Trends Study

BACKGROUND

Subjective cognitive impairment (SCI) measures in population-based surveys offer potential for dementia surveillance, yet their validation against established dementia measures is lacking.

METHODS

We assessed agreement between SCI and a validated probable dementia algorithm in a random one-third sample (n = 1936) of participants in the 2012 National Health and Aging Trends Study (NHATS).

RESULTS

SCI was more prevalent than probable dementia (12.2% vs 8.4%). Agreement between measures was 90.0% and of substantial strength. Misclassification rates were higher among older and less-educated subgroups due to higher prevalence of false-positive misclassification but did not vary by sex or race and ethnicity.

DISCUSSION

SCI sensitivity (63.4%) and specificity (92.5%) against dementia were comparable with similar metrics for the NHATS probable dementia measure against the "gold-standard" Aging, Demographics, and Memory Study-based dementia criteria, implying that population-based surveys may afford cost-effective opportunities for dementia surveillance to assess risk and inform policy.

HIGHLIGHTS

The prevalence of subjective cognitive impairment (SCI) is generally higher than that of a validated measure of probable dementia, particularly within the youngest age group, females, Whites, and persons with a college or higher degree. Percent agreement between SCI and a validated measure of probable dementia was 90.0% and of substantial strength (prevalence- and bias-adjusted kappa, 0.80). Agreement rates were higher in older and less-educated subgroups, driven by the higher prevalence of false-positive disagreement, but did not vary significantly by sex or race and ethnicity. SCI's overall sensitivity and specificity were 63.4% and 92.5%, respectively, against a validated measure of probable dementia, suggesting utility as a low-cost option for dementia surveillance. Heterogeneity in agreement quality across subpopulations warrants caution in its use for subgroup analyses.

Can eHealth programs for cardiac arrhythmias be scaled-up by using the KardiaMobile algorithm?

Background

Remote monitoring devices for atrial fibrillation are known to positively contribute to the diagnostic process and therapy compliance. However, automatic algorithms within devices show varying sensitivity and specificity, so manual double-checking of electrocardiographic (ECG) recordings remains necessary.

Objective

The purpose of this study was to investigate the validity of the KardiaMobile algorithm within the Dutch telemonitoring program (HartWacht).

Methods

This retrospective study determined the diagnostic accuracy of the algorithm using assessments by a telemonitoring team as reference. The sensitivity, specificity, negative predictive value (NPV), positive predictive value (PPV), and F1 scores were determined.

Results

A total of 2298 patients (59.5% female; median age 57 ± 15 years) recorded 86,816 ECGs between April 2019 and January 2021. The algorithm showed sensitivity of 0.956, specificity 0.985, PPV 0.996, NPV 0.847, and F1 score 0.976 for the detection of sinus rhythm. A total of 29 false-positive outcomes remained uncorrected within the same patients. The algorithm showed sensitivity of 0.989, specificity 0.953, PPV 0.835, NPV 0.997, and F1 score 0.906 for detection of atrial fibrillation. A total of 2 false-negative outcomes remained uncorrected.

Conclusion

Our research showed high validity of the algorithm for the detection of both sinus rhythm and, to a lesser extent, atrial fibrillation. This finding suggests that the algorithm could function as a standalone instrument particularly for detection of sinus rhythm.

Contrast-enhanced point of care ultrasound for the evaluation of stable blunt abdominal trauma by the emergency physician: A prospective diagnostic study

Objectives

Clinical examination alone cannot reliably rule out significant traumatic abdominal injury. Computed tomography (CT) has become the primary method for evaluating blunt abdominal trauma and clinicians rely heavily on it to rule out abdominal injury. Ultrasound examination may miss significant abdominal injury particularly in stable patients. The use of a contrast agent improves ultrasound sensitivity to visceral abdominal injuries. The objective of this diagnostic study is to compare bedside contrast enhanced ultrasound (CEUS) performed by emergency physicians to CT in hemodynamically stable adults for the assessment of blunt abdominal trauma and evaluate CEUS accuracy outcomes.

Methods

Hemodynamically stable patients with blunt trauma were prospectively enrolled in the trauma bay. After initial evaluation, we included patients at risk of abdominal injury and for whom an abdominal CT was planned by the trauma leader. Ultrasonography was performed prospectively and at the bedside by the emergency physician followed by abdominal CT used as a reference standard.

Results

Thirty-three patients were enrolled in the study; among them, 52% showed positive traumatic findings in abdominal CT scans, and 42% were diagnosed with solid organ lesions. Compared to CT, a focused abdominal sonography (FOCUS) examination, looking for free fluid or perirenal hematoma, showed limited performance for traumatic findings with a sensitivity of 65% (95% confidence interval [CI]: 38%-86%), a specificity of 75% (95% CI: 48%-93%), a negative likelihood ratio (NLR) of 0.47 (95% CI: 0.23-0.95), and a positive likelihood ratio (PLR) of 2.59 (95% CI: 1.03-6.48). When combining FOCUS with CEUS, the sensitivity of the sonography increased to 94% (95% CI: 71%-100%) with a specificity of 75% (95% CI: 48%-93%). The PLR was 3.76 (95% CI: 1.6-8.87) and the NLR was 0.08 (95% CI: 0.01-0.54). In our population, abdominal sonography with contrast failed to identify a single positive abdominal CT with a grade 1 kidney injury.

Conclusions

A FOCUS examination shows limited sensitivity and specificity to detect positive abdominal CT in stable adults with abdominal trauma. With the addition of contrast and careful inspection of solid organs, abdominal sonography with contrast performed by the emergency physician improves the ability to rule out traumatic findings on abdominal CT. CEUS performed by emergency physicians may miss injuries, especially in the absence of free fluid, in cases of low-grade injuries, simultaneous injuries, or poor-quality examinations.

Citizens can help to map putative transmission sites for snail-borne diseases

INTRODUCTION

Schistosomiasis and fasciolosis are snail-borne diseases of great medical and veterinary health importance. The World Health Organization recommends complementing drug treatment with snail control and community involvement for disease elimination, but there is a general lack of snail experts and hence snail distribution data. Therefore, we adopted a citizen science approach and involved citizens in the monitoring of medically and veterinary important snail taxa.

MATERIALS AND METHODS

Snail data was collected weekly by 25 trained citizen scientists (CSs) at 76 sites around southern Lake Albert (Uganda) for 20 months. At each site, snails were searched for 30 minutes, sorted, target snail hosts identified to genus level, counted and data submitted through a smartphone application. The quality of this data was assessed by comparing it to monthly data collected by an 'expert' malacologist using the same sampling protocol. Generalised binomial logistic and linear mixed-effects models were used to analyse the variables for agreement between the CSs and expert.

FINDINGS

The binary agreement in presence/absence of Biomphalaria, Bulinus and Radix snails reported by the expert and CSs ranged between 70% and 86% (900 reports) with an average of 17% false negatives (sites wrongly defined as snail-free). The agreement for Biomphalaria and Radix increased with snail abundance, and false negatives decreased when the number of snails collected by citizens was aggregated per month. Site type significantly predicted binary agreement, which was lowest at lake sites (55%) and highest at spring sites (99%) with variations across genera. Similar temporal trends in snail abundance were recorded despite the expert reporting higher abundance. However, the relative abundance was consistent across site types. The match between the sites with highest Biomphalaria spp. abundance identified by CSs and expert was consistently high (~84.1%) and increased over time.

CONCLUSIONS AND RECOMMENDATIONS

Our results demonstrate the potential of citizen science to map putative schistosomiasis transmission sites. We therefore argue that this inclusive, powerful and cost-effective approach can be more sustainable than top-down monitoring and intervention campaigns.

On the Dependence of the Critical Success Index (CSI) on Prevalence

The critical success index (CSI) is an established metric used in meteorology to verify the accuracy of weather forecasts. It is defined as the ratio of hits to the sum of hits, false alarms, and misses. Translationally, CSI has gained popularity as a unitary outcome measure in various clinical situations where large numbers of true negatives may influence the interpretation of other, more traditional, outcome measures, such as specificity (Spec) and negative predictive value (NPV), or when unified interpretation of positive predictive value (PPV) and sensitivity (Sens) is needed. The derivation of CSI from measures including PPV has prompted questions as to whether and how CSI values may vary with disease prevalence (P), just as PPV estimates are dependent on P, and hence whether CSI values are generalizable between studies with differing prevalences. As no detailed study of the relation of CSI to prevalence has been undertaken hitherto, the dataset of a previously published test accuracy study of a cognitive screening instrument was interrogated to address this question. Three different methods were used to examine the change in CSI across a range of prevalences, using both the Bayes formula and equations directly relating CSI to Sens, PPV, P, and the test threshold (Q). These approaches showed that, as expected, CSI does vary with prevalence, but the dependence differs according to the method of calculation that is adopted. Bayesian rescaling of both Sens and PPV generates a concave curve, suggesting that CSI will be maximal at a particular prevalence, which may vary according to the particular dataset.

Performance of Echinococcosis Serology is Associated with Disease Endemicity, Hydatid Cyst Location, Eosinophilia, Imaging Finding, and Treatment

BACKGROUND

We aimed to assess echinococcosis serology performance for diagnosing cystic echinococcosis (CE) in children living in CE-endemic vs. non-endemic populations, and in different clinical settings.

METHODS

A retrospective cohort study, assessing children with ELISA test for echinococcosis, 2005-2021. Sensitivity, specificity, positive and negative predictive values (PPV and NPV) were calculated comparing CE-endemic vs. non-endemic populations, cases with/without eosinophilia, and cases with/without CE-suggestive imaging findings. Additionally, we examined the association between serology titers/levels (values) and clinical characteristics.

RESULTS

Of 273 cases, 66 (24%) were confirmed as CE. Overall, 97% of CE were in Bedouin children, and the pre-test probability was 28% vs. 9% (p < 0.001) in CE-endemic vs. non-endemic population, respectively. Sensitivity was higher in hepatic than extra-hepatic CE (74% vs. 47%). Overall specificity was 86%. PPVs were higher in CE-endemic population compared to non-endemic (66% vs. 22%), while NPVs were higher in non-endemic population (100% vs. 87%). Eosinophilia was associated with lower specificity (73% vs. 94%) and PPV (47% vs. 78%). Typical imaging was associated with higher specificity (94% vs. 82%) and PPV (91% vs. 11%), while NPVs were lower in typical imaging cases (77% vs. 98%). Higher titer levels (above median) were associated with typical imaging (76% vs. 49%), higher PPV (79% vs. 43%), albendazole treatment (100% vs. 56%), surgery (60% vs. 19%), and new imaging finding (75% vs. 0%).

CONCLUSIONS

Echinococcosis serology performance was impacted by disease endemicity, and by various clinical characteristics. These findings may assist physicians in the interpretation of echinococcosis serology results.

Performance of Lung-RADS in different target populations: a systematic review and meta-analysis

OBJECTIVES

Multiple lung cancer screening studies reported the performance of Lung CT Screening Reporting and Data System (Lung-RADS), but none systematically evaluated its performance across different populations. This systematic review and meta-analysis aimed to evaluate the performance of Lung-RADS (versions 1.0 and 1.1) for detecting lung cancer in different populations.

METHODS

We performed literature searches in PubMed, Web of Science, Cochrane Library, and Embase databases on October 21, 2022, for studies that evaluated the accuracy of Lung-RADS in lung cancer screening. A bivariate random-effects model was used to estimate pooled sensitivity and specificity, and heterogeneity was explored in stratified and meta-regression analyses.

RESULTS

A total of 31 studies with 104,224 participants were included. For version 1.0 (27 studies, 95,413 individuals), pooled sensitivity was 0.96 (95% confidence interval [CI]: 0.90-0.99) and pooled specificity was 0.90 (95% CI: 0.87-0.92). Studies in high-risk populations showed higher sensitivity (0.98 [95% CI: 0.92-0.99] vs. 0.84 [95% CI: 0.50-0.96]) and lower specificity (0.87 [95% CI: 0.85-0.88] vs. 0.95 (95% CI: 0.92-0.97]) than studies in general populations. Non-Asian studies tended toward higher sensitivity (0.97 [95% CI: 0.91-0.99] vs. 0.91 [95% CI: 0.67-0.98]) and lower specificity (0.88 [95% CI: 0.85-0.90] vs. 0.93 [95% CI: 0.88-0.96]) than Asian studies. For version 1.1 (4 studies, 8811 individuals), pooled sensitivity was 0.91 (95% CI: 0.83-0.96) and specificity was 0.81 (95% CI: 0.67-0.90).

CONCLUSION

Among studies using Lung-RADS version 1.0, considerable heterogeneity in sensitivity and specificity was noted, explained by population type (high risk vs. general), population area (Asia vs. non-Asia), and cancer prevalence.

CLINICAL RELEVANCE STATEMENT

Meta-regression of lung cancer screening studies using Lung-RADS version 1.0 showed considerable heterogeneity in sensitivity and specificity, explained by the different target populations, including high-risk versus general populations, Asian versus non-Asian populations, and populations with different lung cancer prevalence.

KEY POINTS

• High-risk population studies showed higher sensitivity and lower specificity compared with studies performed in general populations by using Lung-RADS version 1.0. • In non-Asian studies, the diagnostic performance of Lung-RADS version 1.0 tended to be better than in Asian studies. • There are limited studies on the performance of Lung-RADS version 1.1, and evidence is lacking for Asian populations.

Diagnostic accuracy of oral glucose tolerance tests, fasting plasma glucose and haemoglobin A1c for type 2 diabetes in women with polycystic ovary syndrome: A systematic review and meta-analysis

AIMS

To inform international guidelines, a systematic review and meta-analysis was conducted to assess the performance of diagnostic methods for type 2 diabetes in women with polycystic ovary syndrome (PCOS).

METHODS

An updated systematic search was conducted on five databases from 2017 until October 2023 and combined with prior searches (from inception). Meta-analyses of diagnostic accuracy tests were conducted.

RESULTS

Nine studies comprising 2628 women with PCOS were included. Against the oral glucose tolerance test, a haemoglobin A1C (HbA1c) ≥ 6.5% had a pooled sensitivity of 50.00% (95% confidence interval (CI): 35.53-64.47), specificity of 99.86% (95%CI: 99.49-99.98), and positive and negative predictive values of 92.59% (95%CI: 75.27-98.09) and 98.27% (95%CI: 97.73-98.68), respectively, with an accuracy of 98.17% (95%CI: 97.34-98.79). Fasting plasma glucose values ≥ 7.0 mmol/L had a pooled sensitivity of 58.14% (95%CI: 42.13-72.99), specificity of 92.59% (95%CI: 75.35-98.08), positive and negative predictive values of 92.59% (95%CI: 75.35-98.08) and 99.09% (95%CI: 98.71-99.36), respectively, and an accuracy of 99.00% (95%CI: 98.46-99.39) against the oral glucose tolerance test.

CONCLUSIONS

To our knowledge, this is the first systematic review assessing the performance of diagnostic methods for type 2 diabetes in women with PCOS. We demonstrate that using a cut-off for HbA1c of ≥6.5% in this population may result in misdiagnosis of half of the women with type 2 diabetes. Our results directly informed the recommendations of the 2023 International PCOS Guideline, suggesting that the oral glucose tolerance test is the optimal method for screening and diagnosing type 2 diabetes in women with PCOS and is superior to fasting plasma glucose and HbA1c.

Accuracy of screening tests for cervical precancer in women living with HIV in low-resource settings: a paired prospective study in Lusaka, Zambia

Objective

This study aimed to provide evidence to improve cervical screening for women living with HIV (WLHIV). We assessed the accuracy of screening tests that can be used in low-resource settings and give results at the same visit.

Methods and analysis

We conducted a paired, prospective study among consecutive eligible WLHIV, aged 18-65 years, receiving cervical cancer screening at one hospital in Lusaka, Zambia. The histopathological reference standard was multiple biopsies taken at two time points. The target condition was cervical intraepithelial neoplasia grade 2 and above (CIN2+). The index tests were high-risk human papillomavirus detection (hrHPV, Xpert HPV, Cepheid), portable colposcopy (Gynocular, Gynius) and visual inspection with acetic acid (VIA). Accuracy of stand-alone and test combinations were calculated as the point estimate with 95% CIs. A sensitivity analysis considered disease when only visible lesions were biopsied.

Results

Women included in the study had well-controlled HIV infection (median CD4 count=542 cells/mm3) and all except one were on antiretroviral therapy. Among 371 participants with histopathological results, 27% (101/371) women had CIN2+ and 23% (23/101) were not detected by any index test. Sensitivity and specificity for stand-alone tests were: hrHPV, 67.3% (95% CI 57.7% to 75.7%) and 65.3% (95% CI 59.4% to 70.7%); Gynocular 51.5% (95% CI 41.9% to 61.0%) and 80.0% (95% CI 74.8% to 84.3%); and VIA 22.8% (95% CI 15.7% to 31.9%) and 92.6% (95% CI 88.8% to 95.2%), respectively. Combining tests did not improve test accuracy measures. All test accuracies improved in sensitivity analysis.

Conclusion

The low accuracy of screening tests assessed might be explained by our reference standard, which reduced verification and misclassification biases. Better screening strategies for WLHIV in low-resource settings are urgently needed.

Trial registration number

NCT03931083.

Prevalence of Microbial Isolates Cultured from Endometrial Swab Samples Collected from United Kingdom Thoroughbred Mares from 2014 to 2020

Determining whether endometrial microbial isolates are pathogens, contaminants, or even part of the "normal" microbiome is extremely complex, particularly given the absence of "gold standard" tests for endometritis. Population-level benchmarking and temporal monitoring can provide novel insights and a wider context to improve understanding. This study aimed to (i) estimate the prevalence of endometrial isolates from swabs of Thoroughbred broodmares in Newmarket, UK between 2014 and 2020; and (ii) evaluate the effects of year, mare age, and cytology findings on isolate prevalence. Generalised linear mixed models with a logit link, both null models and models using year of sampling, mare age, or cytology findings as predictors, were fitted to estimate isolate prevalence. Over the 7-year period, data were available from 18,996 endometrial-swab samples from 6050 mares on 290 premises. The overall isolate prevalence was 35.5% (95% confidence interval (CI) 33.0-37.9), and this varied significantly between years. The most prevalent isolates were β-hemolytic Streptococcus (17.9; 95% CI: 17-19) and E. coli (10.3%; 95% CI: 9.0-11.6). Isolate prevalence increased with mare age except for E. coli isolates, and with increasing category of cytology findings except for α-hemolytic Streptococcus isolates. The results provide novel estimates of isolate prevalence and highlight knowledge gaps around potential complexities in the interpretation of findings.

Bayesian diagnostic test evaluation and true prevalence estimation of malnutrition in gastric cancer patients

BACKGROUND & AIMS

Malnutrition is prevalent among gastric cancer (GC) patients, necessitating early assessment of nutritional status to guide monitoring and interventions for improved outcomes. We aim to evaluate the accuracy and prognostic capability of three nutritional tools in GC patients, providing insights for clinical implementation.

METHODS

The present study is an analysis of data from 1308 adult GC patients recruited in a multicenter from July 2013 to July 2018. Nutritional status was assessed using Nutritional Risk Screening 2002 (NRS-2002), Patient-Generated Subjective Global Assessment (PG-SGA) and Global Leadership Initiative on Malnutrition (GLIM) criteria. Bayesian latent class model (LCM) estimated the malnutrition prevalence of GC patients, sensitivity and specificity of nutritional tools. Cox regression model analyzed the relationship between nutritional status and overall survival (OS) in GC patients.

RESULTS

Among 1308 GC patients, NRS-2002, PG-SGA, and GLIM identified 50.46%, 76.76%, and 68.81% as positive, respectively. Bayesian LCM analysis revealed that PG-SGA had the highest sensitivity (0.96) for malnutrition assessment, followed by GLIM criteria (0.78) and NRS-2002 (0.65). Malnutrition or being at risk of malnutrition were identified as independent prognostic factors for OS. Use any of these tools improved survival prediction in TNM staging system.

CONCLUSION

PG-SGA is the most reliable tool for diagnosing malnutrition in GC patients, whereas NRS-2002 is suitable for nutritional screening in busy clinical practice. Given the lower sensitivity of NRS-2002, direct utilization of GLIM for nutritional assessment may be necessary. Each nutritional tool should be associated with a specific course of action, although further research is needed.

French community grid for the evaluation of radiological artificial intelligence solutions (DRIM France Artificial Intelligence Initiative)

PURPOSE

The purpose of this study was to validate a national descriptive and analytical grid for artificial intelligence (AI) solutions in radiology.

MATERIALS AND METHODS

The RAND-UCLA Appropriateness Method was chosen by expert radiologists from the DRIM France IA group for this statement paper. The study, initiated by the radiology community, involved seven steps including literature review, template development, panel selection, pre-panel meeting survey, data extraction and analysis, second and final panel meeting, and data reporting.

RESULTS

The panel consisted of seven software vendors, three for bone fracture detection using conventional radiology and four for breast cancer detection using mammography. A consensus was reached on various aspects, including general target, main objective, certification marking, integration, expression of results, forensic aspects and cybersecurity, performance and scientific validation, description of the company and economic details, possible usage scenarios in the clinical workflow, database, specific objectives and targets of the AI tool.

CONCLUSION

The study validates a descriptive and analytical grid for radiological AI solutions consisting of ten items, using breast cancer and bone fracture as an experimental guide. This grid would assist radiologists in selecting relevant and validated AI solutions. Further developments of the grid are needed to include other organs and tasks.

A meta-analysis of the performance of ultrasound, hepatobiliary scintigraphy, CT and MRI in the diagnosis of acute cholecystitis

PURPOSE

To evaluate the recently reported relative diagnostic accuracy of US, CT, MRI, and cholescintigraphy for diagnosing acute cholecystitis.

METHODS

2 radiologists independently performed systematic electronic searches for articles published between 2000 and 2021 and applied inclusion/exclusion criteria. 2 different radiologists extracted data from the articles and scored each with a methodological quality tool. Pooled estimates of sensitivity and specificity were calculated with a bivariate linear mixed model. A second analysis made head-to-head comparisons (US vs. CT, US vs. cholescintigraphy). Factors were also analyzed for potential confounding effects on diagnostic accuracy.

RESULTS

Of 6121 initial titles, 22 were included. The prevalence of cholecystitis varied widely across studies (9.4-98%). Pooled sensitivity and specificity estimates were 69% (confidence limit [CL] 62-76%) and 79% (CL 71-86%) for US, 91% (CL 86-94%) and 63% (CL 51-74%) for cholescintigraphy, 78% (CL 69-84%) and 81% (CL 71-88%) for CT, and 91% (CL 78-97%) and 93% (CL 70-99%) for MRI. Regarding head-to-head comparisons, the sensitivity of CT (87.6%, CL 70-96%) was significantly higher than US (66.8%, CL 43-84%), while specificities (81.7% with CL 54-95% for US, 91.9% with CL 67-99% for CT) were similar. The sensitivity of cholescintigraphy (87.4%, CL 76-94%) was significantly greater than US (61.6%, CL 44-77%), while the specificity of US (82%, CL 65-92%) was significantly higher than cholescintigraphy (68%, CL 47-84%).

CONCLUSION

Recent data suggests that CT may have a higher sensitivity than US for diagnosing acute cholecystitis, with similar specificity. Cholescintigraphy remains a highly sensitive modality with lower specificity than previously reported. MRI remains under studied, but with promising results.