Anticipating missing reference standard data when planning diagnostic accuracy studies

The Accuracy of Computed Tomography Angiography Compared With Technetium-99m Labelled Red Blood Cell Scintigraphy for the Diagnosis and Localization of Acute Gastrointestinal Bleeding: A Systematic Review and Meta-Analysis

Imaging tests are commonly used as an initial or early investigation for patients presenting with suspected acute gastrointestinal bleeding (AGIB). However, controversy remains regarding which of two frequently used modalities, computed tomography angiography (CTA) or technetium-99m labelled red blood cell scintigraphy (RBCS), is most accurate. This systematic review and meta-analysis was performed to compare the accuracy of CTA and RBCS for the detection and localization of AGIB. Five electronic databases were searched with additional manual searching of reference lists of relevant publications identified during the search. Two reviewers independently performed screening, data extraction and methodological assessments. Where appropriate, the bivariate model was used for meta-analysis of sensitivities and specificities for the detection of bleeding and Freeman-Tukey double-arcsine transformation used for meta-analysis of proportions of correctly localized bleeding sites. Forty-four unique primary studies were included: twenty-two investigating CTA, seventeen investigating RBCS and five investigating both modalities. Meta-analysis produced similar pooled sensitivities; 0.83 (95% CI 0.74-0.90) and 0.84 (0.68-0.92) for CTA and RBCS respectively. Pooled specificity for CTA was higher than RBCS; 0.90 (0.72-0.97) and 0.84 (0.71-0.91) respectively. However, differences were not statistically significant. CTA was superior to RBCS in correctly localizing bleeding; pooled proportions of 1.00 (0.98-1.00) and 0.90 (0.83-0.96) respectively (statistically significant difference, P < 0.001). There is no evidence that CTA and RBCS have different diagnostic performance with respect to the detection of AGIB. However, CTA is superior to RBCS in terms of correctly localising the bleeding site, supporting usage of CTA over RBCS as the first line imaging investigation.

Cost-benefit and discriminant validity of a stepwise dementia case-finding approach in an Asian older adult community

Background

Case-finding is a recommended approach for dementia early detection in the community.

Aims

To investigate the discriminant validity and cost-effectiveness of a stepwise dementia case-finding approach in a Singaporean older adult community.

Methods

The two-phase study was conducted in the community from 2009 to 2015 in Singapore. A total of 3780 participants (age ≥60 years) completed phase I (a brief cognitive screening); 918 completed phase II and were included in the final analysis. In phase I, all participants were administered the Abbreviated Mental Test (AMT) and the Progressive Forgetfulness Question (PFQ). Those who screened positive on either test were invited to phase II, whereby the Mini-Mental State Examination (MMSE), Montreal Cognitive Assessment (MoCA) and a formal neuropsychological battery were administered, followed by the research diagnosis of no cognitive impairment, cognitive impairment no dementia (CIND)-Mild (≤2 impaired cognitive domains), CIND-Moderate (>2 impaired domains) or dementia. Receiver operating characteristic curve analyses were conducted for the different cognitive instruments. All discriminant indices were calculated, including sensitivity, specificity, positive and negative predictive values (NPV) and accuracy. Cost-effectiveness analysis was conducted by estimating the amount of screening time needed and the number of older adults requiring re-evaluation in two case-finding scenarios, ie, with or without preselection by the PFQ.

Results

The stepwise case-finding approach (preselection by the PFQ, then MMSE or MoCA or AMT) showed an excellent NPV (>99%) and accuracy (>86%) for excluding dementia-free cases. Without preselection by the PFQ, screening time for the three cognitive tools were 317.5, 317.5 and 254 hours, with 159, 302 and 175 screen-positive older adults involved in further evaluation. By adopting the stepwise case-finding approach, total screening time were 156.5, 156.5 and 126.2 hours, which decreased by 50.7%, 50.7% and 50.3% as compared with those without preselection. Furthermore, after preselection, only 98, 167 and 145 screen-positive older adults required further evaluation, corresponding to a reduction of 38.4%, 44.7% and 17.1% in the numbers compared with those without preselection.

Conclusions

A stepwise approach for dementia case-finding should be implemented in the community to minimise the time and resources needed for large-scale early detection of dementia.

Missing values and inconclusive results in diagnostic studies - A scoping review of methods

Most diagnostic studies exclude missing values and inconclusive results from the analysis or apply simple methods resulting in biased accuracy estimates. This may be due to the lack of availability or awareness of appropriate methods. This scoping review aimed to provide an overview of strategies to handle missing values and inconclusive results in the reference standard or index test in diagnostic accuracy studies. Conducting a systematic literature search in MEDLINE, Cochrane Library, and Web of Science, we could identify many articles proposing methods for addressing missing values in the reference standard. There are also several articles describing methods regarding missing values or inconclusive results in the index test. The latter encompass imputation, frequentist and Bayesian likelihood, model-based, and latent class methods. While methods for missing values in the reference standard are regularly applied in practice, this is not true for methods addressing missing values and inconclusive results in the index test. Our comprehensive overview and description of available methods may raise further awareness of these methods and will enhance their application. Future research is needed to compare the performance of these methods under different conditions to give valid and robust recommendations for their usage in various diagnostic accuracy research scenarios.

Evaluating operational parameters of the careHPV, GeneXpert, AmpFire, and MA-6000 HPV systems for cervical precancer screening: Experience from Battor, Ghana

In response to calls by the World Health Organization for cervical precancer screening services in low-resource settings to lean toward HPV DNA testing, a number of testing platforms have been made available. This study aimed to evaluate the operational parameters of four HPV testing systems in previous (careHPV) and current (GeneXpert, AmpFire, and MA-6000) use in a secondary healthcare setting in terms of 'appropriateness', ease of use, throughput, and diagnostic yield. This descriptive retrospective cohort analysis included 6056 women who presented to our facility between June 2016 and March 2022 for cervical precancer screening via HPV testing. A large majority of this cohort underwent AmpFire testing (55.8%), followed by careHPV (23.3%), MA-6000 (14.7%), and GeneXpert (6.1%). MA-6000 showed the highest hr-HPV positivity rate of 26.4% (95% CI, 23.6-29.5), followed by AmpFire (17.2%; 95% CI, 15.9-17.5). GeneXpert and careHPV showed similar hr-HPV positivity rates of 14.8% (95% CI, 11.3-18.8) and 14.8% (95% CI, 13.0-16.8), respectively. For the AmpFire and MA-6000 platforms, which utilize similar detection and reporting formats, we found a significant excess detection rate of 9.2% (95% CI, 6.1-12.4; p-value <0.0001) for MA-6000 compared to AmpFire. At the genotype level, MA-6000 also detected significantly higher rates of HPV 16 and other hr-HPV types (both p-values <0.001) than AmpFire; there was no difference in detection for HPV 18. Based on our experiences and preliminary analysis, we believe that the choice of HPV testing platform cannot be accomplished with a one-size-fits-all approach. Factors worth considering are the financial implications of platform acquisition, costs to clients, and throughput when screening programs are not sufficiently large. We describe our successes and challenges with the different platforms which we believe will be helpful to centers in low-income countries as they transition into using HPV DNA testing for cervical precancer screening.

Validation of a rapid SARS-CoV-2 antibody test in general practice

OBJECTIVES

To validate a rapid serological test (RST) for SARS-CoV-2 antibodies used in seroprevalence studies in healthcare providers, including primary healthcare providers (PHCPs) in Belgium.

DESIGN

A phase III validation study of the RST (OrientGene) within a prospective cohort study.

SETTING

Primary care in Belgium.

PARTICIPANTS

Any general practitioner (GP) working in primary care in Belgium and any other PHCP from the same GP practice who physically manages patients were eligible in the seroprevalence study. For the validation study, all participants who tested positive (376) on the RST at the first testing timepoint (T1) and a random sample of those who tested negative (790) and unclear (24) were included.

INTERVENTION

At T2, 4 weeks later, PHCPs performed the RST with fingerprick blood (index test) immediately after providing a serum sample to be analysed for the presence of SARS-CoV-2 immunoglobulin G antibodies using a two-out-of-three assay (reference test).

PRIMARY AND SECONDARY OUTCOME MEASURES

The RST accuracy was estimated using inverse probability weighting to correct for missing reference test data, and considering unclear RST results as negative for the sensitivity and positive for the specificity. Using these conservative estimates, the true seroprevalence was estimated both for T2 and RST-based prevalence values found in a cohort study with PHCPs in Belgium.

RESULTS

1073 paired tests (403 positive on the reference test) were included. A sensitivity of 73% (a specificity of 92%) was found considering unclear RST results as negative (positive). For an RST-based prevalence at T1 (13.9), T2 (24.9) and T7 (70.21), the true prevalence was estimated to be 9.1%, 25.9% and 95.7%, respectively.

CONCLUSION

The RST sensitivity (73%) and specificity (92%) make an RST-based seroprevalence below (above) 23% overestimate (underestimate) the true seroprevalence.

TRIAL REGISTRATION NUMBER

NCT04779424.

Developing a reference standard for pertussis by applying a stratified sampling strategy to electronic medical record data

PURPOSE

Pertussis surveillance remains essential in Canada, but ascertainment bias limits the accuracy of surveillance data. Introducing other sources to improve detection has highlighted the importance of validation. However, challenges arise due to low prevalence, and oversampling suspected cases can introduce partial verification bias. The aim of this study was to build a reference standard for pertussis validation studies that provides adequate analytic precision and minimizes bias.

METHODS

We used a stratified strategy to sample the reference standard from a primary care electronic medical record cohort. We incorporated abstractor notes into definite, possible, ruled-out, and no mention of pertussis classifications which were based on surveillance case definitions.

RESULTS

We abstracted eight hundred records from the cohort of 404,922. There were 208 (26%) definite and 261 (32.6%) possible prevalent pertussis cases. Classifications demonstrated a wide variety of case severities. Abstraction reliability was moderate to substantial based on Cohen's kappa and raw percent agreement.

CONCLUSIONS

When conducting validation studies for pertussis and other low prevalence diseases, this stratified sampling strategy can be used to develop a reference standard using limited resources. This approach mitigates verification and spectrum bias while providing sufficient precision and incorporating a range of case severities.

Guaiac-based faecal occult blood tests versus faecal immunochemical tests for colorectal cancer screening in average-risk individuals

BACKGROUND

Worldwide, many countries have adopted colorectal cancer (CRC) screening programmes, often based on faecal occult blood tests (FOBTs). CRC screening aims to detect advanced neoplasia (AN), which is defined as CRC or advanced adenomas. FOBTs fall into two categories based on detection technique and the detected blood component: qualitative guaiac-based FOBTs (gFOBTs) and faecal immunochemical tests (FITs), which can be qualitative and quantitative. Screening with gFOBTs reduces CRC-related mortality.

OBJECTIVES

To compare the diagnostic test accuracy of gFOBT and FIT screening for detecting advanced colorectal neoplasia in average-risk individuals.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, BIOSIS Citation Index, Science Citation Index Expanded, and Google Scholar. We searched the reference lists and PubMed-related articles of included studies to identify additional studies.

SELECTION CRITERIA

We included prospective and retrospective studies that provided the number of true positives, false positives, false negatives, and true negatives for gFOBTs, FITs, or both, with colonoscopy as reference standard. We excluded case-control studies. We included studies in which all participants underwent both index test and reference standard ("reference standard: all"), and studies in which only participants with a positive index test underwent the reference standard while participants with a negative test were followed for at least one year for development of interval carcinomas ("reference standard: positive"). The target population consisted of asymptomatic, average-risk individuals undergoing CRC screening. The target conditions were CRC and advanced neoplasia (advanced adenomas and CRC combined).

DATA COLLECTION AND ANALYSIS

Two review authors independently screened and selected studies for inclusion. In case of disagreement, a third review author made the final decision. We used the Rutter and Gatsonis hierarchical summary receiver operating characteristic model to explore differences between tests and identify potential sources of heterogeneity, and the bivariate hierarchical model to estimate sensitivity and specificity at common thresholds: 10 µg haemoglobin (Hb)/g faeces and 20 µg Hb/g faeces. We performed indirect comparisons of the accuracy of the two tests and direct comparisons when both index tests were evaluated in the same population.

MAIN RESULTS

We ran the initial search on 25 June 2019, which yielded 63 studies for inclusion. We ran a top-up search on 14 September 2021, which yielded one potentially eligible study, currently awaiting classification. We included a total of 33 "reference standard: all" published articles involving 104,640 participants. Six studies evaluated only gFOBTs, 23 studies evaluated only FITs, and four studies included both gFOBTs and FITs. The cut-off for positivity of FITs varied between 2.4 μg and 50 µg Hb/g faeces. For each Quality Assessment of Diagnostic Accuracy Studies (QUADAS)-2 domain, we assessed risk of bias as high in less than 20% of studies. The summary curve showed that FITs had a higher discriminative ability than gFOBTs for AN (P < 0.001) and CRC (P = 0.004). For the detection of AN, the summary sensitivity of gFOBTs was 15% (95% confidence interval (CI) 12% to 20%), which was significantly lower than FITs at both 10 μg and 20 μg Hb/g cut-offs with summary sensitivities of 33% (95% CI 27% to 40%; P < 0.001) and 26% (95% CI 21% to 31%, P = 0.002), respectively. Results were simulated in a hypothetical cohort of 10,000 screening participants with 1% CRC prevalence and 10% AN prevalence. Out of 1000 participants with AN, gFOBTs missed 850, while FITs missed 670 (10 μg Hb/g cut-off) and 740 (20 μg Hb/g cut-off). No significant differences in summary specificity for AN detection were found between gFOBTs (94%; 95% CI 92% to 96%), and FITs at 10 μg Hb/g cut-off (93%; 95% CI 90% to 95%) and at 20 μg Hb/g cut-off (97%; 95% CI 95% to 98%). So, among 9000 participants without AN, 540 were offered (unnecessary) colonoscopy with gFOBTs compared to 630 (10 μg Hb/g) and 270 (20 μg Hb/g) with FITs. Similarly, for the detection of CRC, the summary sensitivity of gFOBTs, 39% (95% CI 25% to 55%), was significantly lower than FITs at 10 μg and 20 μg Hb/g cut-offs: 76% (95% CI 57% to 88%: P = 0.001) and 65% (95% CI 46% to 80%; P = 0.035), respectively. So, out of 100 participants with CRC, gFOBTs missed 61, and FITs missed 24 (10 μg Hb/g) and 35 (20 μg Hb/g). No significant differences in summary specificity for CRC were found between gFOBTs (94%; 95% CI 91% to 96%), and FITs at the 10 μg Hb/g cut-off (94%; 95% CI 87% to 97%) and 20 μg Hb/g cut-off (96%; 95% CI 91% to 98%). So, out of 9900 participants without CRC, 594 were offered (unnecessary) colonoscopy with gFOBTs versus 594 (10 μg Hb/g) and 396 (20 μg Hb/g) with FITs. In five studies that compared FITs and gFOBTs in the same population, FITs showed a higher discriminative ability for AN than gFOBTs (P = 0.003). We included a total of 30 "reference standard: positive" studies involving 3,664,934 participants. Of these, eight were gFOBT-only studies, 18 were FIT-only studies, and four studies combined both gFOBTs and FITs. The cut-off for positivity of FITs varied between 5 µg to 250 µg Hb/g faeces. For each QUADAS-2 domain, we assessed risk of bias as high in less than 20% of studies. The summary curve showed that FITs had a higher discriminative ability for detecting CRC than gFOBTs (P < 0.001). The summary sensitivity for CRC of gFOBTs, 59% (95% CI 55% to 64%), was significantly lower than FITs at the 10 μg Hb/g cut-off, 89% (95% CI 80% to 95%; P < 0.001) and the 20 μg Hb/g cut-off, 89% (95% CI 85% to 92%; P < 0.001). So, in the hypothetical cohort with 100 participants with CRC, gFOBTs missed 41, while FITs missed 11 (10 μg Hb/g) and 11 (20 μg Hb/g). The summary specificity of gFOBTs was 98% (95% CI 98% to 99%), which was higher than FITs at both 10 μg and 20 μg Hb/g cut-offs: 94% (95% CI 92% to 95%; P < 0.001) and 95% (95% CI 94% to 96%; P < 0.001), respectively. So, out of 9900 participants without CRC, 198 were offered (unnecessary) colonoscopy with gFOBTs compared to 594 (10 μg Hb/g) and 495 (20 μg Hb/g) with FITs. At a specificity of 90% and 95%, FITs had a higher sensitivity than gFOBTs.

AUTHORS' CONCLUSIONS

FITs are superior to gFOBTs in detecting AN and CRC in average-risk individuals. Specificity of both tests was similar in "reference standard: all" studies, whereas specificity was significantly higher for gFOBTs than FITs in "reference standard: positive" studies. However, at pre-specified specificities, the sensitivity of FITs was significantly higher than gFOBTs.

The Current State and Validity of Digital Assessment Tools for Psychiatry: Systematic Review

BACKGROUND

Given the role digital technologies are likely to play in the future of mental health care, there is a need for a comprehensive appraisal of the current state and validity (ie, screening or diagnostic accuracy) of digital mental health assessments.

OBJECTIVE

The aim of this review is to explore the current state and validity of question-and-answer-based digital tools for diagnosing and screening psychiatric conditions in adults.

METHODS

This systematic review was based on the Population, Intervention, Comparison, and Outcome framework and was carried out in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. MEDLINE, Embase, Cochrane Library, ASSIA, Web of Science Core Collection, CINAHL, and PsycINFO were systematically searched for articles published between 2005 and 2021. A descriptive evaluation of the study characteristics and digital solutions and a quantitative appraisal of the screening or diagnostic accuracy of the included tools were conducted. Risk of bias and applicability were assessed using the revised tool for the Quality Assessment of Diagnostic Accuracy Studies 2.

RESULTS

A total of 28 studies met the inclusion criteria, with the most frequently evaluated conditions encompassing generalized anxiety disorder, major depressive disorder, and any depressive disorder. Most of the studies used digitized versions of existing pen-and-paper questionnaires, with findings revealing poor to excellent screening or diagnostic accuracy (sensitivity=0.32-1.00, specificity=0.37-1.00, area under the receiver operating characteristic curve=0.57-0.98) and a high risk of bias for most of the included studies.

CONCLUSIONS

The field of digital mental health tools is in its early stages, and high-quality evidence is lacking.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/25382.

Statistical methods for evaluating the fine needle aspiration cytology procedure in breast cancer diagnosis

Background

Statistical issues present while evaluating a diagnostic procedure for breast cancer are non rare but often ignored, leading to biased results. We aimed to evaluate the diagnostic accuracy of the fine needle aspiration cytology(FNAC), a minimally invasive and rapid technique potentially used as a rule-in or rule-out test, handling its statistical issues: suspect test results and verification bias.

Methods

We applied different statistical methods to handle suspect results by defining conditional estimates. When considering a partial verification bias, Begg and Greenes method and multivariate imputation by chained equations were applied, however, and a Bayesian approach with respect to each gold standard was used when considering a differential verification bias. At last, we extended the Begg and Greenes method to be applied conditionally on the suspect results.

Results

The specificity of the FNAC test above 94%, was always higher than its sensitivity regardless of the proposed method. All positive likelihood ratios were higher than 10, with variations among methods. The positive and negative yields were high, defining precise discriminating properties of the test.

Conclusion

The FNAC test is more likely to be used as a rule-in test for diagnosing breast cancer. Our results contributed in advancing our knowledge regarding the performance of FNAC test and the methods to be applied for its evaluation.

Supplementary Information

The online version contains supplementary material available at (10.1186/s12874-022-01506-y).

Prevalence and incidence of antibodies against SARS-CoV-2 among primary healthcare providers in Belgium during 1 year of the COVID-19 epidemic: prospective cohort study protocol

INTRODUCTION

National SARS-CoV-2 seroprevalence data provide essential information about population exposure to the virus and help predict the future course of the epidemic. Early cohort studies have suggested declines in levels of antibodies in individuals associated with, for example, illness severity, age and comorbidities. This protocol focuses on the seroprevalence among primary healthcare providers (PHCPs) in Belgium. PHCPs manage the vast majority of (COVID-19) patients and therefore play an essential role in the efficient organisation of healthcare. Currently, evidence is lacking on (1) how many PHCPs get infected with SARS-CoV-2 in Belgium, (2) the rate at which this happens, (3) their clinical spectrum, (4) their risk factors, (5) the effectiveness of the measures to prevent infection and (6) the accuracy of the serology-based point-of-care test (POCT) in a primary care setting.

METHODS AND ANALYSIS

This study will be set up as a prospective cohort study. General practitioners (GPs) and other PHCPs (working in a GP practice) will be recruited via professional networks and professional media outlets to register online to participate. Registered GPs and other PHCPs will be asked at each testing point (n=9) to perform a capillary blood sample antibody POCT targeting IgM and IgG against the receptor-binding domain of SARS-CoV-2 and complete an online questionnaire. The primary outcomes are the prevalence and incidence of antibodies against SARS-CoV-2 in PHCPs during a 12-month follow-up period. Secondary outcomes include the longevity of antibodies against SARS-CoV-2.

ETHICS AND DISSEMINATION

Ethical approval has been granted by the ethics committee of the University Hospital of Antwerp/University of Antwerp (Belgian registration number: 3002020000237). Alongside journal publications, dissemination activities include the publication of monthly reports to be shared with the participants and the general population through the publicly available website of the Belgian health authorities (Sciensano).

TRIAL REGISTRATION NUMBER

NCT04779424.

Comparative accuracy of cervical cancer screening strategies in healthy asymptomatic women: a systematic review and network meta-analysis

To compare all available accuracy data on screening strategies for identifying cervical intraepithelial neoplasia grade ≥ 2 in healthy asymptomatic women, we performed a systematic review and network meta-analysis. MEDLINE and EMBASE were searched up to October 2020 for paired-design studies of cytology and testing for high-risk genotypes of human papillomavirus (hrHPV). The methods used included a duplicate assessment of eligibility, double extraction of quantitative data, validity assessment, random-effects network meta-analysis of test accuracy, and GRADE rating. Twenty-seven prospective studies (185,269 subjects) were included. The combination of cytology (atypical squamous cells of undetermined significance or higher grades) and hrHPV testing (excepting genotyping for HPV 16 or 18 [HPV16/18]) with the either-positive criterion (OR rule) was the most sensitive/least specific, whereas the same combination with the both-positive criterion (AND rule) was the most specific/least sensitive. Compared with standalone cytology, non-HPV16/18 hrHPV assays were more sensitive/less specific. Two algorithms proposed for primary cytological testing or primary hrHPV testing were ranked in the middle as more sensitive/less specific than standalone cytology and the AND rule combinations but more specific/less sensitive than standalone hrHPV testing and the OR rule combination. Further research is needed to assess these results in population-relevant outcomes at the program level.

Real-world artificial intelligence-based opportunistic screening for diabetic retinopathy in endocrinology and indigenous healthcare settings in Australia

This study investigated the diagnostic performance, feasibility, and end-user experiences of an artificial intelligence (AI)-assisted diabetic retinopathy (DR) screening model in real-world Australian healthcare settings. The study consisted of two components: (1) DR screening of patients using an AI-assisted system and (2) in-depth interviews with health professionals involved in implementing screening. Participants with type 1 or type 2 diabetes mellitus attending two endocrinology outpatient and three Aboriginal Medical Services clinics between March 2018 and May 2019 were invited to a prospective observational study. A single 45-degree (macula centred), non-stereoscopic, colour retinal image was taken of each eye from participants and were instantly screened for referable DR using a custom offline automated AI system. A total of 236 participants, including 174 from endocrinology and 62 from Aboriginal Medical Services clinics, provided informed consent and 203 (86.0%) were included in the analysis. A total of 33 consenting participants (14%) were excluded from the primary analysis due to ungradable or missing images from small pupils (n = 21, 63.6%), cataract (n = 7, 21.2%), poor fixation (n = 2, 6.1%), technical issues (n = 2, 6.1%), and corneal scarring (n = 1, 3%). The area under the curve, sensitivity, and specificity of the AI system for referable DR were 0.92, 96.9% and 87.7%, respectively. There were 51 disagreements between the reference standard and index test diagnoses, including 29 which were manually graded as ungradable, 21 false positives, and one false negative. A total of 28 participants (11.9%) were referred for follow-up based on new ocular findings, among whom, 15 (53.6%) were able to be contacted and 9 (60%) adhered to referral. Of 207 participants who completed a satisfaction questionnaire, 93.7% specified they were either satisfied or extremely satisfied, and 93.2% specified they would be likely or extremely likely to use this service again. Clinical staff involved in screening most frequently noted that the AI system was easy to use, and the real-time diagnostic report was useful. Our study indicates that AI-assisted DR screening model is accurate and well-accepted by patients and clinicians in endocrinology and indigenous healthcare settings. Future deployments of AI-assisted screening models would require consideration of downstream referral pathways.

PRAISE: providing a roadmap for automated infection surveillance in Europe

INTRODUCTION

Healthcare-associated infections (HAI) are among the most common adverse events of medical care. Surveillance of HAI is a key component of successful infection prevention programmes. Conventional surveillance - manual chart review - is resource intensive and limited by concerns regarding interrater reliability. This has led to the development and use of automated surveillance (AS). Many AS systems are the product of in-house development efforts and heterogeneous in their design and methods. With this roadmap, the PRAISE network aims to provide guidance on how to move AS from the research setting to large-scale implementation, and how to ensure the delivery of surveillance data that are uniform and useful for improvement of quality of care.

METHODS

The PRAISE network brings together 30 experts from ten European countries. This roadmap is based on the outcome of two workshops, teleconference meetings and review by an independent panel of international experts.

RESULTS

This roadmap focuses on the surveillance of HAI within networks of healthcare facilities for the purpose of comparison, prevention and quality improvement initiatives. The roadmap does the following: discusses the selection of surveillance targets, different organizational and methodologic approaches and their advantages, disadvantages and risks; defines key performance requirements of AS systems and suggestions for their design; provides guidance on successful implementation and maintenance; and discusses areas of future research and training requirements for the infection prevention and related disciplines. The roadmap is supported by accompanying documents regarding the governance and information technology aspects of implementing AS.

CONCLUSIONS

Large-scale implementation of AS requires guidance and coordination within and across surveillance networks. Transitions to large-scale AS entail redevelopment of surveillance methods and their interpretation, intensive dialogue with stakeholders and the investment of considerable resources. This roadmap can be used to guide future steps towards implementation, including designing solutions for AS and practical guidance checklists.

Computerized Tomography (CT) Updates and Challenges in Diagnosis of Bone Metastases During Prostate Cancer

Prostate cancer is one of the most common cancers in men. This cancer is often associated with indolent tumors with little or no lethal potential. Some of the patients with aggressive prostate cancer have increased morbidity and early deaths. A major complication in advanced prostate cancer is bone metastasis that mainly results in pain, pathological fractures, and compression of spinal nerves. These complications in turn cause severe pain radiating to the extremities and possibly sensory as well as motor disturbances. Further, in patients with a high risk of metastases, treatment is limited to palliative therapies. Therefore, accurate methods for the detection of bone metastases are essential. Technical advances such as single-photon emission computed tomography/ computed tomography (SPECT/CT) have emerged after the introduction of bone scans. These advanced methods allow tomographic image acquisition and help in attenuation correction with anatomical co-localization. The use of positron emission tomography/CT (PET/CT) scanners is also on the rise. These PET scanners are mainly utilized with 18F-sodium-fluoride (NaF), in order to visualize the skeleton and possible changes. Moreover, NaF PET/CT is associated with higher tracer uptake, increased target-to-background ratio and has a higher spatial resolution. However, these newer technologies have not been adopted in clinical guidelines due to lack of definite evidence in support of their use in bone metastases cases. The present review article is focused on current perspectives and challenges of computerized tomography (CT) applications in cases of bone metastases during prostate cancer.

Screening test accuracy of portable devices that can be used to perform colposcopy for detecting CIN2+ in low- and middle-income countries: a systematic review and meta-analysis

BACKGROUND

Portable devices that can be used to perform colposcopy may improve cervical cancer screening in low- and middle-income countries (LMIC) where access to colposcopy is limited. The objective of this study was to systematically review the diagnostic test accuracy (DTA) of these devices for the detection of cervical intraepithelial neoplasia grade 2 or higher (CIN2+).

METHODS

In accordance with our protocol (Prospero CRD42018104286), we searched Embase, Medline and the Cochrane Controlled Register of Trials up to 9/2019. We included DTA studies, which investigated portable devices with moderate-to-high optical magnification (≥ 6×) for colposcopy, as described in the manual for Colposcopy and Treatment by the International Agency for Research on Cancer, with a histopathological reference standard. We used the QUADAS-2 tool to assess study quality. We examined results for sensitivity and specificity in paired forest plots, stratified by stages in the clinical pathway. We pooled estimates of test accuracy for the index test, used as an add-on to other tests, using a bivariate random-effect model.

RESULTS

We screened 1737 references and assessed 239 full-text articles for eligibility. Five single-gate DTA studies, including 2693 women, met the inclusion criteria. Studies evaluated two devices (Gynocular™ and Pocket) at different stages of the screening pathway. In three studies, which used the index test in an add-on capacity in 1273 women, we found a pooled sensitivity of 0.79 (95% CI 0.55-0.92) and specificity of 0.83 (95% CI 0.59-0.94). The main sources of bias were partial verification, incorporation and classification bias.

CONCLUSION

Few studies have evaluated portable devices able to perform colposcopy, so their accuracy for the detection of CIN2+ remains uncertain. Future studies should include patient-relevant and long-term outcomes, including missed cases, overtreatment, residual and recurrent disease. To meet the challenge of eliminating cervical cancer in LMIC, methods for visual assessment of the cervix need urgent redress.

Reporting Quality of Diagnostic Accuracy Studies in Laboratory Medicine: Adherence to Standards for Reporting of Diagnostic Accuracy Studies (STARD) 2015

Background

Poor reporting quality in diagnostic accuracy studies hampers an adequate judgment of the validity of the study. The Standards for Reporting of Diagnostic Accuracy Studies (STARD) statement was published to improve the reporting quality of diagnostic accuracy studies. This study aimed to evaluate the adherence of diagnostic accuracy studies published in Annals of Laboratory Medicine (ALM) to STARD 2015 and to identify directions for improvement in the reporting quality of these studies.

Methods

Two independent authors assessed articles published in ALM between 2012–2018 for compliance with 30 STARD 2015 checklist items to identify all eligible diagnostic accuracy studies published during this period. We included 66 diagnostic accuracy studies. A total of the fulfilled STARD items were calculated, and adherence was analyzed on an individual-item basis.

Results

The overall mean±SD number of STARD items reported for the included studies was 11.2±2.7. Only five (7.6%) studies adhered to more than 50% of the 30 items. No study satisfied more than 80% of the items. Large variability in adherence to reporting standards was detected across items, ranging from 0% to 100%.

Conclusions

Adherence to STARD 2015 is suboptimal among diagnostic accuracy studies published in ALM. Our study emphasizes the necessity of adherence to STARD to improve the reporting quality of future diagnostic accuracy studies to be published in ALM.

Diagnostic Accuracy of the Ambulatory EEG vs. Routine EEG for First Single Unprovoked Seizures and Seizure Recurrence: The DX-Seizure Study

Background: The DX-Seizure study aims to evaluate the diagnostic accuracy (sensitivity, specificity, positive predictive value, negative predictive value, and likelihood ratio) of the ambulatory EEG in comparison with the first routine EEG, and a second routine EEG right before the ambulatory EEG, on adult patients with first single unprovoked seizure (FSUS) and define the utility of ambulatory EEG in forecasting seizure recurrence in these patients after 1-year follow-up.

Methods: The DX-Seizure study is a prospective cohort of 113 adult patients (≥18-year-old) presenting with FSUS to the Single Seizure Clinic for evaluation. These patients will be assessed by a neurologist/epileptologist with the first routine EEG (referral EEG) and undergo a second routine EEG and ambulatory EEG. The three EEG (first routine EEG as gold standard) will be compared and evaluated their diagnostic accuracy (sensitivity, specificity, positive predictive value, negative predictive value, and likelihood ratios) with respect of epileptiform activity and other abnormalities. One-year follow-up of each patient will be used to assess recurrence of seizures after a FSUS and the utility of the ambulatory EEG to forecast these recurrences.

Discussion: To the best of our knowledge, this will be the first study to prospectively examine the use of ambulatory EEG for a FSUS in adults and its use for prediction of recurrence of seizures. The overarching goal is to improve diagnostic accuracy with the use of ambulatory EEG in patients with their FSUS. We anticipate that this will decrease incorrect or uncertain diagnoses with resulting psychological and financial cost to the patient. We also anticipate that an improved method to predicting the recurrence of seizures will reduce the chances of repeated seizures and their consequences.

Comparison of HPV-16 and HPV-18 Genotyping and Cytological Testing as Triage Testing Within Human Papillomavirus-Based Screening in Mexico

IMPORTANCE

Triage tests enhance the efficiency cervical cancer screening based on human papillomavirus (HPV), but the best approach for maximizing programmatic effectiveness is still uncertain, particularly in a real-world scenario.

OBJECTIVE

To compare the clinical performance of 6 triage strategies based on liquid-based cytology (LBC) and HPV-16 and HPV-18 genotyping individually or in combination as sequential triage tests to detect cervical intraepithelial neoplasia (CIN) grade 2 or higher among women with high-risk HPV.

DESIGN, SETTING, AND PARTICIPANTS

This diagnostic study of routine cervical cancer screening was conducted at 100 primary health centers in Tlaxcala, Mexico. Women aged 30 to 64 years were recruited from August 1, 2013, to February 24, 2016, as part of the Forwarding Research for Improved Detection and Access for Cervical Cancer Screening and Triage study. Six triage scenarios for referral to colposcopy were examined: (1) LBC testing that found atypical squamous cells of undetermined significance (ASC-US) or worse, (2) positive results in HPV-16 genotyping, (3) positive results in HPV-18 genotyping, (4) positive results in HPV-16/HPV-18 genotyping, (5) positive results in HPV-16 genotyping or, if genotyping results were negative, reflex LBC testing that found ASC-US or worse, and (6) positive results in HPV-16/HPV-18 genotyping or, if genotyping results were negative, reflex LBC testing that found ASC-US or worse. Data were analyzed from October 2017 to August 2018.

EXPOSURES

Liquid-based cytological testing with simultaneous HPV-16 and HPV-18 genotyping. Women whose HPV genotyping results were positive for HPV-16 or HPV-18 or whose LBC results found ASC-US or worse and a random set of negative and normal results were referred to colposcopy with histologic analysis used for disease confirmation.

MAIN OUTCOMES AND MEASURES

Clinical performance of each test strategy for detection of CIN grade 2 or higher. Secondary outcomes included resource utilization of each triage scenario, measured by the number of tests performed, the referral rate for colposcopy, and the numbers of colposcopies per CIN grade 2 or higher detected.

RESULTS

A total of 36 212 women (median [interquartile range] age, 40 [35-47] years) were screened, and 4051 women (11.2%) had high-risk HPV. Of these women, 1109 (24.6%) were found to have HPV-16, HPV-18, or ASC-US or worse. Further histologic testing detected CIN grade 2 or higher in 110 of 788 women (14.0%) who underwent follow-up colposcopy. Sensitivity and specificity for 3 main triage strategies were 42.9% and 74.0% for LBC; 58.3% and 54.4% for HPV-16/HPV-18 genotyping; and 86.6% and 34.0% for HPV-16/HPV-18 genotyping with reflex LBC. The referral rate to colposcopy was 29% for HPV-16/HPV-18 with reflex LBC, which was 2-fold higher than the referral rate of 12% for LBC.

CONCLUSIONS AND RELEVANCE

Triage of women with high-risk HPV with HPV-16/HPV-18 genotyping with reflex LBC was significantly associated with improvement in detection of CIN grade 2 or higher compared with LBC alone. The benefit of disease prevented may outweigh the cost of increasing requirements for colposcopy services in settings with limited adherence to follow-up after a positive screening result.

Diagnostic test evaluation methodology: A systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard - An update

OBJECTIVE

To systematically review methods developed and employed to evaluate the diagnostic accuracy of medical test when there is a missing or no gold standard.

STUDY DESIGN AND SETTINGS

Articles that proposed or applied any methods to evaluate the diagnostic accuracy of medical test(s) in the absence of gold standard were reviewed. The protocol for this review was registered in PROSPERO (CRD42018089349).

RESULTS

Identified methods were classified into four main groups: methods employed when there is a missing gold standard; correction methods (which make adjustment for an imperfect reference standard with known diagnostic accuracy measures); methods employed to evaluate a medical test using multiple imperfect reference standards; and other methods, like agreement studies, and a mixed group of alternative study designs. Fifty-one statistical methods were identified from the review that were developed to evaluate medical test(s) when the true disease status of some participants is unverified with the gold standard. Seven correction methods were identified and four methods were identified to evaluate medical test(s) using multiple imperfect reference standards. Flow-diagrams were developed to guide the selection of appropriate methods.

CONCLUSION

Various methods have been proposed to evaluate medical test(s) in the absence of a gold standard for some or all participants in a diagnostic accuracy study. These methods depend on the availability of the gold standard, its' application to the participants in the study and the availability of alternative reference standard(s). The clinical application of some of these methods, especially methods developed when there is missing gold standard is however limited. This may be due to the complexity of these methods and/or a disconnection between the fields of expertise of those who develop (e.g. mathematicians) and those who employ the methods (e.g. clinical researchers). This review aims to help close this gap with our classification and guidance tools.

Clinical value of (dedicated) 3 Tesla and 7 Tesla MRI for cT1 glottic carcinoma: A feasibility study

Objective

To assess the feasibility of the clinical use of 3 Tesla and 7 Tesla Magnetic Resonance Imaging for early (cT1) glottic carcinoma, including structural assessment of technical image quality and visibility of the tumor; and if feasible, to correlate MRI findings to routine diagnostics.

Methods

Prospective feasibility study. Twenty patients with primary clinical T1 glottic carcinoma underwent both routine clinical staging and CT. In addition, a 3 T and 7 T MRI protocol, developed for small laryngeal lesions, was performed in a 4-point immobilization mask, using dedicated surface coils. Afterwards, routine endoscopic direct suspension laryngoscopy under general anaesthesia was performed.

Results

Only 2 of 7 (29%) of 7 T MRI scans were rated as moderate to good technical image quality. After exclusion of three patients with only mild to moderate dysplasia at the time of MRI, 13 of 17 (76%) of 3 T MRIs were of adequate technical image quality. Tumor visualization was adequate in 8 of 13 (62%) of patients with invasive squamous cell carcinomas. With exclusion of the four MRIs with motion artefacts, the tumor and its boundaries could be adequately seen in 8 of 9 (89%) patients with squamous cell carcinoma versus only one in four (25%) of patients with carcinoma in situ lesions.

Conclusions

7 Tesla MRI was considered not feasible. 3 Tesla MRI, with adequate patient selection, namely clinical exclusion of patients with a history of claustrophobia and inclusion of only histologically proven invasive squamous cell carcinoma, can be feasible. Especially with further improvement of MR image quality.

Level of Evidence

2B, prospective diagnostic study.

Detection of residual disease after neoadjuvant chemoradiotherapy for oesophageal cancer (preSANO): a prospective multicentre, diagnostic cohort study

BACKGROUND

After neoadjuvant chemoradiotherapy for oesophageal cancer, roughly half of the patients with squamous cell carcinoma and a quarter of those with adenocarcinoma have a pathological complete response of the primary tumour before surgery. Thus, the necessity of standard oesophagectomy after neoadjuvant chemoradiotherapy should be reconsidered for patients who respond sufficiently to neoadjuvant treatment. In this study, we aimed to establish the accuracy of detection of residual disease after neoadjuvant chemoradiotherapy with different diagnostic approaches, and the optimal combination of diagnostic techniques for clinical response evaluations.

METHODS

The preSANO trial was a prospective, multicentre, diagnostic cohort study at six centres in the Netherlands. Eligible patients were aged 18 years or older, had histologically proven, resectable, squamous cell carcinoma or adenocarcinoma of the oesophagus or oesophagogastric junction, and were eligible for potential curative therapy with neoadjuvant chemoradiotherapy (five weekly cycles of carboplatin [area under the curve 2 mg/mL per min] plus paclitaxel [50 mg/m² of body-surface area] combined with 41·4 Gy radiotherapy in 23 fractions) followed by oesophagectomy. 4-6 weeks after completion of neoadjuvant chemoradiotherapy, patients had oesophagogastroduodenoscopy with biopsies and endoscopic ultrasonography with measurement of maximum tumour thickness. Patients with histologically proven locoregional residual disease or no-pass during endoscopy and without distant metastases underwent immediate surgical resection. In the remaining patients a second clinical response evaluation was done (PET-CT, oesophagogastroduodenoscopy with biopsies, endoscopic ultrasonography with measurement of maximum tumour thickness, and fine-needle aspiration of suspicious lymph nodes), followed by surgery 12-14 weeks after completion of neoadjuvant chemoradiotherapy. The primary endpoint was the correlation between clinical response during clinical response evaluations and the final pathological response in resection specimens, as shown by the proportion of tumour regression grade (TRG) 3 or 4 (>10% residual carcinoma in the resection specimen) residual tumours that was missed during clinical response evaluations. This study was registered with the Netherlands Trial Register (NTR4834), and has been completed.

FINDINGS

Between July 22, 2013, and Dec 28, 2016, 219 patients were included, 207 of whom were included in the analyses. Eight of 26 TRG3 or TRG4 tumours (31% [95% CI 17-50]) were missed by endoscopy with regular biopsies and fine-needle aspiration. Four of 41 TRG3 or TRG4 tumours (10% [95% CI 4-23]) were missed with bite-on-bite biopsies and fine-needle aspiration. Endoscopic ultrasonography with maximum tumour thickness measurement missed TRG3 or TRG4 residual tumours in 11 of 39 patients (28% [95% CI 17-44]). PET-CT missed six of 41 TRG3 or TRG4 tumours (15% [95% CI 7-28]). PET-CT detected interval distant histologically proven metastases in 18 (9%) of 190 patients (one squamous cell carcinoma, 17 adenocarcinomas).

INTERPRETATION

After neoadjuvant chemoradiotherapy for oesophageal cancer, clinical response evaluation with endoscopic ultrasonography, bite-on-bite biopsies, and fine-needle aspiration of suspicious lymph nodes was adequate for detection of locoregional residual disease, with PET-CT for detection of interval metastases. Active surveillance with this combination of diagnostic modalities is now being assessed in a phase 3 randomised controlled trial (SANO trial; Netherlands Trial Register NTR6803).

FUNDING

Dutch Cancer Society.

Predicting inflammatory bowel disease in children with abdominal pain and diarrhoea: calgranulin-C versus calprotectin stool tests

OBJECTIVE

Calgranulin-C (S100A12) is a new faecal marker of inflammation that is potentially more specific for inflammatory bowel disease (IBD) than calprotectin, since it is only released by activated granulocytes. We compared calgranulin-C and calprotectin to see which of the two tests best predicted IBD in children with chronic abdominal pain and diarrhoea.

DESIGN

Delayed-type cross-sectional diagnostic study.

SETTING AND PATIENTS

Previously undiagnosed patients aged 6-17 years, who were seen in paediatric clinics in the Netherlands and Belgium, sent in a stool sample for analysis. Patients with a high likelihood of IBD underwent upper and lower endoscopy (ie, preferred reference test), while those with a low likelihood were followed for 6 months for latent IBD to become visible (ie, alternative reference test). We used Bayesian modelling to correct for differential verification bias.

MAIN OUTCOME MEASURES

Primary outcome was the specificity for IBD using predefined test thresholds (calgranulin-C: 0.75 µg/g, calprotectin: 50 µg/g). Secondary outcome was the test accuracy with thresholds based on receiver operating characteristics (ROC) analysis.

RESULTS

IBD was diagnosed in 93 of 337 patients. Calgranulin-C had significantly better specificity than calprotectin when predefined thresholds were used (97% (95% credible interval (CI) 94% to 99%) vs 71% (95% CI 63% to 79%), respectively). When ROC-based thresholds were used (calgranulin-C: 0.75 µg/g, calprotectin: 400 µg/g), both tests performed equally well (specificity: 97% (95% CI 94% to 99%) vs 98% (95% CI 95% to 100%)).

CONCLUSIONS

Both calgranulin-C and calprotectin have excellent test characteristics to predict IBD and justify endoscopy.

TRIAL REGISTRATION NUMBER

NCT02197780.

Diagnostic test strategies in children at increased risk of inflammatory bowel disease in primary care

Background

In children with symptoms suggestive of inflammatory bowel disease (IBD) who present in primary care, the optimal test strategy for identifying those who require specialist care is unclear. We evaluated the following three test strategies to determine which was optimal for referring children with suspected IBD to specialist care: 1) alarm symptoms alone, 2) alarm symptoms plus c-reactive protein, and 3) alarm symptoms plus fecal calprotectin.

Methods

A prospective cohort study was conducted, including children with chronic gastrointestinal symptoms referred to pediatric gastroenterology. Outcome was defined as IBD confirmed by endoscopy, or IBD ruled out by either endoscopy or unremarkable clinical 12 month follow-up with no indication for endoscopy. Test strategy probabilities were generated by logistic regression analyses and compared by area under the receiver operating characteristic curves (AUC) and decision curves.

Results

We included 90 children, of whom 17 (19%) had IBD (n = 65 from primary care physicians, n = 25 from general pediatricians). Adding fecal calprotectin to alarm symptoms increased the AUC significantly from 0.80 (0.67–0.92) to 0.97 (0.93–1.00), but adding c-reactive protein to alarm symptoms did not increase the AUC significantly (p > 0.05). Decision curves confirmed these patterns, showing that alarm symptoms combined with fecal calprotectin produced the diagnostic test strategy with the highest net benefit at reasonable threshold probabilities.

Conclusion

In primary care, when children are identified as being at high risk for IBD, adding fecal calprotectin testing to alarm symptoms was the optimal strategy for improving risk stratification.

Risk-adjusted colorectal cancer screening using the FIT and routine screening data: development of a risk prediction model

Background:

The faecal immunochemical test (FIT) is replacing the guaiac faecal occult blood test in colorectal cancer screening. Increased uptake and FIT positivity will challenge colonoscopy services. We developed a risk prediction model combining routine screening data with FIT concentration to improve the accuracy of screening referrals.

Methods:

Multivariate analysis used complete cases of those with a positive FIT (⩾20 μg g⁻¹) and diagnostic outcome (n=1810; 549 cancers and advanced adenomas). Logistic regression was used to develop a risk prediction model using the FIT result and screening data: age, sex and previous screening history. The model was developed further using a feedforward neural network. Model performance was assessed by discrimination and calibration, and test accuracy was investigated using clinical sensitivity, specificity and receiver operating characteristic curves.

Results:

Discrimination improved from 0.628 with just FIT to 0.659 with the risk-adjusted model (P=0.01). Calibration using the Hosmer–Lemeshow test was 0.90 for the risk-adjusted model. The sensitivity improved from 30.78% to 33.15% at similar specificity (FIT threshold of 160 μg g⁻¹). The neural network further improved model performance and test accuracy.

Conclusions:

Combining routinely available risk predictors with the FIT improves the clinical sensitivity of the FIT with an increase in the diagnostic yield of high-risk adenomas.

Diagnostic test accuracy study of 18F-sodium fluoride PET/CT, 99mTc-labelled diphosphonate SPECT/CT, and planar bone scintigraphy for diagnosis of bone metastases in newly diagnosed, high-risk prostate cancer

The aim of this study was to prospectively compare planar, bone scan (BS) versus SPECT/CT and NaF PET/CT in detecting bone metastases in prostate cancer. Thirty-seven consecutive, newly diagnosed, prostate cancer patients with prostate specific antigen (PSA) levels ≥ 50 ng/mL and who were considered eligible for androgen-deprivation therapy (ADT) were included in this study. BS, SPECT/CT, and NaF PET/CT, were performed prior to treatment and were repeated after six months of ADT. Baseline images from each index test were independently read by two experienced readers. The reference standard was based on a consensus decision made by a multidisciplinary team on the basis of baseline and follow-up images of the index tests, the findings of the baseline index tests by the experienced readers, and any available imaging, biochemical, and clinical data, including the response to ADT. Twenty-seven (73%) of the 37 patients had bone metastases according to the reference standard. The sensitivities for BS, SPECT/CT and NaF PET/CT were 78%, 89%, and 89%, respectively, and the specificities were 90%, 100%, and 90%, respectively. The positive predictive values of BS, SPECT/CT and NaF PET/CT were 96%, 100%, and 96%, respectively, and the negative predictive values were 60%, 77% and 75%, respectively. No statistically significant difference among the three imaging modalities was observed. All three imaging modalities showed high sensitivity and specificity. NaF PET/CT and SPECT/CT showed numerically improved, but not statistically superior, sensitivity compared with BS in this limited and selected patient cohort.

Validation of a Novel Assay to Distinguish Bacterial and Viral Infections

BACKGROUND

Reliably distinguishing bacterial from viral infections is often challenging, leading to antibiotic misuse. A novel assay that integrates measurements of blood-borne host-proteins (tumor necrosis factor-related apoptosis-inducing ligand, interferon γ-induced protein-10, and C-reactive protein [CRP]) was developed to assist in differentiation between bacterial and viral disease.

METHODS

We performed double-blind, multicenter assay evaluation using serum remnants collected at 5 pediatric emergency departments and 2 wards from children ≥3 months to ≤18 years without (n = 68) and with (n = 529) suspicion of acute infection. Infectious cohort inclusion criteria were fever ≥38°C and symptom duration ≤7 days. The reference standard diagnosis was based on predetermined criteria plus adjudication by experts blinded to assay results. Assay performers were blinded to the reference standard. Assay cutoffs were predefined.

RESULTS

Of 529 potentially eligible patients with suspected acute infection, 100 did not fulfill infectious inclusion criteria and 68 had insufficient serum. The resulting cohort included 361 patients, with 239 viral, 68 bacterial, and 54 indeterminate reference standard diagnoses. The assay distinguished between bacterial and viral patients with 93.8% sensitivity (95% confidence interval: 87.8%-99.8%) and 89.8% specificity (85.6%-94.0%); 11.7% had an equivocal assay outcome. The assay outperformed CRP (cutoff 40 mg/L; sensitivity 88.2% [80.4%-96.1%], specificity 73.2% [67.6%-78.9%]) and procalcitonin testing (cutoff 0.5 ng/mL; sensitivity 63.1% [51.0%-75.1%], specificity 82.3% [77.1%-87.5%]).

CONCLUSIONS

Double-blinded evaluation confirmed high assay performance in febrile children. Assay was significantly more accurate than CRP, procalcitonin, and routine laboratory parameters. Additional studies are warranted to support its potential to improve antimicrobial treatment decisions.

Selecting children with suspected inflammatory bowel disease for endoscopy with the calgranulin C or calprotectin stool test: protocol of the CACATU study

INTRODUCTION

The introduction of the faecal calprotectin (FC) test to screen children with chronic gastrointestinal complaints has helped the clinician to decide whether or not to subject the patient to endoscopy. In spite of this, a considerable number of patients without inflammatory bowel disease (IBD) is still scoped. Faecal calgranulin C (S100A12) is a marker of intestinal inflammation that is potentially more specific for IBD than FC, as it is exclusively released by activated granulocytes.

OBJECTIVE

To determine whether the specificity of S100A12 is superior to the specificity of FC without sacrificing sensitivity in patients with suspected IBD.

METHODS

An international prospective cohort of children with suspected IBD will be screened with the existing FC stool test and the new S100A12 stool test. The reference standard (endoscopy with biopsies) will be applied to patients at high risk of IBD, while a secondary reference (clinical follow-up) will be applied to those at low risk of IBD. The differences in specificity and sensitivity between the two markers will be calculated.

ETHICS AND DISSEMINATION

This study is submitted to and approved by the Medical Ethics Review Committee of the University Medical Center Groningen (the Netherlands) and the Antwerp University Hospital (Belgium). The results will be disseminated through a peer-reviewed publication, conference presentation and incorporation in the upcoming National Guideline on Diagnosis and Therapy of IBD in Children.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT02197780 .

STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration

Diagnostic accuracy studies are, like other clinical studies, at risk of bias due to shortcomings in design and conduct, and the results of a diagnostic accuracy study may not apply to other patient groups and settings. Readers of study reports need to be informed about study design and conduct, in sufficient detail to judge the trustworthiness and applicability of the study findings. The STARD statement (Standards for Reporting of Diagnostic Accuracy Studies) was developed to improve the completeness and transparency of reports of diagnostic accuracy studies. STARD contains a list of essential items that can be used as a checklist, by authors, reviewers and other readers, to ensure that a report of a diagnostic accuracy study contains the necessary information. STARD was recently updated. All updated STARD materials, including the checklist, are available at http://www.equator-network.org/reporting-guidelines/stard Here, we present the STARD 2015 explanation and elaboration document. Through commented examples of appropriate reporting, we clarify the rationale for each of the 30 items on the STARD 2015 checklist, and describe what is expected from authors in developing sufficiently informative study reports.