Evaluation of Nucleic Acid Amplification Tests in the Absence of a Perfect Gold-Standard Test

Psychometric Evaluation of a Tablet-Based Tool to Detect Mild Cognitive Impairment in Older Adults: Mixed Methods Study

BACKGROUND

With the rapid aging of the global population, the prevalence of mild cognitive impairment (MCI) and dementia is anticipated to surge worldwide. MCI serves as an intermediary stage between normal aging and dementia, necessitating more sensitive and effective screening tools for early identification and intervention. The BrainFx SCREEN is a novel digital tool designed to assess cognitive impairment. This study evaluated its efficacy as a screening tool for MCI in primary care settings, particularly in the context of an aging population and the growing integration of digital health solutions.

OBJECTIVE

The primary objective was to assess the validity, reliability, and applicability of the BrainFx SCREEN (hereafter, the SCREEN) for MCI screening in a primary care context. We conducted an exploratory study comparing the SCREEN with an established screening tool, the Quick Mild Cognitive Impairment (Qmci) screen.

METHODS

A concurrent mixed methods, prospective study using a quasi-experimental design was conducted with 147 participants from 5 primary care Family Health Teams (FHTs; characterized by multidisciplinary practice and capitated funding) across southwestern Ontario, Canada. Participants included health care practitioners, patients, and FHT administrative executives. Individuals aged ≥55 years with no history of MCI or diagnosis of dementia rostered in a participating FHT were eligible to participate. Participants were screened using both the SCREEN and Qmci. The study also incorporated the Geriatric Anxiety Scale-10 to assess general anxiety levels at each cognitive screening. The SCREEN's scoring was compared against that of the Qmci and the clinical judgment of health care professionals. Statistical analyses included sensitivity, specificity, internal consistency, and test-retest reliability assessments.

RESULTS

The study found that the SCREEN's longer administration time and complex scoring algorithm, which is proprietary and unavailable for independent analysis, presented challenges. Its internal consistency, indicated by a Cronbach α of 0.63, was below the acceptable threshold. The test-retest reliability also showed limitations, with moderate intraclass correlation coefficient (0.54) and inadequate κ (0.15) values. Sensitivity and specificity were consistent (63.25% and 74.07%, respectively) between cross-tabulation and discrepant analysis. In addition, the study faced limitations due to its demographic skew (96/147, 65.3% female, well-educated participants), the absence of a comprehensive gold standard for MCI diagnosis, and financial constraints limiting the inclusion of confirmatory neuropsychological testing.

CONCLUSIONS

The SCREEN, in its current form, does not meet the necessary criteria for an optimal MCI screening tool in primary care settings, primarily due to its longer administration time and lower reliability. As the number of digital health technologies increases and evolves, further testing and refinement of tools such as the SCREEN are essential to ensure their efficacy and reliability in real-world clinical settings. This study advocates for continued research in this rapidly advancing field to better serve the aging population.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/25520.

Prospects of Microfluidic Technology in Nucleic Acid Detection Approaches

Conventional diagnostic techniques are based on the utilization of analyte sampling, sensing and signaling on separate platforms for detection purposes, which must be integrated to a single step procedure in point of care (POC) testing devices. Due to the expeditious nature of microfluidic platforms, the trend has been shifted toward the implementation of these systems for the detection of analytes in biochemical, clinical and food technology. Microfluidic systems molded with substances such as polymers or glass offer the specific and sensitive detection of infectious and noninfectious diseases by providing innumerable benefits, including less cost, good biological affinity, strong capillary action and simple process of fabrication. In the case of nanosensors for nucleic acid detection, some challenges need to be addressed, such as cellular lysis, isolation and amplification of nucleic acid before its detection. To avoid the utilization of laborious steps for executing these processes, advances have been deployed in this perspective for on-chip sample preparation, amplification and detection by the introduction of an emerging field of modular microfluidics that has multiple advantages over integrated microfluidics. This review emphasizes the significance of microfluidic technology for the nucleic acid detection of infectious and non-infectious diseases. The implementation of isothermal amplification in conjunction with the lateral flow assay greatly increases the binding efficiency of nanoparticles and biomolecules and improves the limit of detection and sensitivity. Most importantly, the deployment of paper-based material made of cellulose reduces the overall cost. Microfluidic technology in nucleic acid testing has been discussed by explicating its applications in different fields. Next-generation diagnostic methods can be improved by using CRISPR/Cas technology in microfluidic systems. This review concludes with the comparison and future prospects of various microfluidic systems, detection methods and plasma separation techniques used in microfluidic devices.

Core concepts in pharmacoepidemiology: Validation of health outcomes of interest within real-world healthcare databases

Real-world healthcare data, including administrative and electronic medical record databases, provide a rich source of data for the conduct of pharmacoepidemiologic studies but carry the potential for misclassification of health outcomes of interest (HOIs). Validation studies are important ways to quantify the degree of error associated with case-identifying algorithms for HOIs and are crucial for interpreting study findings within real-world data. This review provides a rationale, framework, and step-by-step approach to validating case-identifying algorithms for HOIs within healthcare databases. Key steps in validating a case-identifying algorithm within a healthcare database include: (1) selecting the appropriate health outcome; (2) determining the reference standard against which to validate the algorithm; (3) developing the algorithm using diagnosis codes, diagnostic tests or their results, procedures, drug therapies, patient-reported symptoms or diagnoses, or some combinations of these parameters; (4) selection of patients and sample sizes for validation; (5) collecting data to confirm the HOI; (6) confirming the HOI; and (7) assessing the algorithm's performance. Additional strategies for algorithm refinement and methods to correct for bias due to misclassification of outcomes are discussed. The review concludes by discussing factors affecting the transportability of case-identifying algorithms and the need for ongoing validation as data elements within healthcare databases, such as diagnosis codes, change over time or new variables, such as patient-generated health data, are included in these data sources.

Malaria diagnostic update: From conventional to advanced method

BACKGROUND

Update diagnostic methods play essential roles in dealing with the current global malaria situation and decreasing malaria incidence.

AIM

Global malaria control programs require the availability of adequate laboratory tests in the quick and convenient field.

RESULTS

There are several methods to find out the existence of parasites within the blood. The oldest one is by microscopy, which is still a gold standard, although rapid diagnostic tests (RDTs) have rapidly become a primary diagnostic test in many endemic areas. Because of microscopy and RDTs limitation, novel serological and molecular methods have been developed. Many kinds of polymerase chain reaction (PCR) provide rapid results and higher specificity and sensitivity. The loop-mediated isothermal amplification (LAMP) and biosensing-based molecular techniques as point of care tests (POCT) will become a cost-effective approach to advance diagnostic testing.

CONCLUSION

Despite conventional techniques are still being used in the field, the exploration and field implementation of advanced techniques for the diagnosis of malaria are still being developed rapidly.

A New Approach for Classifying Fetal Growth Restriction

BACKGROUND

Fetal growth restriction is commonly defined using small for gestational age (SGA) birth (birthweight < 10th percentile) as a proxy, but this approach is problematic because most SGA infants are small but healthy. In this proof-of-concept study, we sought to develop a new approach for identifying fetal growth restriction at birth that combines information on multiple, imperfect measures of fetal growth restriction in a probabilistic manner.

METHODS

We combined information on birthweight, placental weight, placental malperfusion lesions, maternal disease, and fetal acidemia using latent profile analysis to classify fetal growth in births at the Royal Victoria Hospital in Montreal, Canada, 2001-2009. We examined the clinical characteristics and health outcomes of infants classified as growth-restricted and nongrowth-restricted by our model, and among the subgroup of growth-restricted infants who had a birthweight ≥10th percentile (i.e., would have been missed by the conventional SGA proxy).

RESULTS

Among 26,077 births, 345 (1.3%) were classified as growth-restricted by our latent profile model. Growth-restricted infants were more likely than nongrowth-restricted infants to have an Apgar score <7 (10% vs. 2%), have hypoglycemia at birth (17% vs. 3%), require neonatal intensive care unit admission (59% vs. 6%), die in the perinatal period (3.8% vs. 0.2%), and require an emergency cesarean delivery (42% vs. 15%). Risks remained elevated in growth-restricted infants who were not SGA, suggesting our model identified at-risk infants not detected using the SGA proxy.

CONCLUSIONS

Latent profile analysis is a promising strategy for classifying growth restriction at birth in fetal growth restriction research.

Xpert Ultra versus Xpert MTB/RIF for pulmonary tuberculosis and rifampicin resistance in adults with presumptive pulmonary tuberculosis

BACKGROUND

Xpert MTB/RIF and Xpert MTB/RIF Ultra (Xpert Ultra) are World Health Organization (WHO)-recommended rapid tests that simultaneously detect tuberculosis and rifampicin resistance in people with signs and symptoms of tuberculosis. This review builds on our recent extensive Cochrane Review of Xpert MTB/RIF accuracy.

OBJECTIVES

To compare the diagnostic accuracy of Xpert Ultra and Xpert MTB/RIF for the detection of pulmonary tuberculosis and detection of rifampicin resistance in adults with presumptive pulmonary tuberculosis. For pulmonary tuberculosis and rifampicin resistance, we also investigated potential sources of heterogeneity. We also summarized the frequency of Xpert Ultra trace-positive results, and estimated the accuracy of Xpert Ultra after repeat testing in those with trace-positive results.

SEARCH METHODS

We searched the Cochrane Infectious Diseases Group Specialized Register, MEDLINE, Embase, Science Citation Index, Web of Science, LILACS, Scopus, the WHO ICTRP, the ISRCTN registry, and ProQuest to 28 January 2020 with no language restriction.

SELECTION CRITERIA

We included diagnostic accuracy studies using respiratory specimens in adults with presumptive pulmonary tuberculosis that directly compared the index tests. For pulmonary tuberculosis detection, the reference standards were culture and a composite reference standard. For rifampicin resistance, the reference standards were culture-based drug susceptibility testing and line probe assays.

DATA COLLECTION AND ANALYSIS

Two review authors independently extracted data using a standardized form, including data by smear and HIV status. We assessed risk of bias using QUADAS-2 and QUADAS-C. We performed meta-analyses comparing pooled sensitivities and specificities, separately for pulmonary tuberculosis detection and rifampicin resistance detection, and separately by reference standard. Most analyses used a bivariate random-effects model. For tuberculosis detection, we estimated accuracy in studies in participants who were not selected based on prior microscopy testing or history of tuberculosis. We performed subgroup analyses by smear status, HIV status, and history of tuberculosis. We summarized Xpert Ultra trace results.

MAIN RESULTS

We identified nine studies (3500 participants): seven had unselected participants (2834 participants). All compared Xpert Ultra and Xpert MTB/RIF for pulmonary tuberculosis detection; seven studies used a paired comparative accuracy design, and two studies used a randomized design. Five studies compared Xpert Ultra and Xpert MTB/RIF for rifampicin resistance detection; four studies used a paired design, and one study used a randomized design. Of the nine included studies, seven (78%) were mainly or exclusively in high tuberculosis burden countries. For pulmonary tuberculosis detection, most studies had low risk of bias in all domains. Pulmonary tuberculosis detection Xpert Ultra pooled sensitivity and specificity (95% credible interval) against culture were 90.9% (86.2 to 94.7) and 95.6% (93.0 to 97.4) (7 studies, 2834 participants; high-certainty evidence) versus Xpert MTB/RIF pooled sensitivity and specificity of 84.7% (78.6 to 89.9) and 98.4% (97.0 to 99.3) (7 studies, 2835 participants; high-certainty evidence). The difference in the accuracy of Xpert Ultra minus Xpert MTB/RIF was estimated at 6.3% (0.1 to 12.8) for sensitivity and -2.7% (-5.7 to -0.5) for specificity. If the point estimates for Xpert Ultra and Xpert MTB/RIF are applied to a hypothetical cohort of 1000 patients, where 10% of those presenting with symptoms have pulmonary tuberculosis, Xpert Ultra will miss 9 cases, and Xpert MTB/RIF will miss 15 cases. The number of people wrongly diagnosed with pulmonary tuberculosis would be 40 with Xpert Ultra and 14 with Xpert MTB/RIF. In smear-negative, culture-positive participants, pooled sensitivity was 77.5% (67.6 to 85.6) for Xpert Ultra versus 60.6% (48.4 to 71.7) for Xpert MTB/RIF; pooled specificity was 95.8% (92.9 to 97.7) for Xpert Ultra versus 98.8% (97.7 to 99.5) for Xpert MTB/RIF (6 studies). In people living with HIV, pooled sensitivity was 87.6% (75.4 to 94.1) for Xpert Ultra versus 74.9% (58.7 to 86.2) for Xpert MTB/RIF; pooled specificity was 92.8% (82.3 to 97.0) for Xpert Ultra versus 99.7% (98.6 to 100.0) for Xpert MTB/RIF (3 studies). In participants with a history of tuberculosis, pooled sensitivity was 84.2% (72.5 to 91.7) for Xpert Ultra versus 81.8% (68.7 to 90.0) for Xpert MTB/RIF; pooled specificity was 88.2% (70.5 to 96.6) for Xpert Ultra versus 97.4% (91.7 to 99.5) for Xpert MTB/RIF (4 studies). The proportion of Ultra trace-positive results ranged from 3.0% to 30.4%. Data were insufficient to estimate the accuracy of Xpert Ultra repeat testing in individuals with initial trace-positive results. Rifampicin resistance detection Pooled sensitivity and specificity were 94.9% (88.9 to 97.9) and 99.1% (97.7 to 99.8) (5 studies, 921 participants; high-certainty evidence) for Xpert Ultra versus 95.3% (90.0 to 98.1) and 98.8% (97.2 to 99.6) (5 studies, 930 participants; high-certainty evidence) for Xpert MTB/RIF. The difference in the accuracy of Xpert Ultra minus Xpert MTB/RIF was estimated at -0.3% (-6.9 to 5.7) for sensitivity and 0.3% (-1.2 to 2.0) for specificity. If the point estimates for Xpert Ultra and Xpert MTB/RIF are applied to a hypothetical cohort of 1000 patients, where 10% of those presenting with symptoms have rifampicin resistance, Xpert Ultra will miss 5 cases, and Xpert MTB/RIF will miss 5 cases. The number of people wrongly diagnosed with rifampicin resistance would be 8 with Xpert Ultra and 11 with Xpert MTB/RIF. We identified a higher number of rifampicin resistance indeterminate results with Xpert Ultra, pooled proportion 7.6% (2.4 to 21.0) compared to Xpert MTB/RIF pooled proportion 0.8% (0.2 to 2.4). The estimated difference in the pooled proportion of indeterminate rifampicin resistance results for Xpert Ultra versus Xpert MTB/RIF was 6.7% (1.4 to 20.1).

AUTHORS' CONCLUSIONS

Xpert Ultra has higher sensitivity and lower specificity than Xpert MTB/RIF for pulmonary tuberculosis, especially in smear-negative participants and people living with HIV. Xpert Ultra specificity was lower than that of Xpert MTB/RIF in participants with a history of tuberculosis. The sensitivity and specificity trade-off would be expected to vary by setting. For detection of rifampicin resistance, Xpert Ultra and Xpert MTB/RIF had similar sensitivity and specificity. Ultra trace-positive results were common. Xpert Ultra and Xpert MTB/RIF provide accurate results and can allow rapid initiation of treatment for rifampicin-resistant and multidrug-resistant tuberculosis.

Validating Real-Time Polymerase Chain Reaction (PCR) Assays

For many years, the development of assays took place in the laboratories where the test was required. Whilst more and more commercially developed tests have become available, novel assays continue to be developed in academic hospital laboratories. Although commercial kits are more expensive than LDTs, they enable the rapid introduction of assays, with the advantage of being CE marked or FDA approved. However, this approval does not necessarily guarantee the rigorous validation of the assay. Furthermore, commercial assays have to be commercially attractive, which is unlikely for small-scale, specialist tests targeting rarely occurring infectious pathogens and thus there will continue to be a need for laboratory-developed tests.

Reevaluating the true diagnostic accuracy of dipstick tests to diagnose urinary tract infection using Bayesian latent class analysis

OBJECTIVE

Previous studies on diagnostic accuracy of dipstick testing for leukocyte esterase (LE) and nitrite to diagnose urinary tract infection (UTI) had used urine culture, which is an imperfect gold standard. Estimates of diagnostic accuracy obtained using the classical gold standard framework might not reflect the true diagnostic accuracy of dipstick tests.

METHODS

We used the dataset from a prospective, observational study conducted in the emergency department of a teaching hospital in southern India. Patients with a clinical suspicion of UTI underwent dipstick testing for LE and nitrite, urine microscopy, and urine culture. Based on the results of urine microscopy and culture, UTI was classified into definite, probable, and possible. Patients with microscopic pyuria and a positive urine culture were adjudicated as definite UTI. Unequivocal imaging evidence of emphysematous pyelonephritis or perinephric collections was also considered definite UTI. We estimated the diagnostic accuracy of LE and nitrite tests using the classical analysis (assuming definite UTI as gold standard) and two different Bayesian latent class models (LCMs; 3-tests in 1-population and 2-tests in 2-populations models).

RESULTS

We studied 149 patients. Overall, 64 (43%) patients had definite, 76 (51%) had probable, and 2 (1.3%) had possible UTI; 7 (4.6%) had alternate diagnoses. In classical analysis, LE was more sensitive than nitrite (87.5% versus 70.5%), while nitrite was more specific (24% versus 58%). The 3-tests in 1-population Bayesian LCM indicated a substantially better sensitivity and specificity for LE (98.1% and 47.6%) and nitrite (88.2% and 97.7%). True sensitivity and specificity of urine culture as estimated by the model was 48.7% and 73.0%. Estimates of the 2-tests in 2-populations model were in agreement with the 3-tests in 1-population model.

CONCLUSIONS

Bayesian LCMs indicate a clinically important improvement in the true diagnostic accuracy of urine dipstick testing for LE and nitrite. Given this, a negative dipstick LE would rule-out UTI, while a positive dipstick nitrite would rule-in UTI in our study setting. True diagnostic accuracy of urine dipstick testing for UTI in various practice settings needs reevaluation using Bayesian LCMs.

Nucleic acid sample preparation from whole blood in a paper microfluidic device using isotachophoresis

Nucleic acid amplification tests (NAATs) are a crucial diagnostic and monitoring tool for infectious diseases. A key procedural step for NAATs is sample preparation: separating and purifying target nucleic acids from crude biological samples prior to nucleic acid amplification and detection. Traditionally, sample preparation has been performed with liquid- or solid-phase extraction, both of which require multiple trained user steps and significant laboratory equipment. The challenges associated with sample preparation have limited the dissemination of NAAT point-of-care diagnostics in low resource environments, including low- and middle-income countries. We report on a paper-based device for purification of nucleic acids from whole blood using isotachophoresis (ITP) for point-of-care NAATs. We show successful extraction and purification of target nucleic acids from large volumes (33 µL) of whole human blood samples with no moving parts and few user steps. Our device utilizes paper-based buffer reservoirs to fully contain the liquid ITP buffers and does not require complex filling procedures, instead relying on the natural wicking of integrated paper membranes. We perform on-device blood fractionation via filtration to remove leukocytes and erythrocytes from our sample, followed by integrated on-paper proteolytic digestion of endogenous plasma proteins to allow for successful isotachophoretic extraction. Paper-based isotachophoresis purifies and concentrates target nucleic acids that are added directly to recombinase polymerase amplification (RPA) reactions. We show consistent amplification of input copy concentrations of as low as 3 × 10³ copies nucleic acid per mL input blood with extraction and purification taking only 30 min. By employing a paper architecture, we are able to incorporate these processes in a single, robust, low-cost design, enabling the direct processing of large volumes of blood, with the only intermediate user steps being the removal and addition of tape. Our device represents a step towards a simple, fully integrated sample preparation system for nucleic acid amplification tests at the point-of-care.

Identification of suspected paragonimiasis-endemic foci using a questionnaire and detection of Paragonimus ova using the Ziehl-Neelsen technique in Zamboanga Region, the Philippines

Improving paragonimiasis surveillance, which is crucial for disease control, requires adopting new tools and techniques useful in mapping endemic areas. This study aimed to (1) develop a questionnaire to identify suspected paragonimiasis-endemic foci, (2) describe the epidemiology of paragonimiasis, and (3) evaluate Ziehl-Nielsen Staining technique (ZNS) in detecting Paragonimus ova. The questionnaire, which municipal health officers filled out, was based on proposed site inclusion criteria utilized in the integrated tuberculosis (TB)-paragonimiasis surveillance and control project. Newly deployed medical technologists in Zamboanga Region underwent training, which included laboratory diagnosis of paragonimiasis using preserved and fresh specimens and an integrated tuberculosis-paragonimiasis survey in nine selected barangays (villages). Paragonimiasis cases were found in seven out of the nine barangays identified by the questionnaire. Of the 373 patients, three (0.80%) were TB-positive, and 29 (7.77%) were paragonimiasis-positive. The highest paragonimiasis prevalence (27%) was found in Barangay Libato. Ziehl-Neelsen Staining technique (ZNS) correctly detected 8 out of the 29 samples positive (sensitivity - 27.59%; 95% CI: 12.73-47.24%) and all the 334 samples negative (specificity - 100%; 95% CI: 98.90-100%) for Paragonimus ova. The questionnaire may be improved by refining the inclusion criteria. In paragonimiasis-endemic areas, the ZNS and the NaOH concentration technique may be used for detecting Paragonimus ova. Modifying the ZNS, for instance by including a concentration step, may improve its sensitivity. The model for the integrated capacity building of health workers and surveillance and research demonstrated in this project may contribute to improving surveillance and control of paragonimiasis and other neglected tropical diseases.

Bayesian Evaluation of Solana HSV 1+2/VZV Assay Compared to Viral Culture and Commercial PCR Assay for Cutaneous or Mucocutaneous Specimens

Results from the Solana HSV 1+2/VZV assay for the detection of herpes simplex virus 1 (HSV-1), HSV-2, and varicella-zoster virus (VZV) in cutaneous or mucocutaneous specimens were compared with that of viral culture and a commercial PCR assay (RealStar alpha herpesvirus PCR kit). Three hundred two mucocutaneous specimens, for which HSV-1, HSV-2, or VZV viral culture or PCR detection have been requested, were randomly selected and prospectively processed on the Solana assay and viral culture or the RealStar assay. Discordant results between culture and the Solana assay were further analyzed using the RealStar assay. A Bayesian latent class model was developed to estimate the performance of each method. Viral culture detected 123 positive specimens (85 HSV-1, 36 HSV-2, and 2 VZV), while the Solana assay detected 27 additional positive specimens (4 HSV-1, 11 HSV-2, and 12 VZV), in agreement with the RealStar PCR assay. The estimated sensitivity of the Solana assay according to our model was 92.7% to 98.7%, 87.1% to 97.8%, and 94.9% to 98.8% (95% confidence interval [CI]) for HSV-1 HSV-2, and VZV, respectively, while the estimated sensitivity of viral culture was 85.2% to 95.0%, 73.6% to 89.6%, and 30.9% to 45.8% (95% CI), respectively. A nonsignificant tendency toward increased sensitivity was noted for the Solana assay compared with culture for HSV-1 and HSV-2, and the Solana assay was significantly more sensitive than culture for the detection of VZV. The Solana assay performed comparably to the RealStar assay. Processing time was reduced with the Solana assay compared with viral culture.

Diagnostic test evaluation methodology: A systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard - An update

OBJECTIVE

To systematically review methods developed and employed to evaluate the diagnostic accuracy of medical test when there is a missing or no gold standard.

STUDY DESIGN AND SETTINGS

Articles that proposed or applied any methods to evaluate the diagnostic accuracy of medical test(s) in the absence of gold standard were reviewed. The protocol for this review was registered in PROSPERO (CRD42018089349).

RESULTS

Identified methods were classified into four main groups: methods employed when there is a missing gold standard; correction methods (which make adjustment for an imperfect reference standard with known diagnostic accuracy measures); methods employed to evaluate a medical test using multiple imperfect reference standards; and other methods, like agreement studies, and a mixed group of alternative study designs. Fifty-one statistical methods were identified from the review that were developed to evaluate medical test(s) when the true disease status of some participants is unverified with the gold standard. Seven correction methods were identified and four methods were identified to evaluate medical test(s) using multiple imperfect reference standards. Flow-diagrams were developed to guide the selection of appropriate methods.

CONCLUSION

Various methods have been proposed to evaluate medical test(s) in the absence of a gold standard for some or all participants in a diagnostic accuracy study. These methods depend on the availability of the gold standard, its' application to the participants in the study and the availability of alternative reference standard(s). The clinical application of some of these methods, especially methods developed when there is missing gold standard is however limited. This may be due to the complexity of these methods and/or a disconnection between the fields of expertise of those who develop (e.g. mathematicians) and those who employ the methods (e.g. clinical researchers). This review aims to help close this gap with our classification and guidance tools.

Combining population-based administrative health records and electronic medical records for disease surveillance

Background

Administrative health records (AHRs) and electronic medical records (EMRs) are two key sources of population-based data for disease surveillance, but misclassification errors in the data can bias disease estimates. Methods that combine information from error-prone data sources can build on the strengths of AHRs and EMRs. We compared bias and error for four data-combining methods and applied them to estimate hypertension prevalence.

Methods

Our study included rule-based OR and AND methods that identify disease cases from either or both data sources, respectively, rule-based sensitivity-specificity adjusted (RSSA) method that corrects for inaccuracies using a deterministic rule, and probabilistic-based sensitivity-specificity adjusted (PSSA) method that corrects for error using a statistical model. Computer simulation was used to estimate relative bias (RB) and mean square error (MSE) under varying conditions of population disease prevalence, correlation amongst data sources, and amount of misclassification error. AHRs and EMRs for Manitoba, Canada were used to estimate hypertension prevalence using validated case definitions and multiple disease markers.

Results

The OR method had the lowest RB and MSE when population disease prevalence was 10%, and the RSSA method had the lowest RB and MSE when population prevalence increased to 20%. As the correlation between data sources increased, the OR method resulted in the lowest RB and MSE. Estimates of hypertension prevalence for AHRs and EMRs alone were 30.9% (95% CI: 30.6–31.2) and 24.9% (95% CI: 24.6–25.2), respectively. The estimates were 21.4% (95% CI: 21.1–21.7), for the AND method, 34.4% (95% CI: 34.1–34.8) for the OR method, 32.2% (95% CI: 31.8–32.6) for the RSSA method, and ranged from 34.3% (95% CI: 34.1–34.5) to 35.9% (95% CI, 35.7–36.1) for the PSSA method, depending on the statistical model.

Conclusions

The OR and AND methods are influenced by correlation amongst the data sources, while the RSSA method is dependent on the accuracy of prior sensitivity and specificity estimates. The PSSA method performed well when population prevalence was high and average correlations amongst disease markers was low. This study will guide researchers to select a data-combining method that best suits their data characteristics.

Electronic supplementary material

The online version of this article (10.1186/s12911-019-0845-5) contains supplementary material, which is available to authorized users.

Xpert MTB/RIF and Xpert MTB/RIF Ultra for pulmonary tuberculosis and rifampicin resistance in adults

BACKGROUND

Xpert MTB/RIF (Xpert MTB/RIF) and Xpert MTB/RIF Ultra (Xpert Ultra), the newest version, are the only World Health Organization (WHO)-recommended rapid tests that simultaneously detect tuberculosis and rifampicin resistance in persons with signs and symptoms of tuberculosis, at lower health system levels. A previous Cochrane Review found Xpert MTB/RIF sensitive and specific for tuberculosis (Steingart 2014). Since the previous review, new studies have been published. We performed a review update for an upcoming WHO policy review.

OBJECTIVES

To determine diagnostic accuracy of Xpert MTB/RIF and Xpert Ultra for tuberculosis in adults with presumptive pulmonary tuberculosis (PTB) and for rifampicin resistance in adults with presumptive rifampicin-resistant tuberculosis.

SEARCH METHODS

We searched the Cochrane Infectious Diseases Group Specialized Register, MEDLINE, Embase, Science Citation Index, Web of Science, Latin American Caribbean Health Sciences Literature, Scopus, the WHO International Clinical Trials Registry Platform, the International Standard Randomized Controlled Trial Number Registry, and ProQuest, to 11 October 2018, without language restriction.

SELECTION CRITERIA

Randomized trials, cross-sectional, and cohort studies using respiratory specimens that evaluated Xpert MTB/RIF, Xpert Ultra, or both against the reference standard, culture for tuberculosis and culture-based drug susceptibility testing or MTBDRplus for rifampicin resistance.

DATA COLLECTION AND ANALYSIS

Four review authors independently extracted data using a standardized form. When possible, we also extracted data by smear and HIV status. We assessed study quality using QUADAS-2 and performed meta-analyses to estimate pooled sensitivity and specificity separately for tuberculosis and rifampicin resistance. We investigated potential sources of heterogeneity. Most analyses used a bivariate random-effects model. For tuberculosis detection, we first estimated accuracy using all included studies and then only the subset of studies where participants were unselected, i.e. not selected based on prior microscopy testing.

MAIN RESULTS

We identified in total 95 studies (77 new studies since the previous review): 86 studies (42,091 participants) evaluated Xpert MTB/RIF for tuberculosis and 57 studies (8287 participants) for rifampicin resistance. One study compared Xpert MTB/RIF and Xpert Ultra on the same participant specimen.Tuberculosis detectionOf the total 86 studies, 45 took place in high tuberculosis burden and 50 in high TB/HIV burden countries. Most studies had low risk of bias.Xpert MTB/RIF pooled sensitivity and specificity (95% credible Interval (CrI)) were 85% (82% to 88%) and 98% (97% to 98%), (70 studies, 37,237 unselected participants; high-certainty evidence). We found similar accuracy when we included all studies.For a population of 1000 people where 100 have tuberculosis on culture, 103 would be Xpert MTB/RIF-positive and 18 (17%) would not have tuberculosis (false-positives); 897 would be Xpert MTB/RIF-negative and 15 (2%) would have tuberculosis (false-negatives).Xpert Ultra sensitivity (95% confidence interval (CI)) was 88% (85% to 91%) versus Xpert MTB/RIF 83% (79% to 86%); Xpert Ultra specificity was 96% (94% to 97%) versus Xpert MTB/RIF 98% (97% to 99%), (1 study, 1439 participants; moderate-certainty evidence).Xpert MTB/RIF pooled sensitivity was 98% (97% to 98%) in smear-positive and 67% (62% to 72%) in smear-negative, culture-positive participants, (45 studies). Xpert MTB/RIF pooled sensitivity was 88% (83% to 92%) in HIV-negative and 81% (75% to 86%) in HIV-positive participants; specificities were similar 98% (97% to 99%), (14 studies).Rifampicin resistance detectionXpert MTB/RIF pooled sensitivity and specificity (95% Crl) were 96% (94% to 97%) and 98% (98% to 99%), (48 studies, 8020 participants; high-certainty evidence).For a population of 1000 people where 100 have rifampicin-resistant tuberculosis, 114 would be positive for rifampicin-resistant tuberculosis and 18 (16%) would not have rifampicin resistance (false-positives); 886 would be would be negative for rifampicin-resistant tuberculosis and four (0.4%) would have rifampicin resistance (false-negatives).Xpert Ultra sensitivity (95% CI) was 95% (90% to 98%) versus Xpert MTB/RIF 95% (91% to 98%); Xpert Ultra specificity was 98% (97% to 99%) versus Xpert MTB/RIF 98% (96% to 99%), (1 study, 551 participants; moderate-certainty evidence).

AUTHORS' CONCLUSIONS

We found Xpert MTB/RIF to be sensitive and specific for diagnosing PTB and rifampicin resistance, consistent with findings reported previously. Xpert MTB/RIF was more sensitive for tuberculosis in smear-positive than smear-negative participants and HIV-negative than HIV-positive participants. Compared with Xpert MTB/RIF, Xpert Ultra had higher sensitivity and lower specificity for tuberculosis and similar sensitivity and specificity for rifampicin resistance (1 study). Xpert MTB/RIF and Xpert Ultra provide accurate results and can allow rapid initiation of treatment for multidrug-resistant tuberculosis.

The WHO guidelines for chronic hepatitis B fail to detect half of the patients in need of treatment in Ethiopia

BACKGROUND & AIMS

In 2015, the World Health Organization (WHO) issued guidelines for the management of chronic hepatitis B (CHB) in low- and middle-income countries, but little is known about the applicability of the WHO treatment criteria in sub-Saharan Africa. The aim of this study was to evaluate the diagnostic performance of the WHO guidelines in a large CHB cohort in Ethiopia.

METHODS

Treatment-naïve adults who attended a public CHB clinic in Addis Ababa were included in this analysis. All patients underwent a standardized evaluation at recruitment, including blood tests and transient elastography (Fibroscan®). A Fibroscan result >7.9 kPa was used to define significant fibrosis and >9.9 kPa to define cirrhosis. Treatment eligibility was assessed using the most recent guidelines from the European Association for the Study of the Liver (EASL) as the 'gold standard'.

RESULTS

Out of 1,190 patients with CHB, 300 (25.2%) were eligible for treatment based on the EASL 2017 guidelines and 182 (15.3%) based on the WHO 2015 guidelines. The sensitivity and specificity of the WHO criteria were 49.0 and 96.1%, respectively. Most patients (94 of 182; 51.6%) who fulfilled the WHO criteria had decompensated cirrhosis and might have a dismal prognosis even with therapy. Only 41 of 115 patients (35.7%) with compensated cirrhosis, who are likely to benefit the most from therapy, were eligible for treatment based on the WHO criteria.

CONCLUSIONS

The WHO guidelines for CHB failed to detect half of the patients in need of treatment in Ethiopia, implying the need for a revision of the WHO treatment criteria.

LAY SUMMARY

Antiviral therapy prevents disease progression and death in patients with chronic hepatitis B (CHB), but the identification of patients in need of treatment is a challenge in low- and middle-income countries. The World Health Organization (WHO) has suggested treatment eligibility criteria for use in such settings, but in our study the WHO criteria detected less than half of those in need of therapy in a large Ethiopian cohort of 1,190 patients with CHB. Our findings suggest that the WHO criteria might be unsuitable in sub-Saharan Africa.

TRIAL REGISTRATION NUMBER

NCT02344498 (ClinicalTrials.gov identifier). Registered 16 January 2015.

Further evidence of Mycobacterium tuberculosis in the sputum of culture-negative pulmonary tuberculosis suspects using an ultrasensitive molecular assay

BACKGROUND

Rapid diagnosis of pulmonary tuberculosis (TB) is critical to TB control. However, many patients with paucibacillary TB disease remain undiagnosed. Current TB elimination goals require new tools to diagnose early disease. We evaluated performance of the Totally Optimized PCR (TOP) TB assay, a novel ultrasensitive molecular test.

METHODS

We assessed analytical specificity against nontuberculous mycobacteria (NTM), and estimated the diagnostic accuracy of TOP in a pilot study in Brazil (n = 46) and a cross-sectional study in Boston (n = 60). We compared TOP results to culture and a composite reference standard (CRS).

RESULTS

TOP exhibited no cross-reactivity against NTM. We tested 132 respiratory specimens from 106 patients with suspected pulmonary TB. The pilot demonstrated feasibility and 100% (95% CI 85-100) sensitivity in predominantly smear-positive specimens; TOP's specificity against solid media culture was low (58%, 37-77) but improved against a CRS (93%, 68-100). Similarly, when using the CRS in the Boston study, TOP (88%, 1-99) had greater sensitivity than solid or liquid media culture (25%, 3-65) and similar specificity (both 100%, 93-100).

CONCLUSIONS

The TOP assay enables detection of M. tuberculosis in culture-negative paucibacillary disease. While the use of TOP for the diagnosis of paucibacillary disease will require further clinical validation, its high sensitivity indicate a more immediate utility as a rule out TB test.

Different latent class models were used and evaluated for assessing the accuracy of campylobacter diagnostic tests: overcoming imperfect reference standards?

In the absence of perfect reference standard, classical techniques result in biased diagnostic accuracy and prevalence estimates. By statistically defining the true disease status, latent class models (LCM) constitute a promising alternative. However, LCM is a complex method which relies on parametric assumptions, including usually a conditional independence between tests and might suffer from data sparseness. We carefully applied LCMs to assess new campylobacter infection detection tests for which bacteriological culture is an imperfect reference standard. Five diagnostic tests (culture, polymerase chain reaction and three immunoenzymatic tests) of campylobacter infection were collected in 623 patients from Bordeaux and Lyon Hospitals, France. Their diagnostic accuracy were estimated with standard and extended LCMs with a thorough examination of models goodness-of-fit. The model including a residual dependence specific to the immunoenzymatic tests best complied with LCM assumptions. Asymptotic results of goodness-of-fit statistics were substantially impaired by data sparseness and empirical distributions were preferred. Results confirmed moderate sensitivity of the culture and high performances of immunoenzymatic tests. LCMs can be used to estimate diagnostic tests accuracy in the absence of perfect reference standard. However, their implementation and assessment require specific attention due to data sparseness and limitations of existing software.

Evaluating Behavioral Health Surveillance Systems

In 2015, more than 27 million people in the United States reported that they currently used illicit drugs or misused prescription drugs, and more than 66 million reported binge drinking during the previous month. Data from public health surveillance systems on drug and alcohol abuse are crucial for developing and evaluating interventions to prevent and control such behavior. However, public health surveillance for behavioral health in the United States has been hindered by organizational issues and other factors. For example, existing guidelines for surveillance evaluation do not distinguish between data systems that characterize behavioral health problems and those that assess other public health problems (eg, infectious diseases). To address this gap in behavioral health surveillance, we present a revised framework for evaluating behavioral health surveillance systems. This system framework builds on published frameworks and incorporates additional attributes (informatics capabilities and population coverage) that we deemed necessary for evaluating behavioral health-related surveillance. This revised surveillance evaluation framework can support ongoing improvements to behavioral health surveillance systems and ensure their continued usefulness for detecting, preventing, and managing behavioral health problems.

Surveillance of intestinal schistosomiasis during control: a comparison of four diagnostic tests across five Ugandan primary schools in the Lake Albert region

Programmatic surveillance of intestinal schistosomiasis during control can typically use four diagnostic tests, either singularly or in combination, but these have yet to be cross-compared directly. Our study assembled a complete diagnostic dataset, inclusive of infection intensities, from 258 children from five Ugandan primary schools. The schools were purposely selected as typical of the endemic landscape near Lake Albert and reflective of high- and low-transmission settings. Overall prevalence was: 44.1% (95% CI 38.0–50.2) by microscopy of duplicate Kato-Katz smears from two consecutive stools, 56.9% (95% CI 50.8–63.0) by urine-circulating cathodic antigen (CCA) dipstick, 67.4% (95% CI 61.6–73.1) by DNA-TaqMan^® and 75.1% (95% CI 69.8–80.4) by soluble egg antigen enzyme-linked immunosorbent assay (SEA-ELISA). A cross-comparison of diagnostic sensitivities, specificities, positive and negative predictive values was undertaken, inclusive of a latent class analysis (LCA) with a LCA-model estimate of prevalence by each school. The latter ranged from 9.6% to 100.0%, and prevalence by school for each diagnostic test followed a static ascending order or monotonic series of Kato-Katz, urine-CCA dipstick, DNA-TaqMan^® and SEA-ELISA. We confirm that Kato-Katz remains a satisfactory diagnostic standalone in high-transmission settings but in low-transmission settings should be augmented or replaced by urine-CCA dipsticks. DNA-TaqMan^® appears suitable in both endemic settings though is only implementable if resources permit. In low-transmission settings, SEA-ELISA remains the method of choice to evidence an absence infection. We discuss the pros and cons of each method concluding that future surveillance of intestinal schistosomiasis would benefit from a flexible, context-specific approach both in choice and application of each diagnostic method, rather than a single one-size fits all approach.

Moving toward rapid and low-cost point-of-care molecular diagnostics with a repurposed 3D printer and RPA

Traditionally, the majority of nucleic acid amplification-based molecular diagnostic tests are done in centralized settings. In recent years, point-of-care tests have been developed for use in low-resource settings away from central laboratories. While most experts agree that point-of-care molecular tests are greatly needed, their availability as cost-effective and easy-to-operate tests remains an unmet goal. In this article, we discuss our efforts to develop a recombinase polymerase amplification reaction-based test that will meet these criteria. First, we describe our efforts in repurposing a low-cost 3D printer as a platform that can carry out medium-throughput, rapid, and high-performing nucleic acid extraction. Next, we address how these purified templates can be rapidly amplified and analyzed using the 3D printer's heated bed or the deconstructed, low-cost thermal cycler we have developed. In both approaches, real-time isothermal amplification and detection of template DNA or RNA can be accomplished using a low-cost portable detector or smartphone camera. Last, we demonstrate the capability of our technologies using foodborne pathogens and the Zika virus. Our low-cost approach does not employ complicated and high-cost components, making it suitable for resource-limited settings. When integrated and commercialized, it will offer simple sample-to-answer molecular diagnostics.

The theoretical reliability of PCR-based fish viral diagnostic methods is critically affected when they are applied to fish populations with low prevalence and virus loads

AIMS

The reliability of polymerase chain reaction (PCR) techniques is an important issue in viral diagnosis, and it is even crucial when they must be applied for detection of viruses in asymptomatic carriers. The problems will arise when the aim is to study wild fish populations, where the viral loads and prevalence values are extremely low. We have evaluated several PCR procedures employed by two laboratories for monitoring fish captured in several oceanographic campaigns performed in the Gulf of Cádiz.

METHODS AND RESULTS

To evaluate the reliability of different diagnostics test used, we have re-analysed fish samples that had been previously subjected to diagnosis for a surveillance of viruses performed in 2010-2011 in wild fish populations. The following parameters were employed: the clinical sensitivity (Ss), the clinical specificity (Sp), the predictive positive value, the predictive negative value, and the positive and negative likelihood ratio (LR⁺ and LR^- ). For viral nervous necrosis virus, a RT-PCR procedure supplemented by nested PCR showed the highest values (100%) for all the parameters. For viral haemorrhagic septicaemia virus, the highest values were provided by RT-PCR supplemented by dot-blot hybridization. In the case of infectious pancreatic necrosis virus, none of the procedures yielded 100% for any parameter.

CONCLUSIONS

The results obtained for viral prevalence indicate: (i) that the conservation of the samples at -80°C did not affect to the capacity of detection of the virus in the tissues, and (ii) that the reproducibility of the diagnosis can be affected by factors including the staff experience and/or the materials employed. Finally, the use of a combination of procedures in advised to ensure the maximum reliability of the diagnosis when it is applied to asymptomatic fish populations.

SIGNIFICANCE AND IMPACT OF THE STUDY

This paper describes a strategy of combining diagnostic tests for the surveillance and monitoring of wild fish populations to reduce underestimation of the prevalence of viruses this type of populations.

Evaluating the accuracy and economic value of a new test in the absence of a perfect reference test

BACKGROUND

Streptococcus pneumoniae (SP) pneumonia is often treated empirically as diagnosis is challenging because of the lack of a perfect test. Using BinaxNOW-SP, a urinary antigen test, as an add-on to standard cultures may not only increase diagnostic yield but also increase costs.

OBJECTIVE

To estimate the sensitivity and specificity of BinaxNOW-SP and subsequently estimate the cost-effectiveness of adding BinaxNOW-SP to the diagnostic work-up.

DESIGN

We fit a Bayesian latent-class meta-analysis model to obtain estimates of BinaxNOW-SP accuracy that adjust for the imperfect accuracy of culture. Meta-analysis results were combined with information on prevalence of SP pneumonia to estimate the number of patients who are correctly classified under competing diagnostic strategies. Taking into consideration the cost of antibiotics, we determined the incremental cost of adding BinaxNOW-SP to the work-up per case correctly diagnosed.

RESULTS

The BinaxNOW-SP test had a pooled sensitivity of 0.74 (95% credible interval [CrI], 0.67-0.83) and a pooled specificity of 0.96 (95% CrI, 0.92-0.99). An overall increase in diagnostic accuracy of 6.2% due to the addition of BinaxNOW-SP corresponded to an incremental cost per case correctly classified of $582 Canadian dollars.

CONCLUSIONS

The methods we have described allow us to evaluate the accuracy and economic value of a new test in the absence of a perfect reference test using an evidence-based approach.

Expert panels as a reference standard in orthodontic research: An assessment of published methods and reporting

INTRODUCTION

The aim of this study was to investigate the expert panel methodology applied in orthodontics and its reporting quality. Additionally, the relationship between the reporting quality and a range of variables was explored.

METHODS

PubMed was searched for orthodontic studies in which the final diagnosis or assessment was made by 2 or more experts published up to March 16, 2015. Reporting quality assessment was conducted using an established modified checklist. The relationship between potential predictors and the total score was assessed using univariable linear regression.

RESULTS

We identified 237 studies with a mean score of 9.97 (SD, 1.12) out of a maximum of 15. Critical information about panel methodology was missing in all studies. The panel composition differed substantially across studies, ranging from 2 to 646 panel members, with large variations in the expertise represented. Only 17 studies (7.2%) reported sample size calculations to justify the panel size. Panel members were partly blinded in 65 (27.4%) studies. Most studies failed to report which statistic was used to compute intrarater (65.8%) and interrater (66.2%) agreements. Journal type (nonorthodontic: β, 0.23; 95% CI, -0.07 to 0.54 compared with orthodontic), publication year (β, 0; 95% CI, -0.02 to 0.02 for each additional year), number of authors (1-3: β, 0.30; 95% CI, -0.13 to 0.74 compared with at least 6; 4-5: β, 0.18; 95% CI, -0.29 to 0.33 compared with at least 6), and number of centers involved (single: β, 0.20; 95% CI, -0.14 to 0.54 compared with multicenter) were not significant predictors of improved reporting. Studies published in Asia and Australia had significantly lower scores compared with those published in Europe (β, -0.54; 95% CI, -0.92 to -0.17).

CONCLUSIONS

Formal guidelines on methodology and reporting of studies involving expert panels are required.

Proportion of Tubal Factor Infertility due to Chlamydia: Finite Mixture Modeling of Serum Antibody Titers

In this study, we examined whether the proportion of tubal factor infertility (TFI) that is attributable to Chlamydia trachomatis, the population excess fraction (PEF), can be estimated from serological data using finite mixture modeling. Whole-cell inclusion immunofluorescence serum antibody titers were recorded among infertile women seen at St. Michael's Hospital in Bristol, United Kingdom, during the period 1985-1995. Women were classified as TFI cases or controls based on laparoscopic examination. Finite mixture models were used to identify the number of component titer distributions and the proportion of serum samples in each, from which estimates of PEF were derived. Four titer distributions were identified. The component at the highest titer was found only in samples from women with TFI, but there was also an excess of the second-highest titer component in TFI cases. Minimum and maximum estimates of the PEF were 28.0% (95% credible interval: 6.9, 50.0) and 46.8% (95% credible interval: 23.2, 64.1). Equivalent estimates based on the standard PEF formula from case-control studies were 0% and over 65%. Finite mixture modeling can be applied to serological data to obtain estimates of the proportion of reproductive damage attributable to C. trachomatis Further studies using modern assays in contemporary, representative populations should be undertaken.

Domestic cats seropositive for Felis catus gammaherpesvirus 1 are often qPCR negative

Felis catus gammaherpesvirus 1 (FcaGHV1) is a newly described virus that infects domestic cats. To identify FcaGHV1 antigens, we developed an immunofluorescent antibody assay by expressing FcaGHV1 open reading frames (ORFs) in feline cells and incubating fixed cells with sera from FcaGHV1-positive cats. Of the seven ORFs tested, ORF52 and ORF38 had the strongest, most consistent antibody responses. We used recombinant ORF52 and ORF38 proteins to develop two FcaGHV1 ELISAs. These assays were used to detect reactivity in cats previously tested by qPCR for FcaGHV1 in blood cell DNA. Results indicated 32%FcaGHV1seroprevalence, compared to 15%qPCR-evaluated prevalence (n=133);all but one qPCR positive animal was seropositive. ELISA results confirmed infection risk factors previously identified by qPCR: geographic location, male sex, and adult age. These data suggest that FcaGHV1is a common infection of domestic cats that has a seropositive but often qPCR negative state characteristic of herpesviral latency.

Detection and Quantification of Mycobacterium tuberculosis in the Sputum of Culture-Negative HIV-infected Pulmonary Tuberculosis Suspects: A Proof-of-Concept Study

RATIONALE

Rapid diagnosis of pulmonary tuberculosis (TB) is critical for timely initiation of treatment and interruption of transmission. Yet, despite recent advances, many patients remain undiagnosed. Culture, usually considered the most sensitive diagnostic method, is sub-optimal for paucibacillary disease.

METHODS

We evaluated the Totally Optimized PCR (TOP) TB assay, a new molecular test that we hypothesize is more sensitive than culture. After pre-clinical studies, we estimated TOP's per-patient sensitivity and specificity in a convenience sample of 261 HIV-infected pulmonary TB suspects enrolled into a TB diagnostic study in Mbarara, Uganda against MGIT culture, Xpert MTB/RIF and a composite reference standard. We validated results with a confirmatory PCR used for sequencing M. tuberculosis.

MEASUREMENTS AND RESULTS

Using culture as reference, TOP had 100% sensitivity but 35% specificity. Against a composite reference standard, the sensitivity of culture (27%) and Xpert MTB/RIF (27%) was lower than TOP (99%), with similar specificity (100%, 98% and 87%, respectively). In unadjusted analyses, culture-negative/TOP-positive patients were more likely to be older (P<0·001), female (P<0·001), have salivary sputum (P = 0·05), sputum smear-negative (P<0.001) and less advanced disease on chest radiograph (P = 0.05). M. tuberculosis genotypes identified in sputum by DNA sequencing exhibit differential growth in culture.

CONCLUSIONS

These findings suggest that the TOP TB assay is accurately detecting M. tuberculosis DNA in the sputum of culture-negative tuberculosis suspects. Our results require prospective validation with clinical outcomes. If the operating characteristics of the TOP assay are confirmed in future studies, it will be justified as a "TB rule out" test.

Latent class regression models for simultaneously estimating test accuracy, true prevalence and risk factors for Brucella abortus

In 2003/2004 a field trial was conducted in Northern Ireland to assess the diagnostic accuracy of six serological tests for bovine brucellosis caused by Brucella abortus. Whereas between-test comparisons have been used to calculate test performances so far, the present study used a latent class approach to estimate diagnostic test accuracy parameters in the absence of a gold standard for these six tests simultaneously and to estimate the true prevalence, while accounting for clustering in the study population and risk factors for true prevalence. Results obtained in this study with regard to prevalence, sensitivity and specificity were largely in accordance with previous findings. Screening tests (SAT and EDTA) appeared to be the most sensitive; however, at low prevalences the EDTA and CFT showed the highest positive predictive values of all investigated tests. The specificities and negative predictive values of all diagnostic tests were found to be very high. Differences of prevalence between three groups of the study population with different risk of exposure could be attributed to the mode of sampling indicating that a more risk-based sampling will result in a higher prevalence than a cross-sectional sampling mode. Age, dairy status and history of abortion were shown to influence the prediction of the latent true infection status.

Development of Real-Time PCR Methods for the Detection of Bacterial Meningitis Pathogens without DNA Extraction

Neisseria meningitidis (Nm), Haemophilus influenzae (Hi), and Streptococcus pneumoniae (Sp) are the lead causes of bacterial meningitis. Detection of these pathogens from clinical specimens using traditional real-time PCR (rt-PCR) requires DNA extraction to remove the PCR inhibitors prior to testing, which is time consuming and labor intensive. In this study, five species-specific (Nm-sodC and -ctrA, Hi-hpd#1 and -hpd#3 and Sp-lytA) and six serogroup-specific rt-PCR tests (A, B, C, W, X, Y) targeting Nm capsular genes were evaluated in the two direct rt-PCR methods using PerfeCTa and 5x Omni that do not require DNA extraction. The sensitivity and specify of the two direct rt-PCR methods were compared to TaqMan traditional rt-PCR, the current standard rt-PCR method for the detection of meningitis pathogens. The LLD for all 11 rt-PCR tests ranged from 6,227 to 272,229 CFU/ml for TaqMan, 1,824–135,982 for 5x Omni, and 168–6,836 CFU/ml for PerfeCTa. The diagnostic sensitivity using TaqMan ranged from 89.2%-99.6%, except for NmB-csb, which was 69.7%. For 5x Omni, the sensitivity varied from 67.1% to 99.8%, with three tests below 90%. The sensitivity of these tests using PerfeCTa varied from 89.4% to 99.8%. The specificity ranges of the 11 tests were 98.0–99.9%, 97.5–99.9%, and 92.9–99.9% for TaqMan, 5x Omni, and PerfeCTa, respectively. PerfeCTa direct rt-PCR demonstrated similar or better sensitivity compared to 5x Omni direct rt-PCR or TaqMan traditional rt-PCR. Since the direct rt-PCR method does not require DNA extraction, it reduces the time and cost for processing CSF specimens, increases testing throughput, decreases the risk of cross-contamination, and conserves precious CSF. The direct rt-PCR method will be beneficial to laboratories with high testing volume.

Design of a New Type of Compact Chemical Heater for Isothermal Nucleic Acid Amplification

Previous chemical heater designs for isothermal nucleic acid amplification have been based on solid-liquid phase transition, but using this approach, developers have identified design challenges en route to developing a low-cost, disposable device. Here, we demonstrate the feasibility of a new heater configuration suitable for isothermal amplification in which one reactant of an exothermic reaction is a liquid-gas phase-change material, thereby eliminating the need for a separate phase-change compartment. This design offers potentially enhanced performance and energy density compared to other chemical and electric heaters.

Statistical evaluation of a commercial Neospora caninum competitive ELISA in the absence of a gold standard: application to wild elk (Cervus elaphus) in Alberta

Neospora caninum is an important abortive agent of domestic ruminants, but few diagnostic tools are available to reliably assess the exposure of wild cervid species such as elk (Cervus elaphus) to this pathogen, which limits our ability to understand their role in the life cycle of this parasite. In the absence of a gold standard test or panels of samples from individuals of known infection status, classical laboratory-based validation methods are not applicable. However, there are a number of statistical methods that can help in selecting an appropriate cut-off value and estimating the resulting diagnostic test performances. In this paper, the performance of a commercial competitive enzyme-linked immunosorbent assay (cELISA) on elk serum samples was evaluated with two statistical approaches: a mixture distribution model fitted to the cELISA results, and a Bayesian latent class analysis combining results from the cELISA and an indirect immuno-fluorescence antibody test. Both methods indicated that the commercial kit could be used on elk serum with the specifications recommended by the manufacturer. In particular, the optimal combination of sensitivity and specificity were obtained for a percentage of inhibition cutoff of 30%. The 95% probability interval of the proportion of elk exposed to N. caninum, adjusting for the sensitivity and specificity of this test in elk, was estimated between 1.3 and 7.4%. There was no association between the serological status of female elk and their pregnancy status. These results point out to the involvement of elk in a sylvatic cycle of N. caninum in this area.

A Bayesian framework for estimating the incremental value of a diagnostic test in the absence of a gold standard

BACKGROUND

The absence of a gold standard, i.e., a diagnostic reference standard having perfect sensitivity and specificity, is a common problem in clinical practice and in diagnostic research studies. There is a need for methods to estimate the incremental value of a new, imperfect test in this context.

METHODS

We use a Bayesian approach to estimate the probability of the unknown disease status via a latent class model and extend two commonly-used measures of incremental value based on predictive values [difference in the area under the ROC curve (AUC) and integrated discrimination improvement (IDI)] to the context where no gold standard exists. The methods are illustrated using simulated data and applied to the problem of estimating the incremental value of a novel interferon-gamma release assay (IGRA) over the tuberculin skin test (TST) for latent tuberculosis (TB) screening. We also show how to estimate the incremental value of IGRAs when decisions are based on observed test results rather than predictive values.

RESULTS

We showed that the incremental value is greatest when both sensitivity and specificity of the new test are better and that conditional dependence between the tests reduces the incremental value. The incremental value of the IGRA depends on the sensitivity and specificity of the TST, as well as the prevalence of latent TB, and may thus vary in different populations.

CONCLUSIONS

Even in the absence of a gold standard, incremental value statistics may be estimated and can aid decisions about the practical value of a new diagnostic test.

Classification in the presence of label noise: a survey

Label noise is an important issue in classification, with many potential negative consequences. For example, the accuracy of predictions may decrease, whereas the complexity of inferred models and the number of necessary training samples may increase. Many works in the literature have been devoted to the study of label noise and the development of techniques to deal with label noise. However, the field lacks a comprehensive survey on the different types of label noise, their consequences and the algorithms that consider label noise. This paper proposes to fill this gap. First, the definitions and sources of label noise are considered and a taxonomy of the types of label noise is proposed. Second, the potential consequences of label noise are discussed. Third, label noise-robust, label noise cleansing, and label noise-tolerant algorithms are reviewed. For each category of approaches, a short discussion is proposed to help the practitioner to choose the most suitable technique in its own particular field of application. Eventually, the design of experiments is also discussed, what may interest the researchers who would like to test their own algorithms. In this paper, label noise consists of mislabeled instances: no additional information is assumed to be available like e.g., confidences on labels.

Xpert® MTB/RIF assay for pulmonary tuberculosis and rifampicin resistance in adults

BACKGROUND

Accurate, rapid detection of tuberculosis (TB) and TB drug resistance is critical for improving patient care and decreasing TB transmission. Xpert® MTB/RIF assay is an automated test that can detect both TB and rifampicin resistance, generally within two hours after starting the test, with minimal hands-on technical time. The World Health Organization (WHO) issued initial recommendations on Xpert® MTB/RIF in early 2011. A Cochrane Review on the diagnostic accuracy of Xpert® MTB/RIF for pulmonary TB and rifampicin resistance was published January 2013. We performed this updated Cochrane Review as part of a WHO process to develop updated guidelines on the use of the test.

OBJECTIVES

To assess the diagnostic accuracy of Xpert® MTB/RIF for pulmonary TB (TB detection), where Xpert® MTB/RIF was used as both an initial test replacing microscopy and an add-on test following a negative smear microscopy result.To assess the diagnostic accuracy of Xpert® MTB/RIF for rifampicin resistance detection, where Xpert® MTB/RIF was used as the initial test replacing culture-based drug susceptibility testing (DST).The populations of interest were adults presumed to have pulmonary, rifampicin-resistant or multidrug-resistant TB (MDR-TB), with or without HIV infection. The settings of interest were intermediate- and peripheral-level laboratories. The latter may be associated with primary health care facilities.

SEARCH METHODS

We searched for publications in any language up to 7 February 2013 in the following databases: Cochrane Infectious Diseases Group Specialized Register; MEDLINE; EMBASE; ISI Web of Knowledge; MEDION; LILACS; BIOSIS; and SCOPUS. We also searched the metaRegister of Controlled Trials (mRCT) and the search portal of the WHO International Clinical Trials Registry Platform to identify ongoing trials.

SELECTION CRITERIA

We included randomized controlled trials, cross-sectional studies, and cohort studies using respiratory specimens that allowed for extraction of data evaluating Xpert® MTB/RIF against the reference standard. We excluded gastric fluid specimens. The reference standard for TB was culture and for rifampicin resistance was phenotypic culture-based DST.

DATA COLLECTION AND ANALYSIS

For each study, two review authors independently extracted data using a standardized form. When possible, we extracted data for subgroups by smear and HIV status. We assessed the quality of studies using QUADAS-2 and carried out meta-analyses to estimate pooled sensitivity and specificity of Xpert® MTB/RIF separately for TB detection and rifampicin resistance detection. For TB detection, we performed the majority of analyses using a bivariate random-effects model and compared the sensitivity of Xpert® MTB/RIF and smear microscopy against culture as reference standard. For rifampicin resistance detection, we undertook univariate meta-analyses for sensitivity and specificity separately to include studies in which no rifampicin resistance was detected.

MAIN RESULTS

We included 27 unique studies (integrating nine new studies) involving 9557 participants. Sixteen studies (59%) were performed in low- or middle-income countries. For all QUADAS-2 domains, most studies were at low risk of bias and low concern regarding applicability.As an initial test replacing smear microscopy, Xpert® MTB/RIF pooled sensitivity was 89% [95% Credible Interval (CrI) 85% to 92%] and pooled specificity 99% (95% CrI 98% to 99%), (22 studies, 8998 participants: 2953 confirmed TB, 6045 non-TB).As an add-on test following a negative smear microscopy result, Xpert®MTB/RIF pooled sensitivity was 67% (95% CrI 60% to 74%) and pooled specificity 99% (95% CrI 98% to 99%; 21 studies, 6950 participants).For smear-positive, culture-positive TB, Xpert® MTB/RIF pooled sensitivity was 98% (95% CrI 97% to 99%; 21 studies, 1936 participants).For people with HIV infection, Xpert® MTB/RIF pooled sensitivity was 79% (95% CrI 70% to 86%; 7 studies, 1789 participants), and for people without HIV infection, it was 86% (95% CrI 76% to 92%; 7 studies, 1470 participants). Comparison with smear microscopy In comparison with smear microscopy, Xpert® MTB/RIF increased TB detection among culture-confirmed cases by 23% (95% CrI 15% to 32%; 21 studies, 8880 participants).For TB detection, if pooled sensitivity estimates for Xpert® MTB/RIF and smear microscopy are applied to a hypothetical cohort of 1000 patients where 10% of those with symptoms have TB, Xpert® MTB/RIF will diagnose 88 cases and miss 12 cases, whereas sputum microscopy will diagnose 65 cases and miss 35 cases. Rifampicin resistance For rifampicin resistance detection, Xpert® MTB/RIF pooled sensitivity was 95% (95% CrI 90% to 97%; 17 studies, 555 rifampicin resistance positives) and pooled specificity was 98% (95% CrI 97% to 99%; 24 studies, 2411 rifampicin resistance negatives). Among 180 specimens with nontuberculous mycobacteria (NTM), Xpert® MTB/RIF was positive in only one specimen that grew NTM (14 studies, 2626 participants).For rifampicin resistance detection, if the pooled accuracy estimates for Xpert® MTB/RIF are applied to a hypothetical cohort of 1000 individuals where 15% of those with symptoms are rifampicin resistant, Xpert® MTB/RIF would correctly identify 143 individuals as rifampicin resistant and miss eight cases, and correctly identify 833 individuals as rifampicin susceptible and misclassify 17 individuals as resistant. Where 5% of those with symptoms are rifampicin resistant, Xpert® MTB/RIF would correctly identify 48 individuals as rifampicin resistant and miss three cases and correctly identify 931 individuals as rifampicin susceptible and misclassify 19 individuals as resistant.

AUTHORS' CONCLUSIONS

In adults thought to have TB, with or without HIV infection, Xpert® MTB/RIF is sensitive and specific. Compared with smear microscopy, Xpert® MTB/RIF substantially increases TB detection among culture-confirmed cases. Xpert® MTB/RIF has higher sensitivity for TB detection in smear-positive than smear-negative patients. Nonetheless, this test may be valuable as an add-on test following smear microscopy in patients previously found to be smear-negative. For rifampicin resistance detection, Xpert® MTB/RIF provides accurate results and can allow rapid initiation of MDR-TB treatment, pending results from conventional culture and DST. The tests are expensive, so current research evaluating the use of Xpert® MTB/RIF in TB programmes in high TB burden settings will help evaluate how this investment may help start treatment promptly and improve outcomes.

Use of expert panels to define the reference standard in diagnostic research: a systematic review of published methods and reporting

BACKGROUND

In diagnostic studies, a single and error-free test that can be used as the reference (gold) standard often does not exist. One solution is the use of panel diagnosis, i.e., a group of experts who assess the results from multiple tests to reach a final diagnosis in each patient. Although panel diagnosis, also known as consensus or expert diagnosis, is frequently used as the reference standard, guidance on preferred methodology is lacking. The aim of this study is to provide an overview of methods used in panel diagnoses and to provide initial guidance on the use and reporting of panel diagnosis as reference standard.

METHODS AND FINDINGS

PubMed was systematically searched for diagnostic studies applying a panel diagnosis as reference standard published up to May 31, 2012. We included diagnostic studies in which the final diagnosis was made by two or more persons based on results from multiple tests. General study characteristics and details of panel methodology were extracted. Eighty-one studies were included, of which most reported on psychiatry (37%) and cardiovascular (21%) diseases. Data extraction was hampered by incomplete reporting; one or more pieces of critical information about panel reference standard methodology was missing in 83% of studies. In most studies (75%), the panel consisted of three or fewer members. Panel members were blinded to the results of the index test results in 31% of studies. Reproducibility of the decision process was assessed in 17 (21%) studies. Reported details on panel constitution, information for diagnosis and methods of decision making varied considerably between studies.

CONCLUSIONS

Methods of panel diagnosis varied substantially across studies and many aspects of the procedure were either unclear or not reported. On the basis of our review, we identified areas for improvement and developed a checklist and flow chart for initial guidance for researchers conducting and reporting of studies involving panel diagnosis. Please see later in the article for the Editors' Summary.

Advances in sampling and screening for chlamydia

Chlamydia is the most commonly diagnosed bacterial sexually transmitted infection in the developed world, with diagnosis rates continuing to increase each year. As chlamydia is largely asymptomatic, screening and treatment is the main way to detect cases and reduce transmission. Recent advances in self-collected specimens and laboratory tests has made chlamydia screening easier to implement as well as possible in nonclinical settings. This review will discuss new approaches to specimen collection and how these have expanded opportunities for reaching target populations for chlamydia screening. Furthermore, it will discuss how advanced molecular microbiological methods can be used with self-collected specimens to further our knowledge of the epidemiology of chlamydia and the dynamics of transmission.

Systematic review and meta-analysis of a urine-based pneumococcal antigen test for diagnosis of community-acquired pneumonia caused by Streptococcus pneumoniae

Standard culture methods for diagnosis of Streptococcus pneumoniae pneumonia take at least 24 h. The BinaxNOW urine-based test for S. pneumoniae (BinaxNOW-SP) takes only 15 min to conduct, potentially enabling earlier diagnosis and targeted treatment. This study was conducted to assess whether the use of BinaxNOW-SP at the time of hospital admission would provide adequate sensitivity and specificity for diagnosis of community-acquired pneumonia (CAP) in adult patients. We searched PubMed, EMBASE/OVID, Cochrane Collaboration, Centre for Reviews and Dissemination, INAHTA, and CADTH for diagnostic or etiologic studies of hospitalized predominately adult patients with clinically defined CAP that reported the diagnostic performance of BinaxNOW-SP versus cultures. Two authors independently extracted study details and diagnostic two-by-two tables. We found that 27 studies met our inclusion criteria, and three different reference standards were used between them. A bivariate meta-analysis of 12 studies using a composite of culture tests as the reference standard estimated the sensitivity of BinaxNOW-SP as 68.5% (95% credibility interval [CrI], 62.6% to 74.2%) and specificity as 84.2% (95% CrI, 77.5% to 89.3%). A meta-analysis of all 27 studies, adjusting for the imperfect and variable nature of the reference standard, gave a higher sensitivity of 74.0% (CrI, 66.6% to 82·3%) and specificity of 97.2% (CrI, 92.7% to 99.8%). The analysis showed substantial heterogeneity across studies, which did not decrease with adjustment for covariates. We concluded that the higher pooled sensitivity (compared to culture) and high specificity of BinaxNOW-SP suggest it would be a useful addition to the diagnostic workup for community-acquired pneumonia. More research is needed regarding the impact of BinaxNOW-SP on clinical practice.

Quantitative PCR for detection of Shigella improves ascertainment of Shigella burden in children with moderate-to-severe diarrhea in low-income countries

Estimates of the prevalence of Shigella spp. are limited by the suboptimal sensitivity of current diagnostic and surveillance methods. We used a quantitative PCR (qPCR) assay to detect Shigella in the stool samples of 3,533 children aged <59 months from the Gambia, Mali, Kenya, and Bangladesh, with or without moderate-to-severe diarrhea (MSD). We compared the results from conventional culture to those from qPCR for the Shigella ipaH gene. Using MSD as the reference standard, we determined the optimal cutpoint to be 2.9 × 10(4) ipaH copies per 100 ng of stool DNA for set 1 (n = 877). One hundred fifty-eight (18%) specimens yielded >2.9 × 10(4) ipaH copies. Ninety (10%) specimens were positive by traditional culture for Shigella. Individuals with ≥ 2.9 × 10(4) ipaH copies have 5.6-times-higher odds of having diarrhea than those with <2.9 × 10(4) ipaH copies (95% confidence interval, 3.7 to 8.5; P < 0.0001). Nearly identical results were found using an independent set of samples. qPCR detected 155 additional MSD cases with high copy numbers of ipaH, a 90% increase from the 172 cases detected by culture in both samples. Among a subset (n = 2,874) comprising MSD cases and their age-, gender-, and location-matched controls, the fraction of MSD cases that were attributable to Shigella infection increased from 9.6% (n = 129) for culture to 17.6% (n = 262) for qPCR when employing our cutpoint. We suggest that qPCR with a cutpoint of approximately 1.4 × 10(4) ipaH copies be the new reference standard for the detection and diagnosis of shigellosis in children in low-income countries. The acceptance of this new standard would substantially increase the fraction of MSD cases that are attributable to Shigella.

Xpert® MTB/RIF assay for pulmonary tuberculosis and rifampicin resistance in adults

BACKGROUND

Accurate and rapid detection of tuberculosis (TB) and drug resistance are critical for improving patient care and decreasing the spread of TB. Xpert® MTB/RIF assay (Xpert) is a rapid, automated test that can detect both TB and rifampicin resistance, within two hours after starting the test, with minimal hands-on technical time, but is more expensive than conventional sputum microscopy.

OBJECTIVES

To assess the diagnostic accuracy of Xpert for pulmonary TB (TB detection), both where Xpert was used as an initial test replacing microscopy, and where Xpert was used as an add-on test following a negative smear microscopy result.To assess the diagnostic accuracy of Xpert for rifampicin resistance detection where Xpert was used as the initial test, replacing conventional culture-based drug susceptibility testing.The population of interest was adults suspected of having pulmonary TB or multidrug-resistant TB (MDR-TB), with or without HIV infection.

SEARCH METHODS

We performed a comprehensive search of the following databases: Cochrane Infectious Diseases Group Specialized Register; MEDLINE; EMBASE; ISI Web of Knowledge; MEDION; LILACS; BIOSIS; and SCOPUS. We also searched the metaRegister of Controlled Trials (mRCT) and the search portal of the WHO International Clinical Trials Registry Platform to identify ongoing trials. We performed searches on 25 September 2011 and we repeated them on 15 December 2011, without language restriction.

SELECTION CRITERIA

We included randomized controlled trials, cross-sectional, and cohort studies that used respiratory specimens to compare Xpert with culture for detecting TB and Xpert with conventional phenotypic drug susceptibility testing for detecting rifampicin resistance.

DATA COLLECTION AND ANALYSIS

For each study, two review authors independently extracted a set of data using a standardized data extraction form. When possible, we extracted data for subgroups by smear and HIV status. We assessed the quality of studies using the QUADAS-2 tool. We carried out meta-analyses to estimate the pooled sensitivity and specificity of Xpert separately for TB detection and rifampicin resistance detection using a bivariate random-effects model. We estimated the median pooled sensitivity and specificity and their 95% credible intervals (CrI).

MAIN RESULTS

We identified 18 unique studies as eligible for this review, including two multicentre international studies, one with five and the other with six distinct study centres. The majority of studies (55.6%) were performed in low-income and middle-income countries. In 17 of the 18 studies, Xpert was performed by trained technicians in reference laboratories.When used as an initial test replacing smear microscopy (15 studies, 7517 participants), Xpert achieved a pooled sensitivity of 88% (95% CrI 83% to 92%) and pooled specificity of 98% (95% CrI 97% to 99%). As an add-on test following a negative smear microscopy result (14 studies, 5719 participants), Xpert yielded a pooled sensitivity of 67% (95% CrI 58% to 74%) and pooled specificity of 98% (95% CrI 97% to 99%). In clinical subgroups, we found the following accuracy estimates: the pooled sensitivity was 98% (95% CrI 97% to 99%) for smear-positive, culture-positive TB and 68% (95% CrI 59% to 75%) for smear-negative, culture-positive TB (15 studies); the pooled sensitivity was 80% (95% CrI 67% to 88%) in people living with HIV and 89% (95% CrI 81% to 94%) in people without HIV infection (four studies). For rifampicin resistance detection (11 studies, 2340 participants), Xpert achieved a pooled sensitivity of 94% (95% CrI 87% to 97%) and pooled specificity of 98% (95% CrI 97% to 99%). In a separate analysis, Xpert could distinguish between TB and nontuberculous mycobacteria (NTM) in clinical samples with high accuracy: among 139 specimens with NTM, Xpert was positive in only one specimen that grew NTM.In a hypothetical cohort of 1000 individuals suspected of having rifampicin resistance (a proxy for MDR-TB), where the prevalence of rifampicin resistance is 30%, we estimated that on average Xpert would wrongly identify 14 patients as being rifampicin resistant. In comparison, where the prevalence of rifampicin resistance is only 2%, we estimated that the number of individuals wrongly identified as rifampicin resistant would increase to 20, an increase of 43%.

AUTHORS' CONCLUSIONS

This review shows that Xpert used as an initial diagnostic test for TB detection and rifampicin resistance detection in patients suspected of having TB, MDR-TB, or HIV-associated TB is sensitive and specific. Xpert may also be valuable as an add-on test following microscopy for patients who have previously been found to be smear-negative. An Xpert result that is positive for rifampicin resistance should be carefully interpreted and take into consideration the risk of MDR-TB in a given patient and the expected prevalence of MDR-TB in a given setting.Studies in this review mainly assessed sensitivity and specificity of the test when used in reference laboratories in research investigations. Most studies were performed in high TB burden countries. Ongoing use of Xpert in high TB burden countries will contribute to the evidence base on the diagnostic accuracy and clinical impact of Xpert in routine programmatic and peripheral health care settings, including settings where the test is performed at the point of care.

Accuracy of real-time PCR, Gram stain and culture for Streptococcus pneumoniae, Neisseria meningitidis and Haemophilus influenzae meningitis diagnosis

BACKGROUND

Although cerebrospinal fluid (CSF) culture is the diagnostic reference standard for bacterial meningitis, its sensitivity is limited, particularly when antibiotics were previously administered. CSF Gram staining and real-time PCR are theoretically less affected by antibiotics; however, it is difficult to evaluate these tests with an imperfect reference standard.

METHODS AND FINDINGS

CSF from patients with suspected meningitis from Salvador, Brazil were tested with culture, Gram stain, and real-time PCR using S. pneumoniae, N. meningitidis, and H. influenzae specific primers and probes. An antibiotic detection disk bioassay was used to test for the presence of antibiotic activity in CSF. The diagnostic accuracy of tests were evaluated using multiple methods, including direct evaluation of Gram stain and real-time PCR against CSF culture, evaluation of real-time PCR against a composite reference standard, and latent class analysis modeling to evaluate all three tests simultaneously.

RESULTS

Among 451 CSF specimens, 80 (17.7%) had culture isolation of one of the three pathogens (40 S. pneumoniae, 36 N. meningitidis, and 4 H. influenzae), and 113 (25.1%) were real-time PCR positive (51 S. pneumoniae, 57 N. meningitidis, and 5 H. influenzae). Compared to culture, real-time PCR sensitivity and specificity were 95.0% and 90.0%, respectively. In a latent class analysis model, the sensitivity and specificity estimates were: culture, 81.3% and 99.7%; Gram stain, 98.2% and 98.7%; and real-time PCR, 95.7% and 94.3%, respectively. Gram stain and real-time PCR sensitivity did not change significantly when there was antibiotic activity in the CSF.

CONCLUSION

Real-time PCR and Gram stain were highly accurate in diagnosing meningitis caused by S. pneumoniae, N. meningitidis, and H. influenzae, though there were few cases of H. influenzae. Furthermore, real-time PCR and Gram staining were less affected by antibiotic presence and might be useful when antibiotics were previously administered. Gram staining, which is inexpensive and commonly available, should be encouraged in all clinical settings.

Rapid clinical bacteriology and its future impact

Clinical microbiology has always been a slowly evolving and conservative science. The sub-field of bacteriology has been and still is dominated for over a century by culture-based technologies. The integration of serological and molecular methodologies during the seventies and eighties of the previous century took place relatively slowly and in a cumbersome fashion. When nucleic acid amplification technologies became available in the early nineties, the predicted "revolution" was again slow but in the end a real paradigm shift did take place. Several of the culture-based technologies were successfully replaced by tests aimed at nucleic acid detection. More recently a second revolution occurred. Mass spectrometry was introduced and broadly accepted as a new diagnostic gold standard for microbial species identification. Apparently, the diagnostic landscape is changing, albeit slowly, and the combination of newly identified infectious etiologies and the availability of innovative technologies has now opened new avenues for modernizing clinical microbiology. However, the improvement of microbial antibiotic susceptibility testing is still lagging behind. In this review we aim to sketch the most recent developments in laboratory-based clinical bacteriology and to provide an overview of emerging novel diagnostic approaches.

Comparison of the BD Viper System with XTR Technology to the Gen-Probe APTIMA COMBO 2 Assay using the TIGRIS DTS system for the detection of Chlamydia trachomatis and Neisseria gonorrhoeae in urine specimens

BACKGROUND

Performances of the BD ProbeTec Chlamydia trachomatis (CT)/Neisseria Gonorrhoeae (GC) Q(x) Amplified DNA Assay reagents on a BD Viper System with XTR Technology and APTIMA COMBO 2 Assay reagents on a TIGRIS DTS platform, for detection of both CT and GC were compared.

METHODS

A total of 1018 first-void urine specimens were tested for the presence of CT and GC DNA using the 2 assays.

RESULTS

CT was detected in 143 specimens (14%). Eight specimens exhibited discordant results, and they were divided equally between the 2 assays. Based on the original results, the overall agreement for CT was 99.2%, with 97.1% and 99.5% in agreement with positive and negative specimens, respectively. Cohen's Kappa was 0.967. GC was detected in 27 specimens (2.6%). Two specimens exhibited discordant results, and they were divided equally between the 2 assays. Based on the original results, the overall agreement was 99.8%, with 96.2% and 99.9% in agreement for positive and negative specimens, respectively. Cohen's Kappa was 0.961.

CONCLUSIONS

There was a high level of agreement between the systems for both CT and GC detection.

Use and evaluation of molecular diagnostics for pneumonia etiology studies

Comprehensive microbiological testing will be a core function of the Pneumonia Etiology Research for Child Health (PERCH) project. The development stage of PERCH provided the time and resources necessary for us to conduct a comprehensive review of the current state of respiratory diagnostics. These efforts allowed us to articulate the unique requirements of PERCH, establish that molecular methods would be central to our testing strategy, and focus on a short list of candidate platforms. This process also highlighted critical challenges in the general design and interpretation of diagnostic evaluation studies, particularly in the field of respiratory infections. Although our final molecular diagnostic platform was ultimately selected on the basis of operational and strategic considerations determined by the specific context of PERCH, our review highlighted several conceptual and practical challenges in respiratory diagnostics that have broader relevance for the performance and interpretation of pneumonia research studies.

Verification bias: an under-recognized source of error in assessing the efficacy of MRI of the meniscii

RATIONALE AND OBJECTIVES

The sensitivity and specificity of magnetic resonance imaging (MRI) for diagnosis of meniscal tears has been studied extensively, with tears usually verified by surgery. However, surgically unverified cases are often not considered in these studies, leading to verification bias, which can falsely increase the sensitivity and decrease the specificity estimates. Our study suggests that such bias may be very common in the meniscal MRI literature, and illustrates techniques to detect and correct for such bias.

MATERIALS AND METHODS

PubMed was searched for articles estimating sensitivity and specificity of MRI for meniscal tears. These were assessed for verification bias, deemed potentially present if a study included any patients whose MRI findings were not surgically verified. Retrospective global sensitivity analysis (GSA) was performed when possible.

RESULTS

Thirty-nine of the 314 studies retrieved from PubMed specifically dealt with meniscal tears. All 39 included unverified patients, and hence, potential verification bias. Only seven articles included sufficient information to perform GSA. Of these, one showed definite verification bias, two showed no bias, and four others showed bias within certain ranges of disease prevalence. Only 9 of 39 acknowledged the possibility of verification bias.

CONCLUSION

Verification bias is underrecognized and potentially common in published estimates of the sensitivity and specificity of MRI for the diagnosis of meniscal tears. When possible, it should be avoided by proper study design. If unavoidable, it should be acknowledged. Investigators should tabulate unverified as well as verified data. Finally, verification bias should be estimated; if present, corrected estimates of sensitivity and specificity should be used. Our online web-based calculator makes this process relatively easy.