Diagnosis of human leptospirosis: systematic review and meta-analysis of the diagnostic accuracy of the Leptospira microscopic agglutination test, PCR targeting Lfb1, and IgM ELISA to Leptospira fainei serovar Hurstbridge

BACKGROUND

Leptospirosis is an underdiagnosed infectious disease with non-specific clinical presentation that requires laboratory confirmation for diagnosis. The serologic reference standard remains the microscopic agglutination test (MAT) on paired serum samples. However, reported estimates of MAT's sensitivity vary. We evaluated the accuracy of four index tests, MAT on paired samples as well as alternative standards for leptospirosis diagnosis: MAT on single acute-phase samples, polymerase chain reaction (PCR) with the target gene Lfb1, and ELISA IgM with Leptospira fainei serovar Hurstbridge as an antigen.

METHODS

We performed a systematic review of studies reporting results of leptospirosis diagnostic tests. We searched eight electronic databases and selected studies that tested human blood samples and compared index tests with blood culture and/or PCR and/or MAT (comparator tests). For MAT selection criteria we defined a threshold for single acute-phase samples according to a national classification of leptospirosis endemicity. We used a Bayesian random-effect meta-analysis to estimate the sensitivity and specificity of MAT in single acute-phase and paired samples separately, and assessed risk of bias using the Quality Assessment of Studies of Diagnostic Accuracy Approach- 2 (QUADAS-2) tool.

RESULTS

For the MAT accuracy evaluation, 15 studies were included, 11 with single acute-phase serum, and 12 with paired sera. Two included studies used PCR targeting the Lfb1 gene, and one included study used IgM ELISA with Leptospira fainei serovar Hurstbridge as antigen. For MAT in single acute-phase samples, the pooled sensitivity and specificity were 14% (95% credible interval [CrI] 3-38%) and 86% (95% CrI 59-96%), respectively, and the predicted sensitivity and specificity were 14% (95% CrI 0-90%) and 86% (95% CrI 9-100%). Among paired MAT samples, the pooled sensitivity and specificity were 68% (95% CrI 32-92%) and 75% (95% CrI 45-93%) respectively, and the predicted sensitivity and specificity were 69% (95% CrI 2-100%) and 75% (2-100%).

CONCLUSIONS

Based on our analysis, the accuracy of MAT in paired samples was not high, but it remains the reference standard until a more accurate diagnostic test is developed. Future studies that include larger numbers of participants with paired samples will improve the certainty of accuracy estimates.

Accuracy of the direct agglutination test for diagnosis of visceral leishmaniasis: a systematic review and meta-analysis

BACKGROUND

Parasitological investigation of bone marrow, splenic or lymph node aspirations is the gold standard for the diagnosis of visceral leishmaniasis (VL). However, this invasive test requires skilled clinical and laboratory staff and adequate facilities, and sensitivity varies depending on the tissue used. The direct agglutination test (DAT) is a serological test that does not need specialised staff, with just minimal training required. While previous meta-analysis has shown DAT to have high sensitivity and specificity when using parasitology as the reference test for diagnosis, meta-analysis of DAT compared to other diagnostic techniques, such as PCR and ELISA, that are increasingly used in clinical and research settings, has not been done.

METHODS

We conducted a systematic review to determine the diagnostic performance of DAT compared to all available tests for the laboratory diagnosis of human VL. We searched electronic databases including Medline, Embase, Global Health, Scopus, WoS Science Citation Index, Wiley Cochrane Central Register of Controlled Trials, Africa-Wide Information, LILACS and WHO Global Index. Three independent reviewers screened reports and extracted data from eligible studies. A meta-analysis estimated the diagnostic sensitivity and specificity of DAT.

RESULTS

Of 987 titles screened, 358 were selected for full data extraction and 78 were included in the analysis, reporting on 32,822 participants from 19 countries. Studies included were conducted between 1987-2020. Meta-analysis of studies using serum and DAT compared to any other test showed pooled sensitivity of 95% (95%CrI 90-98%) and pooled specificity of 95% (95%CrI 88-98%). Results were similar for freeze-dried DAT and liquid DAT when analysed separately. Sensitivity was lower for HIV-positive patients (90%, CrI 59-98%) and specificity was lower for symptomatic patients (70%, CrI 43-89%). When comparing different geographical regions, the lowest median sensitivity (89%, CrI 67-97%) was in Western Asia (five studies).

CONCLUSIONS

This systematic review and meta-analysis demonstrates high estimated pooled sensitivity and specificity of DAT for diagnosis of VL, although sensitivity and specificity were lower for different patient groups and geographical locations. This review highlights the lack of standardisation of DAT methods and preparations, and the lack of data from some important geographical locations. Future well-reported studies could provide better evidence to inform test implementation for different patient populations and use cases.

PROSPERO REGISTRATION

CRD42021240830.

Diagnostic performance of the IMMY cryptococcal antigen lateral flow assay on serum and cerebrospinal fluid for diagnosis of cryptococcosis in HIV-negative patients: a systematic review

BACKGROUND

The incidence of cryptococcosis amongst HIV-negative persons is increasing. Whilst the excellent performance of the CrAg testing in people living with HIV is well described, the diagnostic performance of the CrAg LFA has not been systematically evaluated in HIV-negative cohorts on serum or cerebrospinal fluid.

METHODS

We performed a systematic review to characterise the diagnostic performance of IMMY CrAg® LFA in HIV-negative populations on serum and cerebrospinal fluid. A systematic electronic search was performed using Medline, Embase, Global Health, CENTRAL, WoS Science Citation Index, SCOPUS, Africa-Wide Information, LILACS and WHO Global Health Library. Studies were screened and data extracted from eligible studies by two independent reviewers. A fixed effect meta-analysis was used to estimate the diagnostic sensitivity and specificity.

RESULTS

Of 447 records assessed for eligibility, nine studies met our inclusion criteria, including 528 participants overall. Amongst eight studies that evaluated the diagnostic performance of the IMMY CrAg® LFA on serum, the pooled median sensitivity was 96% (95% Credible Interval (CrI) 68-100%) with a pooled specificity estimate of 96% (95%CrI 84-100%). Amongst six studies which evaluated the diagnostic performance of IMMY CrAg® LFA on CSF, the pooled median sensitivity was 99% (95%CrI 95-100%) with a pooled specificity median of 99% (95%CrI 95-100%).

CONCLUSIONS

This review demonstrates a high pooled sensitivity and specificity for the IMMY CrAg® LFA in HIV-negative populations, in keeping with findings in HIV-positive individuals. The review was limited by the small number of studies. Further studies using IMMY CrAg® LFA in HIV-negative populations would help to better determine the diagnostic value of this test.

Estimating sensitivity and specificity of diagnostic tests using latent class models that account for conditional dependence between tests: a simulation study

BACKGROUND

Latent class models are increasingly used to estimate the sensitivity and specificity of diagnostic tests in the absence of a gold standard, and are commonly fitted using Bayesian methods. These models allow us to account for 'conditional dependence' between two or more diagnostic tests, meaning that the results from tests are correlated even after conditioning on the person's true disease status. The challenge is that it is not always clear to researchers whether conditional dependence exists between tests and whether it exists in all or just some latent classes. Despite the increasingly widespread use of latent class models to estimate diagnostic test accuracy, the impact of the conditional dependence structure chosen on the estimates of sensitivity and specificity remains poorly investigated.

METHODS

A simulation study and a reanalysis of a published case study are used to highlight the impact of the conditional dependence structure chosen on estimates of sensitivity and specificity. We describe and implement three latent class random-effect models with differing conditional dependence structures, as well as a conditional independence model and a model that assumes perfect test accuracy. We assess the bias and coverage of each model in estimating sensitivity and specificity across different data generating mechanisms.

RESULTS

The findings highlight that assuming conditional independence between tests within a latent class, where conditional dependence exists, results in biased estimates of sensitivity and specificity and poor coverage. The simulations also reiterate the substantial bias in estimates of sensitivity and specificity when incorrectly assuming a reference test is perfect. The motivating example of tests for Melioidosis highlights these biases in practice with important differences found in estimated test accuracy under different model choices.

CONCLUSIONS

We have illustrated that misspecification of the conditional dependence structure leads to biased estimates of sensitivity and specificity when there is a correlation between tests. Due to the minimal loss in precision seen by using a more general model, we recommend accounting for conditional dependence even if researchers are unsure of its presence or it is only expected at minimal levels.

Spatiotemporal mapping of malaria prevalence in Madagascar using routine surveillance and health survey data

Malaria transmission in Madagascar is highly heterogeneous, exhibiting spatial, seasonal and long-term trends. Previous efforts to map malaria risk in Madagascar used prevalence data from Malaria Indicator Surveys. These cross-sectional surveys, conducted during the high transmission season most recently in 2013 and 2016, provide nationally representative prevalence data but cover relatively short time frames. Conversely, monthly case data are collected at health facilities but suffer from biases, including incomplete reporting and low rates of treatment seeking. We combined survey and case data to make monthly maps of prevalence between 2013 and 2016. Health facility catchment populations were estimated to produce incidence rates from the case data. Smoothed incidence surfaces, environmental and socioeconomic covariates, and survey data informed a Bayesian prevalence model, in which a flexible incidence-to-prevalence relationship was learned. Modelled spatial trends were consistent over time, with highest prevalence in the coastal regions and low prevalence in the highlands and desert south. Prevalence was lowest in 2014 and peaked in 2015 and seasonality was widely observed, including in some lower transmission regions. These trends highlight the utility of monthly prevalence estimates over the four year period. By combining survey and case data using this two-step modelling approach, we were able to take advantage of the relative strengths of each metric while accounting for potential bias in the case data. Similar modelling approaches combining large datasets of different malaria metrics may be applicable across sub-Saharan Africa.

Global estimation of anti-malarial drug effectiveness for the treatment of uncomplicated Plasmodium falciparum malaria 1991-2019

BACKGROUND

Anti-malarial drugs play a critical role in reducing malaria morbidity and mortality, but their role is mediated by their effectiveness. Effectiveness is defined as the probability that an anti-malarial drug will successfully treat an individual infected with malaria parasites under routine health care delivery system. Anti-malarial drug effectiveness (AmE) is influenced by drug resistance, drug quality, health system quality, and patient adherence to drug use; its influence on malaria burden varies through space and time.

METHODS

This study uses data from 232 efficacy trials comprised of 86,776 infected individuals to estimate the artemisinin-based and non-artemisinin-based AmE for treating falciparum malaria between 1991 and 2019. Bayesian spatiotemporal models were fitted and used to predict effectiveness at the pixel-level (5 km × 5 km). The median and interquartile ranges (IQR) of AmE are presented for all malaria-endemic countries.

RESULTS

The global effectiveness of artemisinin-based drugs was 67.4% (IQR: 33.3-75.8), 70.1% (43.6-76.0) and 71.8% (46.9-76.4) for the 1991-2000, 2006-2010, and 2016-2019 periods, respectively. Countries in central Africa, a few in South America, and in the Asian region faced the challenge of lower effectiveness of artemisinin-based anti-malarials. However, improvements were seen after 2016, leaving only a few hotspots in Southeast Asia where resistance to artemisinin and partner drugs is currently problematic and in the central Africa where socio-demographic challenges limit effectiveness. The use of artemisinin-based combination therapy (ACT) with a competent partner drug and having multiple ACT as first-line treatment choice sustained high levels of effectiveness. High levels of access to healthcare, human resource capacity, education, and proximity to cities were associated with increased effectiveness. Effectiveness of non-artemisinin-based drugs was much lower than that of artemisinin-based with no improvement over time: 52.3% (17.9-74.9) for 1991-2000 and 55.5% (27.1-73.4) for 2011-2015. Overall, AmE for artemisinin-based and non-artemisinin-based drugs were, respectively, 29.6 and 36% below clinical efficacy as measured in anti-malarial drug trials.

CONCLUSIONS

This study provides evidence that health system performance, drug quality and patient adherence influence the effectiveness of anti-malarials used in treating uncomplicated falciparum malaria. These results provide guidance to countries' treatment practises and are critical inputs for malaria prevalence and incidence models used to estimate national level malaria burden.

Mapping the global endemicity and clinical burden of Plasmodium vivax, 2000-17: a spatial and temporal modelling study

BACKGROUND

Plasmodium vivax exacts a significant toll on health worldwide, yet few efforts to date have quantified the extent and temporal trends of its global distribution. Given the challenges associated with the proper diagnosis and treatment of P vivax, national malaria programmes-particularly those pursuing malaria elimination strategies-require up to date assessments of P vivax endemicity and disease impact. This study presents the first global maps of P vivax clinical burden from 2000 to 2017.

METHODS

In this spatial and temporal modelling study, we adjusted routine malariometric surveillance data for known biases and used socioeconomic indicators to generate time series of the clinical burden of P vivax. These data informed Bayesian geospatial models, which produced fine-scale predictions of P vivax clinical incidence and infection prevalence over time. Within sub-Saharan Africa, where routine surveillance for P vivax is not standard practice, we combined predicted surfaces of Plasmodium falciparum with country-specific ratios of P vivax to P falciparum. These results were combined with surveillance-based outputs outside of Africa to generate global maps.

FINDINGS

We present the first high-resolution maps of P vivax burden. These results are combined with those for P falciparum (published separately) to form the malaria estimates for the Global Burden of Disease 2017 study. The burden of P vivax malaria decreased by 41·6%, from 24·5 million cases (95% uncertainty interval 22·5-27·0) in 2000 to 14·3 million cases (13·7-15·0) in 2017. The Americas had a reduction of 56·8% (47·6-67·0) in total cases since 2000, while South-East Asia recorded declines of 50·5% (50·3-50·6) and the Western Pacific regions recorded declines of 51·3% (48·0-55·4). Europe achieved zero P vivax cases during the study period. Nonetheless, rates of decline have stalled in the past five years for many countries, with particular increases noted in regions affected by political and economic instability.

INTERPRETATION

Our study highlights important spatial and temporal patterns in the clinical burden and prevalence of P vivax. Amid substantial progress worldwide, plateauing gains and areas of increased burden signal the potential for challenges that are greater than expected on the road to malaria elimination. These results support global monitoring systems and can inform the optimisation of diagnosis and treatment where P vivax has most impact.

FUNDING

Bill & Melinda Gates Foundation and the Wellcome Trust.

Mapping the global prevalence, incidence, and mortality of Plasmodium falciparum, 2000-17: a spatial and temporal modelling study

BACKGROUND

Since 2000, the scale-up of malaria control interventions has substantially reduced morbidity and mortality caused by the disease globally, fuelling bold aims for disease elimination. In tandem with increased availability of geospatially resolved data, malaria control programmes increasingly use high-resolution maps to characterise spatially heterogeneous patterns of disease risk and thus efficiently target areas of high burden.

METHODS

We updated and refined the Plasmodium falciparum parasite rate and clinical incidence models for sub-Saharan Africa, which rely on cross-sectional survey data for parasite rate and intervention coverage. For malaria endemic countries outside of sub-Saharan Africa, we produced estimates of parasite rate and incidence by applying an ecological downscaling approach to malaria incidence data acquired via routine surveillance. Mortality estimates were derived by linking incidence to systematically derived vital registration and verbal autopsy data. Informed by high-resolution covariate surfaces, we estimated P falciparum parasite rate, clinical incidence, and mortality at national, subnational, and 5 × 5 km pixel scales with corresponding uncertainty metrics.

FINDINGS

We present the first global, high-resolution map of P falciparum malaria mortality and the first global prevalence and incidence maps since 2010. These results are combined with those for Plasmodium vivax (published separately) to form the malaria estimates for the Global Burden of Disease 2017 study. The P falciparum estimates span the period 2000-17, and illustrate the rapid decline in burden between 2005 and 2017, with incidence declining by 27·9% and mortality declining by 42·5%. Despite a growing population in endemic regions, P falciparum cases declined between 2005 and 2017, from 232·3 million (95% uncertainty interval 198·8-277·7) to 193·9 million (156·6-240·2) and deaths declined from 925 800 (596 900-1 341 100) to 618 700 (368 600-952 200). Despite the declines in burden, 90·1% of people within sub-Saharan Africa continue to reside in endemic areas, and this region accounted for 79·4% of cases and 87·6% of deaths in 2017.

INTERPRETATION

High-resolution maps of P falciparum provide a contemporary resource for informing global policy and malaria control planning, programme implementation, and monitoring initiatives. Amid progress in reducing global malaria burden, areas where incidence trends have plateaued or increased in the past 5 years underscore the fragility of hard-won gains against malaria. Efforts towards elimination should be strengthened in such areas, and those where burden remained high throughout the study period.

FUNDING

Bill & Melinda Gates Foundation.

The contribution of non-malarial febrile illness co-infections to Plasmodium falciparum case counts in health facilities in sub-Saharan Africa

Background

The disease burden of Plasmodium falciparum malaria illness is generally estimated using one of two distinct approaches: either by transforming P. falciparum infection prevalence estimates into incidence estimates using conversion formulae; or through adjustment of counts of recorded P. falciparum-positive fever cases from clinics. Whilst both ostensibly seek to evaluate P. falciparum disease burden, there is an implicit and problematic difference in the metric being estimated. The first enumerates only symptomatic malaria cases, while the second enumerates all febrile episodes coincident with a P. falciparum infection, regardless of the fever’s underlying cause.

Methods

Here, a novel approach was used to triangulate community-based data sources capturing P. falciparum infection, fever, and care-seeking to estimate the fraction of P. falciparum-positive fevers amongst children under 5 years of age presenting at health facilities that are attributable to P. falciparum infection versus other non-malarial causes. A Bayesian hierarchical model was used to assign probabilities of malaria-attributable fever (MAF) and non-malarial febrile illness (NMFI) to children under five from a dataset of 41 surveys from 21 countries in sub-Saharan Africa conducted between 2006 and 2016. Using subsequent treatment-seeking outcomes, the proportion of MAF and NMFI amongst P. falciparum-positive febrile children presenting at public clinics was estimated.

Results

Across all surveyed malaria-positive febrile children who sought care at public clinics across 41 country-years in sub-Saharan Africa, P. falciparum infection was estimated to be the underlying cause of only 37.7% (31.1–45.4, 95% CrI) of P. falciparum-positive fevers, with significant geographical and temporal heterogeneity between surveys.

Conclusions

These findings highlight the complex nature of the P. falciparum burden amongst children under 5 years of age and indicate that for many children presenting at health clinics, a positive P. falciparum diagnosis and a fever does not necessarily mean P. falciparum is the underlying cause of the child’s symptoms, and thus other causes of illness should always be investigated, in addition to prescribing an effective anti-malarial medication. In addition to providing new large-scale estimates of malaria-attributable fever prevalence, the results presented here improve comparability between different methods for calculating P. falciparum disease burden, with significant implications for national and global estimation of malaria burden.

Electronic supplementary material

The online version of this article (10.1186/s12936-019-2830-y) contains supplementary material, which is available to authorized users.