Variation in specificity of HIV rapid diagnostic tests over place and time: an analysis of discordancy data using a Bayesian approach

False reactive HIV-1 diagnostic test results in an individual from Kenya on multiple testing platforms-A case report

Background

Rapid diagnostic tests (RDT) are routinely used in screening for HIV infection. More complex diagnostic algorithms incorporating fourth-generation screening and confirmatory HIV-1/HIV-2 differentiation immunoassays (IA) may be used to confirm HIV infection. Co-infections and autoimmune diseases may lead to falsely reactive HIV diagnostic test results.

Case presentation

A Kenyan man with asymptomatic schistosomiasis and low risk factors for HIV infection demonstrated an inconsistent and discordant pattern of reactivity on HIV RDT, repeated reactivity on fourth-generation IA and positive at a single time-point for HIV-1 on the Geenius HIV1/HIV2 confirmatory assay during the course of a prospective cohort study with HIV repeat testing. The individual initiated antiretroviral therapy following HIV diagnosis. However, his bi-annual behavioral questionnaire suggested low-risk factors for infection. Supplementary confirmatory serologic and nucleic acid tests were performed and gave discordant results. The participant was determined to be HIV uninfected using cell-associated HIV-1 DNA/RNA testing and antiretroviral therapy was discontinued.

Discussion and conclusions

Sole reliance on diagnostic test results may result in misdiagnosis of HIV infection, social harm and potential antiretroviral induced drug toxicity. Interpretation of HIV test results should incorporate multiple parameters.

Performance evaluation of eight rapid tests to detect HIV infection: A comparative study from Brazil

Rapid tests (RTs), also known as point-of-care tests, usually release results within 30 minutes with no need for a qualified staff, equipment, or laboratory structure. The Brazilian Ministry of Health published a resolution in 2013, recommending the use of RTs for the diagnosis of HIV infection, where one positive RT must be followed by another different RT. This was meant to increase the chance of proper diagnosis in specific settings and special populations. However, data comparing and validating the different HIV RTs available in Brazil are scarce. Therefore, the present study seeks to evaluate eight anti-HIV RTs available in the Brazilian market regarding their analytical performance: sensitivity, specificity, positive and negative predictive values, positive and negative likelihood ratios, and accuracy. We also evaluated the agreement between kits (Kappa index) and the quality of the reading pattern of the tests. This was an observational, analytical, and concordance study, in which previously defined positive and negative samples, based on their serological pattern for anti-HIV antibodies (chemiluminescent immunoassay-ECLIA-used as screening and Western Blot used as the confirmatory test) were tested. Analytical performance and Kappa index were calculated, considering a 95% CI and p<0.05. This study identified differences in the performances of the eight tested kits. Six out of eight RTs showed good performance and can be used in the routine laboratory and health care units as screening tests. Regarding the quality of the RT band reading pattern, two brands had several samples showing quite faint bands, thus compromising its use in clinical and laboratory settings.

Evaluation of the practicability and virological performance of finger-stick whole-blood HIV self-testing in French-speaking sub-Saharan Africa

BACKGROUND

Opportunities for HIV testing could be enhanced by offering HIV self-testing (HIVST) in populations that fear stigma and discrimination when accessing conventional HIV counselling and testing in health care facilities. Field experience with HIVST has not yet been reported in French-speaking African countries.

METHODS

The practicability of HIVST was assessed using the prototype the Exacto® Test HIV (Biosynex, Strasbourg, France) self-test in 322 adults living in Kisangani and Bunia, Democratic Republic of the Congo, according to World Health Organization's recommendations. Simplified and easy-to-read leaflet was translated in French, Lingala and Swahili.

RESULTS

Forty-nine percent of participants read the instructions for use in French, while 17.1% and 33.9% read the instructions in Lingala and Swahili, respectively. The instructions for use were correctly understood in 79.5% of cases. The majority (98.4%) correctly performed the HIV self-test; however, 20.8% asked for oral assistance. Most of the participants (95.3%) found that performing the self-test was easy, while 4.7% found it difficult. Overall, the results were correctly interpreted in 90.2% of cases. Among the positive, negative, and invalid self-tests, misinterpretation occurred in 6.5%, 11.2%, and 16.0% of cases, respectively (P<0.0001). The Cohen's κ coefficient was 0.84. The main obstacle for HIVST was educational level, with execution and interpretation difficulties occurring among poorly educated people. The Exacto® Test HIV self-test showed 100.0% (95% CI; 98.8-100.0) sensitivity and 99.2% (95% CI; 97.5-99.8) specificity.

CONCLUSIONS

Our field observations demonstrate: (i) the need to adapt the instructions for use to the Congolese general public, including adding educational pictograms as well as instructions for use in the local vernacular language(s); (ii) frequent difficulties understanding the instructions for use in addition to frequent misinterpretation of test results; and (iii) the generally good practicability of the HIV self-test despite some limitations. Supervised use of HIVST is recommended among poorly-educated people.

Misdiagnosis of HIV infection during a South African community-based survey: implications for rapid HIV testing

Introduction: We describe the overall accuracy and performance of a serial rapid HIV testing algorithm used in community-based HIV testing in the context of a population-based household survey conducted in two sub-districts of uMgungundlovu district, KwaZulu-Natal, South Africa, against reference fourth-generation HIV-1/2 antibody and p24 antigen combination immunoassays. We discuss implications of the findings on rapid HIV testing programmes.

Methods: Cross-sectional design: Following enrolment into the survey, questionnaires were administered to eligible and consenting participants in order to obtain demographic and HIV-related data. Peripheral blood samples were collected for HIV-related testing. Participants were offered community-based HIV testing in the home by trained field workers using a serial algorithm with two rapid diagnostic tests (RDTs) in series. In the laboratory, reference HIV testing was conducted using two fourth-generation immunoassays with all positives in the confirmatory test considered true positives. Accuracy, sensitivity, specificity, positive predictive value, negative predictive value and false-positive and false-negative rates were determined.

Results: Of 10,236 individuals enrolled in the survey, 3740 were tested in the home (median age 24 years (interquartile range 19–31 years), 42.1% males and HIV positivity on RDT algorithm 8.0%). From those tested, 3729 (99.7%) had a definitive RDT result as well as a laboratory immunoassay result. The overall accuracy of the RDT when compared to the fourth-generation immunoassays was 98.8% (95% confidence interval (CI) 98.5–99.2). The sensitivity, specificity, positive predictive value and negative predictive value were 91.1% (95% CI 87.5–93.7), 99.9% (95% CI 99.8–100), 99.3% (95% CI 97.4–99.8) and 99.1% (95% CI 98.8–99.4) respectively. The false-positive and false-negative rates were 0.06% (95% CI 0.01–0.24) and 8.9% (95% CI 6.3–12.53). Compared to true positives, false negatives were more likely to be recently infected on limited antigen avidity assay and to report antiretroviral therapy (ART) use.

Conclusions: The overall accuracy of the RDT algorithm was high. However, there were few false positives, and the sensitivity was lower than expected with high false negatives, despite implementation of quality assurance measures. False negatives were associated with recent (early) infection and ART exposure. The RDT algorithm was able to correctly identify the majority of HIV infections in community-based HIV testing. Messaging on the potential for false positives and false negatives should be included in these programmes.

Identification of misdiagnosed HIV clients in an Early Access to ART for All implementation study in Swaziland

Introduction: Rapid diagnostic testing has made HIV diagnosis and subsequent treatment more accessible. However, multiple factors, including improper implementation of testing strategies and clerical errors, have been reported to lead to HIV misdiagnosis. The World Health Organization has recommended HIV retesting prior to antiretroviral therapy (ART) initiation which has become pertinent with scaling up of Early Access to ART for All (EAAA). In this analysis, misdiagnosed clients are identified from a subgroup of clients enrolled in EAAA implementation study in Swaziland.

Methods: The subgroup to assess misdiagnosis was identified from enrolled EAAA study clients, who had an undetectable viral load prior to ART initiation between September 1, 2014 and May 31, 2016. One hundred and five of 2533 (4%) clients had an undetectable viral load prior to initiation to ART (pre-ART). The HIV status of clients was confirmed using the Determine HIV 1/2 and Uni-Gold HIV 1/2 rapid tests performed serially as recommended by the national testing algorithm. The status of clients on ART was additionally confirmed by fourth-generation HIV Ag/Ab combo tests, Architect and Genscreen Ultra.

Results: Fourteen of the 105 (13%) clients were false positive (HIV negative) on confirmation testing, of whom five (36%) were still in pre-ART care, while nine (64%) were in ART care. Overall, proportion of false positive was 0.6% (14/2533). The false-positive clients had a median CD4 of 791 cells/ml (interquartile range (IQR): 628, 967) compared to 549 cells/ml (IQR: 387, 791) for true positives (HIV positive) (p = 0.0081) and were nearly 20 years older (p = 0.0008).

Conclusions: Overall 0.6% of all enrolled EAAA clients were misdiagnosed, and 64% of misdiagnosed clients were initiated on ART. With adoption of EAAA guidelines by national governments, ART initiation regardless of immunological criteria, strengthening of proficiency testing and adoption of retesting prior to ART initiation would allow identification of misdiagnosed clients and further reduce potential of initiating misdiagnosed clients on ART.

HIV misdiagnosis in sub-Saharan Africa: performance of diagnostic algorithms at six testing sites

Introduction: We evaluated the diagnostic accuracy of HIV testing algorithms at six programmes in five sub-Saharan African countries.

Methods: In this prospective multisite diagnostic evaluation study (Conakry, Guinea; Kitgum, Uganda; Arua, Uganda; Homa Bay, Kenya; Doula, Cameroun and Baraka, Democratic Republic of Congo), samples from clients (greater than equal to five years of age) testing for HIV were collected and compared to a state-of-the-art algorithm from the AIDS reference laboratory at the Institute of Tropical Medicine, Belgium. The reference algorithm consisted of an enzyme-linked immuno-sorbent assay, a line-immunoassay, a single antigen-enzyme immunoassay and a DNA polymerase chain reaction test.

Results: Between August 2011 and January 2015, over 14,000 clients were tested for HIV at 6 HIV counselling and testing sites. Of those, 2786 (median age: 30; 38.1% males) were included in the study. Sensitivity of the testing algorithms ranged from 89.5% in Arua to 100% in Douala and Conakry, while specificity ranged from 98.3% in Doula to 100% in Conakry. Overall, 24 (0.9%) clients, and as many as 8 per site (1.7%), were misdiagnosed, with 16 false-positive and 8 false-negative results. Six false-negative specimens were retested with the on-site algorithm on the same sample and were found to be positive. Conversely, 13 false-positive specimens were retested: 8 remained false-positive with the on-site algorithm.

Conclusions: The performance of algorithms at several sites failed to meet expectations and thresholds set by the World Health Organization, with unacceptably high rates of false results. Alongside the careful selection of rapid diagnostic tests and the validation of algorithms, strictly observing correct procedures can reduce the risk of false results. In the meantime, to identify false-positive diagnoses at initial testing, patients should be retested upon initiating antiretroviral therapy.

Rapid Diagnostic Testing of Hospitalized Malawian Children Reveals Opportunities for Improved HIV Diagnosis and Treatment

Recent World Health Organization (WHO) guidelines recommend antiretroviral therapy (ART) for all HIV-infected people; previously CD4+ T lymphocyte quantification (CD4 count) or clinical staging determined eligibility for children ≥ 5 years old in low- and middle-income countries. We examined positive predictive value (PPV) of a rapid diagnostic test (RDT) algorithm and ART eligibility for hospitalized children with newly diagnosed HIV infection. We enrolled 363 hospitalized Malawian children age 2 months to 16 years with two serial positive HIV RDT from 2013 to 2015. Children aged ≤ 18 months whose nucleic acid testing was negative or unavailable were later excluded from the analysis (N = 16). If RNA PCR was undetectable, human immunodeficiency virus (HIV) enzyme immunoassay (EIA) and western blot (WB) were performed. Those with negative or discordant EIA and WB were considered HIV negative and excluded from further analysis (N = 6). ART eligibility was assessed using age, CD4 count, and clinical HIV stage. Among 150 patients with HIV RNA PCR results, 15 had undetectable HIV RNA. Of those, EIA and WB were positive in nine patients and negative or discordant in six patients. PPV of serial RDT was 90% versus RNA PCR alone and 96% versus combined RNA PCR, EIA, and WB. Of all patients aged ≥ 5 years, 8.9% were ineligible for ART under previous WHO guidelines. Improved HIV testing algorithms are needed for accurate diagnosis of HIV infection in children as prevalence of pediatric HIV declines. Universal treatment will significantly increase the numbers of older children who qualify for ART.

To err is human, to correct is public health: a systematic review examining poor quality testing and misdiagnosis of HIV status

INTRODUCTION

In accordance with global testing and treatment targets, many countries are seeking ways to reach the "90-90-90" goals, starting with diagnosing 90% of all people with HIV. Quality HIV testing services are needed to enable people with HIV to be diagnosed and linked to treatment as early as possible. It is essential that opportunities to reach people with undiagnosed HIV are not missed, diagnoses are correct and HIV-negative individuals are not inadvertently initiated on life-long treatment. We conducted this systematic review to assess the magnitude of misdiagnosis and to describe poor HIV testing practices using rapid diagnostic tests.

METHODS

We systematically searched peer-reviewed articles, abstracts and grey literature published from 1 January 1990 to 19 April 2017. Studies were included if they used at least two rapid diagnostic tests and reported on HIV misdiagnosis, factors related to potential misdiagnosis or described quality issues and errors related to HIV testing.

RESULTS

Sixty-four studies were included in this review. A small proportion of false positive (median 3.1%, interquartile range (IQR): 0.4-5.2%) and false negative (median: 0.4%, IQR: 0-3.9%) diagnoses were identified. Suboptimal testing strategies were the most common factor in studies reporting misdiagnoses, particularly false positive diagnoses due to using a "tiebreaker" test to resolve discrepant test results. A substantial proportion of false negative diagnoses were related to retesting among people on antiretroviral therapy. Conclusions HIV testing errors and poor practices, particularly those resulting in false positive or false negative diagnoses, do occur but are preventable. Efforts to accelerate HIV diagnosis and linkage to treatment should be complemented by efforts to improve the quality of HIV testing services and strengthen the quality management systems, particularly the use of validated testing algorithms and strategies, retesting people diagnosed with HIV before initiating treatment and providing clear messages to people with HIV on treatment on the risk of a "false negative" test result.

Designing HIV Testing Algorithms Based on 2015 WHO Guidelines Using Data from Six Sites in Sub-Saharan Africa

Our objective was to evaluate the performance of HIV testing algorithms based on WHO recommendations, using data from specimens collected at six HIV testing and counseling sites in sub-Saharan Africa (Conakry, Guinea; Kitgum and Arua, Uganda; Homa Bay, Kenya; Douala, Cameroon; Baraka, Democratic Republic of Congo). A total of 2,780 samples, including 1,306 HIV-positive samples, were included in the analysis. HIV testing algorithms were designed using Determine as a first test. Second and third rapid diagnostic tests (RDTs) were selected based on site-specific performance, adhering where possible to the WHO-recommended minimum requirements of ≥99% sensitivity and specificity. The threshold for specificity was reduced to 98% or 96% if necessary. We also simulated algorithms consisting of one RDT followed by a simple confirmatory assay. The positive predictive values (PPV) of the simulated algorithms ranged from 75.8% to 100% using strategies recommended for high-prevalence settings, 98.7% to 100% using strategies recommended for low-prevalence settings, and 98.1% to 100% using a rapid test followed by a simple confirmatory assay. Although we were able to design algorithms that met the recommended PPV of ≥99% in five of six sites using the applicable high-prevalence strategy, options were often very limited due to suboptimal performance of individual RDTs and to shared falsely reactive results. These results underscore the impact of the sequence of HIV tests and of shared false-reactivity data on algorithm performance. Where it is not possible to identify tests that meet WHO-recommended specifications, the low-prevalence strategy may be more suitable.

The evaluation of accuracy of serial rapid HIV test algorithm in the diagnosis of HIV antibodies among pregnant women in south east Nigeria

Background

Accurate HIV testing in pregnancy is critical to the prevention of mother to child transmission of HIV infection and linkages to other preventive strategies.

Aims and objectives

This study determined the sensitivity, specificity negative and positive predictive value of serial rapid testing of HIV among pregnant women in Nnewi, south east Nigeria.

Methodology

This was a comparative descriptive study conducted over a 4-month period. Serial rapid testing algorithm was compared with conventional ELISA testing after obtaining informed consents from the pregnant women. All positive and discordant results were confirmed with western blot HIV test. Participants also completed a questionnaire. Data analysis was done using SPSS version 20.

Result

A total of 166 pregnant women participated in this study. The mean age of the participants was 29 ± 4.3 years. The HIV prevalence was highest in the 25–29 years category. This was also the modal age category. Majority of the women were multiparous. The prevalence of HIV infection was 12 %. The sensitivity, specificity, negative and positive predictive value of serial rapid HIV testing was 95, 100, 99.3 and 100 % respectively.

Conclusion

The sensitivity of the serial rapid test algorithm was high but still lower than the WHO recommended 99 % and above. The 100 % specificity and positive predictive value makes it a good diagnostic test strategy. There is need for regular review of HIV test kits and policy.

Accounting for False Positive HIV Tests: Is Visceral Leishmaniasis Responsible?

BACKGROUND

Co-infection with HIV and visceral leishmaniasis is an important consideration in treatment of either disease in endemic areas. Diagnosis of HIV in resource-limited settings relies on rapid diagnostic tests used together in an algorithm. A limitation of the HIV diagnostic algorithm is that it is vulnerable to falsely positive reactions due to cross reactivity. It has been postulated that visceral leishmaniasis (VL) infection can increase this risk of false positive HIV results. This cross sectional study compared the risk of false positive HIV results in VL patients with non-VL individuals.

METHODOLOGY/PRINCIPAL FINDINGS

Participants were recruited from 2 sites in Ethiopia. The Ethiopian algorithm of a tiebreaker using 3 rapid diagnostic tests (RDTs) was used to test for HIV. The gold standard test was the Western Blot, with indeterminate results resolved by PCR testing. Every RDT screen positive individual was included for testing with the gold standard along with 10% of all negatives. The final analysis included 89 VL and 405 non-VL patients. HIV prevalence was found to be 12.8% (47/ 367) in the VL group compared to 7.9% (200/2526) in the non-VL group. The RDT algorithm in the VL group yielded 47 positives, 4 false positives, and 38 negatives. The same algorithm for those without VL had 200 positives, 14 false positives, and 191 negatives. Specificity and positive predictive value for the group with VL was less than the non-VL group; however, the difference was not found to be significant (p = 0.52 and p = 0.76, respectively).

CONCLUSION

The test algorithm yielded a high number of HIV false positive results. However, we were unable to demonstrate a significant difference between groups with and without VL disease. This suggests that the presence of endemic visceral leishmaniasis alone cannot account for the high number of false positive HIV results in our study.

Evaluation of HIV testing algorithms in Ethiopia: the role of the tie-breaker algorithm and weakly reacting test lines in contributing to a high rate of false positive HIV diagnoses

Background

In Ethiopia a tiebreaker algorithm using 3 rapid diagnostic tests (RDTs) in series is used to diagnose HIV. Discordant results between the first 2 RDTs are resolved by a third ‘tiebreaker’ RDT. Médecins Sans Frontières uses an alternate serial algorithm of 2 RDTs followed by a confirmation test for all double positive RDT results. The primary objective was to compare the performance of the tiebreaker algorithm with a serial algorithm, and to evaluate the addition of a confirmation test to both algorithms. A secondary objective looked at the positive predictive value (PPV) of weakly reactive test lines.

Methods

The study was conducted in two HIV testing sites in Ethiopia. Study participants were recruited sequentially until 200 positive samples were reached. Each sample was re-tested in the laboratory on the 3 RDTs and on a simple to use confirmation test, the Orgenics Immunocomb Combfirm® (OIC). The gold standard test was the Western Blot, with indeterminate results resolved by PCR testing.

Results

2620 subjects were included with a HIV prevalence of 7.7%. Each of the 3 RDTs had an individual specificity of at least 99%. The serial algorithm with 2 RDTs had a single false positive result (1 out of 204) to give a PPV of 99.5% (95% CI 97.3%-100%). The tiebreaker algorithm resulted in 16 false positive results (PPV 92.7%, 95% CI: 88.4%-95.8%). Adding the OIC confirmation test to either algorithm eliminated the false positives. All the false positives had at least one weakly reactive test line in the algorithm. The PPV of weakly reacting RDTs was significantly lower than those with strongly positive test lines.

Conclusion

The risk of false positive HIV diagnosis in a tiebreaker algorithm is significant. We recommend abandoning the tie-breaker algorithm in favour of WHO recommended serial or parallel algorithms, interpreting weakly reactive test lines as indeterminate results requiring further testing except in the setting of blood transfusion, and most importantly, adding a confirmation test to the RDT algorithm. It is now time to focus research efforts on how best to translate this knowledge into practice at the field level.

Trial registration

Clinical Trial registration #: NCT01716299

Rapid Tests versus ELISA for Screening of HIV Infection: Our Experience from a Voluntary Counselling and Testing Facility of a Tertiary Care Centre in North India

Early and accurate diagnosis of human immunodeficiency virus (HIV) infection is essential for timely identification of patients needing antiretroviral therapy and for instituting HIV prevention strategies. The primary methodology for HIV testing has shifted from enzyme linked immunosorbent assay (ELISA) to rapid diagnostic tests (RDTs) in recent years, especially in resource limited settings. However, the diagnostic performance of RDTs is a matter of concern. In the present study the performance of an RDT being used as the initial test in serial testing based algorithm for HIV diagnosis was compared with ELISA. Seven hundred and eighty-seven sera, tested at the voluntary counselling and testing facility employing a serial testing algorithm (based on SD Bioline HIV-1/2 3.0 as the first test), were subsequently tested with Microlisa-HIV for anti-HIV antibodies. The first test missed 9 HIV reactive samples and also registered 5 false positives. The sensitivity, specificity, and negative and positive predictive values of the first test were 77.5%, 99.3%, and 98.8% and 86.1%, respectively, taking ELISA as the standard test. Our study highlights that RDTs fare poorly compared to ELISA as screening assays and that reactive results by RDTs need to be confirmed by western blot for a positive serodiagnosis of HIV infection.