Factors influencing the diagnostic accuracy of the rapid influenza antigen detection test (RIADT): a cross-sectional study

Diagnostic accuracy of point-of-care tests for acute respiratory infection: a systematic review of reviews

Background

Acute respiratory infections are a common reason for consultation with primary and emergency healthcare services. Identifying individuals with a bacterial infection is crucial to ensure appropriate treatment. However, it is also important to avoid overprescription of antibiotics, to prevent unnecessary side effects and antimicrobial resistance. We conducted a systematic review to summarise evidence on the diagnostic accuracy of symptoms, signs and point-of-care tests to diagnose bacterial respiratory tract infection in adults, and to diagnose two common respiratory viruses, influenza and respiratory syncytial virus.

Methods

The primary approach was an overview of existing systematic reviews. We conducted literature searches (22 May 2023) to identify systematic reviews of the diagnostic accuracy of point-of-care tests. Where multiple reviews were identified, we selected the most recent and comprehensive review, with the greatest overlap in scope with our review question. Methodological quality was assessed using the Risk of Bias in Systematic Reviews tool. Summary estimates of diagnostic accuracy (sensitivity, specificity or area under the curve) were extracted. Where no systematic review was identified, we searched for primary studies. We extracted sufficient data to construct a 2 × 2 table of diagnostic accuracy, to calculate sensitivity and specificity. Methodological quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies version 2 tool. Where possible, meta-analyses were conducted. We used GRADE to assess the certainty of the evidence from existing reviews and new analyses.

Results

We identified 23 reviews which addressed our review question; 6 were selected as the most comprehensive and similar in scope to our review protocol. These systematic reviews considered the following tests for bacterial respiratory infection: individual symptoms and signs; combinations of symptoms and signs (in clinical prediction models); clinical prediction models incorporating C-reactive protein; and biological markers related to infection (including C-reactive protein, procalcitonin and others). We also identified systematic reviews that reported the accuracy of specific tests for influenza and respiratory syncytial virus. No reviews were found that assessed the diagnostic accuracy of white cell count for bacterial respiratory infection, or multiplex tests for influenza and respiratory syncytial virus. We therefore conducted searches for primary studies, and carried out meta-analyses for these index tests. Overall, we found that symptoms and signs have poor diagnostic accuracy for bacterial respiratory infection (sensitivity ranging from 9.6% to 89.1%; specificity ranging from 13.4% to 95%). Accuracy of biomarkers was slightly better, particularly when combinations of biomarkers were used (sensitivity 80-90%, specificity 82-93%). The sensitivity and specificity for influenza or respiratory syncytial virus varied considerably across the different types of tests. Tests involving nucleic acid amplification techniques (either single pathogen or multiplex tests) had the highest diagnostic accuracy for influenza (sensitivity 91-99.8%, specificity 96.8-99.4%).

Limitations

Most of the evidence was considered low or very low certainty when assessed with GRADE, due to imprecision in effect estimates, the potential for bias and the inclusion of participants outside the scope of this review (children, or people in hospital).

Future work

Currently evidence is insufficient to support routine use of point-of-care tests in primary and emergency care. Further work must establish whether the introduction of point-of-care tests adds value, or simply increases healthcare costs.

Funding

This article presents independent research funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme as award number NIHR159948.

Rapid Multiplex RT-PCR for Influenza A and B by Genesoc®, a Microfluidic PCR System

Background

Rapid antigen tests are widely used to diagnose influenza. However, despite their simplicity and short turnover time, the sensitivity of these tests is relatively low, and molecular tests with greater sensitivity are being sought. In this study, we developed and clinically evaluated a protocol for the rapid multiplex testing of influenza A and B, using a rapid real-time PCR system, GeneSoC^®, that is based on microfluidic thermal cycling technology.

Methods

The specificity of the developed assay was validated using cultured viral strains of influenza A/B, human metapneumovirus, and respiratory syncytial virus. Analytical sensitivity was evaluated using serially diluted RNA synthesized via in vitro transcription and nasopharyngeal swab samples collected from consecutive patients seeking medical attention for a combination of upper respiratory and general symptoms. Cross-validation of GeneSoC^® based on comparisons with conventional real-time RT-PCR and rapid antigen tests was performed by parallel testing of influenza-positive clinical specimens.

Results

The GeneSoC^® assay detected the target sequences of influenza A and B at minimum concentrations of 38 and 65 copies/µL in reaction, respectively. For the analysis of clinical specimens, the positive, negative, and overall agreement between GeneSoC^® RT-PCR and a conventional real-time RT-PCR was in all cases 100%, whereas for the comparison between GeneSoC^® RT-PCR and the rapid antigen test, the agreements for positive, negative, and overall findings were 100%, 90.9%, and 95.7%, respectively. The mean time for completing GeneSoC^® RT-PCR was 16 min 29 s (95% confidence interval, 16 min 18 s to 16 min 39 s).

Conclusion

The microfluidic real-time PCR system, GeneSoC^®, has an analytical performance comparable to that of conventional real-time RT-PCR with rapid turnover time, and represents a promising alternative to rapid antigen tests for diagnosing influenza A and B.

Diagnostic Accuracy of an At-Home, Rapid Self-test for Influenza: Prospective Comparative Accuracy Study

Background

Rapid diagnostic tests (RDTs) for influenza used by individuals at home could potentially expand access to testing and reduce the impact of influenza on health systems. Improving access to testing could lead to earlier diagnosis following symptom onset, allowing more rapid interventions for those who test positive, including behavioral changes to minimize spread. However, the accuracy of RDTs for influenza has not been determined in self-testing populations.

Objective

This study aims to assess the accuracy of an influenza RDT conducted at home by lay users with acute respiratory illness compared with that of a self-collected sample by the same individual mailed to a laboratory for reference testing.

Methods

We conducted a comparative accuracy study of an at-home influenza RDT (Ellume) in a convenience sample of individuals experiencing acute respiratory illness symptoms. Participants were enrolled in February and March 2020 from the Greater Seattle region in Washington, United States. Participants were mailed the influenza RDT and reference sample collection materials, which they completed and returned for quantitative reverse-transcription polymerase chain reaction influenza testing in a central laboratory. We explored the impact of age, influenza type, duration, and severity of symptoms on RDT accuracy and on cycle threshold for influenza virus and ribonuclease P, a marker of human DNA.

Results

A total of 605 participants completed all study steps and were included in our analysis, of whom 87 (14.4%) tested positive for influenza by quantitative reverse-transcription polymerase chain reaction (70/87, 80% for influenza A and 17/87, 20% for influenza B). The overall sensitivity and specificity of the RDT compared with the reference test were 61% (95% CI 50%-71%) and 95% (95% CI 93%-97%), respectively. Among individuals with symptom onset ≤72 hours, sensitivity was 63% (95% CI 48%-76%) and specificity was 94% (95% CI 91%-97%), whereas, for those with duration >72 hours, sensitivity and specificity were 58% (95% CI 41%-74%) and 96% (95% CI 93%-98%), respectively. Viral load on reference swabs was negatively correlated with symptom onset, and quantities of the endogenous marker gene ribonuclease P did not differ among reference standard positive and negative groups, age groups, or influenza subtypes. The RDT did not have higher sensitivity or specificity among those who reported more severe illnesses.

Conclusions

The sensitivity and specificity of the self-test were comparable with those of influenza RDTs used in clinical settings. False-negative self-test results were more common when the test was used after 72 hours of symptom onset but were not related to inadequate swab collection or severity of illness. Therefore, the deployment of home tests may provide a valuable tool to support the management of influenza and other respiratory infections.

Association of physician experience with a higher prescription rate of anti-influenza agents in low-risk patients

During the influenza season, most patients suspected of having influenza undergo rapid influenza diagnostic tests (RIDTs) in Japan despite their low sensitivity. However, the physician's actual rationale for prescribing antivirals, besides the results of RIDTs, remains poorly understood. Our study sought to identify the role of clinical information and physicians' experience in the initiation of anti-influenza agents. We retrospectively reviewed 380 patients who underwent RIDTs at the emergency department of our hospital from September 2018 to May 2019. Data regarding sex, age, etc., which could affect the decision of prescribing antivirals, were extracted from medical records. We performed logistic regression analysis to analyze the concurrent effect of potentially relevant clinical factors, results of RIDTs, and the physician's status on antiviral prescription. Multivariable analysis revealed that a positive RIDT had the largest effect on antiviral prescription, followed by physician status, high regional influenza activity, and patients' presentation within 12 h of symptom onset. Patient's age, comorbidities, and presentation after 48 h of symptom onset were not associated with antiviral treatment. Physicians with more years of experience were significantly more likely to prescribe antivirals for patients with low risk of complications. Our findings revealed the physicians' rationale for initiating antiviral treatment and the discrepancy with guideline indications of antivirals, which is the patient's age and comorbidities. Physicians, especially those with more than 3 years of experience, frequently prescribed antivirals for patients with low risk of complications; thus, educational interventions against this population could be useful to improve this situation.

Harmless or Threatening? Interpreting the Results of Molecular Diagnosis in the Context of Virus-Host Relationships

Molecular methods, established in the 1980s, expanded and delivered tools for the detection of vestigial quantities of nucleic acids in biological samples. Nucleotide sequencing of these molecules reveals the identity of the organism it belongs to. However, the implications of such detection are often misinterpreted as pathogenic, even in the absence of corroborating clinical evidence. This is particularly significant in the field of virology where the concepts of commensalism, and other benign or neutral relationships, are still very new. In this manuscript, we review some fundamental microbiological concepts including commensalism, mutualism, pathogenicity, and infection, giving special emphasis to their application in virology, in order to clarify the difference between detection and infection. We also propose a system for the correct attribution of terminology in this context.

Time variation in the probability of failing to detect a case of polymerase chain reaction testing for SARS-CoV-2 as estimated from a viral dynamics model

Viral tests including polymerase chain reaction (PCR) tests are recommended to diagnose COVID-19 infection during the acute phase of infection. A test should have high sensitivity; however, the sensitivity of the PCR test is highly influenced by viral load, which changes over time. Because it is difficult to collect data before the onset of symptoms, the current literature on the sensitivity of the PCR test before symptom onset is limited. In this study, we used a viral dynamics model to track the probability of failing to detect a case of PCR testing over time, including the presymptomatic period. The model was parametrized by using longitudinal viral load data collected from 30 hospitalized patients. The probability of failing to detect a case decreased toward symptom onset, and the lowest probability was observed 2 days after symptom onset and increased afterwards. The probability on the day of symptom onset was 1.0% (95% CI: 0.5 to 1.9) and that 2 days before symptom onset was 60.2% (95% CI: 57.1 to 63.2). Our study suggests that the diagnosis of COVID-19 by PCR testing should be done carefully, especially when the test is performed before or way after symptom onset. Further study is needed of patient groups with potentially different viral dynamics, such as asymptomatic cases.

Economic consequences of Japanese schools' recovery certificate policy for seasonal influenza

Background

Like other countries, Japan experiences a seasonal influenza epidemic every year. In order to return to school after a influenza-related absence, most Japanese students are required to submit a recovery certificate (chiyu-shoumeisyo in Japanese). The objective of this study was to estimate the economic consequences of this practice.

Methods

A cost analysis was conducted to estimate the additional costs incurred by the issuance of recovery certificates from a restricted societal perspective. The estimated number of influenza patients under 15 years old from the 2013/14 season to the 2017/18 season, the proportion of working mothers were used to calculate the estimated total number of recovery certificates issued per year. The cost of return visits to physicians and the cost for issuing certificates were included in the direct costs. Productivity loss was estimated using the mean monthly salary of women and was included in indirect costs.

Results

The recovery certificate policy imposed an additional cost of 0.94 million USD per one million population. One-way deterministic sensitivity analysis demonstrated that the additional cost of the recovery certificate policy amounted to between 0.55 and 2.27 million USD per one million population. Probabilistic sensitivity analysis showed similar results.

Conclusions

The recovery certificate policy has a substantial negative economic impact on the Japanese healthcare system and society from a restricted societal perspective.

Practical Guidance for Clinical Microbiology Laboratories: Viruses Causing Acute Respiratory Tract Infections

Respiratory viral infections are associated with a wide range of acute syndromes and infectious disease processes in children and adults worldwide. Many viruses are implicated in these infections, and these viruses are spread largely via respiratory means between humans but also occasionally from animals to humans. This article is an American Society for Microbiology (ASM)-sponsored Practical Guidance for Clinical Microbiology (PGCM) document identifying best practices for diagnosis and characterization of viruses that cause acute respiratory infections and replaces the most recent prior version of the ASM-sponsored Cumitech 21 document, Laboratory Diagnosis of Viral Respiratory Disease, published in 1986. The scope of the original document was quite broad, with an emphasis on clinical diagnosis of a wide variety of infectious agents and laboratory focus on antigen detection and viral culture. The new PGCM document is designed to be used by laboratorians in a wide variety of diagnostic and public health microbiology/virology laboratory settings worldwide. The article provides guidance to a rapidly changing field of diagnostics and outlines the epidemiology and clinical impact of acute respiratory viral infections, including preferred methods of specimen collection and current methods for diagnosis and characterization of viral pathogens causing acute respiratory tract infections. Compared to the case in 1986, molecular techniques are now the preferred diagnostic approaches for the detection of acute respiratory viruses, and they allow for automation, high-throughput workflows, and near-patient testing. These changes require quality assurance programs to prevent laboratory contamination as well as strong preanalytical screening approaches to utilize laboratory resources appropriately. Appropriate guidance from laboratorians to stakeholders will allow for appropriate specimen collection, as well as correct test ordering that will quickly identify highly transmissible emerging pathogens.

Comparative epidemiology of influenza A and B viral infection in a subtropical region: a 7-year surveillance in Okinawa, Japan

BACKGROUND

The epidemic patterns of influenza B infection and their association with climate conditions are not well understood. Influenza surveillance in Okinawa is important for clarifying transmission patterns in both temperate and tropical regions. Using surveillance data, collected over 7 years in the subtropical region of Japan, this study aims to characterize the epidemic patterns of influenza B infection and its association with ambient temperature and relative humidity, in a parallel comparison with influenza A.

METHODS

From January 2007 until March 2014, two individual influenza surveillance datasets were collected from external sources. The first dataset, included weekly rapid antigen test (RAT) results from four representative general hospitals, located in the capital city of Okinawa. A nation-wide surveillance of influenza, diagnosed by RAT results and/or influenza-like illness symptoms, included the age distribution of affected patients and was used as the second dataset. To analyze the association between infection and local climate conditions, ambient temperature and relative humidity during the study period were retrieved from the Japanese Meteorological Agency website.

RESULTS

Although influenza A maintained high number of infections from December through March, epidemics of influenza B infection were observed annually from March through July. The only observed exception was 2010, when the pandemic strain of 2009 dominated. During influenza B outbreaks, influenza patients aged 5 to 9 years old and 10 to 14 years old more frequently visited sentinel sites. Although both ambient temperature and relative humidity are inversely associated with influenza A infection, influenza B infection was found to be directly associated with high relative humidity.

CONCLUSION

Further studies are needed to elucidate the complex epidemiology of influenza B and its relationship with influenza A. In the subtropical setting of Okinawa, epidemics of influenza B infection occur from March to July following the influenza A epidemic, and primarily affect school-age children. These findings help to define unknown aspects of influenza B and can inform healthcare decisions for patients located outside temperate regions.

Analytical performance of the BD veritor™ system for rapid detection of influenza virus A and B in a primary healthcare setting

Background

Infections with influenza A virus cannot be clinically differentiated from infections caused by influenza B virus or other respiratory viruses. Additionally, although antiviral treatment is available for influenza A virus, it is not effective for the other viruses and must be initiated early in the course of disease for it to be effective. For these reasons, there is a need for a rapid, accurate diagnostic test for use in physicians’ offices at the time patients are seen. We report the first field performance of BD Veritor™ System for Rapid Detection of Flu A + B test compared to real time PCR. The performance of this test was compared to real time PCR performed in the Istanbul University Influenza Reference Laboratory.

Method

A single-blinded cross sectional study was conducted in nine different family medicine centers in Istanbul, Turkey between 01 November 2014 and 01 May 2015. For every patient, two specimens were collected, one for real time PCR and one for the Veritor test. Specimens for the Veritor test were immediately tested at the participating clinic according to the manufacturer’s instructions. The specimens for real time PCR were transferred to the reference laboratory.

Results

A total of 238 persons were included in the study: 72 (30 %) of the patients included in the study were below 19 years old and accepted as childhood group. Mean age of adults was 42.4 and children 10.2 years. A total of 122 patients out of 238 were positive for influenza. The clinical sensitivity and specificity of the Veritor test in all age groups was determined to be 80 and 94 %, respectively. Positive predictive value was 93 % and the negative one was 81 %.

Conclusion

Field performance of the rapid influenza test was high and found to be useful with respect to rational antiviral use, avoiding unnecessary antibiotic usage and the management of cases by the family physicians.

An algorithm to diagnose influenza infection: evaluating the clinical importance and impact on hospital costs of screening with rapid antigen detection tests

Rapid antigen detection tests (RADTs) are immunoassays that produce results in 15 min or less, have low sensitivity (50 %), but high specificity (95 %). We studied the clinical impact and laboratory savings of a diagnostic algorithm for influenza infection using RADTs as a first-step technique during the influenza season. From January 15th to March 31st 2014, we performed a diagnostic algorithm for influenza infection consisting of an RADT for all respiratory samples received in the laboratory. We studied all the patients with positive results for influenza infection, dividing them into two groups: Group A with a negative RADT but positive reference tests [reverse transcription polymerase chain reaction (RT-PCR) and/or culture] and Group B with an initial positive RADT. During the study period, we had a total of 1,156 patients with suspicion of influenza infection. Of them, 217 (19 %) had a positive result for influenza: 132 (11 %) had an initial negative RADT (Group A) and 85 (7 %) had a positive RADT (Group B). When comparing patients in Group A and Group B, we found significant differences, as follows: prescribed oseltamivir (67 % vs. 82 %; p = 0.02), initiation of oseltamivir before 24 h (89 % vs. 97 %; p = 0.03), antibiotics prescribed (89 % vs. 67 %; p = <0.01), intensive care unit (ICU) admissions after diagnosis (23 % vs. 14 %; p = 0.05), and need for supplementary oxygen (61 % vs. 47 %; p = 0.01). An influenza algorithm including RADTs as the first step improves the time of administration of proper antiviral therapy, reduces the use of antibiotics and ICU admissions, and decreases hospital costs.

Evaluation of the Becton Dickinson Rapid Influenza Diagnostic Tests in Outpatients in Germany during Seven Influenza Seasons

BACKGROUND

An extensive retrospective study spanning several seasons was undertaken to evaluate the diagnostic performance of the BD rapid influenza diagnostic test (RIDT) in comparison with the RT-PCR assay.

METHODS

A total of 2,179 respiratory samples were tested in parallel by in-house RT-PCR and the RIDT. During the 2003-2004, 2006-2007, 2007-2008, and 2008-2009 (n=1671) seasons, the BD Directigen Flu A+B test was used, and during the 2010-2011, 2011-2012 and 2012-2013 (n=508) seasons, the BD Directigen EZ Flu A+B test b was used.

RESULTS

The sensitivity, specificity, PPV and NPV for the BD Directigen Flu A+B test calculated for types A and B together were 39%, 99%, 98%, and 56%, respectively. For the BD Directigen EZ Flu A+B test, these values were 47%, 100%, 100%, 55%, respectively. The sensitivity of the BD Directigen Flu A+B test did not differ significantly from season to season or between types A (44%) and B (37%). The sensitivity of the BD Directigen EZ Flu A+B test calculated for type A only was 59%, which was considerably higher than the sensitivity of this test for type B (23%). The sensitivity of the RIDT was approximately 40-50% in children and teenagers, but it was only 18.% in adults aged 20 years and older. The specificity of both RIDTs was very high (>99%) during all seasons.

CONCLUSIONS

Due to their rapid turnaround time, RIDTs can help guide decisions about the clinical management of influenza. Because of the high specificity, a positive result can be interpreted as a true positive, and antiviral therapy as well as appropriate measures to prevent the transmission of influenza can be initiated. The best sensitivity of the RIDT is achieved in children. However, even in this group, the RIDT will only recognize influenza infection in approximately half of the cases, and influenza should still be considered in patients with negative results; negative RIDT results must be confirmed by PCR.