European proficiency testing program for molecular detection and quantitation of hepatitis B virus DNA

Quality evaluation of molecular diagnostic tests for astrovirus, sapovirus and poliovirus: A multicenter study

BACKGROUND

Astrovirus (AstV), Sapovirus (SaV) and Poliovirus (PV) are important pathogens that cause infections in children under five years of age. It is a very important task to systematically monitor and evaluate the diagnostic performance of these viruses in clinical laboratories.

METHODS

In our study, we performed a multicenter evaluation study among 21 laboratories across China using simulated stool samples spiked with self-designed AstV, SaV and PV pseudoviral particles.

RESULTS

The testing capability of 80.0% (16/20, AstV), 52.6% (10/19, SaV), and 25.0% (2/8, PV) of the participating laboratories were found to be "competent" in reporting correct results for all samples. The main type of errors were false negatives. None of the laboratories identified the subtypes of AstV and SaV, and six laboratories specifically identified the subtypes of PV. Lacking of well-trained personnel and adequate funding were the main challenges. From the questionnaire results, 55.6% laboratories (10/18) believe that training personnel could improve the laboratory testing performance.

CONCLUSIONS

The laboratories showed a competent diagnostic performance for AstV, but inferior diagnostic performances for SaV and PV. Sensitivity of detection and the ability for virus typing should be improved clinically. Professional and standardized personnel training is urgently needed to further improve laboratory performance.

First external quality assurance program for bloodstream Real-Time PCR monitoring of treatment response in clinical trials of Chagas disease

Real-Time PCR (qPCR) testing is recommended as both a diagnostic and outcome measurement of etiological treatment in clinical practice and clinical trials of Chagas disease (CD), but no external quality assurance (EQA) program provides performance assessment of the assays in use. We implemented an EQA system to evaluate the performance of molecular biology laboratories involved in qPCR based follow-up in clinical trials of CD. An EQA program was devised for three clinical trials of CD: the E1224 (NCT01489228), a pro-drug of ravuconazole; the Sampling Study (NCT01678599), that used benznidazole, both conducted in Bolivia; and the CHAGASAZOL (NCT01162967), that tested posaconazole, conducted in Spain. Four proficiency testing panels containing negative controls and seronegative blood samples spiked with 1, 10 and 100 parasite equivalents (par. eq.)/mL of four Trypanosoma cruzi stocks, were sent from the Core Lab in Argentina to the participating laboratories located in Bolivia and Spain. Panels were analyzed simultaneously, blinded to sample allocation, at 4-month intervals. In addition, 302 random blood samples from both trials carried out in Bolivia were sent to Core Lab for retesting analysis. The analysis of proficiency testing panels gave 100% of accordance (within laboratory agreement) and concordance (between laboratory agreement) for all T. cruzi stocks at 100 par. eq./mL; whereas their values ranged from 71 to 100% and from 62 to 100% at 1 and 10 par. eq./mL, respectively, depending on the T. cruzi stock. The results obtained after twelve months of preparation confirmed the stability of blood samples in guanidine-EDTA buffer. No significant differences were found between qPCR results from Bolivian laboratory and Core Lab for retested clinical samples. This EQA program for qPCR analysis of CD patient samples may significantly contribute to ensuring the quality of laboratory data generated in clinical trials and molecular diagnostics laboratories of CD.

Use of a Novel Virus Inactivation Method for a Multicenter Avian Influenza Real-Time Reverse Transcriptase—Polymerase Chain Reaction Proficiency Study

Proficiency assessments are important elements in quality control for diagnostic laboratories. Traditionally, proficiency testing for polymerase chain reaction (PCR)–based assays has involved the use of clinical samples, samples “spiked” with live agents or DNA plasmids. Because of government regulations and biosecurity concerns, distribution of live high-consequence pathogens of livestock and poultry, such as avian influenza, is not possible, and DNA plasmids are not technically suitable for evaluating RNA virus detection. Therefore, a proficiency testing panel using whole avian influenza in a diluent containing a phenolic disinfectant that inactivates the virus while preserving the RNA for at least 8 weeks at −70 C was developed and used in a multicenter proficiency assessment for a type A influenza real-time reverse transcriptase (RT)–PCR test. The test, which was highly standardized, except for variation in the real-time RT-PCR equipment used, was shown to be highly reproducible by proficiency testing in 12 laboratories in the United States, Canada, and Hong Kong. Variation in cycle threshold values among 35 data sets and 490 samples was minimal (CV = 5.19%), and sample identifications were highly accurate (96.7% correct identifications) regardless of real-time PCR instrumentation.

Ring test evaluation of the detection of influenza A virus in swine oral fluids by real-time reverse-transcription polymerase chain reaction and virus isolation

The probability of detecting influenza A virus (IAV) in oral fluid (OF) specimens was calculated for each of 13 assays based on real-time reverse-transcription polymerase chain reaction (rRT-PCR) and 7 assays based on virus isolation (VI). The OF specimens were inoculated with H1N1 or H3N2 IAV and serially diluted 10-fold (10(-1) to 10(-8)). Eight participating laboratories received 180 randomized OF samples (10 replicates × 8 dilutions × 2 IAV subtypes plus 20 IAV-negative samples) and performed the rRT-PCR and VI procedure(s) of their choice. Analysis of the results with a mixed-effect logistic-regression model identified dilution and assay as variables significant (P < 0.0001) for IAV detection in OF by rRT-PCR or VI. Virus subtype was not significant for IAV detection by either rRT-PCR (P = 0.457) or VI (P = 0.101). For rRT-PCR the cycle threshold (Ct) values increased consistently with dilution but varied widely. Therefore, it was not possible to predict VI success on the basis of Ct values. The success of VI was inversely related to the dilution of the sample; the assay was generally unsuccessful at lower virus concentrations. Successful swine health monitoring and disease surveillance require assays with consistent performance, but significant differences in reproducibility were observed among the assays evaluated.

Development of magnetic capture hybridization and quantitative polymerase chain reaction for hepatitis B virus covalently closed circular DNA

BACKGROUND

Hepatitis B virus (HBV) covalently closed circular DNA (cccDNA) served as a vital role in the life cycle of the virus and persistent infection. However, specific and quantitative methods for cccDNA detection have not been available.

OBJECTIVES

Our aim was to develop and primarily evaluate a quantitative method for HBV cccDNA based on magnetic capture hybridization and quantitative PCR technology.

MATERIALS AND METHODS

The functionalized-nanoparticles specifically to capture HBV cccDNA, located on both sides of relaxed circle DNA (rcDNA) gap, were designed. Then, magnetic capture hybridization and quantitative PCR (MCH-qPCR) assay were developed and its performance was primarily evaluated with cccDNA standards and serum samples of patients with chronic hepatitis B.

RESULTS

Specific nanoparticles of cccDNA capture were prepared and a magnetic capture hybridization and quantitative assay method for cccDNA was developed successfully. The limit of detection was 90 IU/mL, and a good linear relationship in the range of 10(2)-10(6) IU/mL was revealed (r(2) = 0.994) with the MCH-qPCR. Compared with directly real-time PCR, a high content of HBV DNA did not affect the detection of cccDNA for the MCH-qPCR method, and there was no cross-reactivity between cccDNA and rcDNA.

CONCLUSIONS

The novel MCH-qPCR method has good sensitivity and specificity. It could meet the requirement of clinical routine detection.

Multicenter external quality assessment program for PCR detection of Mycobacterium ulcerans in clinical and environmental specimens

BACKGROUND

Mycobacterium ulcerans is the causative agent of Buruli ulcer (BU), a necrotizing disease of the skin, soft tissue and bone. PCR is increasingly used in the diagnosis of BU and in research on the mode of transmission and environmental reservoir of M. ulcerans.

METHODOLOGY/PRINCIPAL FINDINGS

The aim of this study was to evaluate the performance of laboratories in detecting M. ulcerans using molecular tests in clinical and environmental samples by implementing sequential multicenter external quality assessment (EQA) programs. The second round of the clinical EQA program revealed somewhat improved performance.

CONCLUSIONS/SIGNIFICANCE

Ongoing EQA programs remain essential and continued participation in future EQA programs by laboratories involved in the molecular testing of clinical and environmental samples for M. ulcerans for diagnostic and research purposes is strongly encouraged. Broad participation in such EQA programs also benefits the harmonization of quality in the BU research community and enhances the credibility of advances made in solving the transmission enigma of M. ulcerans.

A 10-year human hepatitis B virus nucleic test external quality assessment in China: continual improvement

BACKGROUND

Remarkable progress has been made in the quality assurance of Hepatitis B virus (HBV) DNA nucleic amplification techniques (NAT) during the past decade. And this report presents a 10-year external quality assessment (EQA) program performed by National Center for Clinical Laboratories in China since 2003.

METHOD

EQA panels were produced using freeze-dried HBV plasma or negative controls and then calibrated against the first International Standard for HBV DNA.

RESULTS

By 2012, total 35,570 qualitative EQA reports and 56,826 quantitative reports have been collected. The overall correct recognition rate in qualitative test increased from 95.15% in 2003 to 97.99% in 2012. The proportion of participants with acceptable quantitative results also rose to 87.99% in 2012 compared with that of 27.53% in 2003. Besides, we observed a satisfactory reproducibility of <5% in all parallel samples. However, some laboratories still had difficulties in exact quantification of some low viral loads, which near to the limits of the dynamic range of the assays.

CONCLUSION

Taking together, current EQA program showed an encouraging improvement of HBV DNA NAT in China. Distributing more challenging samples and increasing the subtypes are still needed in the future.

Global proficiency study of human papillomavirus genotyping

Internationally comparable quality assurance of Human Papillomavirus (HPV) DNA detection and typing methods is essential for evaluation of HPV vaccines and effective monitoring and implementation of HPV vaccination programs. Therefore, the World Health Organization (WHO) HPV Laboratory Network (LabNet) designed an international proficiency study. Following announcement at the WHO website, the responding laboratories performed HPV typing using one or more of their usual assays on 43 coded samples composed of titration series of purified plasmids of 16 HPV types (HPV6, -11, -16, -18, -31, -33, -35, -39, -45, -51, -52, -56, -58, -59, -66, and -68). Detection of at least 50 IU of HPV16 or HPV18 DNA and of 500 genome equivalents (GE) of the other 14 HPV types (in samples with single and multiple HPV types) was considered proficient. Fifty-four laboratories worldwide submitted a total of 84 data sets. More than 21 HPV-genotyping assays were used. Commonly used methods were Linear Array, Lineblot, InnoLiPa, Clinical Array, type-specific real-time PCR, PCR-Luminex and microarray assays. The major oncogenic HPV types (HPV16 and -18) were detected in 89.7% (70/78) and 92.2% (71/77) of the data sets, respectively. HPV types 56, 59, and 68 were the least commonly detected types (in less than 80% of the data sets). Twenty-eight data sets reported multiple false-positive results and were considered nonproficient. In conclusion, we found that international proficiency studies, traceable to international standards, allow standardized quality assurance for different HPV-typing assays and enable the comparison of data generated from different laboratories worldwide.

Multicenter external quality assessment of molecular methods for detection of human herpesvirus 6

The purpose of this study was to evaluate the performance of laboratories for the detection and quantification of human herpesvirus 6 (HHV-6) by an external quality assessment (EQA) evaluation. The HHV-6 EQA panel consisted of eight samples containing various concentrations of HHV-6 type A (strain GS) or type B (strain Z29), two samples containing other herpesviruses (i.e., human cytomegalovirus [HCMV] and Epstein-Barr virus [EBV]), and two HHV-6-negative samples. Panel samples were prepared in human plasma, heat inactivated, and lyophilized. Panel distribution, data management, and analysis were coordinated by Quality Control for Molecular Diagnostics (QCMD), Glasgow, United Kingdom. Fifty-one laboratories participated and submitted 57 data sets. Eleven (19.3%) data sets were generated using conventional in-house assays, 11 (19.3%) data sets using commercial real-time PCR assays, and 35 (61.4%) data sets using in-house real-time PCR assays. The presence of HHV-6 DNA at viral loads exceeding 6,000 copies/ml was detected by all participants, and over 80% of the participants still reported correct qualitative results for the sample containing just over 200 copies/ml. The false-positivity rate was 1.8% for both the negative samples and the samples containing HCMV or EBV DNA. The majority (23/33; 69.7%) of quantitative data sets were generated using in-house real-time PCR assays. The standard deviations of the geometric means of the samples ranged from 0.5 to 0.7 log(10). The results of this first international EQA demonstrate encouraging analytical sensitivity for the detection of HHV-6-DNA in human plasma, although we observed extensive interlaboratory variation of quantitative HHV-6 DNA results. Standardization needs to be improved to allow further elucidation of the clinical significance of HHV-6 loads.

Molecular Diagnostics and Comparative Genomics in Clinical Microbiology

Initially, the availability of molecular diagnostics was considered a panacea, but replacement of conventional tests for detection and identification of microorganisms by molecular procedures eventually gathered momentum. This chapter describes current state-of-the-art molecular diagnostics and comparative genomics in medical microbiology to provide an understanding of infectious disease over the coming years. Nucleic acid-based tests are being introduced with increasing speed into routine clinical microbiology laboratories. Some of the problems remaining to be solved prior to general acceptance of nucleic acid-mediated detection and identification of microbial pathogens are reviewed. Historic objections are slowly being taken apart, and an accelerated introduction of molecular diagnostics is being pursued in many cases. Clear improvement in clinical testing is achieved by introducing molecular tests. Therefore, swift introduction of such tests into clinical practice is important to be pursued. Several PCR tests show increased sensitivity, excellent specificity, and cost effectiveness highlighting the success of the novel applications in the field of bacterial infections. Finally, some of the problems remaining to be solved prior to general acceptation of nucleic acid-mediated detection and identification of microbial pathogens are also reviewed.

TREAT Asia Quality Assessment Scheme (TAQAS) to standardize the outcome of HIV genotypic resistance testing in a group of Asian laboratories

The TREAT Asia (Therapeutics, Research, Education, and AIDS Training in Asia) Network is building capacity for Human Immunodeficiency Virus Type-1 (HIV-1) drug resistance testing in the region. The objective of the TREAT Asia Quality Assessment Scheme - designated TAQAS - is to standardize HIV-1 genotypic resistance testing (HIV genotyping) among laboratories to permit rigorous comparison of results from different clinics and testing centres. TAQAS has evaluated three panels of HIV-1-positive plasma from clinical material or low-passage, culture supernatant for up to 10 Asian laboratories. Laboratory participants used their standard protocols to perform HIV genotyping. Assessment was in comparison to a target genotype derived from all participants and the reference laboratory's result. Agreement between most participants at the edited nucleotide sequence level was high (>98%). Most participants performed to the reference laboratory standard in detection of drug resistance mutations (DRMs). However, there was variation in the detection of nucleotide mixtures (0-83%) and a significant correlation with the detection of DRMs (p<0.01). Interpretation of antiretroviral resistance showed approximately 70% agreement among participants when different interpretation systems were used but >90% agreement with a common interpretation system, within the Stanford University Drug Resistance Database. Using the principles of external quality assessment and a reference laboratory, TAQAS has demonstrated high quality HIV genotyping results from Asian laboratories.

Interlaboratory comparison of cytomegalovirus viral load assays

To assess interlaboratory variability in qualitative and quantitative cytomegalovirus (CMV) viral load (VL) testing, we distributed a panel of samples to 33 laboratories in the USA, Canada and Europe who performed testing using commercial reagents (n = 17) or laboratory-developed assays (n = 18). The panel included two negatives, seven samples constructed from purified CMV nucleocapsids in plasma (2.0-6.0 log(10) copies/mL) and three clinical plasma samples. Interlaboratory variation was observed in both actual (range, 2.0-4.0 log(10) copies/mL) and self-reported lower limits of detection (range, 1.0-4.0 log(10) copies/mL). Variation observed in reported results for individual samples ranged from 2.0 log(10) (minimum) to 4.3 log(10) (maximum)(.) Variation was greatest at low VLs. Assuming +/- 0.5 log(10) relative to the expected result represents an acceptable result, 57.6% of results fell within this range. Use of commercially available reagents and procedures was associated with less variability compared with laboratory-developed assays. Interlaboratory variability on replicate samples was significantly greater than intralaboratory variability (p < 0.0001). The significant interlaboratory variability in CMV VL observed may be impacting patient care and limiting interinstitutional comparisons. The creation of an international reference standard for CMV VL assay calibration would be an important step in quality improvement of this laboratory tool.

Evaluation of two avian influenza type A rapid antigen tests under Indonesian field conditions

The current study evaluated the test characteristics of 2 commercially available rapid antigen tests for highly pathogenic avian influenza. Diagnostic specimens were collected from free-ranging village chickens in Indonesia. A total of 174 healthy, sick, and dead birds were included in the study. The relative diagnostic test sensitivity and the relative diagnostic test specificity were calculated by using real-time reverse transcription polymerase chain reaction (RT-PCR) as the confirmatory diagnosis. The AnigenR Rapid AIV Ag test had a relative diagnostic sensitivity of 0.69 (95% confidence interval [CI]: 0.56-0.80) and a relative diagnostic specificity of 0.98 (95% CI: 0.93-0.99). The Flu Detect(TM) Antigen Capture test strip had a relative diagnostic sensitivity of 0.71 (95% CI: 0.58-0.82) and a relative diagnostic specificity of 0.98 (95% CI: 0.93-0.99). These tests are a valuable tool for the Indonesian avian influenza control program by reliably and quickly detecting Influenza A virus from oropharyngeal swabs from sick or dying chickens.

Prolonged antiviral therapy for hepatitis B virus-infected health care workers: a feasible option to prevent work restriction without jeopardizing patient safety

To prevent transmission of hepatitis B virus (HBV) from health care workers (HCWs) to patients, highly viraemic HCWs are often advised to restrict performing exposure prone procedures (EPPs). To prevent loss of highly qualified medical personnel and simultaneously minimize transmission risk to patients, we offered highly viraemic HCWs antiviral therapy and evaluated the effects of this strategy. Eighteen chronic HBV-infected HCWs have been monitored every 3-6 months for a median period of 5.6 years (range 1.1-12.5 years). Antiviral therapy was offered if HBV DNA was above 10(5) copies/mL and EPPs were performed or active liver disease was present. Median HBV DNA levels, the percentage of days with HBV DNA above 10(3), 10(4) and 10(5) copies/mL, and reduction of HBV DNA during antiviral treatment have been analysed for hepatitis B e antigen (HBeAg)-positive and HBeAg-negative HCWs separately. Prolonged viral suppression was achieved in both HBeAg-positive, as well as HBeAg-negative HCWs. In HBeAg-negative HCWs treatment with interferon or lamivudine maintained HBV DNA levels below 10(5) copies/mL. For HBeAg-positive HCWs continuous treatment with tenofovir or entecavir was essential for reaching low viraemia persistently. In 2004, median HBV DNA levels in both HBeAg-negative and HBeAg-positive HCWs were below 10(3) copies/mL and all HCWs executed their professional work full-range. For both HBeAg-positive and HBeAg-negative HCWs, antiviral treatment is effective in persistent suppression of virus levels below 10(5) copies/mL. This observation supports antiviral therapy as a viable management option instead of work restriction, with the provision of regular expert monitoring including quantification of HBV DNA.

Three years of multi-laboratory external quality control for the molecular detection of Toxoplasma gondii in amniotic fluid in France

Between 2002 and 2004, panels of amniotic fluid containing varying concentrations of Toxoplasma gondii were sent to up to 23 laboratories in France for molecular (PCR-based) detection as part of a national quality assurance initiative in the molecular prenatal diagnosis of toxoplasmosis. Participants were free to enroll and no fees were required. The general level of sensitivity was high, and the rate of false-positive reactions was relatively low. Considerable diversity among PCR methods and primers was revealed. This external quality assurance scheme provided the opportunity to improve laboratory practice and performance, and to increase communication among laboratories involved in making this diagnosis.

Detection and quantification of hepatitis B virus DNA by SYBR green real-time polymerase chain reaction

A single-round real-time polymerase chain reaction (PCR) assay based on SYBR green dye technology for the detection and quantification of hepatitis B virus (HBV) DNA in serum was evaluated and compared with a qualitative nested PCR and the Cobas Amplicor HBV Monitor assay (Roche Molecular Diagnostics, Milan, Italy). The performance of the real-time PCR assay was evaluated in a routine clinical laboratory setting with a total of 212 clinical specimens. The sensitivity of the real-time PCR corresponded to 31 IU/ml (70 copies/ml), and comparison with the qualitative nested PCR showed significant concordance for 94% of samples. The linear curve over 7 log units, spanning 10(3)-10(9) IU/ml (2.28 x 10(3) to 2.28 x 10(9) copies/ml), was observed in the quantitative determination. The interexperimental variability coefficient of the assay ranged from 0.22 to 0.39 and the intraexperimental variability coefficient from 0.24 to 0.41. By excluding values outside of the dynamic ranges of both tests, the HBV Monitor and the real-time PCR gave an agreement within +/-1 log unit for 90% of samples, while those for the remaining 10% were found to be above 1 log unit but less than 1.5 log units. When the results inside and outside the dynamic range of the HBV Monitor were examined, 90% of the results were in agreement. In conclusion, the real-time PCR based on SYBR green technology proved suitable for routine diagnostic purposes, showing good sensitivity, high specificity, high reproducibility, and good linearity over a broad dynamic range of quantification.

Follow-up on diagnostic proficiency of laboratories equipped to perform orthopoxvirus detection and quantification by PCR: the second international external quality assurance study

Two years after the first external quality assurance study on bioterrorism-relevant viruses, we have conducted a follow-up study on orthopoxvirus detection by PCR. Thirty-three laboratories (27 European, 4 Austral-Asian, and 2 American) participated. Samples contained 0 to 40,000,000 DNA copies of lyophilized monkeypox, cowpox, and vaccinia virus per ml. Laboratories achieved a >80% detection chance above 56,234 copies per ml. Global sensitivity was not significantly improved over that of the first study. Twenty-seven and 9 participants, respectively, were able to genotype and quantify virus. Four of 27 genotyping results were incorrect. Quantification accuracy was significantly better for vaccinia virus than for the other viruses. False-positive results occurred in 22 (11.8%) of all 186 tests on negative samples, but 18 of these were contributed by only five laboratories. Fifty-five percent of laboratories could appropriately detect PCR inhibition. The use of either real-time PCR or commercial diagnostic kits had significant positive influence on laboratory performance.

Two quality control exercises involving nucleic acid amplification methods for detection of Mycoplasma pneumoniae and Chlamydophila pneumoniae and carried out 2 years apart (in 2002 and 2004)

The quality performance of laboratories for the detection of Mycoplasma pneumoniae and Chlamydophila pneumoniae by two quality control (QC) exercises with a 2-year interval was investigated. For the 2002 QC exercise, specimens were spiked with M. pneumoniae at concentrations of 5,000, 500, 50, and 0 color-changing units (CCU)/100 microl. The limit of detectability was 50 CCU/100 microl. Therefore, this concentration was omitted from the 2004 panel and was excluded from the analysis. In 2002, 2 out of 12 participants obtained 100% correct results, 2 out of 12 produced false-positive results, and 10 out of 12 had between 0 out of 9 and 8 out of 9 correct positive results. In 2004, correct results were obtained in 15 out of 18 tests, and no false-positive results were reported. In 2002, specimens were spiked with C. pneumoniae at concentrations of 490, 49, 4.9, and 0 inclusion-forming units/100 microl (IFU/100 microl). In the 2004 panel, samples spiked with a lower dilution of 0.49 IFU/100 microl were added to the panel. For the C. pneumoniae QC, correct results were produced in 12 out of 16 and 13 out of 18 tests in 2002 and in 2004, respectively. Both multiplex PCR and nucleic acid sequence-based amplification (NASBA) formats scored a smaller number of samples positive than the monoplex reactions.

Benchmark for evaluating the quality of DNA sequencing: proposal from an international external quality assessment scheme

BACKGROUND

In the past 15 years, clinical laboratory science has been transformed by the use of technologies that cross the traditional boundaries between laboratory disciplines. However, during this period, issues of quality have not always been given adequate attention. The European Molecular Genetics Quality Network (EMQN) has developed a novel external quality assessment scheme for evaluation of DNA sequencing. We report the results of an international survey of the quality of DNA sequencing among 64 laboratories from 21 countries.

METHODS

Current practice for DNA sequence analysis was established by use of an online questionnaire. Participating laboratories were provided with 4 DNA samples of validated genotype. Evaluation of the results included assessing the quality of sequence data, variant genotypes, and mutation nomenclature. To accommodate variations in mutation nomenclature, variants indicated by participants were scored for compliance with 3 acceptable marking schemes.

RESULTS

A total of 346 genotypes were analyzed. Of these, 19 (5%) genotyping errors were made. Of these, 10 (53%) were false-negative and 9 (47%) were false-positive results. A further 27 (8%) errors were made in naming mutations. Results were analyzed for 3 indicators of data quality: PHRED quality scores, Quality Read Length, and Quality Read Overlap. Most laboratories produced results of acceptable diagnostic quality as judged by these indicators. The results were used to calculate a consensus benchmark for DNA sequencing against which individual laboratories could rank their performance.

CONCLUSIONS

We propose that the consensus benchmark can be used as a baseline against which the aggregate and individual laboratory standard of DNA sequencing may be tracked from year to year.

Results of the first World Health Organization international collaborative study of detection of human papillomavirus DNA

Twenty-nine laboratories in 12 countries participated in a study to assess the performance of various human papillomavirus (HPV) detection assays through the use of a recombinant HPV DNA standard reagent panel. The panel was designed by a group of HPV experts, and samples were prepared and distributed by the World Health Organization International Laboratory for Standards and Biologicals in The Netherlands. Each panel consisted of 24 coded samples including a dilution series for HPV types 16 and 18, alone or in combination with five other high-risk (HR) HPV types including HPV types 31, 33, 35, 45, and 52, the low-risk HPV type 6, and a negative control. Qualitative assays were generally consistent across laboratories, and most invalid results reflected a lack of HPV test sensitivity. The combined data sets had a proficiency for HPV 16 of 62.5% (15/24) and for HPV 18 of 73.9% (17/23). HPV 31 was the least accurately detected by participating laboratories. Approximately half of participating laboratories failed to detect high concentrations of HPV 31 and, to a lesser extent, to detect HPV types 35, 52, and 6. The panel sample materials offer a source of renewable and reproducible material that could be used in the future development of international standard reagents for calibration of HPV DNA assays and kits.

Hepatitis B virus (HBV) DNA levels and the management of HBV-infected health care workers

Different guidelines exist for the management of hepatitis B virus (HBV)-infected health care workers (HCWs). Various HBV DNA levels are used as a cutoff level to determine whether an HBV-infected HCW is allowed to perform exposure-prone procedures (EPPs) or not. In this paper we discuss the factors that determine HBV DNA levels and the implications of different HBV DNA cutoff levels for EPP performing HCWs. If the level of HBV DNA in the serum of HCWs is used to determine acceptability for the conduct of EPPs, it is necessary to take into account the variability in time of HBV DNA levels in HBV carriers and the reliability and reproducibility of the molecular diagnostic test involved. The issue of standardization has to be addressed, before a universal, maximum level of viraemia for EPP performing HCWs can be introduced.

Confidence in polymerase chain reaction diagnosis can be improved by Bayesian estimation of post-test disease probability

OBJECTIVE

Polymerase chain reaction (PCR) techniques allow highly sensitive detection of specific DNA for diagnosis of infectious and genetic disease, but uncertainty relating to sensitivity and contamination has frequently resulted in controversy over results. We propose a new design in which the PCR contamination rate is estimated experimentally. The sensitivity of duplicate test results, and hence the post-test disease probabilities, can be derived algebraically, but wide confidence limits around these point estimates reduce their usefulness.

STUDY DESIGN AND SETTING

We have developed a Bayesian method which gives better estimates of post-test disease probability and can substantially reduce uncertainty by using the prior belief that sensitivity is not lower than 90%.

RESULTS

With 100 duplicate test samples and 100 control samples, we find that the post-test disease probability for concordant results (both positive or both negative) is generally unequivocal. The post-test disease probability for discordant results (one test positive and one negative) is often sufficiently clear to allow useful interpretation of individual test results, depending on the context.

CONCLUSION

Using this approach, the performance of a PCR can be evaluated experimentally allowing post-test disease probability to be estimated, giving improved confidence in test results.

External quality assessment for molecular detection of Bordetella pertussis in European laboratories

Although the PCR for the detection of Bordetella pertussis is routinely performed in diagnostic laboratories, no quality assessment program has so far been described. We report on the results obtained with two external quality assessment proficiency panels sent to European laboratories. The first proficiency panel contained a series of dilutions of three previously characterized B. pertussis clinical isolates and two negative controls. No false-positive results were reported by six laboratories providing seven data sets. The reported limits of detection of the three B. pertussis strains varied between 4 and 4,000, 9 and 9,000, and 3 and 30,000 CFU/ml, respectively. The second proficiency panel, composed of a series of dilutions of reference strains of B. pertussis, B. holmesii, B. hinzii, and B. bronchiseptica, as well as negative controls, was sent to nine laboratories. One laboratory reported a negative result for a sample and reported a B. parapertussis-positive sample to be positive for B. pertussis. By using the B. pertussis-specific target gene pertactin, one laboratory detected B. pertussis with 100% specificity. All other laboratories, which used IS481-based assays, reported positive results for the samples containing B. holmesii and B. bronchiseptica, species that have occasionally been recovered from human respiratory samples. These data show that the choice of the target gene is particularly critical for the species specificity of B. pertussis PCR assays.

Assessment of the target-capture PCR hepatitis B virus (HBV) DNA quantitative assay and comparison with commercial HBV DNA quantitative assays

Recent clinical studies suggest that hepatitis B virus (HBV) load and genotype may be independent predictors of responses to antiviral therapies. However, it is difficult for clinicians to accurately determine viral loads in patient samples because results--both the values and the units of measure--can vary greatly among different tests. Accordingly, the World Health Organization (WHO) has produced the first international standard for HBV DNA for nucleic acid amplification technology (NAT) assays. In the present study, we describe the performance of the target-capture PCR HBV DNA quantitative assay for the quantitation of HBV DNA in clinical samples and reference panels. The range of quantitation was between 50 and 10(10) IU/ml. The sensitivity and accuracy of the target-capture PCR assay were demonstrated by using the HBV panel from Quality Control for Medical Diagnostics (QCMD) and the WHO HBV DNA standard. The target-capture PCR assay quantitated the six genotype A members of the QCMD panel and dilutions of the WHO HBV DNA standard within an accuracy of 74 to 142%. Compared to current serological methods, the assay offers window period reductions of 19 days prior to HBV surface antigen and 26 days prior to HBV e antigen detection. The target-capture PCR assay was also compared with four commercially available NAT assays, and the various units of measure were standardized with respect to the international units of the WHO HBV DNA standard. The target-capture PCR assay is a sensitive, accurate, high-throughput, rapid, and reproducible assay for the determination of HBV loads.

Quantitative detection of circulating tumor cells in cutaneous and ocular melanoma and quality assessment by real-time reverse transcriptase-polymerase chain reaction

PURPOSE

Inconsistent reports on the detection of melanoma cells in peripheral blood by reverse transcriptase-PCR (RT-PCR) have resulted in uncertainty on the prognostic value of circulating melanoma cells.

EXPERIMENTAL DESIGN

We developed real-time RT-PCR assays for quantitation of tyrosinase, MelanA/MART1, and gp100 and for porphobilinogen deaminase housekeeping gene. Melanoma tissue (n = 18), peripheral blood samples from healthy donors (n = 21), and patients with cutaneous (n = 122) and uveal (n = 64) melanoma from our institution were analyzed. For quality control, an additional 251 samples from ongoing multicenter studies were compared with in-house samples.

RESULTS

Tyrosinase was not detected in healthy donor blood samples. For the two other markers, cutoff values had to be defined to distinct patient samples from controls. Patients with stage IV uveal and cutaneous melanoma expressed all three markers more frequently and at higher levels in peripheral blood as compared with earlier stages. The variation of expression was 4 logs and correlated with tumor load and serum lactate dehydrogenase. In 2 of 3 uveal melanoma patients, detection of circulating tumor cells preceded the development of liver metastases. The diagnostic sensitivity was optimal in blood samples containing >0.1pg/ microl porphobilinogen deaminase (95.7% of in-house samples and 57.4% of multicenter samples).

CONCLUSIONS

Real-time RT-PCR is able to quantitatively define the quality of a sample and provides quantitative data for melanoma markers. Disparities in the results of previous studies may be attributable to undetected differences in sample quality. The prognostic relevance of this assay is currently under evaluation in several prospective randomized trials.

External quality control assessment in PCR diagnostics of dengue virus infections

BACKGROUND

Increased travelling to countries endemic for dengue fever (DF) demands efficient laboratory diagnostics. Nucleic acid amplification techniques (NAT) are now frequently used for rapid diagnosis of imported viral diseases. Different PCR systems are available.

OBJECTIVES

In order to assess the quality of molecular diagnostics of dengue virus infections, an external quality assurance (EQA) in PCR diagnostics was conducted.

STUDY DESIGN

A panel of 10 human plasma samples was prepared and spiked with dengue virus types DEN-1 to DEN-4. In addition, a 10-fold dilution series (1:10-1:10(4) ) of DEN-3 virus was included. The panel was pre-tested by nested RT-PCR, in-house real-time PCR, and a commercial real-time PCR kit. The samples were inactivated by gamma irradiation and shipped in freeze dried state. Thirteen laboratories, within the European network for the diagnostics of imported viral diseases (ENIVD) took part using either single-round, nested, or real-time RT-PCR methods. Two laboratories used two methods in parallel, summarising up to 15 comparable results.

RESULTS

33-100% correct results were achieved. All laboratories detected DEN-2 correctly, followed by DEN-1 (14 positive results of 15), DEN-3 (12/15) and DEN-4 (11/15). Testing of the serial dilution revealed low sensitivity in many labs, with results ranging from 33 to 80% of correctly tested samples.

CONCLUSION

The EQA gives a feedback of the quality of the RT-PCR system used by each respective laboratory. The different test systems and amplification conditions demonstrate the importance of external quality control measures.

Multicentre quality control study for detection of Mycobacterium tuberculosis in clinical samples by nucleic amplification methods

The aim of this study was to evaluate the laboratory performance of nucleic acid amplification tests (NATs) for detection of the Mycobacterium tuberculosis complex. A proficiency panel consisting of eight sputum specimens and four specimens diluted in phosphate-buffered saline (PBS) was sent to 82 laboratories in 23 countries by the Quality Control for Molecular Diagnostics (QCMD) TB programme. The performance of different NATs was analysed in combination with a questionnaire on the applied methods. Seventy-eight participants (95.2%) contributed a total of 85 evaluable data sets. The percentage of correct results on the eight sputum samples was 86.3% (586/679). Of the sputum specimens considered as 'smear-negatives' (650 CFU/250 micro L), only 61.2% (104/170) were reported positive. The percentage of correct results for the three scored PBS samples was 75.7% (193/255). The total number of false-positive results was 11 (4.3%); these were reported for seven (8.2%) of the 85 data sets. In 32 (37.6%) data sets an 'in-house' NAT method was used, and in 53 (62.4%) sets a commercial assay was tested. The percentage of data sets achieving correct results on all sputum samples was 35.3% and 37.8%, respectively. For the PBS samples this was 45.8% and 41.5%. Overall, the results of this study demonstrated that the performance of NATs for the detection of M. tuberculosis has improved since previous studies. The percentage of false-positives has decreased considerably. However, a large number of procedures still lack sufficient sensitivity for application to smear-negative samples.

Fully automated, internally controlled quantification of hepatitis B Virus DNA by real-time PCR by use of the MagNA Pure LC and LightCycler instruments

We report on the development of a fully automated real-time PCR assay for the quantitative detection of hepatitis B virus (HBV) DNA in plasma with EDTA (EDTA plasma). The MagNA Pure LC instrument was used for automated DNA purification and automated preparation of PCR mixtures. Real-time PCR was performed on the LightCycler instrument. An internal amplification control was devised as a PCR competitor and was introduced into the assay at the stage of DNA purification to permit monitoring for sample adequacy. The detection limit of the assay was found to be 200 HBV DNA copies/ml, with a linear dynamic range of 8 orders of magnitude. When samples from the European Union Quality Control Concerted Action HBV Proficiency Panel 1999 were examined, the results were found to be in acceptable agreement with the HBV DNA concentrations of the panel members. In a clinical laboratory evaluation of 123 EDTA plasma samples, a significant correlation was found with the results obtained by the Roche HBV Monitor test on the Cobas Amplicor analyzer within the dynamic range of that system. In conclusion, the newly developed assay has a markedly reduced hands-on time, permits monitoring for sample adequacy, and is suitable for the quantitative detection of HBV DNA in plasma in a routine clinical laboratory.

Molecular and diagnostic clinical virology in real time

During the last decade, the application of both qualitative and quantitative nucleic acid detection techniques has had a major impact on diagnostics in clinical virology. Both signal and target amplification-based systems are currently used routinely in most if not all virology laboratories. However, commercial assays are only available for a very limited number of targets, and this has resulted in the development and introduction of assays developed in-house for most viral targets. With improved and automated nucleic acid sample isolation techniques, as well as real-time detection methods, a new generation of assays for most clinically important viruses is being developed. These technological improvements also make it possible to generate results with a very short turnaround time. As an example of a more individual-patient disease-management concept, we have introduced in our clinical setting the quantitative detection of Epstein-Barr virus (EBV) in T-cell-depleted allogeneic stem cell transplant patients. This has enabled us to develop models for pre-emptive anti-B-cell immunotherapy for EBV reactivation, and for reducing not only the incidence of EBV lymphoproliferative disease (EBV-LPD), but the virus-related mortality. It is now also feasible to introduce molecular testing for those viruses that can easily be detected using classical virological methods, such as culture techniques or antigen detection. Prospective studies are needed to evaluate the clinical importance of the additional positive samples detected. It should, however, be clear that a complete exchange of technology is unlikely to occur, and that complementary methods should stay operational, making possible the discovery of new viruses. Furthermore, the ability to characterise viruses more easily by sequencing opens new possibilities for epidemiological studies. There is also an urgent need, with regard to molecular diagnostic methods, for the introduction and use of standardised materials and participation in international quality control programmes. Finally, with the introduction of a universal internal control throughout the whole procedure, the accuracy of the results generated is warranted.

An international external quality assessment of nucleic acid amplification of herpes simplex virus

BACKGROUND

There is an increasing awareness of the need for external quality control of diagnostic virology.

OBJECTIVES

To assess the quality of nucleic acid amplification tests (NAT) of herpes simplex within Europe.

STUDY DESIGN

Herpes simplex virus (HSV) proficiency panels were produced at the Swedish Institute for Infectious Disease Control on behalf of the European Union Concerted Action for Quality Control of Nucleic Acid Amplification in 1999 and 2000. Nine reference laboratories evaluated the production process. Each panel consisted of 12 coded samples with various concentrations of inactivated, freeze-dried HSV type 1 (HSV-1), and HSV type 2 (HSV-2), or negative controls. Positive samples included HSV-1 and HSV-2 in a range of concentrations (2 x 10(2) to 2 x 10(7) genome copies per ml) similar to those found in cerebrospinal fluids from patients with HSV encephalitis.

RESULTS

Sixty-six participants reported a total of 76 data sets for panel 1, and 71 reported 78 data sets for panel 2. The majority of the participants employed qualitative 'in-house' polymerase chain reaction (PCR) methods, either in a single, nested or semi-nested format. For panel 2, 9 laboratories reported use of 'real-time' PCR in contrast to 3 for panel 1. Three laboratories submitted quantitative results on both panels. Thirty percent of the data sets had correct results for the entire panel 1. In 6 data sets (8%) a total of 11 false positive results were reported. For panel 2, 28% of the data sets had correct result. Nineteen false positive results were reported in 14 data sets (18%), but most of the incorrect results reflected a lack of test sensitivity.

CONCLUSIONS

The relatively high frequency of false positive results and the large number of false-negative results, albeit at low copy number, stress the need for improvement in the quality of HSV NAT and for external quality control programmes.

Reliability of nucleic acid amplification methods for detection of Chlamydia trachomatis in urine: results of the first international collaborative quality control study among 96 laboratories

The first European Quality Control Concerted Action study was organized to assess the ability of laboratories to detect Chlamydia trachomatis in a panel of urine samples by nucleic acid amplification tests (NATs). The panel consisted of lyophilized urine samples, including three negative, two strongly positive, and five weakly positive samples. Ninety-six laboratories in 22 countries participated with a total of 102 data sets. Of 204 strongly positive samples 199 (97.5%) were correctly reported, and of 506 weakly positive samples 466 (92.1%) were correctly reported. In 74 (72.5%) data sets correct results were reported on all samples, and 17 data sets (16.7%) showed either one false-negative or one false-positive result. In another 11 data sets, two or more incorrect results were reported, and two data sets reported a false-positive result on one negative sample. The Roche COBAS Amplicor test was performed in 44 (43%) data sets, the Abbott LCx assay was performed in 31 (30%) data sets, the Roche Amplicor manual assay was performed in 9 (9%) data sets, an in-house PCR was performed in 9 (9%) data sets, the Becton Dickinson ProbeTec ET assay was performed in 5 (4.9%) data sets, and the GenProbe TMA assay was performed in 4 (3.9%) data sets. The results of the Roche Amplicor manual (95.6% correct), COBAS Amplicor (97.0%), and Abbott LCx (94.8%) tests were comparable (P = 0.48). The results with the in-house PCR, BD ProbeTec ET, and GenProbe TMA tests were reported correctly in 88.6, 98, and 92.5% of the tests, respectively. Freeze-drying of clinical urine specimens proved to be a successful method for generating standardized, stable, and easy-to-transport samples for the detection of C. trachomatis by using NATs. Although the results, especially the specificity, for this proficiency panel were better than most quality control studies, sensitivity problems occurred frequently, underlining the need for good laboratory practice and reference reagents to monitor the performance of these assays.

External quality assurance program for PCR amplification of genomic DNA: an Italian experience

BACKGROUND

External quality assurance (EQA) programs for diagnostic tests based on nucleic acid amplification have not been widely implemented in clinical laboratories and remain limited to few tests. Development of specific EQA programs based on application-based proficiency testing for any diagnostic molecular target is challenging. Development of EQA trials based on methodologic proficiency testing and directed to the evaluation of analytical aspects common to the majority of PCR-based tests may be valuable.

METHODS

We developed an EQA program for evaluation of DNA extraction and amplification and analysis of products after PCR. Participants received a package containing primers and reference materials to evaluate three specific controls for, respectively, DNA extraction (quality and quantity), PCR performance (specificity and efficiency), and interpretation of results after electrophoresis. Each participant was asked to return to the organizers a form with their numerical results and an aliquot of all amplified samples for joint evaluation.

RESULTS

Results varied in all phases of the experimental procedure: preamplification, amplification, and post-PCR interpretation. To give a general estimation on the quality of performances for each laboratory, we designed a score scheme in which the results of any specific action were evaluated on the basis of the distribution around the median consensus values. The maximum possible score was 84. On the basis of total score obtained by each laboratory, we created a qualitative ranking list that provided the final interpretation of results as excellent (>63 points; n = 4 laboratories), good (53-63 points; n = 13), sufficient (42-52 points; n = 15), poor (31-41 points; n = 3), and not acceptable (<31 points; n = 4).

CONCLUSIONS

This survey demonstrates the importance of EQA trials based on methodologic proficiency testing directed to evaluation of analytical aspects common to the majority of PCR-based tests.

The role of the virology laboratory in the management of hepatitis C virus infection

The ability to detect nucleic acids has had and still has a major impact on diagnostics in clinical virology. Both quantitative and qualitative techniques, whether signal or target amplification based systems, are currently used routinely in most if not all virology laboratories. Technological improvements, from automated sample isolation to real time amplification technology, have given the ability to develop and introduce systems for most viruses of clinical interest, and to obtain clinical relevant information needed for optimal antiviral treatment options. Both polymerase chain reaction (PCR) and nucleic acid sequence-based amplification (NASBA) can currently be used together with real time detection to generate results in a short turn-around time and to determine whether variants relevant for antiviral resistance are present. These new technologies enable the introduction of an individual patient disease management concept. Within our clinical setting, we have introduced this e.g. for quantitative detection of Epstein–Barr Virus (EBV) in T-dell depleted allogeneic stem cell transplant patients. This enabled us to develop models for pre-emptive anti B-cell immunotherapy for EBV reactivation, thereby effectively reducing not the incidence of EBV-lymphoproliferative disease but the virus related mortality. Furthermore, additional clinically relevant viruses can now easily be detected simultaneously. It also becomes more feasible to introduce molecular testing for those viruses that can easily be detected using classical virological methods, like culture techniques or antigen detection. Prospective studies are needed to evaluate the clinical importance of the additional positive samples detected. It should however be made clear that a complete exchange of technologies is unlikely to occur, and that some complementary technologies should stay operational enabling the discovery of new viruses. The implementation of these molecular diagnostic technologies furthermore warrants the use and introduction of standardized materials as well as participation in international quality control programs. Finally, the use of an internal control throughout the whole procedure not only ensures the accuracy of the results generated, but also is necessary to enable precise quantification of these results and to determine detection thresholds more accurately. Since so many targets do have clinical implications, laboratories might prefer to use universal internal controls before the in-house developed assays should be introduced in clinical virology.

Quality control in nucleic acid testing--where do we stand?

Quality control has been playing an increasingly important role in the implementation of nucleic acid amplification techniques (NATs) for clinical diagnosis since the introduction of these methods in the early 1990s. Initial multicenter studies involving hepatitis B virus (HBV), hepatitis C virus (HCV), Mycobacterium tuberculosis, and human immunodeficiency virus type 1 (HIV-1) revealed serious problems in specificity (false-positive rates of ca. 40%) and sensitivity, large variations in quantitative results, and a plethora of units (largely not comparable between assays). The problem areas identified included the need for standardized reagents and common units, contamination control mechanisms, inhibition control mechanisms, genotype-independent detection and quantitation, facilitated nucleic acid isolation procedures, clinically relevant dynamic ranges, and internal run controls. Progress made in each of these areas will be discussed. In addition to the above-mentioned problem areas, the value of external quality control of existing and evolving NATs was recognized. To this end, the European Union Quality Control Concerted Action for Nucleic Acid Amplification in Diagnostic Virology was established in May 1998. During its three-and-a-half years of existence, a total of 14 proficiency panels containing 8-13 well-characterized, simulated clinical samples of various viral loads and genotypes were prepared for herpesviruses (herpes simplex virus, human cytomegalovirus), blood-borne viruses (HBV, HCV, HIV-1), enteroviruses, and Chlamydia trachomatis, distributed to up to 20 different countries, and tested by up to 97 different laboratories. The results show dramatic improvement in specificity (false-positive rates <3% for most panels), presumably due to a generally greater expertise of participating laboratories, more frequent use of enzymatic or mechanical contamination control mechanisms, and increased utilization of standardized reagents (commercial kits). However, considerable problems with sensitivity remain (false-negative rates up to 50%), reflecting the high detection limits of some commercial viral load kits still on the market as well as inadequate standardization of quantitation controls between assay systems. In conclusion, although considerable progress has been made, quality control of NATs in clinical diagnosis remains an ongoing challenge.

Clinical virology in real time

The ability to detect nucleic acids has had and still has a major impact on diagnostics in clinical virology. Both quantitative and qualitative techniques, whether signal or target amplification based systems, are currently used routinely in most if not all virology laboratories. Technological improvements, from automated sample isolation to real time amplification technology, have given the ability to develop and introduce systems for most viruses of clinical interest, and to obtain clinical relevant information needed for optimal antiviral treatment options. Both polymerase chain reaction (PCR) and nucleic acid sequence-based amplification (NASBA) can currently be used together with real time detection to generate results in a short turn-around time and to determine whether variants relevant for antiviral resistance are present. These new technologies enable the introduction of an individual patient disease management concept. Within our clinical setting, we have introduced this e.g. for quantitative detection of Epstein-Barr Virus (EBV) in T-dell depleted allogeneic stem cell transplant patients. This enabled us to develop models for pre-emptive anti B-cell immunotherapy for EBV reactivation, thereby effectively reducing not the incidence of EBV-lymphoproliferative disease but the virus related mortality. Furthermore, additional clinically relevant viruses can now easily be detected simultaneously. It also becomes more feasible to introduce molecular testing for those viruses that can easily be detected using classical virological methods, like culture techniques or antigen detection. Prospective studies are needed to evaluate the clinical importance of the additional positive samples detected. It should however be made clear that a complete exchange of technologies is unlikely to occur, and that some complementary technologies should stay operational enabling the discovery of new viruses. The implementation of these molecular diagnostic technologies furthermore warrants the use and introduction of standardized materials as well as participation in international quality control programs. Finally, the use of an internal control throughout the whole procedure not only ensures the accuracy of the results generated, but also is necessary to enable precise quantification of these results and to determine detection thresholds more accurately. Since so many targets do have clinical implications, laboratories might prefer to use universal internal controls before the in-house developed assays should be introduced in clinical virology.

External quality assessment program for qualitative and quantitative detection of hepatitis C virus RNA in diagnostic virology

To assess the performance of laboratories in detecting and quantifying hepatitis C virus (HCV) RNA levels in HCV-infected patients, we distributed two proficiency panels for qualitative and quantitative HCV RNA testing. The panels were designed by the European Union Quality Control Concerted Action, prepared by Boston Biomedica Inc., and distributed in May 1999 (panel 1) and February 2000 (panel 2). Each panel consisted of two negative samples and six positive samples, with HCV RNA target levels from 200 to 500,000 copies/ml. Panel 1 had four samples with at least 50,000 copies/ml, and panel 2 had two samples with at least 50,000 copies/ml. Fifty-seven laboratories submitted 45 qualitative and 35 quantitative data sets on panel 1, and 81 laboratories submitted 75 qualitative and 48 quantitative data sets on panel 2. In both panels, about two-thirds of the qualitative data sets and >90% of the quantitative data sets were obtained with commercial assays. With each panel, two data sets gave one false-positive result, corresponding to false-positivity rates of 1.3% and 0.8% for panel 1 and panel 2, respectively. Samples containing at least 50,000 copies/ml were found positive in 97% and 99% of the cases with panel 1 and panel 2, respectively. In contrast, the positive samples containing < or =5,000 copies/ml were reported positive in only 71% and 77% of the cases with panel 1 and panel 2, respectively. Adequate or better scores on qualitative results (all results correct or only the low-positive samples missed) were obtained in 84% (panel 1) and 80% (panel 2) of the data sets. In the analysis of quantitative results, 60% (panel 1) and 73% (panel 2) of the data sets obtained an adequate or better score (> or =80% of the positive results within the range of the geometric mean +/- 0.5 log(10)). Our results indicate that considerable improvements in molecular detection and quantitation of HCV have been achieved, particularly through the use of commercial assays. However, the lowest detection levels of many assays are still too high, and further standardization is still needed. Finally, this study underlines the importance of proficiency panels for monitoring the quality of diagnostic laboratories.