Assessing subsets of analytes in context of detecting laboratory errors

Laboratory error detection is a hard task yet plays an important role in efficient care of the patients. Quality controls are inadequate in detecting pre-analytic errors and are not frequent enough. Hence population- and patient-based detectors are developed. However, it is not clear what set of analytes leads to the most efficient error detectors. Here, we use three different scoring functions that can be used in detecting errors, to rank a set of analytes in terms of their strength in distinguishing erroneous measurements. We also observe that using evaluations of larger subsets of analytes in our analysis does not necessarily lead to a more accurate error detector. In our data set obtained from renal kidney disease inpatients, calcium, potassium, and sodium, emerged as the top-3 indicators of an erroneous measurement. Using the joint likelihood of these three analytes, we obtain an estimated AUC of 0.73 in error detection.

Quantitative mass spectrometry of unconventional human biological matrices

The development of sensitive and versatile mass spectrometric methodology has fuelled interest in the analysis of metabolites and drugs in unconventional biological specimens. Here, we discuss the analysis of eight human matrices-hair, nail, breath, saliva, tears, meibum, nasal mucus and skin excretions (including sweat)-by mass spectrometry (MS). The use of such specimens brings a number of advantages, the most important being non-invasive sampling, the limited risk of adulteration and the ability to obtain information that complements blood and urine tests. The most often studied matrices are hair, breath and saliva. This review primarily focuses on endogenous (e.g. potential biomarkers, hormones) and exogenous (e.g. drugs, environmental contaminants) small molecules. The majority of analytical methods used chromatographic separation prior to MS; however, such a hyphenated methodology greatly limits analytical throughput. On the other hand, the mass spectrometric methods that exclude chromatographic separation are fast but suffer from matrix interferences. To enable development of quantitative assays for unconventional matrices, it is desirable to standardize the protocols for the analysis of each specimen and create appropriate certified reference materials. Overcoming these challenges will make analysis of unconventional human biological matrices more common in a clinical setting.This article is part of the themed issue 'Quantitative mass spectrometry'.

The assessment of interpretation in clinical biochemistry: a personal view

In many laboratories, clinical biochemists add interpretative comments to laboratory reports. There is, however, little evidence base to support this activity. Interpretative comments attached to reports are quite complex, usually consisting of several components that may suggest possible diagnoses and additional tests. Every comment is different, and assessment of interpretation is difficult. We illustrate different approaches which can be used: assessing whole comments or comment components or key phrases; and using independent assessors or a pooled panel of experts. No approach has yet been optimized: assessment is a guide to and not a definition of exact solutions. Although External Quality Assurance Schemes examining interpretation provide information to individual participants on how their comments compare with others, a more important role of these Schemes is to enable us to pool knowledge, and their primary purpose is educational.

Prospective validation of cerebrospinal fluid bilirubin in suspected subarachnoid haemorrhage

Background: The recommended spectrophotometric scanning for diagnosis of subarachnoid haemorrhage (SAH) is relatively expensive, not fully automated and often requires expert interpretation. Analysis of cerebrospinal fluid (CSF) bilirubin offers an alternative approach and may obviate the need for scanning and, hence, we undertook a prospective validation study.

Methods: CSF bilirubin and spectrophotometric scans were compared from 193 patients in our institution over a two-year period and for this 162 clinical records (83.9%) were reviewed. CSF bilirubin was tested for its ability to predict elevated net bilirubin absorbance by spectrophotometry. Final outcomes were obtained by review of clinical records and contacting the New Zealand Health Information Service.

Results: From receiver operating characteristic curve analysis, there was an area under the curve of 0.99 (95% confidence interval: 0.97-1.00). At a cut-off of 359 nmol/L, corresponding to our upper reference interval, CSF bilirubin assay had a sensitivity of 100%, a specificity of 92.2% and a negative predictive value of 100%. There were no outcomes to suggest that SAH had been missed in any case.

Conclusion: CSF bilirubin is a robust screening test that accurately identifies those samples needing to be scanned and eliminates the need for this to be done in most others.

Timeliness “at a glance”: assessing the turnaround time through the six sigma metrics

Almost thirty years of systematic analysis have proven the turnaround time to be a fundamental dimension for the clinical laboratory. Several indicators are to date available to assess and report quality with respect to timeliness, but they sometimes lack the communicative immediacy and accuracy. The six sigma is a paradigm developed within the industrial domain for assessing quality and addressing goal and issues. The sigma level computed through the Z-score method is a simple and straightforward tool which delivers quality by a universal dimensionless scale and allows to handle non-normal data. Herein we report our preliminary experience in using the sigma level to assess the change in urgent (STAT) test turnaround time due to the implementation of total automation. We found that the Z-score method is a valuable and easy to use method for assessing and communicating the quality level of laboratory timeliness, providing a good correspondence with the actual change in efficiency which was retrospectively observed.

Unnecessary repeated total cholesterol tests in biochemistry laboratory

INTRODUCTION

We aimed to determine the number of repeated cholesterol (RC) tests and the ratio of unnecessary-repeated cholesterol (URC) tests among patients admitted to Pamukkale University Hospital (Denizli, Turkey) and provide solutions to avoid URC testing.

MATERIALS AND METHODS

Total cholesterol (T-cholesterol) tests (N = 86,817) between June 2014 and May 2015 were evaluated. The tests performed more than once per patient were determined as RC test (N = 28,811). RC test with an interval shorter than 4 weeks were determined as URC test (N = 3968) according to the shortest retest interval stated in ACC/AHA blood cholesterol guideline. RC testing included internal medicine, surgery and paediatric outpatients and inpatients. Reference change value (RCV) of total cholesterol was calculated.

RESULTS

The 33.1% of the T-cholesterol tests were RC tests (N = 28,811), 13.7% of them were URC tests (N = 3968). Our RCV value was 25%. The percentage change between consecutive tests was less than RCV in 86.1% (N = 3418) of URC tests. URC tests were performed more frequently in patients with desirable total cholesterol value (P < 0.001).

CONCLUSION

There is a significant part of repeated T-cholesterol tests requested in our hospital. URC test requests can be evaluated by laboratories and the obtained data should be shared with clinicians. Laboratories can calculate RCV for the tests they performed and report this value with the test result. To prevent from URC tests, a warning plug-in can be added to hospital information software in accordance with guidelines to prevent from URC test requests.

Mass Spectrometry in Clinical Laboratory: Applications in Biomolecular Analysis

Mass spectrometry (MS) is a technique that can identify analytes on the basis of mass-to-charge (m/z) ratio. Although this technique has been used in research and specialized clinical laboratories for decades, however, in recent years, MS has been increasingly used in routine clinical laboratories. MS, especially when coupled to gas chromatography or liquid chromatography, provides very specific and often sensitive analysis of many analytes. Other advantages of MS include simultaneous analysis of multiple analytes (>100) and generally without need for specialized reagents. Commonly measured analytes by MS include drugs, hormones, and proteins.

Clinical evaluation of the Nanoduct sweat test system in the diagnosis of cystic fibrosis after newborn screening

After a positive newborn screening test for cystic fibrosis (CF), a sweat test is performed to confirm the diagnosis. The success rate of the generally acknowledged methods (Macroduct/Gibson and Cooke) in newborns varies between 73 and 99%. The Nanoduct sweat test system is easier to perform and less sweat is needed. The main aim of this study was to measure the success rate of the Nanoduct compared to current approved sweat test methods in a newborn population. After informed consent of the parents, newborns with a positive screening test for CF were included. The Macroduct or Gibson and Cooke and Nanoduct were performed in all infants, during the same appointment. The chloride concentration was determined by standard coulorimetry; conductivity was measured directly and converted to a NaCl molarity. One hundred eight newborns were included: 17 with CF, 7 with cystic fibrosis transmembrane regulator (CFTR)-related metabolic syndrome (CRMS), and 84 healthy children. The success rate of the Nanoduct was 93% and for the Macroduct/Gibson and Cooke 79% (McNemar, p = 0.002). The Nanoduct detected the same CF patients as the Macroduct/Gibson and Cooke; one CF patient had an equivocal result for both tests, and no patients were missed. The area under the receiver operating characteristic curve for detection of CF with the Nanoduct was 0.999, with ideal cutoff levels of 91 and 66 mmol/l, comparable to former studies.

CONCLUSION

The success rate of the Nanoduct to collect sufficient sweat in infants was higher compared to the Macroduct and Gibson and Cooke.

Sigma metrics used to assess analytical quality of clinical chemistry assays: importance of the allowable total error (TEa) target

BACKGROUND

Six Sigma metrics were used to assess the analytical quality of automated clinical chemistry and immunoassay tests in a large Belgian clinical laboratory and to explore the importance of the source used for estimation of the allowable total error. Clinical laboratories are continually challenged to maintain analytical quality. However, it is difficult to measure assay quality objectively and quantitatively.

METHODS

The Sigma metric is a single number that estimates quality based on the traditional parameters used in the clinical laboratory: allowable total error (TEa), precision and bias. In this study, Sigma metrics were calculated for 41 clinical chemistry assays for serum and urine on five ARCHITECT c16000 chemistry analyzers. Controls at two analyte concentrations were tested and Sigma metrics were calculated using three different TEa targets (Ricos biological variability, CLIA, and RiliBÄK).

RESULTS

Sigma metrics varied with analyte concentration, the TEa target, and between/among analyzers. Sigma values identified those assays that are analytically robust and require minimal quality control rules and those that exhibit more variability and require more complex rules. The analyzer to analyzer variability was assessed on the basis of Sigma metrics.

CONCLUSIONS

Six Sigma is a more efficient way to control quality, but the lack of TEa targets for many analytes and the sometimes inconsistent TEa targets from different sources are important variables for the interpretation and the application of Sigma metrics in a routine clinical laboratory. Sigma metrics are a valuable means of comparing the analytical quality of two or more analyzers to ensure the comparability of patient test results.

Methods in capillary electrophoresis coupled to mass spectrometry for the identification of clinical proteomic/peptidomic biomarkers in biofluids

Proteomic biomarkers hold the promise of enabling assessment of patients according to a pathological condition aiming at improvements in diagnosis, prognosis, in general clinical patient management. Capillary electrophoresis coupled to an electrospray ionization time-of-flight mass spectrometer (CE-MS) allows the detection of thousands of small proteins and peptides in various biofluids, in a single, reproducible and time-limited step, enabling the simultaneous comparison of multiple individual proteins and peptides in biomarker discovery, but also in clinical applications. The reliability of the CE-MS platform, together with the use of a validated approach for data processing and mining is, to date, the most advanced technique for biomarker discovery of clinical significance. In this chapter, we report on the materials, methods and protocols used for CE-MS-based clinical proteomics allowing the reproducible profiling of biofluids.

Evaluation of the Lipid Interference for Siemens BN ProSpec Cystatin C Assay Using Pediatric Samples

Endogenous interferents (lipids, hemoglobin and bilirubin) are a common cause of pre-analytical laboratory errors. We evaluated the effect of lipemia on Siemens cystatin C assay using pediatric samples. Lipemic samples were prepared by adding various concentrations of triglycerides into low and high cystatin C sample pools. Cystatin C concentrations were then measured on Siemens BN ProSpec analyzer and change of the analyte concentrations was determined. Low and high cystatin C sample pools were not affected by additions of lower lipid concentrations (150, 500 and 750 mg/dL), while the negative bias of <10% was seen with additions of higher lipid concentrations (1000 and 1500 mg/dL). Our results suggest that the BN ProSpec assay is a good alternative for cystatin C measurements in our pediatric population with no major interference from lipemia.

The European Medicines Agency experience with biomarker qualification

Since the launch of the qualification process in 2009, the CHMP reviewed/is reviewing 48 requests for qualification advice or opinion (as of Sept 2013) related to biomarkers (BM) or other novel drug development tools (e.g. patient reported outcome measures, modeling, and statistical methods). The qualification opinions are available on the EMA website (Qualification of novel methodologies for medicine development, http://www.ema.europa.eu/ema/index.jsp?curl=pages/regulation/document_listing/document_listing_000319.jsp&mid=WC0b01ac0580022bb0#section2 , 2013). Also there is a trend of increasing numbers of qualification requests to CHMP, indicative of the pace that targeted drug development and personalized medicine is gaining and the need to bring the new tools from research to drug development and clinical use. This chapter will focus on the regulatory experience gained so far from the CHMP qualification procedure. Basic qualification principles will be presented. Through qualification examples, we will elaborate on common grounds and divergences between the different stakeholders.

Tracing a roadmap for vitamin B₁₂ testing using the health technology assessment approach

In our hospital, we are currently working to manage the appropriateness of vitamin B₁₂ (B12) testing. Unfortunately, the classic evidence-based approach is unhelpful in this process and meta-analyzing data on the accuracy of this marker for cobalamin deficiency detection is misleading due to the lack of reference diagnostic methods. The approach currently proposed by the Health Technology Assessment (HTA) enables us to tackle the issue of B₁₂ requests as a "healthcare" problem by considering the position of stakeholders involved in ordering, performing, interpreting the test, and receiving its results. Clinical expectations, methodological issues, and ethical aspects concerning the performance of the test can aid us in providing more guidance on the use of this marker. By building such structured information, hemodialysis patients and pregnant women have emerged as those groups preferentially requiring B₁₂ testing, as it may potentially improve the clinical outcome. To avoid misinterpretation of B₁₂ results more care should be taken in considering its biochemical and biological features, as well as the analytical issues. Spurious values obtained by current automated immunoassays may reflect suboptimal pre-analytical steps as well as known interfering conditions. Furthermore, the harmonization of results by available methods is still a far-reaching goal and the approach to interpret an individual's results should be improved. Tracing a roadmap for B₁₂ testing by exploiting the HTA model to balance the stakeholders' claims and maximizing the patient's outcome may help to manage the marker demand.

Different methods to estimate serum free cortisol: a comparison during cortisol tetracosactide testing

BACKGROUND

Serum cortisol is routinely quantified by immunoassays. In intensive care units serum free cortisol (FC) determination has been described as a better indicator of survival than total cortisol (TC). To estimate FC different methods are available including saliva sampling. We compared five methods to estimate FC, before and after an ACTH stimulating test in patients suspected of adrenal insufficiency.

METHOD

Serum and saliva was collected from 130 patients from the Endocrine Department of a university hospital before and after tetracosactide injection for TC determination. FC was estimated: after serum ultrafiltration, quadratic (Coolens') or cubic (Dorin's) equations, using TC/cortisol-binding globulin concentrations ratio or using cortisol concentration determination in saliva.

RESULTS

FC concentrations obtained by different techniques were significantly correlated and Passing-Bablok regressions showed no deviation from linearity between salFC and filtFC or quadFC. Using the routine assumption that the patients were correctly diagnosed using a post-tetracosactide TC threshold of 550 nmol/L the FC methods generating the best ROC curves were salFC and filtFC or cubFC 30 min after tetracosactide injection.

CONCLUSIONS

FC concentrations obtained by different techniques are significantly but not similarly correlated with TC. As, salFC and filtFC are more convenient to perform than methods involving CBG assays and are better correlated to TC during tetracosactide tests they may be preferred as FC surrogate assays.

Proposed guidance for carryover studies, based on elementary equivalence testing techniques

BACKGROUND

Carryover experiments are widely used for clinical chemistry and immunochemistry analysers to evaluate and validate carryover effects. The experimental design is well described. However, there is no guideline on the statistical approach on data analysis, especially if absence of carryover has to be shown. The only reporting of carryover in ppm is not helpful because its uncertainty is not taken into account. Furthermore, the most commonly used method fails to demonstrate the absence of carryover. We propose a step-by-step guidance applying a new statistical design for analysis of carryover studies based on equivalence testing, and provide a sample based tutorial.

METHODS

For statistical analysis of carryover effects an one-sided version of equivalence testing by comparing the difference with a predefined limit (i.e., a test of non-superiority) is used. The methodology is demonstrated by measuring total betahCG in human serum samples with a UniCel DxI 880 analyser.

RESULTS

A new statistical approach based on equivalence testing has been developed for analysis of data resulting from a typical experimental protocol for carryover studies. Experiments using 8 (11) cycles of high and low concentration samples are appropriate to validate the absence of carryover with 80% (90%) power and an alpha-level of 0,05 if no carryover is expected. We propose to predefine an acceptance criterion based on the imprecision (here: expressed as one standard deviation) observed for those replicates of the low concentration samples expected to be unaffected by carryover. In the demonstration, the absence of carry-over was concluded with a significance of p < 0.05.

CONCLUSIONS

Appropriate statistical methods should be applied when the target of a method-validation experiment is (i) absence of any effect, (ii) non-inferiority/non-superiority or (iii) equivalence. Using the example of carryover studies, we show that one-sided equivalence testing is the proper model, and propose a guidance for analysis of these experiments. The example of carryover illustrates a methodology which is also applicable for analysis of a wide range of experimental approaches, including method comparison, commutability and robustness.

[Screening methods for colorectal cancer can be improved]

Screening programmes for colorectal cancer (CRC) are being implemented in various countries worldwide including Denmark. The majority of programmes rely on faecal occult blood testing with subsequent colonoscopy. This approach is challenged by limited compliance, which reduces the efficiency of the screening programme. Current research into improve-ments of screening of CRC includes biological markers identified in blood. Combining blood-based biological markers with clinical and demographical parameters have shown promising results, which may improve the present approach to screening.

[Express diagnostics of endotoxaemia during postoperative period in cardiac surgical patients]

Medical technologies development and recent approaches in management of patients with septic complications during the early postoperative period present new obstacles to the laboratory service. Endotoxin is a main agent in the systemic inflammatory cascade and plays important role in sepsis pathogenesis. Recent express methods of diagnostics allow determining blood activity of endotoxin during 30-50 min. 55 ICU patients with clinical and laboratory signs of systemic inflammatory response syndrome (SIRS) after cardiac surgery were studied in the single-center prospective research. Endotoxaemia was diagnosed by express tests. Level of endotoxaemia was assessed before and after sorption in 15 patients receiving complex intensive care with selective lipopolysaccharide (LPS) adsorption. Endotoxaemia level assessment allows to define indications for different programs of intensive care in time and to assess its efficiency. Test systems for assessment endotoxin level based on the principle of interaction antigen - antibody (EAA and MACH-endotox spp.) is a most efficient for express diagnostics of endotoxaemia.

Measurement of total rather than free thyroxine in pregnancy: the diagnostic implications

BACKGROUND

In light of several recent recommendations to use total thyroxine (T4) measurements in the diagnosis of thyroid function in pregnancy (in particular, "Clinical Practice Guidelines for Hypothyroidism in Adults," cosponsored by the American Thyroid Association and the American Association of Clinical Endocrinologists, which promote the use of T4 over free T4 [FT4 ]), we have examined the implications of employing T4 for diagnostic discrimination in both pregnant and nonpregnant patient panels. Use of T4 assays has significant drawbacks in this regard, and we believe that the suggestion is a retrograde step in thyroid function testing.

SUMMARY AND CONCLUSIONS

Analysis of the interplay between the concentrations of T4 and thyroxine-binding globulin (TBG), typifying their respective reference ranges in either the nonpregnant or pregnant euthyroid state, shows that the effective T4 range is widened significantly by the accompanying hidden variation in TBG levels. Accordingly FT4 assays that fully compensate for serum T4-binding protein concentrations should discriminate dysfunctionality from normality more efficiently than total hormone measurements, whether in pregnant or nonpregnant states. The euthyroid FT4 reference ranges typical of late pregnancy should also be more compact than those for the total hormone, because of the increased dominance of higher, though equivalently variable TBG concentrations on T4 levels. Parallel effects on T4 from similarly variable, though lower concentrations of TBG are indicated in the nonpregnant group. While acknowledging the difficulties in FT4 measurement arising from inconsistent calibration of present-day commercial assays, this finding questions the recommendation that total hormone assays should supersede the former in pregnancy.

PSAQ™ standards for accurate MS-based quantification of proteins: from the concept to biomedical applications

Absolute protein quantification, i.e. determining protein concentrations in biological samples, is essential to our understanding of biological and physiopathological phenomena. Protein quantification methods based on the use of antibodies are very effective and widely used. However, over the last ten years, absolute protein quantification by mass spectrometry has attracted considerable interest, particularly for the study of systems biology and as part of biomarker development. This interest is mainly linked to the high multiplexing capacity of MS analysis, and to the availability of stable-isotope-labelled standards for quantification. This article describes the details of how to produce, control the quality and use a specific type of standard: Protein Standard Absolute Quantification (PSAQ™) standards. These standards are whole isotopically labelled proteins, analogues of the proteins to be assayed. PSAQ standards can be added early during sample treatment, thus they can correct for protein losses during sample prefractionation and for incomplete sample digestion. Because of this, quantification of target proteins is very accurate and precise using these standards. To illustrate the advantages of the PSAQ method, and to contribute to the increase in its use, selected applications in the biomedical field are detailed here.

A quantitative assay for the juvenile hormones and their precursors using fluorescent tags

BACKGROUND

The juvenile hormones (JHs) are sesquiterpenoid compounds that play a central role in insect reproduction, development and behavior. The lipophilic nature of JHs and their precursors, in conjunction with their low concentration in tissues and susceptibility to degradation had made their quantification difficult. A variety of methods exist for JH quantification but few can quantify on the femtomole range. Currently applied methods are expensive and time consuming. In the present study we sought to develop a novel method for accurate detection and quantification of JHs and their precursors.

METHODS

A sensitive and robust method was developed to quantify the precursor, farnesoic acid (FA) and juvenile hormone III (JH III) in biological samples. The assay is based on the derivatization of analytes with fluorescent tags, with subsequent analysis by reverse phase high performance liquid chromatography coupled to a fluorescent detector (HPLC-FD). The carboxyl group of FA was derivatized with 4-Acetamido-7-mercapto-2,1,3-benzoxadiazole (AABD-SH). Tagging the epoxide group of JH III required a two-step reaction: the opening of the epoxide ring with sodium sulfide and derivatization with the fluorescent tag 4-(N,N-Dimethylaminosulfonyl)-7-(N-chloroformylmethyl-N-methylamino)-2,1,3-benzoxadiazole (DBD-COCl).

CONCLUSIONS

The method developed in the present study showed high sensitivity, accuracy and reproducibility. Linear responses were obtained over the range of 10-20 to 1000 fmols. Recovery efficiencies were over 90% for JH III and 98% for FA with excellent reproducibility.

SIGNIFICANCE

The proposed method is applicable when sensitive detection and accurate quantification of limited amount of sample is needed. Examples include corpora allata, hemolymph and whole body of female adult Aedes aegypti and whole body Drosophila melanogaster. A variety of additional functional groups can be targeted to add fluorescent tags to the remaining JH III precursors.