Evidence-based laboratory medicine as a tool for continuous professional improvement

Determining qualitative effect size ratings using a likelihood ratio scatter matrix in diagnostic test accuracy systematic reviews

Background Diagnostic test accuracy (DTA) systematic reviews (SRs) characterize a test's potential for diagnostic quality and safety. However, interpreting DTA measures in the context of SRs is challenging. Further, some evidence grading methods (e.g. Centers for Disease Control and Prevention, Division of Laboratory Systems Laboratory Medicine Best Practices method) require determination of qualitative effect size ratings as a contributor to practice recommendations. This paper describes a recently developed effect size rating approach for assessing a DTA evidence base. Methods A likelihood ratio scatter matrix will plot positive and negative likelihood ratio pairings for DTA studies. Pairings are graphed as single point estimates with confidence intervals, positioned in one of four quadrants derived from established thresholds for test clinical validity. These quadrants support defensible judgments on "substantial", "moderate", or "minimal" effect size ratings for each plotted study. The approach is flexible in relation to a priori determinations of the relative clinical importance of false positive and false negative test results. Results and conclusions This qualitative effect size rating approach was operationalized in a recent SR that assessed effectiveness of test practices for the diagnosis of Clostridium difficile. Relevance of this approach to other methods of grading evidence, and efforts to measure diagnostic quality and safety are described. Limitations of the approach arise from understanding that a diagnostic test is not an isolated element in the diagnostic process, but provides information in clinical context towards diagnostic quality and safety.

Long-term systemic metal distribution in patients with stainless steel spinal instrumentation: a case-control study

STUDY DESIGN

Case-control study.

OBJECTIVE

To verify whether metal ions in the serum of patients bearing spinal stainless steel instrumentation were elevated over the long-term period after implantation of stainless steel prostheses and to determine whether these levels could predict potential unfavorable outcomes.

SUMMARY OF BACKGROUND DATA

Instrumented spinal arthrodesis, the standard procedure to correct scoliosis, routinely remains in situ for the lifetime of the patient. Elevated metal ion levels have been reported at short-term follow-up, but the long-term status, possibly related to systemic toxic effects, is unknown.

METHODS

Twenty-two patients treated for scoliosis with posterior spinal arthrodesis using stainless steel instrumentation were included. Minimum follow-up was 10 years. Oswestry Disability Index and visual analog scale were recorded. Chromium (Cr) and nickel (Ni) levels were measured (ng/mL) and compared with levels in a control group including 30 healthy subjects. A receiver-operating characteristic curve was calculated on the basis of the clinical assessment (pain and disability) and the x-ray picture; the cutoff values for the parameters were settled, and the ion-testing potential was considered as a surrogate marker for failure.

RESULTS

The level of Cr was significantly increased in patients, compared with controls (P=0.018). A remarkable Cr release without any clinical-radiologic sign was recorded in some female patients. A high specificity (93%), positive likelihood ratio (7.00), and overall accuracy (77%) were calculated for Cr; these indicate a high risk of failure when the levels exceeded the cutoff value, which was 0.6 ng/mL. No significant difference between the groups was found for Ni (P=0.7).

CONCLUSIONS

Cr testing is suggested as a reliable marker for the malfunctioning assessment and as a support for standard procedures, especially with doubtful diagnosis. Furthermore, high levels of Cr ions were observed in female patients. This finding deserves attention especially when counseling young fertile women.

Regional variations in test requiring patterns of general practitioners in Spain

OBJECTIVE

To analyze the requesting patterns for a range of laboratory tests ordered in 2009 from eight laboratories providing services to eight health areas, using appropriate indicators.

DESIGN

Indicators measured every test request per 1,000 inhabitants, and indicators that measured the number of tests per related test requested by general practitioners were calculated. The savings generated, if each Health Care Department achieved the appropriate indicator standard, were also calculated. Laboratory Information System registers were collected, and indicators were calculated automatically in each laboratory using a data warehouse application.

RESULTS

There was a large difference in demand for tests by health areas. The ratio of related tests also showed a great variability. The savings generated if each Health Care Department had achieved the appropriate indicator standard were €172,116 for free thyroxine, €18,289 for aspartate aminotransferase, and €62,678 for urea.

CONCLUSIONS

Considerable variability exists in general practitioners' demand for laboratory tests.

The potential role of metal ion release as a marker of loosening in patients with total knee replacement

We investigated the role of ion release in the assessment of fixation of the implant after total knee replacement and hypothesised that ion monitoring could be a useful parameter in the diagnosis of prosthetic loosening. We enrolled 59 patients with unilateral procedures and measured their serum aluminium, titanium, chromium and cobalt ion levels, blinded to the clinical and radiological outcome which was considered to be the reference standard. The cut-off levels for detection of the ions were obtained by measuring the levels in 41 healthy blood donors who had no implants. Based on the clinical and radiological evaluation the patients were divided into two groups with either stable (n = 24) or loosened (n = 35) implants.

A significant increase in the mean level of Cr ions was seen in the group with failed implants (p = 0.001). The diagnostic accuracy was 71% providing strong evidence of failure when the level of Cr ions exceeded the cut-off value. The possibility of distinguishing loosening from other causes of failure was demonstrated by the higher diagnostic accuracy of 83%, when considering only patients with failure attributable to loosening.

Measurement of the serum level of Cr ions may be of value for detecting failure due to loosening when the diagnosis is in doubt. The other metal ions studies did not have any diagnostic value.

Pharmacogenomics: the promise of personalized medicine for CNS disorders

This review focuses first on the concept of pharmacogenomics and its related concepts (biomarkers and personalized prescription). Next, the first generation of five DNA pharmacogenomic tests used in the clinical practice of psychiatry is briefly reviewed. Then the possible involvement of these pharmacogenomic tests in the exploration of early clinical proof of mechanism is described by using two of the tests and one example from the pharmaceutical industry (iloperidone clinical trials). The initial attempts to use other microarray tests (measuring RNA expression) as peripheral biomarkers for CNS disorders are briefly described. Then the challenge of taking pharmacogenomic tests (compared to drugs) into clinical practice is explained by focusing on regulatory oversight, the methodological/scientific issues concerning diagnostic tests, and cost-effectiveness issues. Current information on medicine-based evidence and cost-effectiveness usually focuses on average patients and not the outliers who are most likely to benefit from personalized prescription. Finally, future research directions are suggested. The future of 'personalized prescription' in psychiatry requires consideration of pharmacogenomic testing and environmental and personal variables that influence pharmacokinetic and pharmacodynamic drug response for each individual drug used by each patient.

Original research in pathology: judgment, or evidence-based medicine?

Pathology is both a medical specialty and an investigative scientific discipline, concerned with understanding the essential nature of human disease. Ultimately, pathology is accountable as well, as measured by the accuracy of our diagnoses and the resultant patient care outcomes. As such, we must consider the evidence base underlying our practices. Within the realm of Laboratory Medicine, extensive attention has been given to testing accuracy and precision. Critical examination of the evidence base supporting the clinical use of specific laboratory tests or technologies is a separate endeavor, to which specific attention must be given. In the case of anatomic pathology and more specifically surgical pathology, the expertise required to render a diagnosis is derived foremost from experience, both personal and literature-based. In the first instance, knowledge of the linkage between one's own diagnoses and individual patient outcomes is required, to validate the role of one's own interpretations in the clinical course of patients. Experience comes from seeing this linkage first hand, from which hopefully comes wisdom and, ultimately, good clinical judgment. In the second instance, reading the literature and learning from experts is required. Only a minority of the relevant literature is published in pathology journals to which one may subscribe. A substantial portion of major papers relevant to the practice of anatomic pathology are published in collateral clinical specialty journals devoted to specific disease areas or organs. Active effort is therefore required to seek out the literature beyond the domain of pathology journals. In examining the published literature, the essential question then becomes: Does the practice of anatomic pathology fulfill the tenets of 'evidence-based medicine' (EBM)? If the pinnacle of EBM is 'systematic review of randomized clinical trials, with or without meta-analysis', then anatomic pathology falls far short. Our published literature is largely observational in nature, with reports of case series (with or without statistical analysis) constituting the majority of our 'evidence base'. Moreover, anatomic pathology is subject to 'interobserver variation', and potentially to 'error'. Taken further, individual interpretation of tissue samples is not an objective endeavor, and it is not easy to fulfill the role of a 'gold standard'. Both for rendering of an overall interpretation, and for providing the semi-quantitative and quantitative numerical 'scores' which support evidence-based clinical treatment algorithms, the Pathologist has to exercise a high level of interpretive judgment. Nevertheless, the contribution of anatomic pathology to 'EBM' is remarkably strong. To the extent that our judgmental interpretations become data, our tissue interpretations become the arbiters of patient care management decisions. In a more global sense, we support highly successful cancer screening programs, and play critical roles in the multidisciplinary management of complex patients. The true error is for the clinical practitioners of 'EBM' to forget the contribution to the supporting evidence base of the physicians that are Anatomic Pathologists. Finally, the academic productivity of pathology faculty who operate in the clinical realm must be considered. A survey of six North American academic pathology departments reveals that 26% of all papers published in 2005 came from 'unfunded' clinical faculty. While it is likely that their academic productivity is lower than that of 'funded' research faculty, the contribution of clinical faculty to the knowledge base for the practice of modern medicine, and to the academic reputation of the department, must not be overlooked. The ability of clinical faculty in academic departments of pathology to pursue original scholarship must be supported if our specialty is to retain its preeminence as an investigative scientific discipline in the age of EBM.

Risk management in the preanalytical phase of laboratory testing

The clinical laboratory is no longer its own limited ecosystem, as it is increasingly integrated with patient care, assisting diagnosis, monitoring therapies and predicting clinical outcomes. Although efforts and resources are continuously focused to achieve a satisfactory degree of analytical quality, there is clear evidence that the preanalytical phase is much more vulnerable to uncertainties and accidents, which can substantially influence patient care. Most errors within the preanalytical phase result from system flaws and insufficient audit of the operators involved in specimen collection and handling responsibilities, leading to an unacceptable number of unsuitable specimens due to in vitro hemolysis, clotting, insufficient volume, wrong container, contamination and misidentification. A reliable approach to overcome this problem entails prediction of accidental events (exhaustive process analysis, reassessment and rearrangement of quality requirements, dissemination of operating guidelines and best-practice recommendations, reduction of complexity and error-prone activities, introduction of error-tracking systems and continuous monitoring of performances), an increase in and diversification of defenses (application of multiple and heterogeneous systems to identify non-conformities), and a decrease in vulnerability (implementation of reliable and objective detection systems and causal relation charts, education and training). This policy, which requires integration between requirements and design, full commitment and interdepartmental cooperation, should make laboratory activity more compliant to the inalienable paradigm of total quality in the testing process.

Clin Chem Lab Med 2007;45:720–7.

Systemic cross-linked N-terminal telopeptide and procollagen I C-terminal extension peptide as markers of bone turnover after total hip arthroplasty

There is no diagnostic, non-invasive method for the early detection of loosening after total hip arthroplasty. In a pilot study, we have analysed two serum markers of bone remodelling, procollagen I C-terminal extension peptide (PICP) and cross-linked N-terminal telopeptide (NTx), as well as the diagnostic performance of NTx for the assessment of osteolysis. We recruited 21 patients with loosening (group I), 18 with a well-fixed prosthesis (group II) and 17 at the time of primary arthroplasty for osteoarthritis (OA) (group III). Internal normal reference ranges were obtained from 30 healthy subjects (group IV). The serum PICP level was found to be significantly lower in patients with OA and those with loosening, when compared with those with stable implants, while the NTx level was significantly increased only in the group with loosening, suggesting that collagen degradation depended on the altered bone turnover induced by the implant. This hypothesis was reinforced by the finding that the values in the pre-surgery patients and stable subjects were comparable with the reference range of younger healthy subjects.A high specificity and positive predictive value for NTx provided good diagnostic evidence of agreement between the test and the clinical and radiological evaluations. The NTx level could be used to indicate stability of the implant. However, further prospective, larger studies are necessary.