Let's Think Clinically Instead of Mathematically About Device Accuracy

The use of a noninvasive hemoglobin monitor for determining fluid distribution and elimination in pediatric patients undergoing minor surgery

In pediatric fluid therapy it would be preferable to describe distribution and elimination a fluid bolus based on repetitive hemoglobin (Hb) according to kinetic principles. Pulse CO-Oximetry is a recent advancement in patient monitoring that allows for the continuous noninvasive measurement of Hb (SpHb). The aim of this study was to describe the distribution and elimination of hydroxyethylstarch (HES) 130/0.4 in combination with crystalloids using a noninvasive Hb monitor in two cohorts of young children undergoing minor surgeries under general anesthesia. Two cohorts, 16 children aged 1-3 years and 12 aged 4-6 years, were investigated during anesthesia and minor surgical procedures. They were given a maintenance solution of lactated Ringer's and a fluid bolus of HES 130/0.4, 6 mL/kg over a period of 20 min. The whole procedure lasted 120 min, and SpHb values were measured every 10 min. The SpHb values were used to calculate plasma dilution, net volume, and mean residence time (MRT) of the infused fluid. A total of 377 measured SpHbs generated individual dilution plots that showed variability, particularly for the older cohort. Distribution and elimination rates of the infused fluid were calculated. Mean dilution plots were generated. There were no significant differences in dilution, net volume or MRT between groups. A non invasive Hb analyzer could be used to calculate fluid distribution. The variability in the data can probably be explained by reactions to anesthetic drugs, variability in measurement technique, variability in generating the complex capillary signals, and individual variability in baseline fluid status. The latter finding is important because this is a prerequisite for perioperative fluid planning for each individual.

Near-infrared spectroscopy: exposing the dark (venous) side of the circulation

The safety of anesthesia has improved greatly in the past three decades. Standard perioperative monitoring, including pulse oximetry, has practically eliminated unrecognized arterial hypoxia as a cause for perioperative injury. However, most anesthesia-related cardiac arrests in children are now cardiovascular in origin, and standard monitoring is unable to detect many circulatory abnormalities. Near-infrared spectroscopy provides noninvasive continuous access to the venous side of regional circulations that can approximate organ-specific and global measures to facilitate the detection of circulatory abnormalities and drive goal-directed interventions to reduce end-organ ischemic injury.

Evaluation of multiwave pulse total-hemoglobinometer during general anesthesia

The purpose of this prospective study was to evaluate the accuracy and trending ability of a four-wavelength pulse-total hemoglobinometer that continuously and noninvasively measures hemoglobin in surgical patients. With IRB approval and informed consent, spectrophotometric hemoglobin (SpHb) was measured with a pulse-total hemoglobinometer manufactured by Nihon Kohden Corp (Tokyo, Japan) and compared to the CO-oximeter equipped with blood gas analyzer. Two hundred twenty-five samples from 56 subjects underwent analysis. Bland-Altman analysis revealed that the bias ± precision of the current technology was 0.0 ± 1.4 g/dl and -0.2 ± 1.3 g/dl for total samples and samples with 8 < Hb < 11 g/dl, respectively. The percentages of samples with intermediate risk of therapeutic error in error grid analysis and the concordance rate of 4-quadrant trending assay was 17 % and 77 %, respectively. The Cohen kappa statistic for Hb < 10 g/dl was 0.38, suggesting that the agreement between SpHb and CO-oximeter-derived Hb was fair. Collectively, wide limits of agreement, especially at the critical level of hemoglobin, and less than moderate agreement against CO-oximeter-derived hemoglobin preclude the use of the pulse-total hemoglobinometer as a decision-making tool for transfusion.

Noninvasive hemoglobin monitoring: how accurate is enough?

Evaluating the accuracy of medical devices has traditionally been a blend of statistical analyses, at times without contextualizing the clinical application. There have been a number of recent publications on the accuracy of a continuous noninvasive hemoglobin measurement device, the Masimo Radical-7 Pulse Co-oximeter, focusing on the traditional statistical metrics of bias and precision. In this review, which contains material presented at the Innovations and Applications of Monitoring Perfusion, Oxygenation, and Ventilation (IAMPOV) Symposium at Yale University in 2012, we critically investigated these metrics as applied to the new technology, exploring what is required of a noninvasive hemoglobin monitor and whether the conventional statistics adequately answer our questions about clinical accuracy. We discuss the glucose error grid, well known in the glucose monitoring literature, and describe an analogous version for hemoglobin monitoring. This hemoglobin error grid can be used to evaluate the required clinical accuracy (±g/dL) of a hemoglobin measurement device to provide more conclusive evidence on whether to transfuse an individual patient. The important decision to transfuse a patient usually requires both an accurate hemoglobin measurement and a physiologic reason to elect transfusion. It is our opinion that the published accuracy data of the Masimo Radical-7 is not good enough to make the transfusion decision.

Accuracy of the Masimo Pronto-7® system in patients with left ventricular assist device

Background

The Masimo Pronto-7^® calculates hemoglobin (Hb) values using the pulsoximetry technique and a variety of mathematical algorithms analyzing the pulse waveform. Although this system has demonstrated a high level of accuracy in average patients, the performance might be altered in special patient populations. Regarding patients with left ventricular cardiac failure, a rotary blood pump generates a constant, continuous, non-pulsatile flow to improve effective cardiac output. Due to this alteration in both, blood flow and arterial blood pressure we hypothesized a reduced accuracy of the Masimo Pronto-7^® to detect Hb in patients with left ventricular cardiac failure. To test our hypothesis, we evaluated the Pronto-7^®SpHb system in outpatients after continuous-flow-left ventricular assist device (cf-LVAD) implantation (HeartMate II, Thoratec).

Methods

21 cf-LVAD outpatients from the Clinic for Cardiac, Thoracic and Vascular Surgery were investigated during routine follow up examinations. After venous blood samples were drawn, the Pronto-7^® sensor was attached to one randomly selected finger of one hand. The collected SpHb data were compared with Hb values measured by our central laboratory. The difference between the methods was determined using Bland – Altman analysis. The study was registered in the DRKS (DRKS00004415).

Results

In all cf-LVAD patients evaluated, the Pronto-7^® successfully detected SpHb values. Using Bland – Altman analysis, a bias of 0.14 g/dl (95% upper and lower limits of agreement ± 2.76 g/dl) was calculated.

Conclusion

The Pronto-7^® overestimated the actual Hb value in cf-LVAD outpatients with the HeartMate II. Due to this, we conclude that the system is suitable for screening in routine examinations and further analysis can be performed if needed. However, its use as an emergency tool is questionable because of the increased inaccuracy when Hb values are critically low.

The ability of anesthesia providers to visually estimate systolic pressure variability using the "eyeball" technique

BACKGROUND

Systemic arterial respiratory variation has been shown to be a reliable predictor of changes in cardiac output after fluid administration. Arterial respiratory variation is often estimated from visual examination of the arterial waveform tracing. Our goal in this study was to assess the ability of anesthesia providers to visually estimate systolic pressure variation (SPV) as a percentage of systolic blood pressure (SPV).

METHODS

Fifty anesthesia providers were recruited and asked to visually examine 10 recorded arterial waveform tracings (played in real time), to estimate SPV, and to state whether or not a fluid bolus was indicated. After completion of the examination, the participants were shown the original tracings, the true value for SPV, and their estimate. The percentage of incorrect physician decisions to administer or not administer additional fluid was analyzed using a binomial proportion confidence interval. Clinical utility was also assessed using clinical significance analysis. Limits of agreement were analyzed using the nonparametric approach recommended by Bland and Altman.

RESULTS

The mean bias was +1.2%. The nonparametric limits of agreement were -5.1 and 7.5%, and contained 82% of values. Actual physician decisions were incorrect 4.4% of the time (95% confidence interval [CI] 2.8% to 6.6%). On the basis of the clinical significance analysis, only 1% of treatments based on the visual estimation would have been incorrect.

CONCLUSION

Visual estimates of respiratory variation are within clinically reasonable limits 82% of the time and lead to erroneous management decisions in 4.4% of measurements.

Intravenous fluids cause systemic bias in a conductivity-based point-of-care hematocrit meter

BACKGROUND

Point-of-care (POC) devices measuring hematocrit rely on determination of electrical conductivity of whole blood. We hypothesized that some frequently administered IV fluids independently alter blood conductivity and confound hematocrit determination.

METHODS

Whole human blood was diluted to predetermined hematocrit values with normal saline, lactated Ringer solution, hetastarch, or plasma. Electrical conductivity and hematocrit (i-STAT® and spun methods) were measured at each dilution. In separate experiments, the effects of propofol and heparin were noted on these variables.

RESULTS

Greater dilution significantly increased conductivity irrespective of diluent type. The magnitude of the conductivity slopes increased in order for plasma, hetastarch, lactated Ringer solution, and normal saline dilution. Moreover, each slope varied from every other slope (all P < 0.0001), and 94.2% of hematocrit values measured by i-STAT (n = 211 of 224) were less than those for the spun method. Dilution with plasma, normal saline, lactated Ringer solution, and hetastarch caused bias (Bland-Altman limits of agreement) of -2.7% (-6.9/1.4), -4.6% (-7.3/-2.0), -4.8% (-7.8/-1.7), and -2.0% (-5.6/1.9), respectively. The Cohen κ agreement values (5th-95th confidence interval) for a transfusion trigger of 30% were 0.90 (all values, 0.85-0.95), 0.25 (hematocrit <30%, 0.02-0.48), and 0.21 (hematocrit 18%-30%, 0.01-0.42). Clinically relevant concentrations of propofol and heparin had minimal effects on electrical conductivity or hematocrit determination.

CONCLUSIONS

Dilution of blood with frequently used IV solutions affects whole blood conductivity determinations and thereby decreases hematocrits measured by a POC device relying on this method as compared with spun hematocrit. Conductivity-based hematocrit POC devices should be cautiously interpreted when hemodilution is present.

Continuous noninvasive hemoglobin monitoring during complex spine surgery

BACKGROUND

Monitoring hemoglobin levels in the operating room currently requires repeated blood draws, several steps, and a variable time delay to receive results. Consequently, blood transfusion management decisions may be delayed or made before hemoglobin results become available. The ability to measure hemoglobin continuously and noninvasively may enable a more rapid assessment of a patient's condition and more appropriate blood management. A new technology, Pulse CO-Oximetry, provides a continuous, noninvasive estimate of hemoglobin concentration (SpHb) from a sensor placed on the finger. We evaluated the accuracy of SpHb compared with laboratory CO-Oximetry measurements of total hemoglobin (tHb) during complex spine procedures in patients at high risk for blood loss.

METHODS

Patients eligible for the study were undergoing complex spine surgery with planned invasive arterial or central venous monitoring and hourly blood draws for hemoglobin measurement. During each surgery, blood samples were obtained hourly (or more often if clinically indicated) and analyzed by the central laboratory with CO-Oximetry, a standard method of hemoglobin measurement in many hospitals. The tHb measurements were compared with SpHb obtained at the time of the blood draw.

RESULTS

Twenty-nine patients were included in the study. The tHb values ranged from 6.9 to 13.9 g/dL, and the SpHb values ranged from 6.9 to 13.4 g/dL. A total of 186 data pairs (tHb/SpHb) were analyzed; after removal of SpHb readings with low signal quality, the bias (defined as the difference between SpHb and tHb) and precision (defined as 1 SD of the bias) were -0.1 g/dL ± 1.0 g/dL for the remaining 130 data pairs. Bland-Altman analysis showed good agreement of SpHb to tHb values over the range of values; limits of agreement were -2.0 to 1.8 g/dL. The absolute bias and precision were 0.8 ± 0.6 g/dL.

CONCLUSIONS

Continuous, noninvasive hemoglobin measurement via Pulse CO-Oximetry demonstrated clinically acceptable accuracy of hemoglobin measurement within 1.5 g/dL compared with a standard laboratory reference device when used during complex spine surgery. This technology may provide more timely information on hemoglobin status than intermittent blood sample analysis and thus has the potential to improve blood management during surgery.