Acceptance and validity of the methods used to implement a competency based medical education programme in an Intensive Care Department of a teaching referral center

OBJECTIVES

1. To determine the satisfaction of tutors and residents with a specific methodology used to implement CoBaTrICE. 2. To determine the reliability and validity of the global rating scales designed ad hoc to assess the performance of the residents for training purposes.

DESIGN

Prospective cohort study.

PARTICIPANTS

All the residents and tutors of the ICU Department of the Hospital Universitario y Politécnico la Fe de Valencia.

INTERVENTION

CoBaTrICE implementation started in March 2016, it was based on: (1) Training the tutors in feedback techniques; (2) Performing multiple objective and structured work based assessments to achieve the competences of the program; and (3) The use of an electronic portfolio to promote learning reflection and to collect the evidence that learning was taking place.

METHODS

The acceptance of CoBaTrICE was explored through a satisfaction survey conducted after 9 months of implementation of the training program. The 15 residents and 5 tutors of the ICU Department were asked about the methodology of the formative assessments, the quality of the feedback, self-learning regulation and the electronic portfolio usefulness. The validity of the global rating scales was assessed through the tests alfa de Cronbach, reliability and generalizability indexes, and intraclass correlation coefficient.

RESULTS

The implementation of CoBaTrICE was satisfactory in all the dimensions studied. The global rating scales used for formative purposes showed reliability and validity.

CONCLUSIONS

The methodology used to implement CoBaTrICE was highly valued by tutors and residents. The global rating scales used for formative purposes showed reliability and validity.

Training in intensive care medicine. A challenge within reach

The medical training model is currently immersed in a process of change. The new paradigm is intended to be more effective, more integrated within the healthcare system, and strongly oriented towards the direct application of knowledge to clinical practice. Compared with the established training system based on certification of the completion of a series or rotations and stays in certain healthcare units, the new model proposes a more structured training process based on the gradual acquisition of specific competences, in which residents must play an active role in designing their own training program. Training based on competences guarantees more transparent, updated and homogeneous learning of objective quality, and which can be homologated internationally. The tutors play a key role as the main directors of the process, and institutional commitment to their work is crucial. In this context, tutors should receive time and specific formation to allow the evaluation of training as the cornerstone of the new model. New forms of objective summative and training evaluation should be introduced to guarantee that the predefined competences and skills are effectively acquired. The free movement of specialists within Europe is very desirable and implies that training quality must be high and amenable to homologation among the different countries. The Competency Based training in Intensive Care Medicine in Europe program is our main reference for achieving this goal. Scientific societies in turn must impulse and facilitate all those initiatives destined to improve healthcare quality and therefore specialist training. They have the mission of designing strategies and processes that favor training, accreditation and advisory activities with the government authorities.

Hospital mortality prognostication in sepsis using the new biomarkers suPAR and proADM in a single determination on ICU admission

PURPOSE

The soluble form of the urokinase-type plasminogen activator receptor (suPAR) and proadrenomedullin (proADM) are two new and promising sepsis biomarkers. We assessed the prognostic value of a single determination of proADM and suPAR, comparing them with C-reactive protein (CRP) and procalcitonin (PCT), and evaluating whether their addition to severity scores (APACHE II and SOFA) could improve their prognostic accuracy.

METHODS

A single-centre prospective observational study conducted in an adult intensive care department at Marques de Valdecilla University Hospital in Spain. APACHE II and SOFA scores, CRP, PCT, suPAR and proADM levels on the day of ICU admission were collected.

RESULTS

A total of 137 consecutive septic patients were studied. The best area under the curve (AUC) for the prediction of in-hospital mortality was for APACHE II (0.82) and SOFA (0.75) scores. The ROC curve for suPAR yielded an AUC of 0.67, higher than proADM (0.62), CRP (0.50) and PCT (0.44). Significant dose-response trends were found between hospital mortality and suPAR (OR Q4 = 4.83, 95% CI 1.60-14.62) and pro-ADM (OR Q4 = 3.00, 95% CI 1.06-8.46) quartiles. Non-significant associations were found for PCT and CRP. The combination of severity scores and each biomarker did not provide superior AUCs.

CONCLUSIONS

SuPAR and, to a lesser extent, proADM levels on ICU admission were better tools in prognosticating in-hospital mortality than CRP or PCT. However, neither of the two new biomarkers has been demonstrated to be excessively useful in the current setting. The prognostic accuracy was better for severity scores than for any of the biomarkers.

[Prognostic value of procalcitonin, C-reactive protein and leukocytes in septic shock]

OBJECTIVES

This study evaluates the potential prognostic value of serial measurements of different biomarkers (procalcitonin [PCT], C-reactive protein and leukocytes [CRP]) in septic shock patients.

DESIGN

Prospective observational study.

SETTING

Intensive care unit of a third-level University Hospital.

PATIENTS

The study comprised a total of 88 septic shock patients defined using the 2001 Consensus Conference SCCM/ESICM/ACCP/ATS/SIS criteria. The PCT, CRP and leukocytes were recorded on admission to the ICU and again 72 hours after admission.

INTERVENTIONS

None.

RESULTS

Those patients with increasing procalcitonin levels showed higher hospital mortality than those with a decreasing levels (58.8% vs. 15.4%, P<0.01). No such effect was observed in relation to C-reactive protein or leukocytes. The best area under the curve for prognosis was for procalcitonin clearance (0.79). A procalcitonin clearance of 70% or higher offered a sensitivity and specificity of 94.7% and 53%, respectively.

CONCLUSIONS

Serial procalcitonin measurements are more predictive of the prognosis of septic shock patients than single measurements of this parameter. The prognostic reliability of the latter is also better than in the case of C-reactive protein and leukocytes. The application of serial procalcitonin measurements may allow the identification of those septic patients at increased mortality risk, and help improve their treatment.

Comparison of the performance of two general and three specific scoring systems for meningococcal septic shock in children

OBJECTIVE

To evaluate the performance at admission to the pediatric intensive care unit (PICU) of five severity scores, two general (the Pediatric Risk of Mortality [PRISM] II and III scores) and three specific for meningococcal septic shock (Leclerc, Glasgow Meningococcal Septicemia Prognostic Score [GMSPS], and Gedde-Dahl's MOC score) in children with this condition.

DESIGN

Multicenter, retrospective, cohort study.

SETTING

The PICUs from four tertiary centers.

PATIENTS

Patients were 192 children ranging in age from 1 month to 14 yrs consecutively admitted to the participating PICUs during a period of 12 yrs and 6 months (January 1983 to June 1995), who were diagnosed with presumed or confirmed meningococcal septic shock. Patients with a length of stay <2 hrs were excluded from the study.

INTERVENTIONS

Clinical and laboratory data gathered during the first 2 hrs after admission were used to compute the scoring systems tested.

MEASUREMENTS AND MAIN RESULTS

There were 66 deaths (34%). Neisseria meningitidis was cultured from 142 (74%) children. GMSPS and PRISM II provided the best discriminative capability, as measured by the area under the receiver operating characteristic curve (SEM): 0.816 (0.036) and 0.803 (0.041), respectively. The other three scores gave lower receiver operating characteristic areas: PRISM III = 0.777 (0.043), MOC = 0.775 (0.037), and Leclerc = 0.661 (0.045). There was a statistically significant difference between the areas under the receiver operating characteristic curve of GMSPS and Leclerc (p < .01) but not between the GMSPS and the remaining three scores. All five scores presented good calibration with no significant differences between observed and predicted mortality (Hosmer-Lemeshow goodness-of-fit test).

CONCLUSIONS

The specific GMSPS and the general pediatric severity system PRISM II performed better than the other three scores, being appropriate tools to assess severity of illness at admission to the PICU in children with presumed meningococcal septic shock.