Specialist training: workplace-based assessments impact on teaching, learning and feedback to support competency-based postgraduate programs

BACKGROUND

Workplace-based assessments (WBAs) are part of a competency-based curriculum where training progression is dependent on the achievement of defined competencies in a real-world clinical environment. There is a significant literature gap on the impact of WBAs implemented in resource constrained countries and their contextual challenges. This study aimed to examine the use, impact, and educational context of WBAs in South African medical specialist training programs drawing on perspectives from both trainees and trainers to identify educational challenges and propose effective solutions.

METHODS

A mixed methods national electronic survey was conducted with specialist medical trainees and supervising trainers from all eight specialist training institutions in South Africa involving 16 specialities. The survey responses were voluntary and anonymous. The survey was closed after seven months when data saturation was achieved. Descriptive statistical analysis was performed using SPSS Version 27 (SPSS Inc, 2012, Chicago, IL) for the quantitative analysis. The thematic coding framework for the qualitative analysis was facilitated by NVivo Version 12 software.

RESULTS

There were 108 ethnically diverse supervising trainers and 248 specialist trainees' survey respondents. Across the 16 medical specialities, 45% of the respondents were using WBAs. Despite contextual resource and staff challenges, this study found that WBAs had a positive impact to Kirkpatrick level 2 in providing actionable feedback to improve competency. WBA users had a significantly higher rating for trainee supervision (p < 0.01), general quality of feedback on trainee competence (< 0.01) and the specialist training program (p = 0.03) compared to WBA non-users. They also had a higher rating for the assessment of the trainee as a professional (p < 0.01); scholar (p < 0.01); communicator (p < 0.01); collaborator (p = 0.001) and leader/manager (p < 0.001) based on the AfriMEDS competency framework. Racism, sexism and favouritism were challenges that negatively affected the training programs.

CONCLUSION

Overall, this study reports that the use of WBAs had a substantially favourable impact on teaching, learning, feedback and supports a competency-based approach to specialist training programs. Addressing the contextual concerns that negatively impact training; training the trainees and trainers about their relationship, roles and responsibilities; and focusing on a trainee-centred, inclusive and empowering teaching approach will help further enhance its effectiveness.

Building Consensus on the Point-of-Care Ultrasound Skills Required for Effective Healthcare Service Delivery at District Hospitals in South Africa: A Delphi Study

BACKGROUND

Despite the widespread availability of ultrasound machines in South African district hospitals, there are no guidelines on the competency in point-of-care ultrasound (POCUS) use required by generalist doctors in this setting. This study aimed to define the required POCUS competencies by means of consensus via the Delphi method.

METHODS

An online Delphi process was initiated in June 2022, using the existing American Academy of Family Physicians' ultrasound curriculum (84 skillsets) as the starting questionnaire. Panelists were selected across the country, including two from district hospitals in each province and two from each academic family medicine department in South Africa (N = 36). In each iterative round, the participants were asked to identify which POCUS skillsets were essential, optional (region-specific), or non-essential for South African district hospitals. This process continued until consensus (>70% agreement) was achieved on all of the skillsets.

RESULTS

Consensus was achieved on 81 of the 84 skillsets after 5 iterative rounds (96.4%), with 3 skillsets that could not achieve consensus (defined as <5% change over more than 2 consecutive rounds). The final consensus identified 38 essential, 28 optional, and 15 non-essential POCUS skillsets for the South African district hospital context.

CONCLUSIONS

The list of essential POCUS skillsets provided by this study highlights the predominance of obstetric- and trauma-based skillsets required for generalist healthcare workers in South African district hospitals. The findings will require priority setting and revalidation prior to their implementation across the country.

Diagnosis of human immunodeficiency virus associated disseminated intravascular coagulation

INTRODUCTION

Disseminated intravascular Coagulation (DIC) is a thrombotic microangiopathy which may complicate a number of severe disease processes including sepsis. Development of microvascular thromboses results in consumption of coagulation factors and platelets and ultimate bleeding. Patients with HIV infection (PWH) often present with baseline dysregulation of the coagulation system which may increase severity and derangement of DIC presentation. Previously, we have shown that HIV is a significant risk factor for development of DIC.

METHODOLOGY

We conducted a retrospective record review of all DIC screens submitted to our tertiary coagulation laboratory in Johannesburg, South Africa, over a one year period and compared the laboratory presentation of DIC in PWH with presentation of DIC in patients without HIV infection.

RESULTS

Over the year, 246 patients fulfilled the International Society of Thrombosis and Haemostasis (ISTH) diagnostic criteria for DIC- 108 were confirmed HIV-infected and 77 were confirmed uninfected. PWH and DIC presented at a significantly earlier age (41 vs 46 years respectively, p<0.02). The prothrombin time was significantly more prolonged (30.1s vs 26.s), the d-dimer levels were substantially higher (5.89mg/L vs 4.52mg/L) and the fibrinogen (3.92g/L vs 1.73g/L) and platelet levels (64.8 vs 114.8x109/l) were significantly lower in PWH. PWH also showed significant synthetic liver dysfunction and higher background inflammation.

CONCLUSION

PWH who fulfil the diagnostic criteria for DIC show significantly more dysregulation of the haemostatic system. This may reflect baseline abnormalities including endothelial dysfunction in the context of inflammation and liver dysfunction.

An analysis of obstetric practices and outcomes in a deep rural district hospital in South Africa

Background

Internationally, there has been a focus on ensuring that Caesarean deliveries are performed only when indicated, to ensure the best outcome for mother and baby. In South Africa, despite a variety of health system interventions, maternal and perinatal mortality remain unacceptably high.

Objectives

To describe and compare the clinical outcomes related to the mode of delivery, for patients managed at rural primary healthcare level.

Methods

This retrospective cross-sectional observational analytical study was conducted at a deep rural district hospital in northern KwaZulu-Natal, South Africa. Maternity Case Records and Caesarean delivery audit tools from 2018 were reviewed.

Results

In total, 634 files were retrieved. The Caesarean delivery rate in the sample was 30.8% (193 of 634 deliveries), and according to the Robson classification, groups 5 and 1 were the biggest contributors to Caesarean delivery. All Caesarean deliveries were deemed to have been medically indicated. As compared to those whose delivery was normal vaginal, the odds of having post-partum haemorrhage were 25 times higher, and the odds of having any complication were three times higher, if a mother delivered by Caesarean (p<0.001). In neonates who were delivered by Caesarean, the odds of being admitted to nursery were four times higher than those delivered vaginally (p<0.001).

Conclusion

Showing a significantly higher risk of maternal and neonatal complications, this study validated Caesarean delivery at rural primary care as a potentially dangerous undertaking, for which adequate precautions should be taken. There is a need for interventions targeting rural healthcare in South Africa, to ensure that obstetric services are offered to patients in as safe a manner as possible in this environment.

Serum albumin and mortality in patients with HIV and end-stage renal failure on peritoneal dialysis

Background

Peritoneal dialysis (PD) is an easily implementable dialysis modality in end-stage renal disease (ESRD). PD may improve access to renal replacement therapy in low- and middle-income countries; however, these countries have a higher prevalence of protein-energy wasting in patients and poorer socioeconomic conditions. We evaluated the effects of HIV infection on serum albumin levels in ESRD patients starting continuous ambulatory PD (CAPD) and mortality outcomes.

Methods

We conducted a single-center prospective cohort study of consecutive incident CAPD patients recruited from two hospitals in Durban, South Africa, from September 2012 to February 2015. Seventy HIV-negative and 70 HIV-positive ESRD patients were followed monthly for serum albumin levels and mortality events during the first 18 months of CAPD therapy.

Results

The HIV-positive cohort recorded 28 deaths (40%) among patients with a functional CAPD catheter at 18 months and 13 deaths (18.6%) in the HIV-negative cohort (p = 0.005). The mean serum albumin levels were lower in the HIV-positive cohort than in the HIV-negative cohort during the 18-month follow-up. The mean difference in serum albumin levels between the two cohorts was 4.24 g/L (95% confidence interval [CI] 2.02–6.46, p<0.001) at baseline and 3.99 g/L (95% CI 1.19–6.79, p = 0.006) at 18 months. HIV-positive status (adjusted regression coefficient -2.84, CI -5.00–-0.67, p = 0.011), diabetes (adjusted coefficient -2.85; CI, -5.58–-0.12; p = 0.041), and serum C-reactive protein and blood hemoglobin levels were independent predictors of serum albumin levels on multivariable linear regression. Baseline serum albumin <25 g/L (subdistribution-hazard ratio [SHR] 13.06, 95% CI 3.09–55.14, p<0.001) and CD4⁺ cell count <200 cells/μL (SHR 3.2, CI 1.38–7.45, p = 0.007) were independent predictors of mortality in our competing risk model.

Conclusions

HIV infection can adversely affect serum albumin levels in ESRD patients managed with CAPD, while low baseline serum albumin levels and impaired immunity reliably predict mortality.