Emergency medicine in the developing world: a Delphi study

Assessment of the HIV Enhanced Access Testing in the Emergency Department (HEATED) program in Nairobi, Kenya: a quasi-experimental prospective study

BACKGROUND

Persons seeking emergency injury care are often from higher-risk and underserved key populations (KPs) and priority populations (PPs) for HIV programming. While facility-based HIV Testing Services (HTS) in Kenya are effective, emergency department (ED) delivery is limited, despite the potential to reach underserved persons.

METHODS

This quasi-experimental prospective study evaluated implementation of the HIV Enhanced Access Testing in Emergency Departments (HEATED) at Kenyatta National Hospital ED in Nairobi, Kenya. The HEATED program was designed as a multi-component intervention employing setting appropriate strategies for HIV care sensitization and integration, task shifting, resource reorganization, linkage advocacy, skills development and education to promote ED-HTS with a focus on higher-risk persons. KPs included sex workers, gay men, men who have sex with men, transgender persons and persons who inject drugs. PPs included young persons (18-24 years), victims of interpersonal violence, persons with hazardous alcohol use and persons never HIV tested. Data were obtained from systems-level records, enrolled injured patient participants and healthcare providers. Systems and patient-level data were collected during a pre-implementation period (6 March - 16 April 2023) and post-implementation (period 1, 1 May - 26 June 2023). Additional, systems-level data were collected during a second post-implementation (period 2, 27 June - 20 August 2023). HTS data were evaluated as facility-based HIV testing (completed in the ED) and distribution of HIV self-tests independently, and aggregated as ED-HTS. Evaluation analyses were completed across reach, effectiveness, adoption, implementation and maintenance framework domains.

RESULTS

All 151 clinical staff were reached through trainings and sensitizations on the HEATED program. Systems-level ED-HTS among all presenting patients increased from 16.7% pre-implementation to 23.0% post-implementation periods 1 and 2 (RR = 1.31, 95% CI: 1.21-1.43; p < 0.001). Among 605 enrolled patient participants, facilities-based HTS increased from 5.7% pre-implementation to 62.3% post-implementation period 1 (RR = 11.2, 95%CI: 6.9-18.1; p < 0.001). There were 440 (72.7%) patient participants identified as KPs (5.6%) and/or PPs (65.3%). For enrolled KPs/PPs, facilities-based HTS increased from 4.6% pre-implementation to 72.3% post-implementation period 1 (RR = 13.8, 95%CI: 5.5-28.7, p < 0.001). Systems and participant level data demonstrated successful adoption and implementation of the HEATED program. Through 16 wk post-implementation a significant increase in ED-HTS delivery was maintained as compared to pre-implementation.

CONCLUSIONS

The HEATED program increased overall ED-HTS and augmented delivery to KPs/PPs, suggesting that broader implementation could improve HIV services for underserved persons already in contact with health systems.

IFEM model curriculum: emergency medicine learning outcomes for undergraduate medical education

BACKGROUND

The International Federation for Emergency Medicine (IFEM) published its model curriculum for medical student education in emergency medicine in 2009. Because of the evolving principles of emergency medicine and medical education, driven by societal, professional, and educational developments, there was a need for an update on IFEM recommendations. The main objective of the update process was creating Intended Learning Outcomes (ILOs) and providing tier-based recommendations.

METHOD

A consensus methodology combining nominal group and modified Delphi methods was used. The nominal group had 15 members representing eight countries in six regions. The process began with a review of the 2009 curriculum by IFEM Core Curriculum and Education Committee (CCEC) members, followed by a three-phase update process involving survey creation [The final survey document included 55 items in 4 sections, namely, participant & context information (16 items), intended learning outcomes (6 items), principles unique to emergency medicine (20 items), and content unique to emergency medicine (13 items)], participant selection from IFEM member countries and survey implementation, and data analysis to create the recommendations.

RESULTS

Out of 112 invitees (CCEC members and IFEM member country nominees), 57 (50.9%) participants from 27 countries participated. Eighteen (31.6%) participants were from LMICs, while 39 (68.4%) were from HICs. Forty-four (77.2%) participants have been involved with medical students' emergency medicine training for more than five years in their careers, and 56 (98.2%) have been involved with medical students' training in the last five years. Thirty-five (61.4%) participants have completed a form of training in medical education. The exercise resulted in the formulation of tiered ILO recommendations. Tier 1 ILOs are recommended for all medical schools, Tier 2 ILOs are recommended for medical schools based on perceived local healthcare system needs and/or adequate resources, and Tier 3 ILOs should be considered for medical schools based on perceived local healthcare system needs and/or adequate resources.

CONCLUSION

The updated IFEM ILO recommendations are designed to be applicable across diverse educational and healthcare settings. These recommendations aim to provide a clear framework for medical schools to prepare graduates with essential emergency care capabilities immediately after completing medical school. The successful distribution and implementation of these recommendations hinge on support from faculty and administrators, ensuring that future healthcare professionals are well-prepared for emergency medical care.

Implementation and Assessment of the HIV Enhanced Access Testing in the Emergency Department (HEATED) Program in Nairobi, Kenya: A Quasi-Experimental Prospective Study

Background

Persons seeking emergency injury care are often from underserved key populations (KPs) and priority populations (PPs) for HIV programming. While facility-based HIV Testing Services (HTS) in Kenya are effective, emergency department (ED) delivery is limited, despite the potential to reach underserved persons.

Methods

This quasi-experimental prospective study evaluated implementation of the HIV Enhanced Access Testing in Emergency Departments (HEATED) at Kenyatta National Hospital ED in Nairobi, Kenya. The HEATED program was designed using setting specific data and utilizes resource reorganization, services integration and HIV sensitization to promote ED-HTS. KPs included sex workers, gay men, men who have sex with men, transgender persons and persons who inject drugs. PPs included young persons (18-24 years), victims of interpersonal violence, persons with hazardous alcohol use and those never previously HIV tested. Data were obtained from systems-level records, enrolled injured patient participants and healthcare providers. Systems and patient-level data were collected during a pre-implementation period (6 March - 16 April 2023) and post-implementation (period 1, 1 May - 26 June 2023). Additional, systems-level data were collected during a second post-implementation (period 2, 27 June - 20 August 2023). Evaluation analyses were completed across reach, effectiveness, adoption, implementation and maintenance framework domains.

Results

All 151 clinical staff were reached through trainings and sensitizations on the HEATED program. Systems-level ED-HTS increased from 16.7% pre-implementation to 23.0% post-implementation periods 1 and 2 (RR=1.31, 95% CI:1.21-1.43; p<0.001) with a 62.9% relative increase in HIV self-test kit provision. Among 605 patient participants, facilities-based HTS increased from 5.7% pre-implementation to 62.3% post-implementation period 1 (RR=11.2, 95%CI:6.9-18.1; p<0.001). There were 440 (72.7%) patient participants identified as KPs (5.6%) and/or PPs (65.3%). For enrolled KPs/PPs, HTS increased from 4.6% pre-implementation to 72.3% post-implementation period 1 (RR=13.8, 95%CI:5.5-28.7, p<0.001). Systems and participant level data demonstrated successful adoption and implementation of the HEATED program. Through 16-weeks post-implementation a significant increase in ED-HTS delivery was maintained as compared to pre-implementation.

Conclusions

The HEATED program increased ED-HTS and augmented delivery to KPs/PPs, suggesting that broader implementation could improve HIV services for underserved persons, already in contact with health systems.

Developing a consensus-based definition of out-of-hospital clinical deterioration: A Delphi study

BACKGROUND

Clinical deterioration is a time-critical medical emergency requiring rapid recognition and intervention. Deteriorating patients are seen across various healthcare settings, including the out-of-hospital (OOH) environment. OOH care is an evolving area of medicine where decisions are made regarding priority and timing of clinical interventions, ongoing management, and transport to appropriate care. To date, the literature lacks a standardised definition of OOH clinical deterioration.

OBJECTIVE

The objective of this study was to create a consensus-based definition of OOH clinical deterioration informed by emergency medicine health professionals.

METHODS

A Delphi study consisting three rounds was conducted electronically between June 2020 and January 2021. The expert panel consisted of 30 clinicians, including emergency physicians and paramedics.

RESULTS

A consensus-based definition of OOH clinical deterioration was identified as changes from a patient's baseline physiological status resulting in their condition worsening. These changes primarily take the form of measurable vital signs and assessable symptoms but should be evaluated in conjunction with the history of events and pertinent risk factors. Clinicians should be suspicious that a patient could deteriorate when changes occur in one or more of the following vital signs: respiratory rate, heart rate, blood pressure, Glasgow Coma Scale, oxygen saturation, electrocardiogram, and skin colour. Almost all participants (92%) indicated an early warning system would be helpful to assist timely recognition of deteriorating patients.

CONCLUSION

The creation of a consensus-based definition of OOH clinical deterioration can serve as a starting point for the development and validation of OOH-specific early warning systems. Moreover, a standardised definition allows meaningful comparisons to be made across health services and ensures consistency in future research. This study has shown recognition of OOH clinical deterioration to be a complex issue requiring further research. Improving our understanding of key factors contributing to deterioration can assist timely recognition and intervention, potentially reducing unnecessary morbidity and mortality.

Cardiopulmonary resuscitation in low-resource settings: a statement by the International Liaison Committee on Resuscitation, supported by the AFEM, EUSEM, IFEM, and IFRC

Most recommendations on cardiopulmonary resuscitation were developed from the perspective of high-resource settings with the aim of applying them in these settings. These so-called international guidelines are often not applicable in low-resource settings. Organisations including the International Liaison Committee on Resuscitation (ILCOR) have not sufficiently addressed this problem. We formed a collaborative group of experts from various settings including low-income, middle-income, and high-income countries, and conducted a prospective, multiphase consensus process to formulate this ILCOR Task Force statement. We highlight the discrepancy between current cardiopulmonary resuscitation guidelines and their applicability in low-resource settings. Successful existing initiatives such as the Helping Babies Breathe programme and the WHO Emergency Care Systems Framework are acknowledged. The concept of the chainmail of survival as an adaptive approach towards a framework of resuscitation, the potential enablers of and barriers to this framework, and gaps in the knowledge are discussed, focusing on low-resource settings. Action points are proposed, which might be expanded into future recommendations and suggestions, addressing a large diversity of addressees from caregivers to stakeholders. This statement serves as a stepping-stone to developing a truly global approach to guide resuscitation care and science, including in health-care systems worldwide.

How Health Care Practitioners experience emergencies at Primary Health Care facilities – Kinks in the chain of survival

Background

The 72^nd World Health Assembly has recognised that emergency care at primary health care level is vital for reducing overall mortality and disability. The system of emergency care at this level is affected by various external factors. Little is known about these factors and how they shape the experiences of health care practitioners dealing with medical emergencies in Primary Health Care (PHC) settings. The objective of the study was to explore the experiences of health care practitioners in dealing with emergencies in PHC facilities in the Gauteng province of South Africa.

Methods

A qualitative formative evaluation approach was used. Data were collected using semi structured interviews and analysed using qualitative content analysis to describe the experiences of health care practitioners dealing with emergencies at a primary health care level. Participants included health care practitioners from various levels of the district health system.

Results

Major themes that emerged explored challenges faced by health care practitioners, the referral system and influential policy such as the ideal clinic movement.

Research priority setting in emergency care: A scoping review

Objective

Priority areas for emergency care research are emerging and becoming ever more important. The objectives of this scoping review were to (1) provide a comprehensive overview of published emergency care priority-setting studies by collating and comparing priority-setting methodology and (2) describe the resulting research priorities identified.

Methods

The Joanna Briggs Institute methodological framework was used. Inclusion criteria were peer-review articles available in English, published between January 1, 2008 and March 31, 2019 and used 2 or more search terms. Five databases (Scopus, AustHealth, EMBASE, CINAHL, and Ovid MEDLINE) were searched. REporting guideline for PRIority SEtting of health research (REPRISE) criteria were used to assess the quality of evidence of included articles.

Results

Forty-five studies were included. Fourteen themes for emergency care research were considered within 3 overarching research domains: emergency populations (pediatrics, geriatrics), emergency care workforce and processes (nursing, shared decision making, general workforce, and process), and emergency care clinical areas (imaging, falls, pain management, trauma care, substance misuse, infectious diseases, mental health, cardiology, general clinical care). Variation in the reporting of research priority areas was evident. Priority areas to drive the global agenda for emergency care research are limited given the country and professional group-specific context of existing studies.

Conclusion

This comprehensive summary of generated research priorities across emergency care provides insight into current and future research agendas. With the nature of emergency care being inherently broad, future priorities may warrant population (eg, children, geriatrics) or subspecialty (eg, trauma, toxicology, mental health) focus and be derived using a rigorous framework and patient engagement.

Assessment of standard HIV testing services delivery to injured persons seeking emergency care in Nairobi, Kenya: A prospective observational study

Emergency departments (EDs) in Africa are contact points for key groups for HIV testing services (HTS) but understanding of ED-testing delivery is limited which may impeded program impacts. This study evaluated the offering and uptake of standard HTS among injured persons seeking ED care at Kenyatta National Hospital (KNH) in Nairobi, Kenya. An ED population of adult injured persons was prospectively enrolled (1 March-25 May 2021) and followed through ED disposition. Participants requiring admission were followed through hospital discharge and willing participants were contacted at 28-days for follow up. Data on population characteristics and HTS were collected by personnel distinct from clinicians responsible for standard HTS. Descriptive analyses were performed and prevalence values with 95% confidence intervals (CI) were calculated for HIV parameters. The study enrolled 646 participants. The median age was 29 years with the majority male (87.8%). Most ED patients were discharged (58.9%). A prior HIV diagnosis was reported by 2.3% of participants and 52.7% reported their last testing as >6 months prior. Standard ED-HTS were offered to 49 or 8.6% of participants (95% CI: 5.8-9.9%), among which 89.8% accepted. For ED-tested participants 11.4% were newly diagnosed with HIV (95% CI: 5.0-24.0%). Among 243 participants admitted, testing was offered to 6.2% (95% CI: 3.9-9.9%), with 93.8% accepting. For admitted participants tested 13.3% (95% CI: 4.0-35.1%) were newly diagnosed (all distinct from ED cases). At 28-day follow up an additional 22 participants reported completing testing since ED visitation, with three newly diagnosed. During the full follow-up period the HIV prevalence in the population tested was 10.3% (95% CI: 5.3-19.0%); all being previously undiagnosed. Offering of standard HTS was infrequent, however, when offered, uptake and identification of new HIV diagnoses were high. These data suggest that opportunities exist to improve ED-HTS which could enhance identification of undiagnosed HIV.

Mobile application adjunct to the WHO basic emergency care course: a mixed methods study

OBJECTIVES

The WHO developed a 5-day basic emergency care (BEC) course using the traditional lecture format. However, adult learning theory suggests that lecture-based courses alone may not promote long-term knowledge retention. We assessed whether a mobile application adjunct (BEC app) can have positive impact on knowledge acquisition and retention compared with the BEC course alone and evaluated perceptions, acceptability and barriers to adoption of such a tool.

DESIGN

Mixed-methods prospective cohort study.

PARTICIPANTS

Adult healthcare workers in six health facilities in Tanzania who enrolled in the BEC course and were divided into the control arm (BEC course) or the intervention arm (BEC course plus BEC app).

MAIN OUTCOME MEASURES

Changes in knowledge assessment scores, self-efficacy and perceptions of BEC app.

RESULTS

92 enrolees, 46 (50%) in each arm, completed the BEC course. 71 (77%) returned for the 4-month follow-up. Mean test scores were not different between the two arms at any time period. Both arms had significantly improved test scores from enrolment (prior to distribution of materials) to day 1 of the BEC course and from day 1 of BEC course to immediately after BEC course completion. The drop-off in mean scores from immediately after BEC course completion to 4 months after course completion was not significant for either arm. No differences were observed between the two arms for any self-efficacy question at any time point. Focus groups revealed five major themes related to BEC app adoption: educational utility, clinical utility, user experience, barriers to access and barriers to use.

CONCLUSION

The BEC app was well received, but no differences in knowledge retention and self-efficacy were observed between the two arms and only a very small number of participants reported using the app. Technologic-based, linguistic-based and content-based barriers likely limited its impact.

Self-efficacy beliefs and expectations during an Emergency Medicine Clerkship

Background

Undergraduate emergency medicine (EM) training is important because all medical graduates are expected to have basic emergency knowledge and skills regardless of their future speciality. EM clerkship should provide opportunities to improve not only knowledge and skills but also the self-efficacy of learners. This study aims to evaluate the expectations, opinions, and self-efficacy beliefs of medical students during a 4-week mandatory EM clerkship.

Methods

This study used a prospective longitudinal design with quantitative and qualitative survey methods. It includes final year medical students of the 2015–2016 academic year. Voluntary de-identified pre- and post-clerkship surveys included 25 statements. The post-clerkship survey included two open-ended questions asking participants to identify the best and worst three aspects of EM clerkship. Responses were analysed to determine themes or commonalities in participant comments indicative of the EM clerkship learning experiences and environment.

Results

Sixty-seven out of seventy-nine (85%) students responded to both pre- and post-clerkship surveys. Medical students’ expectations of EM clerkships’ effect on knowledge and skill acquisition were high, and a 4-week mandatory EM clerkship was able to meet their expectations. Medical students had very high expectations of EM clerkships’ educational environment. In most aspects, their experiences significantly exceeded their expectations (p value < 0.001). The only exception was the duration of clerkship, which was deemed insufficient both at the beginning and at the end (p value: 0.92). The students perceived that their self-efficacy improved significantly in the majority of basic EM skills and procedures (p value < 0.001). Emergent qualitative themes in the study also supported these results.

Conclusion

This study showed that a 4-week mandatory EM clerkship increased medical students' perceived self-efficacy in basic emergency management skills. The EM clerkship met students' expectations on knowledge and skill acquisition, and exceeded students’ expectations on educational environment.

Acceptability and uptake of HIV self-testing in emergency care settings: A systematic review and meta-analysis

BACKGROUND

Emergency departments (ED) interface with large numbers of patients that are often missed by conventional HIV testing approaches. ED-based HIV self-testing (HIVST) is an innovative engagement approach which has potential for testing gains among populations that have failed to be reached. This systematic review and meta-analysis evaluated acceptability and uptake of HIVST, as compared to standard provider-delivered testing approaches, among patients seeking care in ED settings.

METHODS

Six electronic databases were systematically searched (Dates: January 1990-May 2021). Reports with data on HIVST acceptability and/or testing uptake in ED settings were included. Two reviewers identified eligible records (κ= 0.84); quality was assessed using formalized criteria. Acceptability and testing uptake metrics were summarized, and pooled estimates were calculated using random-effects models with assessments of heterogeneity.

RESULTS

Of 5773 records identified, seven met inclusion criteria. The cumulative sample was 1942 subjects, drawn from three randomized control trials (RCTs) and four cross-sectional studies. Four reports assessed HIVST acceptability. Pooled acceptability of self-testing was 92.6% (95% confidence interval [CI]: 88.0%-97.1%). Data from two RCTs demonstrated that HIVST significantly increased testing uptake as compared to standard programs (risk ratio [RR] = 4.41, 95% CI: 1.95-10.10, I2  = 25.8%). Overall, the quality of evidence was low (42.9%) or very low (42.9%), with one report of moderate quality (14.2%).

CONCLUSIONS

Available data indicate that HIVST may be acceptable and may increase testing among patients seeking emergency care, suggesting that expanding ED-based HIVST programs could enhance HIV diagnosis. However, given the limitations of the reports, additional research is needed to better inform the evidence base.

Utilizing Lean Software Methods To Improve Acceptance of Global eHealth Initiatives: Results From the Implementation of the Basic Emergency Care App

Background

Health systems in low- and middle-income countries face considerable challenges in providing high-quality accessible care. eHealth has had mounting interest as a possible solution given the unprecedented growth in mobile phone and internet technologies in these locations; however, few apps or software programs have, as of yet, gone beyond the testing phase, most downloads are never opened, and consistent use is extremely rare. This is believed to be due to a failure to engage and meet local stakeholder needs and the high costs of software development.

Objective

World Health Organization Basic Emergency Care course participants requested a mobile point-of-care adjunct to the primary course material. Our team undertook the task of developing this solution through a community-based participatory model in an effort to meet trainees’ reported needs and avoid some of the abovementioned failings. We aimed to use the well-described Lean software development strategy—given our familiarity with its elements and its ubiquitous use in medicine, global health, and software development—to complete this task efficiently and with maximal stakeholder involvement.

Methods

From September 2016 through January 2017, the Basic Emergency Care app was designed and developed at the University of California San Francisco. When a prototype was complete, it was piloted in Cape Town, South Africa and Dar es Salaam, Tanzania—World Health Organization Basic Emergency Care partner sites. Feedback from this pilot shaped continuous amendments to the app before subsequent user testing and study of the effect of use of the app on trainee retention of Basic Emergency Care course material.

Results

Our user-centered mobile app was developed with an iterative participatory approach with its first version available within 6 months and with high acceptance—95% of Basic Emergency Care Course participants felt that it was useful. Our solution had minimal direct costs and resulted in a robust infrastructure for subsequent assessment and maintenance and allows for efficient feedback and expansion.

Conclusions

We believe that utilizing Lean software development strategies may help global health advocates and researchers build eHealth solutions with a process that is familiar and with buy-in across stakeholders that is responsive, rapid to deploy, and sustainable.

Establishment of an Undergraduate FOAM Initiative: International Emergency Medicine (iEM) Education Project for Medical Students

Introduction

Our goal was to describe the structure, process, platforms, and piloting period activities of the International Emergency Medicine (iEM) Education Project, which is a Free Open Access Medical Education (FOAM) initiative designed for medical students.

Methods

This was a descriptive study. We analyzed the activity data of iEM Education Project platforms (website and image, video, audio archives) in the piloting period (June 1, 2018–August 31, 2018). Studied variables included the total and monthly views, views by country and continents, the official languages of the countries where platforms were played, and their income levels.

Results

Platforms were viewed or played 38,517 times by users from 123 countries. The total views and plays were 8,185, 11,896, and 18,436 in June, July, and August, respectively. We observed a monthly increasing trend in all platforms. Image archive and website were viewed the most. All platforms were dominantly viewed from Asia and North America, high- and upper-middle-income countries, and non-English speaking countries. However, there were no statistically significant differences between continents, income levels, or language in platforms, except for the website, the project’s main hub, which showed a strong trend for difference between income levels (Kruskal-Wallis, P = 0.05). Website views were higher in high-income countries compared with low- and lower-middle income countries (Mann Whitney U test, P = 0.038 and P = 0.021, respectively).

Conclusion

The iEM Education Project was successfully established. Our encouraging initial results support the international expansion and increased collaboration of this project. Despite targeting developing countries with limited resources in this project, their engagement was suboptimal. Solutions to reach medical students in these countries should be investigated.

Qualitative exploration of patient flow in a Caribbean emergency department

OBJECTIVES

Emergency departments (EDs) are complex adaptive systems and improving patient flow requires understanding how ED processes work. This study aimed to explore the patient flow process in an ED in Trinidad and Tobago, identifying organisational factors influencing patient flow.

METHODS

Multiple qualitative methods, including non-participant observations, observational process mapping and informal conversational interviews were used to explore patient flow. The process maps were generated from the observational process mapping. Thematic analysis was used to analyse the data.

SETTING

The study was conducted at a major tertiary level ED in Trinidad and Tobago.

PARTICIPANTS

Patient and staff journeys in the ED were directly observed.

RESULTS

Six broad categories were identified: (1) ED organisational work processes, (2) ED design and layout, (3) material resources, (4) nursing staff levels, roles, skill mix and use, (5) non-clinical ED staff and (6) external clinical and non-clinical departments. Within each category there were individual factors that appeared to either facilitate or hinder patient flow. Organisational processes such as streaming, front loading of investigations and the transfer process were pre-existing strategies in the ED while staff actions to compensate for limitations with flow were more intuitive. A conceptual framework of factors influencing ED patient flow is also presented.

CONCLUSION

The knowledge gained may be used to strengthen the emergency care system in the local context. However, the study findings should be validated in other settings.

Clinical outcomes from out-of-hospital cardiac arrest in low-resource settings - A scoping review

AIM OF THE SCOPING REVIEW

Scientific recommendations on resuscitation are typically formulated from the perspective of an ideal resource environment, with little consideration of applicability in lower-income countries. We aimed to determine clinical outcomes from out-of-hospital cardiac arrest (OHCA) in low-resource countries, to identify shortcomings related to resuscitation in these areas and possible solutions, and to suggest future research priorities.

DATA SOURCES

This scoping review was part of the continuous evidence evaluation process of the International Liaison Committee on Resuscitation (ILCOR), and was performed following the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews. We identified low-resource countries as countries with a low- or middle gross national income per capita (World Bank data). We performed a literature search on outcomes after OHCA in these countries, and we extracted data on the outcome. We applied descriptive statistics and conducted a post-hoc correlation analysis of cohort size and ROSC rates.

RESULTS

We defined 24 eligible studies originating from middle-income countries, but none from low-income regions, suggesting a reporting bias. The number of reported patients in these studies ranged from 54 to 3214. Utstein-style reporting was rarely used. Return of spontaneous circulation varied from 0% to 62%. Fifteen studies reported on survival to hospital discharge (between 1.0 and 16.7%) or favourable neurological outcome (between 1.0 and 9.3%). An inverse correlation was found for study cohort size and the rate of return of spontaneous circulation (ρ = -0.48, p = 0.034).

CONCLUSION

Studies of OHCA outcomes in low-resource countries are heterogeneous and may be compromised by reporting bias. Minimum cardiopulmonary resuscitation standards for low-resource settings should be developed collaboratively involving local experts, respecting culture and context while balancing competing health priorities.

Emergency care status, priorities and standards for the Pacific region: A multiphase survey and consensus process across 17 different Pacific Island Countries and Territories

Background

Effective emergency care (EC) reduces mortality, aids disaster and outbreak response, and is necessary for universal health coverage. Surge events frequently challenge Pacific Island Countries and Territories (PICTs), where robust routine EC is required for resilient health systems. We aimed to describe the current status, determine priority actions and set minimum standards for EC systems development across the Pacific region.

Methods

We used a prospective, multiphase, expert consensus process to collect data from PICT EC stakeholders using focus groups, electronic surveys and panel review between August 2018 and April 2019. Data were analysed using descriptive statistics, consensus agreement and graphic interpretation. We structured the research according to the World Health Organisation EC Systems and building block framework adapted for the Pacific context.

Findings

Over 200 participants from 17 PICTs engaged in at least one component of the multiphase process. Gaps in functional capacity exist in most PICTs for both facility-based and pre-hospital care. EC is a low priority across the Pacific and integrated poorly with disaster plans. Participants emphasised human resource support and government recognition of EC as priority actions, and generated 24 facility-based and 22 pre-hospital Pacific EC standards across all building blocks.

Interpretation

PICT stakeholders now have baseline indicators and a comprehensive roadmap for EC development within a globally recognised health systems framework. This study generates practical, context-appropriate tools to trigger further research, conduct evidence-based advocacy, drive future improvements and measure progress towards achieving universal health access for Pacific peoples.

Funding

Secretariat of the Pacific Community (partial)

Emergency Medicine Training Programs in Low- and Middle-Income Countries: A Systematic Review

Background

Despite the growing interest in the development of emergency care systems and emergency medicine (EM) as a specialty globally, there still exists a significant gap between the need for and the provision of emergency care by specialty trained providers. Many efforts to date to expand the practice of EM have focused on programs developed through partnerships between higher- and lower-resource settings.

Objective

To systematically review the literature to evaluate the composition of EM training programs in low- and middle-income countries (LMICs) developed through partnerships.

Methods

An electronic search was conducted using four databases for manuscripts on EM training programs - defined as structured education and/or training in the methods, procedures, and techniques of acute or emergency care - developed through partnerships. The search produced 7702 results. Using a priori inclusion and exclusion criteria, 94 manuscripts were included. After scoring these manuscripts, a more in-depth examination of 26 of the high-scoring manuscripts was conducted.

Findings

Fifteen highlight programs with a focus on specific EM content (i.e. ultrasound) and 11 cover EM programs with broader scopes. All outline programs with diverse curricula and varied educational and evaluative methods spanning from short courses to full residency programs, and they target learners from medical students and nurses to mid-level providers and physicians. Challenges of EM program development through partnerships include local adaptation of international materials; addressing the local culture(s) of learning, assessment, and practice; evaluation of impact; sustainability; and funding.

Conclusions

Overall, this review describes a diverse group of programs that have been or are currently being implemented through partnerships. Additionally, it highlights several areas for program development, including addressing other topic areas within EM beyond trauma and ultrasound and evaluating outcomes beyond the level of the learner. These steps to develop effective programs will further the advancement of EM as a specialty and enhance the development of effective emergency care systems globally.

Novel educational adjuncts for the World Health Organization Basic Emergency Care Course: A prospective cohort study

INTRODUCTION

The World Health Organization's (WHO) Basic Emergency Care Course (BEC) is a five day, in-person course covering basic assessment and life-saving interventions. We developed two novel adjuncts for the WHO BEC: a suite of clinical cases (BEC-Cases) to simulate patient care and a mobile phone application (BEC-App) for reference. The purpose was to determine whether the use of these educational adjuncts in a flipped classroom approach improves knowledge acquisition and retention among healthcare workers in a low-resource setting.

METHODS

We conducted a prospective, cohort study from October 2017 through February 2018 at two district hospitals in the Pwani Region of Tanzania. Descriptive statistics, Fisher's exact t-tests, and Wilcoxon ranked-sum tests were used to examine whether the use of these adjuncts resulted in improved learner knowledge. Participants were enrolled based on location into two arms; Arm 1 received the BEC course and Arm 2 received the BEC-Cases and BEC-App in addition to the BEC course. Both Arms were tested before and after the BEC course, as well as a 7-month follow-up exam. All participants were invited to focus groups on the course and adjuncts.

RESULTS

A total of 24 participants were included, 12 (50%) of whom were followed to completion. Mean pre-test scores in Arm 1 (50%) were similar to Arm 2 (53%) (p=0.52). Both arms had improved test scores after the BEC Course Arm 1 (74%) and Arm 2 (87%), (p=0.03). At 7-month follow-up, though with significant participant loss to follow up, Arm 1 had a mean follow-up exam score of 66%, and Arm 2, 74%.

DISCUSSION

Implementation of flipped classroom educational adjuncts for the WHO BEC course is feasible and may improve healthcare worker learning in low resource settings. Our focus- group feedback suggest that the course and adjuncts are user friendly and culturally appropriate.

Learning in the Digital Era - Awareness and Usage of Free Open Access Meducation among Emergency Department Doctors

Introduction

Information and communication technology has revolutionized the space of medical education by providing a multitude of up-to-date evidence-based data to healthcare practitioners. Despite the increasing popularity of FOAM - Free Open Access Meducation (Medical Education) globally - data relating to its awareness and usage in Africa is lacking. In this study, we explore the awareness and usage of FOAM among doctors working at select emergency departments in Johannesburg.

Methods

The study comprised a prospective, questionnaire based, cross-sectional survey of medical doctors working at five academically affiliated emergency departments in Johannesburg. Data was described and compared.

Results

One-hundred and four participants completed the survey. Most of the respondents were aged between 31 and 39 years (n = 40, 43.9%). There were no significant differences between the proportion of females and males that used FOAM (p = 0.56). Most participants (n = 91, 87.5%) were aware of FOAM, while 82 (78.8%) used FOAM, 13 (12.5%) were unsure if they used FOAM and nine (8.7%) did not use FOAM. Majority of those that used FOAM, only used it once a week (n = 47, 57.3%). Most participants spent between one and two hours per day on FOAM (n = 29, 35.4%). Smartphones were by far the most commonly used device to access FOAM (n = 91, 87.5%).

Conclusion

The level of awareness of FOAM is high and its usage is prevalent among emergency medicine healthcare professionals in Johannesburg. As technology becomes more prominent, institutions must aim to adapt to the digital era in their teaching methods.

Inpatient Cross-Cover Consensus Recommendations for Medical and Surgical Residents: A Delphi Analysis

BACKGROUND

Residents regularly care for hospitalized patients for whom they are not the primary provider (cross-cover), often without guidance.

OBJECTIVE

We identified and defined components of safe cross-cover care.

METHODS

Sixty medical and surgical faculty physicians and chief residents from the Midwest were invited to participate in a Delphi study analyzing the appropriateness of cross-covering residents evaluating patients at bedside, deferring issues to the primary team, documenting a note, contacting the attending, and communicating with nurses. The first survey was free text, and responses were categorized. In the second survey, physicians rated categorized responses based on appropriateness using a 5-point Likert scale. High consensus was defined as ≥ 80% agreement, approaching consensus as 51% to 79% agreement, and nonconsensus as ≤ 50% agreement. Results were analyzed by specialty and cross-cover experience in the past year using Pearson χ² test or Fisher exact test.

RESULTS

Forty respondents (67%) completed the first survey and 30 (50%) completed the second. Responses led to 46 categories. Twenty-eight items (60%) achieved high consensus, 8 (17%) approached consensus, and 10 (22%) did not achieve consensus, with no difference based on specialty or experience. Responses with 100% consensus included: residents should evaluate a patient at bedside whenever asked by the nurse; documentation should occur for change in level of care, death, code, or rapid response team activation; and physician-nurse communication should be respectful and closed loop.

CONCLUSIONS

This regional physician panel reached consensus on 28 elements important in cross-cover care, which can be used for training and future studies.

Development of a simple, practice-based tool to assess quality of paediatric emergency care delivery in resource-limited settings: identifying critical actions via a Delphi study

OBJECTIVE

Provision of timely, high-quality care for the initial management of critically ill children in African hospitals remains a challenge. Monitoring the completion of critical actions during resuscitations can inform efforts to reduce variability and improve outcomes. We sought to develop a practice-based tool based on contextually relevant actions identified via a Delphi process. Our goal was to develop a tool that could identify gaps in care, facilitate identification of training and standardised assessment to support quality improvement efforts.

DESIGN

Six sentinel conditions were selected based on disease epidemiology and mortality at rural and urban African emergency departments. Potential critical actions were identified through focused literature review. These actions were evaluated within a three-round modified Delphi process. A set of logistical filters was applied to the candidate list to derive a practice-based tool.

SETTING AND PARTICIPANTS

Attendees at an international emergency medicine conference comprised an expert panel of 25 participants, with 84% working primarily in African settings. Consensus rounds allowing novel responses were conducted via online and in-person surveys.

RESULTS

The expert panel generated 199 actions that apply to six conditions in emergently ill children. Application of appropriateness criteria refined this to 92 candidate actions across the following seven categories: core skills, active seizure, altered mental status, diarrhoeal illness, febrile illness, respiratory distress and polytrauma. From these, we identified 28 actions for inclusion in a practice-based tool contextually relevant to the initial management of critically ill children in Africa.

CONCLUSIONS

A group consensus process identified critical actions for severely ill children with select sentinel conditions in emergency paediatric care in an African setting. Absence of these actions during resuscitation might reflect modifiable gaps in quality of care. The resulting practice-based tool is context relevant and can serve as a foundation for training and quality improvement efforts in African hospitals and emergency departments.

Free Open Access Medical Education (FOAM) in Emergency Medicine: The Global Distribution of Users in 2016

Introduction

Free open-access medical education (FOAM) is a collection of interactive online medical education resources-free and accessible to students, physicians and other learners. This novel approach to medical education has the potential to reach learners across the globe; however, the extent of its global uptake is unknown.

Methods

This descriptive report evaluates the 2016 web analytics data from a convenience sample of FOAM blogs and websites with a focus on emergency medicine (EM) and critical care. The number of times a site was accessed, or "sessions", was categorized by country of access, cross-referenced with World Bank data for population and income level, and then analyzed using simple descriptive statistics and geographic mapping.

Results

We analyzed 12 FOAM blogs published from six countries, with a total reported volume of approximately 18.7 million sessions worldwide in 2016. High-income countries accounted for 73.7% of population-weighted FOAM blog and website sessions in 2016, while upper-middle income countries, lower-middle income countries and low-income countries accounted for 17.5%, 8.5% and 0.3%, respectively.

Conclusion

FOAM, while largely used in high-income countries, is used in low- and middle-income countries as well. The potential to provide free, online training resources for EM in places where formal training is limited is significant and thus is prime for further investigation.

Prioritising minimum standards of emergency care for children in resource-limited settings

BACKGROUND

There is global variation in the ability of hospital-based emergency centres to provide paediatric emergency medicine (PEM) services. Although minimum standards have been proposed, they may not be applicable in resource-limited settings.

OBJECTIVE

The goal was to identify reasonable minimum standards to provide safe and effective care for acutely ill children in resource-limited settings.

METHODS

Using previously proposed standards from the International Federation of Emergency Medicine (IFEM), a modified Delphi approach was used to reach agreement regarding minimum standards for PEM in resource-limited settings. Three rounds of surveys were electronically distributed to physicians working in resource-limited settings. Those standards with >67% agreement advanced to the subsequent round.

RESULTS

The categories of the surviving criteria included integrated service design, child and family-friendly care, initial assessment of the ill child, stabilising and treating an ill child, staff training and competence, equipment, supplies and medications, quality and safety, child protection, and advanced training and academic research.

CONCLUSIONS

Experts with experience in acute care of children in resource-limited settings have prioritised standards for paediatric emergency care. They identified 26 variables in nine domains from the original IFEM list of standards and two additional free text standards for the care of acutely ill children. This list may serve as a helpful guide for emergency centres to provide medical treatment for acutely ill children in resource-limited settings.

Developing metrics for emergency care research in low- and middle-income countries

INTRODUCTION

There is little research on emergency care delivery in low- and middle-income countries (LMICs). To facilitate future research, we aimed to assess the set of key metrics currently used by researchers in these settings and to propose a set of standard metrics to facilitate future research.

METHODS

Systematic literature review of 43,109 published reports on general emergency care from 139 LMICs. Studies describing care for subsets of emergency conditions, subsets of populations, and data aggregated across multiple facilities were excluded. All facility- and patient-level statistics reported in these studies were recorded and the most commonly used metrics were identified.

RESULTS

We identified 195 studies on emergency care delivery in LMICs. There was little uniformity in either patient- or facility-level metrics reported. Patient demographics were inconsistently reported: only 33% noted average age and 63% the gender breakdown. The upper age boundary used for paediatric data varied widely, from 5 to 20 years of age. Emergency centre capacity was reported using a variety of metrics including annual patient volume (n = 175, 90%); bed count (n = 60, 31%), number of rooms (n = 48, 25%); frequently none of these metrics were reported (n = 16, 8%). Many characteristics essential to describe capabilities and performance of emergency care were not reported, including use and type of triage; level of provider training; admission rate; time to evaluation; and length of EC stay.

CONCLUSION

We found considerable heterogeneity in reporting practices for studies of emergency care in LMICs. Standardised metrics could facilitate future analysis and interpretation of such studies, and expand the ability to generalise and compare findings across emergency care settings.

Free Open Access Medical Education resource knowledge and utilisation amongst Emergency Medicine trainees: A survey in four countries

Introduction

Free Open Access Medical Education encompasses a broad array of free online resources and discussion fora. The aim of this paper was to describe whether Emergency Medicine trainees in different contexts know about Free Open Access Medical Education, whether or not they know about its different platforms, which ones they use, and what the major barriers to regular usage are.

Methods

A convenience sample was surveyed on awareness and use of Free Open Access Medical Education blogs, podcasts, websites and Twitter at three institutions (in Australia, Botswana and Papua New Guinea) and one deanery (United Kingdom) between June 2013 and June 2014 using an online survey tool or via hand-distributed survey.

Results

44 trainees responded: four from Botswana, seven from Papua New Guinea, ten from the United Kingdom and 23 from Australia. 82% were aware of blogs, 80% of websites, 75% of podcasts and 61% of Twitter as resources in Emergency Medicine. Awareness and use of specific resources were lower in Botswana and Papua New Guinea. For blogs, podcasts and websites, trainees who had looked at a resource at least once were neutral or agreed that it was relevant. For Twitter, some trainees found it difficult to navigate or not relevant. Lack of awareness of resources rather than lack of internet access was the main barrier to use.

Conclusion

The Emergency Medicine trainees in both developed and low resource settings studied were aware that Free Open Access Medical Education resources exist, but trainees in lower income settings were generally less aware of specific resources. Lack of internet and device access was not a barrier to use in this group.

A structured assessment of emergency and acute care providers in Afghanistan during the current conflict

BACKGROUND

Afghanistan has struggled with several decades of well-documented conflict, increasing the importance of providing emergency services to its citizens. However, little is known about the country's capacity to provide such care.

METHODS

Three native-speaking Afghan-American physicians performed an assessment of emergency care via combined quantitative and qualitative survey tools. Hospitals in Kabul, Afghanistan were selected based on probability proportional to size methodology, in which size was derived from prior work in the country and permission granted by the administering agency and the Ministry of Health. A written survey was given to physicians and nurses, followed by structured focus groups, and multiple days of observation per facility. A descriptive analysis was performed and data analyzed through a combination of variables in eight overarching categories relevant to emergency care.

RESULTS

One hundred twenty-five surveys were completed from 9 hospitals. One third of respondents (32.8 %) worked full time in the emergency departments, with another 28.8 % working there at least three quarters of the time. Over 63 % of providers believed that the greatest delay for care in emergencies was in the prehospital setting. Differences were noted among the various types of facilities when looking at specific components of emergency care such as skill level of workers, frequencies of assaults in the hospitals, and other domains of service provision. Sum of squares between the different facility types were highest for areas of skill (SS = 210.3; p = .001), confidence in the system (SS = 156.5; p < .005), assault (SS = 487.6; p < .005), and feeling safe in the emergency departments (SS = 193.1, p < .005). Confidence negatively correlated to frequency of assaults (Pearson r = -.33; p < .005) but positively correlated with feeling safe (Pearson r = .51; p < .005) and reliability of equipment (Pearson r = .48; p < .005). The only correlation for access to services was prehospital care (Pearson r = .72, p < .005).

CONCLUSIONS

There is a significant need to provide emergency care services in Afghanistan, specifically prehospital care. High variability exists among facility-type in various components of emergency services provision.

A research agenda for acute care services delivery in low- and middle-income countries

Delivery of acute care services at every level of the health system is essential to ensure appropriate evaluation and management of emergent illness and injury in low- and middle-income countries (LMICs). The health services breakout group at the 2013 Academic Emergency Medicine consensus conference developed recommendations for a research agenda along the following themes: infrastructure, implementation, and sustainable provision of acute care services. Based on these recommendations, a set of priorities was created to promote and guide future research on acute care services.

Emergency Medicine in Guyana: Lessons from Developing the Country's First Degree-conferring Residency Program

INTRODUCTION

Academic departments of emergency medicine are becoming increasingly involved in assisting with the development of long-term emergency medicine training programs in low and middle-income countries. This article presents our 10-year experience working with local partners to improve emergency medical care education in Guyana.

METHODS

The Vanderbilt Department of Emergency Medicine has collaborated with the Georgetown Public Hospital Corporation on the development of Emergency Medicine skills followed by the implementation of an emergency medicine residency training program. Residency development included a needs assessment, proposed curriculum, internal and external partnerships, University of Guyana and Ministry of Health approval, and funding.

RESULTS

In our experience, we have found that our successful program initiation was due in large part to the pre-existing interest of several local partners and followed by long-term involvement within the country. As a newer specialty without significant local expertise, resident educational needs mandated a locally present full time EM trained attending to serve as the program director. Both external and internal funding was required to achieve this goal. Local educational efforts were best supplemented by robust distance learning. The program was developed to conform to local academic standards and to train the residents to the level of consultant physicians. Despite the best preparations, future challenges remain.

CONCLUSION

While every program has unique challenges, it is likely many of the issues we have faced are generalizable to other settings and will be useful to other programs considering or currently conducting this type of collaborative project.

Reduced overtriage and undertriage with a new triage system in an urban accident and emergency department in Botswana: a cohort study

BACKGROUND

Improvements in triage have demonstrated improved clinical outcomes in resource-limited settings. In 2009, the Accident and Emergency (A&E) Department at the Princess Marina Hospital (PMH) in Botswana identified the need for a more objective triage system and adapted the South African Triage Scale to create the PMH A&E Triage Scale (PATS).

AIM

The primary purpose was to compare the undertriage and overtriage rates in the PATS and pre-PATS study periods.

METHODS

Data were collected from 5 April 2010 to 1 May 2011 for the PATS and compared with a database of patients triaged from 1 October 2009 to 24 March 2010 for the pre-PATS. Data included patient disposition outcomes, demographics and triage level assignments.

RESULTS

14 706 (pre-PATS) and 25 243 (PATS) patient visits were reviewed. Overall, overtriage rates improved from 53% (pre-PATS) to 38% (PATS) (p<0.001); likewise, undertriage rates improved from 47% (pre-PATS) to 16% (PATS) (p<0.001). Statistically significant decreases in both rates were found when paediatric and adult cases were analysed separately. PATS was more predictive of inpatient admission, Intensive Care Unit (ICU) admission and death rates in the A&E than was the pre-PATS. The lowest acuity category of each system had a 0.6% (pre-PATS) and 0% (PATS) chance of death in the A&E or ICU admission (p<0.001). No change in death rate was seen between the pre-PATS and PATS, but ICU admission rates decreased from 0.35% to 0.06% (p<0.001).

CONCLUSIONS

PATS is a more predictive triage system than pre-PATS as evidenced by improved overtriage, undertriage and patient severity predictability across triage levels.

Availability and potential impact of international rotations in emergency medicine residency programs

BACKGROUND

Interest in international emergency medicine (IEM) is growing. With the globalization of medicine, IEM as a field has expanded from disaster relief efforts to opportunities for resident education. Numerous accounts have been published voicing the educational benefits of international rotations (IRs). As such, many residencies now offer opportunity for IRs.

OBJECTIVE

To evaluate the availability and utilization of IRs in emergency medicine (EM) residency programs.

METHODS

EM residency program directors were surveyed from the 126 Accreditation Council for Graduate Medical Education-accredited programs with ≥2 years of residency graduates. Directors were asked about availability of IR, categorized as: 1) required; 2) elective (with or without pre-designated sites); or 3) not available.

RESULTS

One hundred eleven (88%) program directors reported data on 2240 graduates over 2 years. IRs were offered by 101 (91%) programs. No program required an IR. Among programs offering IRs, most (69%) did not have pre-designated sites. Eighty-nine of 101 programs (88%) allowing IRs had at least one resident completing an IR; 23 of 111 programs (21%) had more than 30% resident participation in IRs. Programs offering IRs at pre-designated sites had 210 of 727 (29%) residents complete an IR, compared to 272 of 1469 (19%) in programs without pre-designated sites (p < 0.001). Four-year programs had twice as many IR participants (32%) compared to 3-year programs (17%; p < 0.001).

CONCLUSIONS

More residents participated in IRs when a pre-designated site was available compared to programs without. This suggests that programs interested in supporting IRs consider developing pre-designated sites to accommodate residents.

Characterizing emergency departments to improve understanding of emergency care systems

International emergency medicine aims to understand different systems of emergency care across the globe. To date, however, international emergency medicine lacks common descriptors that can encompass the wide variety of emergency care systems in different countries. The frequent use of general, system-wide indicators (e.g. the status of emergency medicine as a medical specialty or the presence of emergency medicine training programs) does not account for the diverse methods that contribute to the delivery of emergency care both within and between countries. Such indicators suggest that a uniform approach to the development and structure of emergency care is both feasible and desirable. One solution to this complex problem is to shift the focus of international studies away from system-wide characteristics of emergency care. We propose such an alternative methodology, in which studies would examine emergency department-specific characteristics to inventory the various methods by which emergency care is delivered. Such characteristics include: emergency department location, layout, time period open to patients, and patient type served. There are many more ways to describe emergency departments, but these characteristics are particularly suited to describe with common terms a wide range of sites. When combined, these four characteristics give a concise but detailed picture of how emergency care is delivered at a specific emergency department. This approach embraces the diversity of emergency care as well as the variety of individual emergency departments that deliver it, while still allowing for the aggregation of broad similarities that might help characterize a system of emergency care.

Identification of performance indicators for emergency centres in South Africa: results of a Delphi study

Background

Emergency medicine is a rapidly developing field in South Africa (SA) and other developing nations. There is a need to develop performance indicators that are relevant and easy to measure. This will allow identification of areas for improvement, create standards of care and allow inter-institutional comparisons to be made. There is evidence from the international literature that performance measures do lead to performance improvements.

Aims

To develop a broad-based consensus document detailing quality measures for use in SA Emergency Centres (ECs).

Methods

A three-round modified Delphi study was conducted over e-mail. A panel of experts representing the emergency medicine field in SA was formed. Participants were asked to provide potential performance indicators for use in SA, under subheaders of the various disciplines that are seen in emergency patients. These statements were collated and sent out to the panel for scoring on a 9-point Lickert scale. Statements that did not reach a predefined consensus were sent back to the panellist for reconsideration.

Results

Consensus was reached on 99 out of 153 (65%) of the performance indicators proposed. These were further refined, and a synopsis of the statements is presented, classified as to whether the statements were thought to be feasible or not in the current circumstances.

Conclusions

A synopsis of the useful and feasible performance indicators is presented. The majority are structural and performance-based indicators appropriate to the development of the field in SA. Further refinement and research is needed to implement these indicators.

Electronic supplementary material

The online version of this article (doi:10.1007/s12245-010-0240-6) contains supplementary material, which is available to authorized users.