Evaluation of an instructional model for emergency ultrasonography

Teaching emergency ultrasound to emergency medicine residents: a scoping review of structured training methods

BACKGROUND

Over the past 2 decades, emergency ultrasound has become essential to patient care, and is a mandated competency for emergency medicine residency graduation. However, the best evidence regarding emergency ultrasound education in residency training is not known. We performed a scoping review to determine the (1) characteristics and (2) outcomes of published structured training methods, (3) the quality of publications, and (4) the implications for research and training.

METHODS

We searched broadly on multiple electronic databases and screened studies from the United States and Canada describing structured emergency ultrasound training methods for emergency medicine residents. We evaluated methodological quality with the Medical Education Research Study Quality Instrument (MERSQI), and qualitatively summarized study and intervention characteristics.

RESULTS

A total of 109 studies were selected from 6712 identified publications. Publications mainly reported 1 group pretest-posttest interventions (38%) conducted at a single institution (83%), training in image acquisition (82%) and interpretation (94%) domains with assessment of knowledge (44%) and skill (77%) outcomes, and training in cardiac (18%) or vascular access (15%) applications. Innovative strategies, such as gamification, cadaver models, and hand motion assessment are described. The MERSQI scores of 48 articles ranged from 0 to 15.5 (median, 11.5; interquartile range, 9.6-13.0) out of 18. Low scores reflected the absence of reported valid assessment tools (73%) and higher level outcomes (90%).

CONCLUSIONS

Although innovative strategies are illustrated, the overall quality of research could be improved. The use of standardized planning and assessment tools, intentionally mapped to targeted domains and outcomes, might provide valuable formative and summative information to optimize emergency ultrasound research and training.

Recommendations on the Use of Ultrasound Guidance for Adult Abdominal Paracentesis: A Position Statement of the Society of Hospital Medicine

1. We recommend that ultrasound guidance should be used for paracentesis to reduce the risk of serious complications, the most common being bleeding. 2. We recommend that ultrasound guidance should be used to avoid attempting paracentesis in patients with an insufficient volume of intraperitoneal free fluid to drain. 3. We recommend that ultrasound guidance should be used with paracentesis to improve the success rates of the overall procedure. 4. We recommend that ultrasound should be used to assess the volume and location of intraperitoneal free fluid to guide clinical decision making of where paracentesis can be safely performed. 5. We recommend that ultrasound should be used to identify a needle insertion site based on size of the fluid collection, thickness of the abdominal wall, and proximity to abdominal organs. 6. We recommend that the needle insertion site should be evaluated using color flow Doppler ultrasound to identify and avoid abdominal wall blood vessels along the anticipated needle trajectory. 7. We recommend that a needle insertion site should be evaluated in multiple planes to ensure clearance from underlying abdominal organs and detect any abdominal wall blood vessels along the anticipated needle trajectory. 8. We recommend that a needle insertion site should be marked with ultrasound immediately before performing the procedure, and the patient should remain in the same position between marking the site and performing the procedure. 9. We recommend that using real-time ultrasound guidance for paracentesis should be considered when the fluid collection is small or difficult to access. 10. We recommend that dedicated training sessions, including didactics, supervised practice on patients, and simulation-based practice, should be used to teach novices how to perform ultrasound-guided paracentesis. 11. We recommend that simulation-based practice should be used, when available, to facilitate acquisition of the required knowledge and skills to perform ultrasoundguided paracentesis. 12. We recommend that competence in performing ultrasound-guided paracentesis should be demonstrated prior to independently performing the procedure on patients.

Focused abdominal ultrasound for blunt trauma in an emergency department without advanced imaging or on-site surgical capability

Objectives:

To determine whether focused abdominal sonogram for trauma (FAST) in a rural hospital provides information that prompts immediate transfer to a tertiary care facility for patients with blunt abdominal trauma who would otherwise be discharged or held for observation.

Methods:

Prior to the study, participating emergency physicians underwent a minimum of 30 hours of ultrasound training. All patients who presented with blunt abdominal trauma to our rural hospital between Mar. 1, 2002, and Apr. 30, 2003, were eligible for study. Following a history and physical examination, the emergency physician documented his or her disposition decision. A FAST was then performed, and the disposition reconsidered in light of the FAST results.

Results:

Sixty-seven FAST exams were performed on 65 patients. Three examinations (4.5%) were true-positive (95% confidence interval [CI] 0.9%–12.5%); 60 (89.6%) were true-negative (95% CI 79.7%–95.7%), 4 (6%) were false-negative (95% CI 1.7%–14.6%) and none (0%) were false-positive (95% CI 0%–5.4%). These values reflect sensitivity, specificity, negative predictive value and positive predictive values of 43%, 100%, 94% and 100% respectively. FAST results did not alter the decision to transfer any patient (0%: 95% CI 0.0%–5.4%), although one positive FAST may have led to an expedited transfer. One of 38 patients who was discharged after a negative FAST study returned 24 hours later because of worsening symptoms, and was ultimately found to have splenic and pancreatic injuries.

Conclusions:

This study failed to demonstrate that FAST improves disposition decisions for patients with blunt abdominal trauma who are evaluated in a hospital without advanced imaging or on-site surgical capability. However, the study is not sufficiently powered to rule out a role for FAST in these circumstances, and our data suggest that up to 5.4% of transfer decisions could be influenced by FAST. Rural emergency physicians should not allow a negative FAST study to override a clinical indication for transfer to a trauma centre; however, positive FAST studies can be used to accelerate transfer for definitive treatment.

Using Standardized Patients to Teach Point-of-Care Ultrasound-Guided Physical Examination Skills to Internal Medicine Residents

BACKGROUND

Point-of-care (POC) ultrasound has been shown to improve procedural outcomes and physical examination accuracy in multiple settings. There are limited data regarding the optimal way to train nonradiologists in POC ultrasound. This is a primary barrier to more widespread use of ultrasound in the physical examination.

OBJECTIVE

We created a workshop to instruct postgraduate year (PGY)-2 and PGY-3 internal medicine residents in POC ultrasound imaging of the abdominal aorta and kidneys.

METHODS

A half-day simulation center workshop was created to review ultrasound operations and teach residents to independently obtain ultrasound images of the abdominal aorta and kidneys on standardized patients with normal anatomy. The workshop incorporated didactic instruction and hands-on ultrasound practice in small groups. Each resident's ability to independently obtain ultrasound images was assessed using a preworkshop and postworkshop skills examination with a standardized patient. Resident knowledge and attitudes toward POC ultrasound were also assessed using a preworkshop and postworkshop test and survey.

RESULTS

A total of 58 residents completed the workshop, and 84% were able to independently obtain high-quality images of the abdominal aorta and kidney after workshop completion, compared with 16% on the preworkshop test. Residents demonstrated a statistically significant increase in their self-reported confidence with ultrasound operation and image acquisition.

CONCLUSIONS

Training using standardized patients can prepare residents to independently obtain POC ultrasound images of the aorta and kidneys. Training resulted in increased resident confidence with POC ultrasound and self-reported likelihood of future use.

Establishment of ultrasound as a diagnostic aid in the referral of patients with abdominal pain in an emergency department - a pilot study

Purpose

Ultrasonography is a noninvasive, cheap, and fast way of assessing abdominal pain in an emergency department. Many physicians working in emergency departments do not have pre-existing ultrasound experience. The purpose of this study was to investigate the ability of first-year internship doctors to perform a reliable ultrasound examination on patients with abdominal pain in an emergency setting.

Materials and methods

This study took place in an emergency department in Denmark. Following a 1-day ultrasound introduction course, three doctors without prior ultrasound experience scanned 45 patients during a 2-month period. The applicability of the examinations was evaluated by subsequent control examination: computed tomography, operation, or ultrasound by a trained radiologist or gynecologist or, in cases where the patient was immediately discharged, by ultrasound image evaluation.

Results

In 14 out of 21 patients with a control examination, there was diagnostic agreement between the project ultrasound examination and the control. Image evaluation of all patients showed useful images of the gallbladder, kidneys, liver, abdominal aorta, and urinary bladder, but no useful images for either the pancreas or colon.

Conclusion

With only little formal training, it is possible for first-year internship doctors to correctly visualize some abdominal organs with ultrasonography. However, a longer study time frame, including more patients, and an ultrasound course specifically designed for the purpose of use in an emergency department, is needed to enhance the results.

Focused renal sonography performed and interpreted by internal medicine residents

OBJECTIVES

Intensivist-performed focused sonography, including renal sonography, is becoming accepted practice. Whether internal medicine residents can be trained to accurately rule out renal obstruction and identify sonographic findings of chronic kidney disease is unknown. The purpose of this study was to test the ability of residents to evaluate for this specific constellation of findings.

METHODS

Internal medicine residents were trained in a 5-hour module on focused renal sonography evaluating renal length, echogenicity, hydronephrosis, and cysts on a convenience sample of medical ward, intermediate care, and medical intensive care unit patients. All patients underwent comprehensive sonography within 24 hours. The primary outcome was represented by the Fleiss κ statistic, which indicated the degree of interobserver agreement between residents and radiologists. Sensitivity, specificity, and positive and negative predictive values were calculated using the comprehensive radiologist-read examination as the reference.

RESULTS

Seventeen internal medicine residents imaged 125 kidneys on 66 patients. The average number of studies performed was 7.3 (SD, 6.6). Residents demonstrated excellent agreement with radiologists for hydronephrosis (κ = 0.73; P < .001; SE, 0.15; sensitivity, 94%; specificity, 93%), moderate agreement for echogenic kidneys (κ = 0.43; P < .001; SE, 0.13; sensitivity, 40%; specificity, 98%), and substantial agreement for renal cysts (κ = 0.61; P < .001; SE, 0.12; sensitivity, 60%; specificity, 96%). Residents showed sensitivity of 100% and specificity of 88% for identification of atrophic kidneys, defined as length less than 8 cm.

CONCLUSIONS

After a 5-hour training course, medical residents accurately identified hydronephrosis and key sonographic findings of chronic kidney disease in a cohort of medical patients. Screening for hydronephrosis and renal atrophy can be performed by medical residents after adequate training.

The efficacy and value of emergency medicine: a supportive literature review

Study objectives

The goal of this study was to identify publications in the medical literature that support the efficacy or value of Emergency Medicine (EM) as a medical specialty and of clinical care delivered by trained emergency physicians. In this study we use the term "value" to refer both to the "efficacy of clinical care" in terms of achieving desired patient outcomes, as well as "efficiency" in terms of effective and/or cost-effective utilization of healthcare resources in delivering emergency care. A comprehensive listing of publications describing the efficacy or value of EM has not been previously published. It is anticipated that the accumulated reference list generated by this study will serve to help promote awareness of the value of EM as a medical specialty, and acceptance and development of the specialty of EM in countries where EM is new or not yet fully established.

Methods

The January 1995 to October 2010 issues of selected journals, including the EM journals with the highest article impact factors, were reviewed to identify articles of studies or commentaries that evaluated efficacy, effectiveness, and/or value related to EM as a specialty or to clinical care delivered by EM practitioners. Articles were included if they found a positive or beneficial effect of EM or of EM physician-provided medical care. Additional articles that had been published prior to 1995 or in other non-EM journals already known to the authors were also included.

Results

A total of 282 articles were identified, and each was categorized into one of the following topics: efficacy of EM for critical care and procedures (31 articles), efficacy of EM for efficiency or cost of care (30 articles), efficacy of EM for public health or preventive medicine (34 articles), efficacy of EM for radiology (11 articles), efficacy of EM for trauma or airway management (27 articles), efficacy of EM for using ultrasound (56 articles), efficacy of EM faculty (34 articles), efficacy of EM residencies (24 articles), and overviews and editorials of EM efficacy and value (35 articles).

Conclusion

There is extensive medical literature that supports the efficacy and value for both EM as a medical specialty and for emergency patient care delivered by trained EM physicians.

Evaluating emergency ultrasound training in India

Background:

In countries with fully developed emergency medicine systems, emergency ultrasound (EUS) plays an important role in the assessment and treatment of critically ill patients.

Methods:

The authors sought to introduce EUS to a group of doctors working in the emergency departments (EDs) in India through an intensive 4-day adult and pediatric ultrasound course held at the Apex Trauma Center and EM division of the All India Institute of Medical Sciences in New Delhi. The workshop was evaluated with a survey questionnaire and a hands-on practical test. The questionnaire was designed to assess the current state of EUS in India's EDs, and to identify potential barriers to the incorporation of EUS into current EM practice. The EUS course consisted of a general introductory didactic session followed by pediatric, abdominal and trauma, cardiothoracic, obstetrical and gynecologic, and vascular modules. Each module had a didactic session followed by handson applications with live models and/or simulators. A post-course survey questionnaire was given to the participants, and there was a practical test on the final day of the course. The ultrasound images taken by the participants were digitally recorded, and were subsequently graded for their accuracy by independent observers, residency, and/or fellowship trained in EUS.

Results:

There were a total of 42 participants who completed the workshop and took the practical examination; 32 participants filled in the course evaluation survey. Twenty-four (75%) participants had no prior experience with EUS, 5 (16%) had some experience, and 3 (9%) had significant experience. During the practical examination, 38 of 42 participants (90%) were able to identify Morison's pouch on the focused abdominal sonography for trauma (FAST) examination, and 32 (76%) were able to obtain a parasternal long axis cardiac view and identify the left ventricle. The inferior vena cava was identified as it crosses the diaphragm into the right atrium by 20 (48%) participants. All participants felt they would be able to incorporate what they had learned into their practice, and indicated that they were advocates for further training of non-radiologist clinicians in the use of ED ultrasound.

Conclusion:

After this introductory workshop in EUS, the participants were comfortable in their ability to use the ultrasound machine. Participants deemed it particularly useful for certain ED applications, particularly the FAST examination, the lung examination, and vascular access.

Assessment of a training curriculum for emergency ultrasound for pediatric soft tissue infections

OBJECTIVES

The objective was to evaluate a training protocol for pediatric emergency physicians (EPs) learning emergency ultrasound (EUS) for the evaluation of skin and soft tissue infections (SSTIs) by assessing technical ability and interrater reliability.

METHODS

Pediatric emergency medicine (EM) fellows and attending physicians completed a 1-day training course taught by an expert emergency sonologist. After the course, EPs performed proctored examinations on patients with SSTIs until they reached predefined performance criteria, after which they performed independent EUS examinations. All EUS examinations were recorded using still images and video clips that were reviewed and rated by the expert sonologist on four technical measures and combined into a composite score. The expert's opinion regarding the presence or absence of an abscess was also compared to the study sonologist's opinion and analyzed for interrater reliability.

RESULTS

Seven EPs performed 107 EUS examinations. The mean (±SD) composite score for the evaluation of technical ability for the first EUS was 3.3 ± 0.14 (on a 4-point scale), indicating a high level of quality following the training course. There was a small amount of improvement in the quality score (0.015, 95% confidence interval [CI] = 0.0003 to 0.03) with each consecutive EUS examination. The interrater reliability between the sonologist and the expert for the presence of an abscess as measured by the kappa statistic was 0.80 (95% CI = 0.63 to 0.97), indicating substantial agreement.

CONCLUSIONS

After a brief training program, pediatric EPs can perform technically successful emergency EUS examination of SSTIs, with excellent agreement with an expert sonologist.

A pilot study of comprehensive ultrasound education at the Wayne State University School of Medicine: a pioneer year review

OBJECTIVE

Ultrasound is a versatile diagnostic modality used in a variety of medical fields. Wayne State University School of Medicine (WSUSOM) is one of the first medical schools in the United States to integrate an ultrasound curriculum through both basic science courses and clinical clerkships.

METHODS

In 2006, 25 portable ultrasound units were donated to WSUSOM. First-year medical students were provided an ultrasound curriculum consisting of 6 organ-system sessions that addressed the basics of ultrasound techniques, anatomy, and procedural skills. After the last session, students were administered 2 anonymous and voluntary evaluations. The first assessed their overall experience with the ultrasound curriculum, and the second assessed their technical skills in applying ultrasound techniques.

RESULTS

Eighty-three percent of students agreed or strongly agreed that their experience with ultrasound education was positive. On the summative evaluation, nearly 91% of students agreed or strongly agreed that they would benefit from continued ultrasound education throughout their 4 years of medical school. Student performance on the technical assessment was also very positive, with mean class performance of 87%.

CONCLUSIONS

As residency programs adopt ultrasound training, medical school faculty should consider incorporating ultrasound education into their curriculum. Portable ultrasound has the potential to be used in many different settings, including rural practice sites and sporting events. The WSUSOM committee's pilot ultrasound curriculum will continue to use student feedback to enhance the ultrasound experience, helping students prepare for challenges that they will face in the future.

Assessment of knowledge retention and the value of proctored ultrasound exams after the introduction of an emergency ultrasound curriculum

BACKGROUND

Optimal training required for proficiency in bedside ultrasound is unknown. In addition, the value of proctored training is often assumed but has never been quantified.

METHODS

To compare different training regimens for both attending physicians and first year residents (interns), a prospective study was undertaken to assess knowledge retention six months after an introductory ultrasound course. Eighteen emergency physicians and twelve emergency medicine interns were assessed before and 6 months after an introductory ultrasound course using a standardized, image-based ultrasound test. In addition, the twelve emergency medicine interns were randomized to a group which received additional proctored ultrasound hands-on instruction from qualified faculty or to a control group with no hands-on instruction to determine if proctored exam training impacts ultrasound knowledge. Paired and unpaired estimates of the median shift in test scores between groups were made with the Hodges-Lehmann extension of the Wilcoxon-Mann-Whitney test.

RESULTS

Six months after the introductory course, test scores (out of a 24 point test) were a median of 2.0 (95% CI 1.0 to 3.0) points higher for residents in the control group, 5.0 (95% CI 3.0 to 6.0) points higher for residents in the proctored group, and 2.5 (95% CI 1.0 to 4.0) points higher for the faculty group. Residents randomized to undergo proctored ultrasound examinations exhibited a higher score improvement than their cohorts who were not with a median difference of 3.0 (95% CI 1.0 to 5.0) points.

CONCLUSION

We conclude that significant improvement in knowledge persists six months after a standard introductory ultrasound course, and incorporating proctored ultrasound training into an emergency ultrasound curriculum may yield even higher knowledge retention.

History of emergency and critical care ultrasound: The evolution of a new imaging paradigm

The tradition of clinical ultrasound in the hands of physicians who provide critical care to the most acutely ill patients stretches back into the 1980s and is rich with experiences from surgical, emergency medicine, and other practices. Now, as critical care ultrasound explodes around the world, it is important to realize the path its development has taken and learn from trials and tribulations of early practitioners in the field. The development and battles for the right to use ultrasound at the patient's bedside for >20 yrs is described in relation to its emergency medicine and surgical origins. Approaches to education, scanning, documentation, and organization at the national and regional levels are described.

Anatomy teaching: ghosts of the past, present and future

INTRODUCTION

Anatomy teaching has perhaps the longest history of any component of formalised medical education. In this article we briefly consider the history of dissection, but also review the neglected topic of the history of the use of living anatomy.

CURRENT DEBATES

The current debates about the advantages and disadvantages of cadavers, prosection versus dissection, and the use of living anatomy and radiology instead of cadavers are discussed.

THE FUTURE

Future prospects are considered, along with some of the factors that might inhibit change.

Ultrasonography in community emergency departments in the United States: access to ultrasonography performed by consultants and status of emergency physician-performed ultrasonography

STUDY OBJECTIVE

Nearly all emergency medicine residency programs provide some training in emergency physician-performed ultrasonography, but the extent of emergency physician-performed ultrasonography in community emergency departments (EDs) is not known. We seek to determine the state of ultrasonography in community EDs in terms of access to ultrasonography by other specialists and performance of ultrasonography by emergency physicians.

METHODS

A 6-page survey that addressed access to ultrasonography performed by other specialists and emergency physician-performed ultrasonography was designed and pilot tested. A list of all US ED directors was obtained from the American College of Emergency Physicians. Twelve hundred of 5264 EDs were randomly selected to receive the anonymous survey, with responses tracked by separate postcard. There were 3 mailings from Fall 2003 to Spring 2004.

RESULTS

Overall response rate was 61% (684/1130). Respondents who self-reported as being academic with emergency medicine residents were excluded from further analysis (n=35). A sensitivity analysis (reported in parentheses) was performed on the key outcome question to adjust for response bias. As reported by ED directors, ultrasonography was available in the ED for use by emergency physicians at all times in 19% of EDs (12% to 28%), with an additional 15% (9% to 21%) reporting a machine available for use by emergency physicians in some capacity and 66% (51% to 80%) reporting that there was no access to a machine for emergency physician use. ED directors reported being requested or required to limit ultrasonography orders performed by radiology in 41% of EDs, with less timely access to radiology-performed ultrasonography in off hours. Of EDs with emergency physician-performed ultrasonography, the most common applications were Focused Assessment with Sonography for Trauma (FAST) examination (85%), code situation (72%), and check for pericardial effusion (67%). Of physicians performing ultrasonography, 16% stated they were currently requesting reimbursement (billing). The primary reason cited for not implementing emergency physician-performed ultrasonography was lack of emergency physician training. For the statement "emergency medicine residents now starting residency should be trained to perform and interpret focused bedside ultrasonography," 84% of ED directors agreed, 14% were neutral, and less than 2% disagreed.

CONCLUSION

Community ED directors continue to report barriers to obtaining ultrasonography from consultants, especially in off hours. Nineteen percent of community ED directors report having a machine available for emergency physician use at all times; however, two thirds of EDs report no access to ultrasonography for emergency physician use. A majority of community ED directors support residency training in emergency physician-performed ultrasonography.

Survey of attitudes of senior emergency physicians towards the introduction of emergency department ultrasound

INTRODUCTION

Emergency department ultrasound (EDU) is widely practised in the USA, Australia, parts of Europe, and Asia. EDU has been used in the UK since the late 1990s but as yet, few areas have established a practice.

OBJECTIVES

To assess the current climate of opinion with respect to the practice, constraints, and establishment of EDU among emergency department (ED) consultants on the island of Ireland.

METHODS

A postal questionnaire was formulated, piloted, and assessed for ambiguity by a sample of ED consultants and an independent non-ED consultant, prior to being mailed to all ED consultants in Ireland.

RESULTS

Of the 58 consultants canvassed 46 (79%) responded. Of the respondents, 40 (87%) strongly agreed/agreed that EDU is appropriate and should be performed in the ED. Of these, 3 (7%) are currently performing EDU; 37 (80%) have not had formal training in EDU, however 42 (91%) support the establishment of national guidelines for training in focused ultrasound in the ED. Problems instituting EDU were often multifactorial. Commonly highlighted difficulties included financial issues (24 respondents, 52%) and radiology department support (16 respondents, 34%). Other cited problems include varying interdepartmental practices (15 respondents, 33%) and (for some EDs) low numbers of patients requiring EDU, with projected difficulties in skills maintenance.

CONCLUSION

Despite the vast majority of ED consultants being in favour of EDU, very few actually perform it on a regular basis or have had any formal training. Highlighted difficulties in EDU implementation included financial constraints, lack of support from radiology departments, and lack of formal training.

Teaching medical students diagnostic sonography

OBJECTIVE

The purpose of this pilot project was to train medical students in sonography.

METHODS

Thirty-three medical students participated in a pilot sonography course, which included exposure to ultrasound physics, knobology of a compact ultrasound scanner, training in scanning and anatomy of the aorta and right kidney, and reading assignments in these areas. Pretraining and posttraining examinations were given in these areas to analyze the degree of knowledge gained by these methods.

RESULTS

Nearly all of the medical students increased their basic knowledge of sonography and improved their scanning skills. The improvement was statistically significant in all areas.

CONCLUSIONS

Training in sonography for medical students could be used as a foundation for later, more specialty-specific training to improve the overall medical sonography skills for all physicians.

The association between operator confidence and accuracy of ultrasonography performed by novice emergency physicians

The variable accuracy of emergency department (ED) ultrasound described in the literature has limited its utility as the sole imaging modality in critical decision making. Although ultrasound accuracy is highly dependent upon the technical abilities of the operator and conditions unique to each patient, no previous study of ED ultrasound has included estimates of operator confidence. This prospective observational study explores the association between operator confidence and the accuracy of ED ultrasound. Ultrasound was not performed in our ED until a formal training module was instituted. Patients were enrolled prospectively for the first year following the training module if they underwent one of the following ultrasound studies: abdominal examination for intraperitoneal fluid, right upper quadrant examination for gallstones, renal examination for hydronephrosis, pelvic examination for intrauterine pregnancy, abdominal examination for aorta diameter > 3 cm, or cardiac examination for pericardial fluid. In addition, formal ultrasound, computed tomography, magnetic resonance imaging, or an invasive procedure was required as a "gold standard" for each patient. Operators recorded their interpretation of the ED ultrasound and rated their confidence with the analysis before the formal imaging study or procedure. Test performance characteristics for each examination type and for all studies together were determined. The association between operator confidence and accuracy was explored using logistic regression and by determining test performance characteristics with patients stratified by confidence value. A total of 276 ED ultrasound studies were included. There were no significant differences in accuracy between ED attendings and residents. Overall accuracy, sensitivity, specificity, LR+, and LR- were 90%, 92%, 86%, 6.8, and 0.09, respectively. With confidence scores of 9 or 10 (n = 113), these values improved to 96%, 99%, 90%, 9.6, and 0.01, respectively. Logistic regression revealed an association between confidence and ED ultrasound accuracy (p < 0.001). It is concluded that a significant association exists between operator confidence and the accuracy of ED ultrasound. High confidence values are associated with clinically useful test performance characteristics.

Performance, training, quality assurance, and reimbursement of emergency physician-performed ultrasonography at academic medical centers

OBJECTIVE

To determine the current state of bedside emergency physician-performed ultrasonography in terms of prevalence, training, quality assurance, and reimbursement at emergency medicine residency programs.

METHODS

The link to a 10-question Web-based survey was e-mailed to ultrasound/residency directors at 122 emergency medicine residency programs in the United States.

RESULTS

The overall response rate was 84%. Ninety-two percent of programs reported 24-hour emergency physician-performed ultrasonography availability. Fifty-one percent of programs reported that a credentialing/privileging plan was in place at their hospital, and 71% of programs had a quality assurance/image review procedure in place. Emergency medicine specialty-specific guidelines of 150 ultrasonographic examinations and 40 hours of didactic instruction were met by 39% and 22% of residencies, respectively, although only 13.7% of programs were completing the 300 examinations recommended by the American Institute of Ultrasound in Medicine. Sixteen programs (16%) reported that they were currently billing for emergency physician-performed ultrasonography; of those not billing, 10 (12%) planned to bill within 1 year, and 32 (37%) planned to bill at some point in the future.

CONCLUSIONS

Performance and training in emergency physician-performed ultrasonography at academic medical centers continues to increase. The number of emergency medicine residency programs meeting specialty-specific guidelines has more than doubled in the last 4 years, but only a small number are meeting American Institute of Ultrasound in Medicine guidelines. Although only 16% of programs reported that they were currently billing for emergency physician-performed ultrasonography, most had plans to bill in the future.

Use of ultrasound to determine ventricular capture in transcutaneous pacing

Determining ventricular capture when using transcutaneous pacing (TCP) can be difficult. Our objective was to evaluate the use of ultrasound (US) to determine capture in patients undergoing TCP. We studied 15 patients in a convenience sample. Videotaped US views were obtained during TCP with concurrent electrocardiographic monitoring on the US screen. The treating physician made capture determinations first by using clinical indicators, followed by US images. Two reviewing physicians blinded to the treating physician's findings and to each other determined capture on videotape. Kappa levels of agreement were calculated. A value of kappa = 0.84 was found for agreement of the treating physician's findings through clinical measures and US. Agreement between the first reviewer and the treating physician had kappa =.47 and between the second reviewer and the treating physician was had kappa =.67. All P values were <.05. US and clinical impression of ventricular capture have good to excellent agreement. US may be useful for determining ventricular capture in patients undergoing TCP.

Emergency surgeon-performed hepatobiliary ultrasonography

BACKGROUND

Acute hepatobiliary pathology is a common general surgical emergency referral. Diagnosis requires imaging of the biliary tree by ultrasonography. The accuracy and impact of surgeon-performed ultrasonography (SUS) on the diagnosis of emergent hepatobiliary pathology was examined.

METHODS

A prospective study, over a 6-month period, enrolled all patients with symptoms or signs of acute hepatobiliary pathology. Patients provided informed consent and underwent both SUS and standard radiology-performed ultrasonography (RUS). SUS was performed using a 2-5-MHz broadband portable ultrasound probe by two surgeons trained in ultrasonography, and RUS using a 2-5-MHz fixed unit. SUS results were correlated with those of RUS and pathological diagnoses.

RESULTS

Fifty-three consecutive patients underwent 106 ultrasonographic investigations. SUS agreed with RUS in 50 (94.3 per cent) of 53 patients. SUS accurately detected cholelithiasis in all but two cases and no patient was inaccurately diagnosed as having cholelithiasis at SUS (95.2 per cent sensitivity and 100 per cent specificity). As an overall complementary diagnostic tool SUS provided the correct diagnosis in 96.2 per cent of patients. Time to scan was significantly shorter following SUS (3.1 versus 12.0 h, P < 0.05).

CONCLUSION

SUS provides a rapid and accurate diagnosis of emergency hepatobiliary pathology and may contribute to the emergency management of hepatobiliary disease.

General practitioner's skills to perform limited goal-oriented abdominal US examinations after one month of intensive training

A training program of "limited goal-oriented abdominal sonography" for general practitioners (GPs) was planned, set up and tested. After 1 month of intensive training (about 100 examinations), four test subjects succeeded in technically performing examinations in four patients out of five patients, and were able to rule out or exclude fluid collections, aortic aneurysms and common gallbladder disease.

Bedside echocardiography by emergency physicians

STUDY OBJECTIVE

Timely diagnosis of a pericardial effusion is often critical in the emergency medicine setting, and echocardiography provides the only reliable method of diagnosis at the bedside. We attempt to determine the accuracy of bedside echocardiography as performed by emergency physicians to detect pericardial effusions in a variety of high-risk populations.

METHODS

Emergency patients presenting with high-risk criteria for the diagnosis of pericardial effusion underwent emergency bedside 2-dimensional echocardiography by emergency physicians who were trained in ultrasonography. The presence or absence of a pericardial effusion was determined, and all images were captured on video or as thermal images. All emergency echocardiograms were subsequently reviewed by the Department of Cardiology for the presence of a pericardial effusion.

RESULTS

During the study period, a total of 515 patients at high risk were enrolled. Of these, 103 patients were ultimately deemed to have a pericardial effusion according to the comparative standard. Emergency physicians detected pericardial effusion with a sensitivity of 96% (95% confidence interval [CI] 90.4% to 98.9%), specificity of 98% (95% CI 95.8% to 99.1%), and overall accuracy of 97.5% (95% CI 95.7% to 98.7%).

CONCLUSION

Echocardiography performed by emergency physicians is reliable in evaluating for pericardial effusions; this bedside diagnostic tool may be used to examine specific patients at high risk. Emergency departments incorporating bedside ultrasonography should teach focused echocardiography to evaluate the pericardium.

Accuracy of emergency department bedside ultrasonography

OBJECTIVES

To determine which focused ultrasound examinations can be interpreted accurately by emergency physicians who have limited training and experience. To determine whether image quality and/or the operator's level of confidence in the findings correlates with accurate scan interpretation.

METHODS

A prospective sample of consenting adult emergency department patients with the conditions was selected for study. Scans were performed by emergency physicians who had attended a 3-day focused ultrasound examinations instruction course. All scans were videotaped and subsequently reviewed by a radiologist. Accuracy was determined by comparing the emergency physicians scan interpretation with preselected gold standards. Chi-squared tests were employed to determine if the individual performing the scan, the type of scan, patient's body habitus, image quality and/or operator confidence were reliable predictors of accuracy.

RESULTS

Between September 1997 and January 1999, 221 scans were studied. Accuracy varied widely depending on the type of scan performed: aortic scans were 100% accurate whereas renal scans had 68% accuracy. On bivariate analyses, there was little variation in the various operators' levels of proficiency and accuracy of interpretation was not associated with patient body habitus, image quality or operator confidence.

CONCLUSIONS

Neophytes can accurately perform and interpret aortic scans; additional training and/or experience appear to be necessary to achieve proficiency in conducting most of the other scans studied. Inexperienced operators are unable to discern whether their scan interpretations will prove accurate.

The utility of ultrasound to determine ventricular capture in external cardiac pacing

Determining electrical capture when using an external cardiac pacemaker is often difficult and confusing, especially when the resulting clinical signs of an effective blood pressure and pulse are inadequate or nondetectable. The objective of this study was to determine the efficacy of using 2-dimensional ultrasound (US) in determining the presence of ventricular capture of an external cardiac pacemaker in a swine model. Five anesthetized swine underwent external cardiac pacing (ECP) at variable levels of energy output while concurrent US images and electrocardiograph monitoring were recorded on videotape. Determinations of capture/no capture were made in the laboratory. Segments of videotape were selected to be reviewed by 2 physicians blinded to these laboratory determinations of capture and to each other. Kappa levels of agreement were determined among the 3 pairs of comparisons. Seventeen segments were reviewed. Kappa levels of agreement were 0.76 for Reviewer A versus Laboratory determination, 0.88 for Reviewer B versus Laboratory determination, and 0.88 for Reviewer A versus Reviewer B. All P values were <.001. These excellent levels of agreement show that 2D US in this animal model is highly effective in determining the presence of ventricular capture in ECP.

Ultrasound training for emergency physicians--a prospective study

OBJECTIVES

Bedside ultrasound examination by emergency physicians (EPs) is being integrated into clinical emergency practice, yet minimum training requirements have not been well defined or evaluated. This study evaluated the accuracy of EP ultrasonography following a 16-hour introductory ultrasound course.

METHODS

In phase I of the study, a condensed 16-hour emergency ultrasound curriculum based on Society for Academic Emergency Medicine guidelines was administered to emergency medicine houseofficers, attending staff, medical students, and physician assistants over two days. Lectures with syllabus material were used to cover the following ultrasound topics in eight hours: basic physics, pelvis, right upper quadrant, renal, aorta, trauma, and echo-cardiography. In addition, each student received eight hours of hands-on ultrasound instruction over the two-day period. All participants in this curriculum received a standardized pretest and posttest that included 24 emergency ultrasound images for interpretation. These images included positive, negative, and nondiagnostic scans in each of the above clinical categories. In phase II of the study, ultrasound examinations performed by postgraduate-year-2 (PGY2) houseofficers over a ten-month period were examined and the standardized test was readministered.

RESULTS

In phase I, a total of 80 health professionals underwent standardized training and testing. The mean +/- SD pretest score was 15.6 +/- 4.2, 95% CI = 14. 7 to 16.5 (65% of a maximum score of 24), and the mean +/- SD posttest score was 20.2 +/- 1.6, 95% CI = 19.8 to 20.6 (84%) (p < 0. 05). In phase II, a total of 1,138 examinations were performed by 18 PGY2 houseofficers. Sensitivity was 92.4% (95% CI = 89% to 95%), specificity was 96.1% (95% CI = 94% to 98%), and overall accuracy was 94.6% (95% CI = 93% to 96%). The follow-up ultrasound written test showed continued good performance (20.7 +/- 1.2, 95% CI = 20.0 to 21.4).

CONCLUSIONS

Emergency physicians can be taught focused ultrasonography with a high degree of accuracy, and a 16-hour course serves as a good introductory foundation.

Physician training requirements in sonography: how many cases are needed for competence?

OBJECTIVE

Physician competence in the performance of sonographic studies was assessed after their involvement in predetermined increments of cases to determine whether the case volumes currently required by the American Institute of Ultrasound in Medicine and the American College of Radiology for training in sonography can be lowered substantially.

MATERIALS AND METHODS

Sonographic competence tests were administered to 10 first-year diagnostic radiology residents after their involvement in increments of 50 cases, up to a total of 200 cases (four competency tests). Each competency test consisted of the resident's independently scanning and interpreting 10 clinically mandated studies that were scored in comparison with the examination performed by the sonographer and interpreted by an attending radiologist. Trainee studies were graded on the percentage of anatomic landmarks depicted, the number of reporting errors, the number of clinically significant reporting errors, and the percentage of cases receiving a passing score.

RESULTS

Although resident performance improved progressively with increasing experience for all parameters assessed, performance of the group was poor even after their involvement in 200 cases. At this testing level, the mean percentage of anatomic landmarks depicted successfully was 56.5%; the mean total reporting errors per case was 1.2; the mean clinically significant errors per case was 0.5; and the mean percentage of cases receiving a passing score was 16%. Impressive performance differences were observed among residents for all parameters assessed, and these differences were not explained by the number of months of radiology training the resident had taken before the sonography rotation.

CONCLUSION

Involvement in 200 or fewer cases during the training period is not sufficient for physicians to develop an acceptable level of competence in sonography.

The focused abdominal sonography for trauma (FAST) examination: considerations and recommendations for training physicians in the use of a new clinical tool

Focused abdominal sonography for trauma (FAST) is being used by growing numbers of emergency physicians and surgeons because it has proven to be an accurate, rapid, and repeatable bedside test for evaluating abdominal trauma victims. Controversy exists about the optimal means of FAST education and the number of examinations necessary to demonstrate competency. Most FAST educators agree that FAST education should consist of three phases: didactic, practical, and experiential. This article summarizes options and preliminary recommendations suitable for developing a FAST curriculum.

A preliminary evaluation of emergency ultrasound in the setting of an emergency medicine training program

In this article we seek to evaluate the diagnostic accuracy of emergency physicians performing emergency ultrasonography in the setting of an emergency medicine training program. A prospective observational study was performed at an inner city Level I trauma center with an emergency medicine residency training program. From July 1994 to December 1996 a convenience sample of ultrasound exams was recorded. The diagnostic quality ("acceptable or technically limited") was determined by a board-certified cardiologist or radiologist with fellowship training in ultrasonography. The emergency department interpretations were then compared to those of the blinded cardiologist or radiologist. Four hundred and fifty-six ultrasound examinations were videotaped and entered into the study; 408 (89%) of the studies performed were determined to be "acceptable." The diagnostic accuracy (sensitivity, specificity, positive and negative predictive values) of these studies were as follows: cardiac, to rule out effusion (n = 67; 0.83, 0.98, 0.88, 0.98); transabdominal, to rule out abdominal aortic aneurysms (AAA), cholelithiasis, or free peritoneal fluid (n = 263; 0.91, 0.89, 0.88, 0.92); renal, to rule out hydronephrosis (n = 45; 0.94, 0.96, 0.94, 0.96); pelvic, to rule in intrauterine pregnancy (n = 33; 1.0, 0.90, 0.96, 1.0). The 48 "technically limited studies" included: 39 transabdominal (33 gallbladder, 1 abdominal aortic aneurysm, 5 free peritoneal fluid), 6 cardiac, 2 renal, and 1 pelvic ultrasound. This study suggests that emergency physicians with a minimal amount of training display acceptable technical skill and interpretive acumen in their approach to emergency ultrasonography.

Serial abdominal ultrasound in the setting of trauma

Ultrasound is gaining wide acceptance in Emergency Medicine as an inexpensive and accurate examination modality. One of the leading uses of this technology is in the initial assessment of the trauma patient, where the ultrasound examination is often used to determine the need for immediate laparotomy or further diagnostic study. We present a series of four patients, all of whom sustained blunt or penetrating abdominal trauma. In each case, the initial screening abdominal ultrasound was negative for free intraperitoneal (i.p.) fluid but, when repeated by the same practitioner, became positive. These cases demonstrate the need for serial ultrasounds in evaluating the patient with abdominal trauma. Future studies of trauma ultrasound should investigate the utility of serial sonographic examinations.

Credentialing issues in emergency ultrasonography

The use of ultrasonography, traditionally performed by radiologists, is becoming increasingly widespread in emergency medicine. Consequently, much debate has evolved over whether emergency medicine physicians are qualified to provide this service, and the criteria by which training and credentialing can be achieved. This article discusses training and credentialing guidelines, paths to becoming credentialed in emergency sonography, and quality assurance issues. Also, strategies are proposed for emergency departments seeking to perform emergency sonography.