A new way for surgical education--development and evaluation of a computer-based training module

The Effectiveness of a Self-Directed e-Learning Module on Trainee Knowledge and Confidence during Plastic Surgery Clinical Rotations

Background

Exposure to plastic surgery is limited during medical school. This makes rotations for clinical clerks and off-service residents challenging. Available resources are often too detailed and overwhelming. Having an accessible, concise, and interactive plastic surgery e-learning module reviewing core plastic surgery topics could help prepare incoming trainees for their rotations.

Methods

An e-learning module was created using text, images, and in-house recorded video recordings. Two cohorts were recruited: control cohort (n = 9), who completed their plastic surgery rotation without use of the module, and an interventional cohort (n = 18), who completed the rotation with use of the module. A demographic survey, a 20-question multiple-choice knowledge test, and self-reported confidence score were completed by both cohorts at the end of their plastic surgery rotations. The intervention cohort also completed the knowledge test at the beginning of their rotation to establish baseline. Knowledge and confidence scores were compared using two-tailed, unpaired, nonparametric analyses (Mann-Whitney test).

Results

Learners from the intervention cohort reported a 95% module completion rate and found the resource "extremely helpful" (average Likert of 4.8/5). Learners indicated that they were very likely to recommend the resource to others (average Likert 4.9/5). The intervention cohort scored significantly higher on the knowledge test compared with the control cohort (P = 0.008), and on average reported higher confidence levels; however, this was not statistically significant (P = 0.057).

Conclusion

An accessible and concise module on core plastic surgery concepts enhances learner knowledge and confidence during plastic surgery clinical rotations.

Evolution and current state of research into E-learning

This article aims to undertake a bibliometric review along with a conceptual and intellectual analysis of research on distance learning and e-learning. The purpose of this study is to focus on several academic fields and offer a comprehensive approach on how research on distance learning and e-learning has been approached since 1970. This work applies several bibliometric techniques to assess the research evolution of topics addressed, the most productive authors and the most influential journals. The findings revealed an exponential increase of publications over the last 20 years, highlighting the evolution of topics. The research themes include four main groups: the first relates to pedagogical processes in terms of effectiveness, outcomes, learning strategies, interaction, and self-regulation; the second group includes aspects associated with ICT applied in distance education; the third group focuses on the perceived value, usefulness, acceptance, and satisfaction of e-learning; and the last group portrays the forced application of distance learning strategies to deal with the consequences of the pandemic. This work contributes to expanding the existing literature devoted to study the structure of research on e-learning. It analyses the most representative authors, institutions, and documents, and gathers the growing literature on e-learning, from distance learning in the seventies until the implementation of online learning in the COVID-19 era.

A Video Teaching Tool Is Effective for Training Residents in Hip Arthroplasty Templating

Work hour restrictions imposed on orthopedic surgery residents since the early 2000s have reduced educational opportunities at the workplace and encouraged alternative strategies for teaching outside the clinical setting. Preoperative templating is essential for safe and effective total hip arthroplasty (THA) and is accurate in predicting final implants. We sought to determine the effectiveness of a video tool for teaching orthopedic residents basic THA templating skills. We developed a video-based teaching tool with instructions on proper THA templating techniques. Ten cases were selected for testing, after excluding patients with severe hip deformities and poor-quality radiographs and only retaining those with concordance between templating by the senior authors and implanted components. The study subjects included three postgraduate year 1 (PGY-1), three PGY-2, and three PGY-5 residents, and three adult reconstruction fellows (PGY-6). Templating skills were assessed before and after watching the instructional video. The evaluation included the size and positioning of femoral and acetabular components, as well as the restoration of leg length. Each templating session was repeated twice. Variance was measured to evaluate consistency in measurements. A linear mixed model and F-test were used for statistical analyses. The number of years in training significantly affected performance prior to exposure to the instructional video. Post-exposure, there was a significant improvement in the accuracy of sizing and positioning of acetabular and femoral components for PGY-1, PGY-2, and PGY-5 residents. The results achieved were comparable to PGY-6 examiners, who did not gain substantial performance benefits from the instructional video. Limb length restoration was less affected by experience or exposure to the video. Component positioning and sizing, as well as leg length discrepancy (LLD), showed a significant decrease in variance after the intervention in all study groups. Video learning is reliable in teaching invaluable skills to orthopedic surgery residents without encroaching on work hours. We conceived a concise video to train orthopedic residents to perform THA templating with proper technique and demonstrated its efficiency and reproducibility.

Visualisation Approaches in Technology-Enhanced Medical Simulation Learning: Current Evidence and Future Directions

Technology-enhanced learning (TEL) has been proposed as an approach to minimise the healthcare workforce shortage preventing universal healthcare coverage. Simulation-based medical education is a well-established teaching method. Little is known about effective strategies to translate in-person medical simulation teaching into a virtual world. This work aimed to review the literature on approaches to visualisation in technology-enhanced medical simulation. A systematic search strategy was optimised using three databases: Embase, MEDLINE, and APA PsycInfo. Additional papers were identified through cross-referencing. The last date of this search was 3 January 2022. The articles were analysed qualitatively. The risk of bias was assessed using ROBINS-I and RoB 2 tools. The search yielded 656 results with 9 additional papers identified through cross-referencing. Following deduplication and exclusions, 23 articles were included in a qualitative synthesis of evidence. Offline and online computer-based modules with virtual patient cases or practical skills simulations were identified as the most prevalent clinical simulation teaching modalities. Visualisation approaches included text, images, animations, videos, and 3D environments. Significant heterogeneity of study designs with a moderate risk of bias was established. Based on the current data, the virtual patient scenarios should use natural language input interfaces enriched with video and voice recordings, 3D animations, and short text descriptions to make the patient management experience more lifelike and increase knowledge retention. However, there is no agreed framework for assessing the pedagogical value of these innovations. High-quality randomised controlled trials of TEL-based clinical simulation are essential to advance the field.

Evaluation of an animation tool developed to supplement dental student study of the cranial nerves

INTRODUCTION

The structure/function of the cranial nerves is a core topic for dental students. However, due to the perceived complexity of the subject, it is often difficult for students to develop a comprehensive understanding of key concepts using textbooks and models. It is accepted that the acquisition of anatomical knowledge can be facilitated by visualisation of structures. This study aimed to develop and assess a novel cranial nerve animation as a supplemental learning aid for dental students.

MATERIALS AND METHODS

A multidisciplinary team of anatomists, neuroscientists and a computer scientist developed a novel animation depicting the cranial nerves. The animation was viewed by newly enrolled first-year dental students, graduate entry dental students (year 1) and dental hygiene students (year 1). A simple life scenario employing the use of the cranial nerves was developed using a cartoon-type animation with a viewing time of 3.58 minutes. The animation was developed with emphasis on a life scenario. The animation was placed online for 2 weeks with open access or viewed once in a controlled laboratory setting. Questionnaires were designed to assess the participants' attitude towards the animation and their knowledge of the cranial nerves before and after visualisation. This study was performed before the delivery of core lectures on the cranial nerves.

RESULTS

Our findings indicate that the use of the animation can act as a supplemental tool to improve student knowledge of the cranial nerves. Indeed, data indicate that a single viewing of the animation, in addition to 2-week access to the animation, can act as a supplemental learning tool to assist student understanding of the structure and function of cranial nerves. The animation significantly enhanced the student's opinion that their cranial nerve knowledge had improved. From a qualitative point of view, the students described the animation as an enjoyable and useful supplement to reading material/lectures and indicated that the animation was a useful tool in understanding the cranial nerves.

CONCLUSION

Overall, these findings indicate that an animation demonstrating the cranial nerves in a simple, everyday functional scenario may act as a learning aid in the study of cranial nerves.

Teaching Tip: The Development of an Interactive Computer-Based Training Program for Timely and Humane On-Farm Pig Euthanasia

With extensive knowledge and training in the prevention, management, and treatment of disease conditions in animals, veterinarians play a critical role in ensuring good welfare on swine farms by training caretakers on the importance of timely euthanasia. To assist veterinarians and other industry professionals in training new and seasoned caretakers, an interactive computer-based training program was created. It consists of three modules, each containing five case studies, which cover three distinct production stages (breeding stock, piglets, and wean to grower-finisher pigs). Case study development was derived from five specific euthanasia criteria defined in the 2015 Common Swine Industry Audit, a nationally recognized auditing program used in the US. Case studies provide information regarding treatment history, clinical signs, and condition severity of the pig and prompt learners to make management decisions regarding pig treatment and care. Once a decision is made, feedback is provided so learners understand the appropriateness of their decision compared to current industry guidelines. In addition to training farm personnel, this program may also be a valuable resource if incorporated into veterinary, graduate, and continuing education curricula. This innovative tool represents the first interactive euthanasia-specific training program in the US swine industry and offers the potential to improve timely and humane on-farm pig euthanasia.

Usefulness and capability of three-dimensional, full high-definition movies for surgical education

Background

Because of changing surgical procedures in the fields of oral and maxillofacial surgery, new methods for surgical education are needed and could include recent advances in digital technology. Many doctors have attempted to use digital technology as educational tools for surgical training, and movies have played an important role in these attempts. We have been using a 3D full high-definition (full-HD) camcorder to record movies of intra-oral surgeries.

Method

The subjects were medical students and doctors receiving surgical training who did not have actual surgical experience (n = 67). Participants watched an 8-min, 2D movie of orthognathic surgery and subsequently watched the 3D version. After watching the 3D movie, participants were asked to complete a questionnaire.

Result

A lot of participants (84%) felt a 3D movie excellent or good and answered that the advantages of a 3D movie were their appearance of solidity or realism. Almost all participants (99%) answered that 3D movies were quite useful or useful for medical practice.

Conclusions

Three-dimensional full-HD movies have the potential to improve the quality of medical education and clinical practice in oral and maxillofacial surgery.

Basic Burns Management E-Learning: A New Teaching Tool

Burns teaching is organized only in a few medical schools in the United Kingdom. An e-learning tutorial was developed with the objective of incorporating burns teaching within the medical school curriculum. A 33-webpage e-learning was created, covering topics such as local and general response to burns, assessment of burns, first aid, primary and secondary survey, and referral guidelines. Medical student satisfaction was then evaluated using a 12-question feedback survey rated based on a Likert scale from 1 (very poor) to 5 (very good). The 12-question survey was completed by a total of 18 medical students ranging from second to fourth years (second = 17%, third = 22%, fourth = 61%). While only a couple of students had received prior burns teaching, 50% of the cohort had an interest to pursue surgery as a career. The majority of students (72%) would be interested to have an e-learning module on basic burns management in their medical curriculum. The means of all domains specific to the e-learning were rated as "good" or "very good." Students' rating for ease of use was 87%, usefulness was 88%, relevance to the medical curriculum was 90%, clarity and quality of content were 78% and 83%, respectively, design was 79%, and the overall satisfaction with this e-learning was 87%. The "Basic Burns Management" e-learning tutorial can provide an efficient and effective means of information delivery to medical students and junior doctors, allowing easy and fast incorporation of burns teaching within the medical curriculum and in other medical teaching settings.

Long-bone fracture detection in digital X-ray images based on digital-geometric techniques

Automated fracture detection is an essential part of a computer-aided tele-medicine system. In this paper, we have proposed a unified technique for the detection and evaluation of orthopaedic fractures in long-bone digital X-ray image. We have also developed a software tool that can be conveniently used by paramedics or specialist doctors. The proposed tool first segments the bone region of an input digital X-ray image from its surrounding flesh region and then generates the bone-contour using an adaptive thresholding approach. Next, it performs unsupervised correction of bone-contour discontinuities that might have been generated because of segmentation errors, and finally detects the presence of fracture in the bone. Moreover, the method can also localize the line-of-break for easy visualization of the fracture, identify its orientation, and assess the extent of damage in the bone. Several concepts from digital geometry such as relaxed straightness and concavity index are utilized to correct contour imperfections, and to detect fracture locations and type. Experiments on a database of several long-bone digital X-ray images show satisfactory results.

Audiovisual preconditioning enhances the efficacy of an anatomical dissection course: A randomised study

The benefits of incorporating audiovisual materials into learning are well recognised. The outcome of integrating such a modality in to anatomical education has not been reported previously. The aim of this randomised study was to determine whether audiovisual preconditioning is a useful adjunct to learning at an upper limb dissection course. Prior to instruction participants completed a standardised pre course multiple-choice questionnaire (MCQ). The intervention group was subsequently shown a video with a pre-recorded commentary. Following initial dissection, both groups completed a second MCQ. The final MCQ was completed at the conclusion of the course. Statistical analysis confirmed a significant improvement in the performance in both groups over the duration of the three MCQs. The intervention group significantly outperformed their control group counterparts immediately following audiovisual preconditioning and in the post course MCQ. Audiovisual preconditioning is a practical and effective tool that should be incorporated in to future course curricula to optimise learning. Level of evidence This study appraises an intervention in medical education.

LEVEL OF EVIDENCE

Kirkpatrick Level 2b (modification of knowledge).

Gender differences in the learning and teaching of surgery: a literature review

OBJECTIVE

To explore evidence concerning gender differences in teaching and learning in surgery to guide future initiatives.

METHODS

This systematic review was conducted searching in the following electronic databases: MEDLINE, EMBASE, CINAHL, PsycINFO, ERIC, Web of Science, Scopus and PubMed. All studies related to gender differences in surgical education, teaching or learning of surgery at an undergraduate level were included. Data was extracted and critically appraised. Gender differences in learning, teaching, skills acquisition, perceptions and attitudes, interest on surgery, personality and factors influencing interest in surgical careers were differentiated.

RESULTS

There is an underrepresentation of women in surgical academia, due to lack of role models and gender awareness. It is not clear whether or not gender itself is a factor that affects the learning of surgical tasks. Female students pursuing a surgical career had experienced sexual harassment and gender discrimination that can have an effect on the professional identity formation and specialty choice. There are differences in personality among female and male students interested in surgery. Gender is a determining factor to choose surgery, with a consistent lower proportion of women compared interested in pursuing a surgical career. Mentoring and personality fit are important in medical student's specialty selection. Female students are more likely to be discouraged from pursuing a surgical career by a lack of female role models.

CONCLUSIONS

Bias against women in surgery still exists. There is a lack of studies that investigate the role of women in the teaching of surgery.

Components of Critical Decision Making and ABSITE Assessment: Toward a More Comprehensive Evaluation

RATIONALE

Accurate assessment of resident competency is a fundamental requisite to assure the training of physicians is adequate. In surgical disciplines, structured tests as well as ongoing evaluation by faculty are used for evaluating resident competency. Although structured tests evaluate content knowledge, faculty ratings are a better measure of how that knowledge is applied to real-world problems. In this study, we sought to explore the performance of surgical residents in a simulation exercise (strategic management simulations [SMS]) as an objective surrogate of real-world performance.

METHODS

Forty surgical residents participated in the SMS simulation that entailed decision making in a real-world-oriented task situation. The task requirements enable the assessment of decision making along several parameters of thinking under both crisis and noncrisis situations. Performance attributes include "simpler" measures of competency (activity level), intermediate categories (information management and emergency responses) to complex measures (breadth of approach and strategy). Scores obtained in the SMS were compared with the scores obtained on the American Board of Surgery In-Training Examination (ABSITE).

RESULTS

The data were intercorrelated and subjected to a multiple regression analysis with ABSITE as the dependent variable and simulation scores as independent variables. Using a 1-tail test analysis, only 3 simulation variables correlated with performance on ABSITE at the .01 level (ie, basic activity, focused activity, task orientation). Other simulation variables showed no meaningful relationships to ABSITE scores at all.

CONCLUSIONS

The more complex real-world-oriented decision-making parameters on SMS did not correlate with ABSITE scores. We believe that techniques such as the SMS, which focus on critical thinking, complement assessment of medical knowledge using ABSITE. The SMS technique provides an accurate measure of real-world performance and provides objective validation of faculty ratings.

Computer animations in medical education: a critical literature review

CONTEXT

Animations can depict dynamic changes over time and location, and illustrate phenomena and concepts that might otherwise be difficult to visualise. However, animations may not always be effective and educators who use animations must understand the principles that govern their use.

OBJECTIVES

This review aims to illustrate potential applications of animations in medical education, to identify evidence-based principles for their design and use, and to propose an agenda for future research.

METHODS

We searched MEDLINE, PsychINFO and EMBASE for articles describing the use of computer animations in medical education. We reviewed and summarised all identified original research studies comparing animations with an alternative computer-based or non-computer-based format. We also selectively reviewed non-medical education research on the use of computer animations.

RESULTS

Medical educators have used animations in a variety of computer-assisted learning applications, but few comparative studies have been published and the evidence is inconclusive. Research outside medical education shows conflicting results for studies comparing animations with static images. This may reflect differences in cognitive load induced by animation, or differences in the type of motion being illustrated. The benefits of animations may also vary according to learner characteristics such as prior knowledge and spatial ability. Features of animation that appear to facilitate learning include permitting learner control over the animation's pace, allowing learners to interact with animations and splitting the animation activity into small chunks (segmenting).

CONCLUSIONS

Existing medical education research does little to inform the use of animations. Research is needed to confirm and extend non-medicine research to ascertain when to use animations and how to use them effectively.

What is an hour-lecture worth?

BACKGROUND

Although there are many ways to convey knowledge, attitudes, and techniques when teaching residents and students, the most optimal method (lecture, online lecture, online tutorial, simulator practice, and so on) is yet to be determined.

METHODS

This study was designed to be a prospective analysis of change in resident behavior, and the model chosen was resident compliance with alcohol screening during admissions to the trauma service. Baseline values were determined the month before the educational "intervention," which was planned to be a 1-hour lecture during Grand Rounds on the importance of screening for alcohol disuse syndromes. After the "intervention," results were analyzed at 3 points in time: during the first month after the lecture and then at 3 and 12 months.

RESULTS

Resident compliance with alcohol usage screening rose from 53% at baseline to 80% at 1 year.

CONCLUSIONS

This straightforward model of utility of a lecture showed a significant change in resident behavior.

Development of a tool for evaluating multimedia for surgical education

BACKGROUND

Educational multimedia has been designed to provide surgical trainees with expert operative information outside of the operating theater. The effectiveness of multimedia (e.g., CD-ROMs) for learning has been a common research topic since the 1990s. To date, however, little discussion has taken place on the mechanisms to evaluate the quality of multimedia-driven teaching. This may be because of a lack of research into the development of appropriate tools for evaluating multimedia, especially for surgical education.

METHODS

This paper reports on a small-scale pilot and exploratory study (n = 12) that developed a tool for surgical multimedia evaluation. The validity of the developed tool was established through adaptation of an existing tool, which was reviewed using experts in surgery, usability, and education. The reliability of the developed tool was tested with surgical trainees who used it to assess a multimedia CD-ROM created for teaching basic surgical skills.

RESULTS

The findings contribute to an understanding of surgical trainees' experience of using educational multimedia, in terms of characteristics of the learning material for interface design and content and the process of developing evaluation tools, in terms of inclusion of appropriate assessment criteria.

CONCLUSIONS

The increasing use of multimedia in medical education necessitates the development of standardized tools for determining the quality of teaching and learning. Little research exists into the development of such tools and so the present work stimulates discussion on how to evaluate surgical training.

[A web-based e-learning tool in academic teaching of trauma surgery. First experiences and evaluation results]

There are lots of possibilities for universities to offer contents of teaching to students by the Internet. Often the students can download slides or a special lecture note from the intranet of the university. Another way is to make a movie of the lecture and post this lecture movie on the Internet. In the Hanover Medical School we employed an alternative. It was developed by the Trauma Surgery Clinic and the Institute of Medical Informatics at the Hanover Medical School. Our goal was to use just one web-based content resource for the lecture and for the work at home. The Institute of Medical Informatics used a web-based content management system (CMS) Schoolbook to implement this e-learning application.Since October 2005 the Trauma Surgery Schoolbook has been used in the lecture on trauma surgery in all terms, and we evaluated the academic year 2005/2006. The results of the evaluation showed us that the students were very interested in using this e-learning application. The possibility to reinforce the learning material at home is a good chance for the students. Also the organisation of lectures was improved because the materials were all in one place. The lecturer needs to learn several new tasks, but we also got a positive response. Our experiences of the last academic year showed that it was a good way to use one web-based content resource for teaching and learning in the context of a lecture.

Information and communication technologies in higher education: evidence-based practices in medical education

In contrast to traditional meta-analyses of research, an alternative overview and analysis of the research literature on the impact of information and communication technologies (ICT) in medical education is presented in this article. A distinction is made between studies that have been set up at the micro-level of the teaching and learning situation and studies on meso-level issues. At the micro-level, ICT is hypothesized to foster three basic information processing activities: presentation, organization, and integration of information. Next to this, ICT is expected to foster collaborative learning in the medical knowledge domain. Empirical evidence supports the potential of ICT to introduce students to advanced graphical representations but the studies also stress the importance of prior knowledge and the need for real-life tactile and practical experiences. The number of empirical studies focusing on the impact of ICT on information organization is restricted but the results suggest a positive impact on student attitudes and relevant learning gains. However, again, students need a relevant level of prior knowledge. Empirical studies focusing on the impact of ICT on information integration highlight the positive impact of ICT-based assessment and computer simulations; for the latter this is especially the case when novices are involved, and when they master the prerequisite ICT skills. Little empirical evidence is available regarding the impact of computer games. Research results support the positive impact of ICT-based collaboration but care has to be taken when skills development is pursued. At the meso-level, the available empirical evidence highlights the positive impact of ICT to promote the efficiency of learning arrangements. Research grounds the key position of ICT in a state-of-the-art medical curriculum. Recent developments focusing on repositories of learning materials for medical education have yet not been evaluated. The article concludes by stressing the need for evaluative studies, especially in the promising field of ICT-based collaborative learning. Furthermore, the importance to be attached to the position and qualifications of the teaching staff is emphasized.

Advantage of three dimensional animated teaching over traditional surgical videos for teaching ophthalmic surgery: a randomised study

BACKGROUND/AIM

Owing to the complex topographical aspects of ophthalmic surgery, teaching with conventional surgical videos has led to a poor understanding among medical students. A novel multimedia three dimensional (3D) computer animated program, called "Ophthalmic Operation Vienna" has been developed, where surgical videos are accompanied by 3D animated sequences of all surgical steps for five operations. The aim of the study was to assess the effect of 3D animations on the understanding of cataract and glaucoma surgery among medical students.

METHOD

Set in the Medical University of Vienna, Department of Ophthalmology, 172 students were randomised into two groups: a 3D group (n=90), that saw the 3D animations and video sequences, and a control group (n=82), that saw only the surgical videos. The narrated text was identical for both groups. After the presentation, students were questioned and tested using multiple choice questions.

RESULTS

Students in the 3D group found the interactive multimedia teaching methods to be a valuable supplement to the conventional surgical videos. The 3D group outperformed the control group not only in topographical understanding by 16% (p<0.0001), but also in theoretical understanding by 7% (p<0.003). Women in the 3D group gained most by 19% over the control group (p<0.0001).

CONCLUSIONS

The use of 3D animations lead to a better understanding of difficult surgical topics among medical students, especially for female users. Gender related benefits of using multimedia should be further explored.

Computer simulation of the human respiratory system for educational purposes

The main objective of this study was the development of a computer simulation system for the human respiratory system, in order to educate students of nursing. This approach was based on existing mathematical models and on our own constructed specific functions. For the development of this educational tool the appropriate software packages were used according to the special demands of this process. This system is called ReSim (Respiratory Simulation) and consists of two parts: the first part deals with pulmonary volumes and the second one represents the mechanical behavior of lungs. The target group evaluated ReSim. The outcomes of the evaluation process were positive and helped us realize the system characteristics that needed improvements. Our basic conclusion is that the extended use of such systems supports the educational process and offers new potential for learning.

Comparison of computer-assisted instruction (CAI) versus traditional textbook methods for training in abdominal examination (Japanese experience)

PURPOSE

This study aimed to compare the effects of computer-assisted, text-based and computer-and-text learning conditions on the performances of 3 groups of medical students in the pre-clinical years of their programme, taking into account their academic achievement to date. A fourth group of students served as a control (no-study) group.

METHOD

Participants were recruited from the pre-clinical years of the training programmes in 2 medical schools in Japan, Jichi Medical School near Tokyo and Kochi Medical School near Osaka. Participants were randomly assigned to 4 learning conditions and tested before and after the study on their knowledge of and skill in performing an abdominal examination, in a multiple-choice test and an objective structured clinical examination (OSCE), respectively. Information about performance in the programme was collected from school records and students were classified as average, good or excellent. Student and faculty evaluations of their experience in the study were explored by means of a short evaluation survey.

RESULTS

Compared to the control group, all 3 study groups exhibited significant gains in performance on knowledge and performance measures. For the knowledge measure, the gains of the computer-assisted and computer-assisted plus text-based learning groups were significantly greater than the gains of the text-based learning group. The performances of the 3 groups did not differ on the OSCE measure. Analyses of gains by performance level revealed that high achieving students' learning was independent of study method. Lower achieving students performed better after using computer-based learning methods.

CONCLUSION

The results suggest that computer-assisted learning methods will be of greater help to students who do not find the traditional methods effective. Explorations of the factors behind this are a matter for future research.

Operative Surgical Education: Results of a Society of Surgical Oncology Fellowship Survey and Proposal for an Operative Database

BACKGROUND

Preparation of surgical trainees for oncological operative procedures is challenging. The purpose of this survey was to focus on identifying methods and resources used by trainees to prepare for procedures and to ascess the need for additional educational tools.

METHODS

A 34-item survey was mailed electronically to 97 surgical oncology fellows at 14 Society of Surgical Oncology-approved training programs. General surgery residents at an affiliate training program (n = 65) and residents attending an American Board of Surgery In-Training Examination review course (n = 129) were polled via hard-copy mailings. The survey was distributed with the Dillman method. Self-education practices, factors influencing operative education, and strengths/weaknesses of available resources were identified.

RESULTS

Response rates were 56% and 78% for fellows and residents, respectively. Trainees prepare for more than 50% of cases they perform (82%; 169 of 205), devoting up to 1 hour (87%; 178 of 205) in review the evening before a procedure (64%; 131 of 205). Time availability and attending of record were dominant factors influencing resident preparation, whereas case complexity was the most important variable motivating fellows. Surgical atlases, texts, anatomical references, and case discussion with attending staff were the most useful and available resources rated by trainees. Skills stations were recognized as the least valuable. Critical assessment of six educational resources identified no one particular area for improvement.

CONCLUSIONS

There is a need for contemporary operative educational tools, incorporating time-sensitive and procedure-specific needs of surgical trainees preparing for oncological operative procedures.

Long-term retention of knowledge after a distance course in medical informatics at Charles University Prague

BACKGROUND

Distance education is instructional delivery that does not constrain the student to be physically present in the same location as the instructor. The electronic distance learning called e-learning has evolved with the development of computer technologies and electronic communication.

PURPOSE

Before setting the distance way of teaching as a standard part of medical schools' curricula, the impact of number of factors on the effectiveness of this way of teaching should be considered.

METHODS

A group of 38 students went through a distance course of medical informatics. The course consisted of 10 lessons. At the end of the course the students sat for a final test that contained 60 multiple-choice test questions. There was always one correct answer. Time limit for test completion was 60 minutes. After 12 months, 31 students from the original group sat for the same test. The topics of the course were not repeated in the meantime. The students were not aware that their knowledge would be tested after 1 year.

RESULTS

The average retention of knowledge expressed as a percentage of the students' performance in the first test was 66.8%. The knowledge retention correlated significantly with the statement "I liked the online course more than the classroom course" and positively with the number of hours spent with the computer weekly.

CONCLUSIONS

Retention of knowledge after the electronic distance course after 12 months is close to 67%. Other results indicate that we can expect better retention of knowledge from independent, responsible, and positively motivated students who can easily operate information technologies.

Virtual coronary cineangiography

The mastering of myocardial infarction diagnosis is traditionally composed of laborious trial- and error-based examination of canonical coronary cineangiographies. In the following article we suggest a system that enables the instructor to generate student-specific cases, thus allowing teaching not only the basic feature searching and stenosis evaluation processes, but also the importance of the correct acquisition viewpoint. With the proposal of the development of the Digital Cardiologist intelligent agent we also envisage the possibility of the student's self-tutoring.

Spinal cord injury computer-assisted instruction for medical students

OBJECTIVE

To determine if a computer-assisted instruction program would improve fourth-year medical students' knowledge base related to spinal cord injury, as determined by pretest and posttest scores.

DESIGN

A multimedia computer-assisted instruction program was developed and offered on a volunteer basis to an entire class of fourth-year medical students (n = 168). Effectiveness of the instructional content was evaluated with pretests and posttests, and overall user satisfaction with the module was assessed with the courseware evaluation.

RESULTS

The responses yielded 83 sets of completed pretest and posttest pairs and 80 sets of fully completed courseware evaluations. Mean posttest score was significantly higher than the mean pretest score (pretest, 6.65 +/- 1.44, vs. posttest, 7.36 +/- 1.38; df = 82, t = -4.74, P < 0.001). Courseware evaluations yielded positive ratings in all areas, including applicability and usability.

CONCLUSIONS

The significantly increased posttest scores suggest that the students left the program with an expanded knowledge base in the content areas of spinal cord injury medicine covered in the computer-assisted instruction program.

Are multiple objective measures of student performance necessary?

BACKGROUND

This study examines the effect of using multiple modalities to evaluate medical students.

METHODS

Thirty-four students were evaluated by a complex model utilizing National Board of Medical Examiners (NBME) shelf examination, Objective Structured Clinical Examination (OSCE), Computer Patient Simulation (CPS), faculty and peer evaluation. Results were compared with a traditional model based on NBME and faculty evaluation alone.

RESULTS

Reliability (coefficient alpha) of the complex and traditional models were 0.72 and 0.47, respectively. Item correlations suggested that NBME was most discriminating (r = 0.75), followed by OSCE (r = 0.52), peer evaluation (r = 0.43), CPS (r = 0.39), and faculty evaluation (r = 0.32). Rank order correlation (Spearman's rho) between scores calculated using each model was 0.87.

CONCLUSIONS

Although the complex model has improved reliability, both models rank students similarly. However, neither model fully captures and reflects the information provided by each of the specific evaluation methods.

The TEAM methodology for the evaluation of information systems in biomedicine

The TEAM evaluation methodology for information systems in biomedicine (Total Evaluation and Acceptance Methodology) is a unifying methodology for any computer-based information system based on a three dimensional framework; these dimensions being Role, Time and Structure. The theory is derived from how the information system relates to the general system where it should operate, the properties of information flow within a general system and the relation between a system and its models. As a system can in theory be modelled from many perspectives, a perspective to be modelled is built up by formulating criteria relevant to that perspective which can be evaluated by quantitative and qualitative assessment methods. Key characteristics of the methodology include the insistence on a global rather than partial approach to the evaluation of information systems, also the dynamic nature of an information system which is continually in modification as it more successfully deals with the inherent complexity of the environment in which it is operating. The role dimension identifies four main categories, designer, specialist user, end user and stakeholder from which several sub-categories may be identified. The time dimension has four main phases towards relative stability of the information system. The structural dimension distinguishes strategic, tactical or organisational and operational levels that often are confused together with risk of dilution in current approaches. It is believed that this framework and methodology can provide a basis for future standardisation of evaluation methodologies.

Measuring medical students' experience with surgical problems and procedures

BACKGROUND

Measuring medical students' experience on their surgical clerkship rotations to assess the adequacy of the breadth of exposure is essential for producing generalist clinicians.

METHODS

A Surgical Clinical Checklist was developed by surveying the surgical faculty for those surgical problems and procedures that every generalist physician should experience. The checklist was then distributed to 48 consecutive third-year medical students for completion during their core clerkship in surgery.

RESULTS

Students reported encounters with surgical procedures more frequently than with surgical problems (64.3% of procedures versus 21.9% of problems were encountered by 80% of respondents). Students actively participated as often as they reported passive observation alone. Students assigned to two different teaching sites encountered similar numbers of items at each site although the distribution of individual items was different.

CONCLUSIONS

The Surgical Clinical Checklist provides a valuable measurement tool to assess student experiences on their surgical clerkship and can be used to direct future teaching initiatives.