Relationships Matter: Enhancing Trainee Development with a (Simple) Clerkship Curriculum Reform

PROBLEM

The traditional clerkship model of brief encounters between faculty and students results in reduced meaningful learning opportunities due to the lack of a relationship that enables repeated observation, supervisor feedback, trust formation, and growth.

INTERVENTION

Clinical clerkships at our institution were restructured to decrease fragmentation of supervision and foster an educational alliance between faculty and student. A mixed-methods approach was used to study the impact of this curriculum reform on the student experience in the obstetrics and gynecology clerkship. Student participation in patient care was assessed by comparing the number of common obstetric procedures performed before and after clerkship reform. Separate qualitative analyses of comments from student surveys and a faculty focus group revealed themes impacting student involvement. The supervisor-trainee relationship was further investigated by analysis of "rich picture" discussions with students and faculty.

CONTEXT

Clerkships in the 3rd year of our 4-year undergraduate medical curriculum were converted from an experience fragmented by both didactic activities and multiple faculty supervisors to one with a single supervisor and the elimination of competing activities.

OUTCOMES

Students in the revised clerkship performed twice the number of obstetric procedures. Objective measures (United States Medical Licensing Examination Step 1 scores, receiving clerkship honors, self-reported interest in obstetrics, and gender) did not correlate with the number of procedures performed by students. Qualitative analysis of student survey comments revealed that procedure numbers were influenced by being proactive, having a supervisor with a propensity to teach (trust), and contextual factors (busy service or competition with other learners). Themes identified by faculty that influenced student participation included relationship continuity; growth of patient care skills; and observed student engagement, interest, and confidence. The quality of the relationship was cited by both students and faculty as a factor influencing meaningful clinical participation. Discussions of "rich pictures" drawn by students and faculty revealed that relationships are influenced by continuity, early alignment of goals, and the engagement and attitude of both student and faculty.

LESSONS LEARNED

Clinical curricular reforms that strengthen the continuity of the supervisor-trainee relationship promote mutual trust and can result in a more meaningful training experience in less time. Reciprocal engagement and early alignment of goals between supervisor and trainee are critical for creating a positive relationship.

Prevalence and Distribution of Potential Vascularized Composite Allotransplant Donors, Implications for Optimizing the Donor-recipient Match

BACKGROUND

Vascularized composite allotransplantation (VCA) is an emerging and growing field. Little is known about the prevalence and distribution of the adult potential donor population in the United States now that it falls under the oversight of the United Network for Organ Sharing (UNOS).

METHODS

We assessed the UNOS database from 2008 to 2015 to estimate the prevalence and distribution of adult potential vascularized composite allograft donors. Donor inclusion and exclusion criteria were developed in a way to minimize risk to recipients and were applied to the dataset. Donors were categorized by factors that influence vascularized composite allograft matching including ABO blood type, cytomegalovirus status, and ethnicity (correlate for skin color) and sorted by UNOS region.

RESULTS

Just under half of all brain dead donors met the inclusion/exclusion criteria. Blood type O, cytomegalovirus+, White donors represented the most frequent donor profile while blood type AB, cytomegalovirus-, Asian donors were the least common. UNOS region 3 had the most and region 1 had the least potential VCA donors per year. Nearly all potential VCA donors were solid organ donors with the liver being the most commonly donated solid organ in this population.

CONCLUSIONS

A large portion of the solid organ donor pool would qualify as adult vascularized composite allograft donors in the current UNOS system. These data will assist transplant teams in determining the prevalence and distribution of vascularized composite allograft donors for their individual patients awaiting composite allografts based on relevant matching characteristics in addition to standard transplant criteria.

Neuroepidemiologic Trends in 105 US Cases of Pediatric Opsoclonus-Myoclonus Syndrome

Opsoclonus-myoclonus syndrome (OMS) is a rare, autoimmune neurological disorder that is poorly recognized and undertreated. Neuroblastoma is found in one half of the cases. Because of the high incidence of spontaneous regression of neuroblastoma, it is unknown whether not finding a tumor means there was none. To define demographic trends and the standard of care in the first large series of OMS, 105 children were recruited over a 13-year period in a retrospective questionnaire survey. Children with and without a tumor differed little in viral-like prodrome and neurological symptoms. Earliest neurological symptoms were staggering and falling, leading to a misdiagnosis of acute cerebellitis. Later symptoms included body jerks, drooling, refusal to walk or sit, speech problems, decreased muscle tone, opsoclonus, and inability to sleep. Tumor resection alone did not provide adequate therapy for most. Adrenocorticotropic hormone (ACTH), prednisone, and intravenous immunoglobulin were used with equal frequency, but ACTH was associated with the best early response. More than one half of the children had relapses. Residual behavioral, language, and cognitive problems occurred in the majority. The delay in diagnosis (11 weeks) and initiation of treatment (17 weeks) is unacceptably long.

Individual and Combined Effects of Attention Deficits and Learning Disabilities on Computerized ADHD Assessment

The widespread use of computerized assessments in the diagnosis of attention deficit disorders (ADD/ADD-H) necessitates identification of factors that influence performance on these instruments. The individual and combined influence of two factors, attention deficits (determined by DSM-III) and learning disabilities (LD), on computerized ADHD assessment was evaluated in a clinic population of 253 children referred because of problems with attention or concentration, high activity levels, or poor academic achievement. Intelligence scores, levels of academic achievement, DSM-III diagnoses, parent and teacher rating scale data, and the presence of LDs were recorded. In ADD subjects, 66% also had one or more identified LD. In children without ADD, 64% were diagnosed as LD. Analyses of both summary scores (age-adjusted percentiles) and separate trial (raw) scores of a computerized assessment device indicated main effects for ADD/ADD-H on the continuous performance task (CPT) number correct and number of commissions. No main effect for LD was found. Delay task (DRL) results were not as clear; ADD effects were significant when raw scores, but not percentile scores, were used. It appears the computerized CPT task is influenced by ADD/ADD-H and is not affected independently by LD; however, age and IQmust be considered in such assessment. The delay task might not be as clinically useful.

Factor Structure of the Wide Range Assessment of Memory and Learning in a Clinical Population

The Wide Range Assessment of Memory and Learning (WRAML) factor structure is evaluated in a clinical sample of 323 children referred because of problems in school performance ( M age 9.83 years, M grade 4.18, M FSIQ 95.03). Of these, 72% had attention deficits, whereas 8 to 35% had learning disabilities. Pairwise principal factor analyses with the Montanelli and Humphreys criterion produced a three-factor solution that accounted for 36% of the variance: Factor 1 is a Visual Content factor (four subtests), factor 2 is a Short-term Verbal factor (2 subtests), and factor 3 is a Verbal Semantic/Strategic factor (2 subtests). “Learning” subtests did not separate out, and Sound-symbol did not load significantly on any factor. Solutions for the two age divisions of the test were highly similar. These findings are not consistent with the WRAML factor structure reported by the test authors and suggest that alternative means of interpretation be considered. Modality-related and functional processing dimensions (strategic/nonstrategic, episodic/semantic) are recommended for clinical use in the evaluation of children's memory.

Relationships Between Continuous Performance Task Scores and Other Cognitive Measures: Causality or Commonality?

Relationships among continuous performance test, IQ, achievement, and memory/learning scores were explored in a clinical sample of 1,280 children ( M age = 9.4 years, M grade = 3.9). Intercorrelations among CPT measures were significant, but modest. Correlations between CPT measures and IQ, achievement, and memory/learning scores were also significant, but again generally weak. The CPT number correct scores were more strongly related to other cognitive measures than were commission (i.e., responding to incorrect stimuli) scores. The breadth and extent of associations among the CPT measures and the various cognitive/academic tasks suggest that all, to some extent, require attention and inhibition. The importance of routinely assessing attention and disinhibition in psychological testing is discussed.

Effect of Position-Within-Sequence on Case Performance in a Multiple-Stations Examination Using Standardized-Patient Cases

Several recent studies of multiple-stations examinations of clinical competence have found a "sequence effect," which refers to an observed improvement in performance across a sequence of examination cases, so that performance on stations encountered later in the sequence is significantly superior to that on stations encountered earlier. The present study was conducted to assess the possibility of a sequence effect in the multiple-stations performance-based examination given to senior medical students at Southern Illinois University School of Medicine. Unlike the previous studies, the present study assessed the sequence effect at the level of the individual case, the level at which the effect creates a serious problem for score interpretation. Analyses were performed on scores obtained from checklists completed by standardized patients and on scores to written questions following the patient encounter for each standardized-patient case for the classes of 1989 and 1990. In general, the results showed no improvement in case scores across successive cases in the examination. There was no evidence for a sequence effect on student examination performance.

D-methionine (D-met) significantly reduces kanamycin-induced ototoxicity in pigmented guinea pigs

OBJECTIVE

Test D-methionine (D-met) as an otoprotectant from kanamycin-induced ototoxicity and determine the lowest maximally protective D-met dose.

DESIGN

Auditory brainstem responses (ABR) were measured at 4, 8, 14, and 20 kHz at baseline and two, four, and six weeks after kanamycin and D-met administration initiation. ABR threshold shifts assessed auditory function. Following six-week ABR testing, animals were decapitated and cochleae collected for outer hair cell (OHC) quantification.

STUDY SAMPLE

Eight groups of 10 male pigmented guinea pigs were administered a subcutaneous kanamycin (250 mg/kg/dose) injection once per day and an intraperitoneal D-met injection (0 (saline), 120, 180, 240, 300, 360, 420, or 480 mg/kg/day) twice per day for 23 days.

RESULTS

Significant ABR threshold shift reductions and increased OHC counts (p ≤ 0.01) were measured at multiple D-met-dosed groups starting at two-week ABR assessments. A 300 mg/kg/day optimal otoprotective D-met dose provided 34-41 dB ABR threshold shift reductions and OHC protection. Lesser, but significant, D-met otoprotection was measured at lower and higher D-met doses.

CONCLUSIONS

D-met significantly reduced ABR threshold shifts and increased OHC percentages compared to kanamycin-treated controls. Results may be clinically significant particularly for multidrug-resistant tuberculosis patients who frequently suffer from kanamycin-induced hearing loss in developing countries.

Rasch analysis of professional behavior in medical education

The use of students' "consumer feedback" to assess faculty behavior and improve the process of medical education is a significant challenge. We used quantitative Rasch measurement to analyze pre-categorized student comments listed by 385 graduating medical students. We found that students differed little with respect to the number of comments they provided and that their comments indeed form a probabilistic Rasch hierarchy. However, different hierarchies were found across medical departments and faculty. An analysis of these interactions provides valuable, detailed, and quantitative information that can augment qualitative research approaches. In addition, we suggest how the Rasch scaling of student comments can assist researchers in the design and implementation of new faculty evaluation instruments. Finally, the interactions between student and department identified a subset of behaviors that appear to guide and possibly elicit students' comments.

d-Methionine reduces tobramycin-induced ototoxicity without antimicrobial interference in animal models

BACKGROUND

Tobramycin is a critical cystic fibrosis treatment however it causes ototoxicity. This study tested d-methionine protection from tobramycin-induced ototoxicity and potential antimicrobial interference.

METHODS

Auditory brainstem responses (ABRs) and outer hair cell (OHC) quantifications measured protection in guinea pigs treated with tobramycin and a range of d-methionine doses. In vitro antimicrobial interference studies tested inhibition and post antibiotic effect assays. In vivo antimicrobial interference studies tested normal and neutropenic Escherichia coli murine survival and intraperitoneal lavage bacterial counts.

RESULTS

d-Methionine conferred significant ABR threshold shift reductions. OHC protection was less robust but significant at 20kHz in the 420mg/kg/day group. In vitro studies did not detect d-methionine-induced antimicrobial interference. In vivo studies did not detect d-methionine-induced interference in normal or neutropenic mice.

CONCLUSIONS

d-Methionine protects from tobramycin-induced ototoxicity without antimicrobial interference. The study results suggest d-met as a potential otoprotectant from clinical tobramycin use in cystic fibrosis patients.

Biocompatibility of single-walled carbon nanotube composites for bone regeneration

OBJECTIVES

The purpose of this study was to evaluate in vivo biocompatibility of novel single-walled carbon nanotubes (SWCNT)/poly(lactic-co-glycolic acid) (PLAGA) composites for applications in bone and tissue regeneration.

METHODS

A total of 60 Sprague-Dawley rats (125 g to 149 g) were implanted subcutaneously with SWCNT/PLAGA composites (10 mg SWCNT and 1gm PLAGA 12 mm diameter two-dimensional disks), and at two, four, eight and 12 weeks post-implantation were compared with control (Sham) and PLAGA (five rats per group/point in time). Rats were observed for signs of morbidity, overt toxicity, weight gain and food consumption, while haematology, urinalysis and histopathology were completed when the animals were killed.

RESULTS

No mortality and clinical signs were observed. All groups showed consistent weight gain, and the rate of gain for each group was similar. All groups exhibited a similar pattern for food consumption. No difference in urinalysis, haematology, and absolute and relative organ weight was observed. A mild to moderate increase in the summary toxicity (sumtox) score was observed for PLAGA and SWCNT/PLAGA implanted animals, whereas the control animals did not show any response. Both PLAGA and SWCNT/PLAGA showed a significantly higher sumtox score compared with the control group at all time intervals. However, there was no significant difference between PLAGA and SWCNT/PLAGA groups.

CONCLUSIONS

Our results demonstrate that SWCNT/PLAGA composites exhibited in vivo biocompatibility similar to the Food and Drug Administration approved biocompatible polymer, PLAGA, over a period of 12 weeks. These results showed potential of SWCNT/PLAGA composites for bone regeneration as the low percentage of SWCNT did not elicit a localised or general overt toxicity. Following the 12-week exposure, the material was considered to have an acceptable biocompatibility to warrant further long-term and more invasive in vivo studies. Cite this article: Bone Joint Res 2015;4:70-7.

Variations in senior medical student diagnostic justification ability

PURPOSE

To determine the diagnostic justification proficiency of senior medical students across a broad spectrum of cases with common chief complaints and diagnoses.

METHOD

The authors gathered diagnostic justification exercise data from the Senior Clinical Comprehensive Examination taken by Southern Illinois University School of Medicine's students from the classes of 2011 (n = 67), 2012 (n = 66), and 2013 (n = 79). After interviewing and examining standardized patients, students listed their key findings and diagnostic possibilities considered, and provided a written explanation of how they used key findings to move from their initial differential diagnoses to their final diagnosis. Two physician judges blindly rated responses.

RESULTS

Student diagnostic justification performance was highly variable from case to case and often rated below expectations. Of the students in the classes of 2011, 2012, and 2013, 57% (38/67), 23% (15/66), and 33% (26/79) were judged borderline or poor on diagnostic justification performance for more than 50% of the cases on the examination.

CONCLUSIONS

Student diagnostic justification performance was inconsistent across the range of cases, common chief complaints, and underlying diagnoses used in this study. More than 20% of students exhibited borderline or poor diagnostic justification performance on more than 50% of the cases. If these results are confirmed in other medical schools, attention needs to be directed to investigating new curricular methods that ensure deliberate practice of these competencies across the spectrum of common chief complaints and diagnoses and do not depend on the available mix of patients.

Expression of CXCR3 and its ligands CXCL9, -10 and -11 in paediatric opsoclonus-myoclonus syndrome

Opsoclonus-myoclonus syndrome (OMS) is a neuroinflammatory disorder associated with remote cancer. To understand more clearly the role of inflammatory mediators, the concentration of CXCR3 ligands CXCL10, CXCL9 and CXCL11 was measured in 245 children with OMS and 81 paediatric controls using enzyme-linked immunosorbent assay (ELISA), and CXCR3 expression on CD4(+) T cells was measured by flow cytometry. Mean cerebrospinal fluid (CSF) CXCL10 was 2·7-fold higher in untreated OMS than controls. Intrathecal production was demonstrated by significantly different CXCL10 CSF : serum ratios. The dichotomized 'high' CSF CXCL10 group had higher CSF leucocyte count (P = 0·0007) and B cell activating factor (BAFF) and CXCL13 concentrations (P < 0·0001). CSF CXCL10 did not correlate with clinical severity or relapse using grouped data, although it did in some patients. Among seven types of immunotherapy, including rituximab or chemotherapy, only adrenocorticotrophic hormone (ACTH) monotherapy showed reduced CSF CXCL10, but prospective longitudinal studies of ACTH combination therapies indicated no reduction in CXCL10 despite clinical improvement (P < 0·0001). CXCL10 concentrations were 11-fold higher in CSF and twofold higher in serum by multiplexed fluorescent bead-based immunoassay than enzyme-linked immunosorbent assay, but the two correlated (r = 0·7 and 0·83). In serum, no group differences for CXCL9 or CXCL11 were found. CXCR3 expression on CD4(+) T cells was fivefold higher in those from CSF than blood, but was not increased in OMS or altered by conventional immunotherapy. These data suggest alternative roles for CXCL10 in OMS. Over-expression of CXCL10 was not reduced by clinical immunotherapies as a whole, indicating the need for better therapeutic approaches.

Active comparator-controlled, rater-blinded study of corticotropin-based immunotherapies for opsoclonus-myoclonus syndrome

To test the efficacy and safety of corticotropin-based immunotherapies in pediatric opsoclonus-myoclonus syndrome, 74 children received corticotropin alone or with intravenous immunoglobulin (groups 1 and 2, active controls); or both with rituximab (group 3) or cyclophosphamide (group 4); or with rituximab plus chemotherapy (group 5) or steroid sparers (group 6). There was 65% improvement in motor severity score across groups (P < .0001), but treatment combinations were more effective than corticotropin alone (P = .0009). Groups 3, 4, and 5 responded better than group 1; groups 3 and 5 responded better than group 2. The response frequency to corticotropin was higher than to prior corticosteroids (P < .0001). Fifty-five percent had adverse events (corticosteroid excess), more so with multiagents (P = .03); and 10% had serious adverse events. This study demonstrates greater efficacy of corticotropin-based multimodal therapy compared with conventional therapy, greater response to corticotropin than corticosteroid-based therapy, and overall tolerability.

From test validity to construct validity … and back?

CONTEXT

  Major changes in thinking about validity have occurred during the past century, shifting the focus in thinking from the validity of the test to the validity of test score interpretations. These changes have resulted from the 'new' thinking about validity in which construct validity has emerged as the central or unifying idea of validity today. Construct validity was introduced by Cronbach and Meehl in the mid-1950s in an attempt to address the validity of those many psychological concepts that have no clear referent in reality. To do this, construct validity theory required a nomological network--an elaborate theoretical network of constructs and observations connected by scientific laws--to validate the constructs. However, nomological networks are hard to come by and none that would do the job required by construct validity has been forthcoming to date. Thus, the current construct validity approach has retreated to one of simply 'interpretation and argument', but this seems to be too general to tie down the constructs in the way a nomological network would do to give credibility to the validity of the construct. As a result, the concept of validity seems to have been watered down and the credibility of validity claims weakened.

OBJECTIVES

  The purpose of this paper is to encourage a discussion of the use of construct validity in medical education, and to suggest that test developers and users reconsider the use of abstract theoretical constructs that have no referent apart from theory.

METHODS

  We present a critical review of these concerns about construct validity and provide for contrast a brief overview of a recently proposed view of measurement based on scientific realism and causality analysis.

A validity study of the Working Group's Autobiographical Memory Test for individuals with moderate to severe intellectual disability

The purpose of the present study was to investigate the validity of the Working Group's Autobiographical Memory Test as a dementia screening tool for individuals with moderate to severe intellectual disabilities (ID). Twenty-one participants with Dementia of Alzheimer's Type (DAT) and moderate to severe ID and 42 controls with similar levels of ID were tested. The majority were re-tested one year after the initial evaluation. The DAT group scored considerably lower than the control group on the initial evaluation. The controls with DS exhibited a considerable decline on the follow-up evaluation whereas other participants exhibited little changes. This demonstrates an insignificant overall difference between the DAT group and the control group on the follow-up evaluation. Virtually all participants exhibited the same scores on 3 out of 6 test items and the percentage of participants who correctly answered the remaining three test items were not significantly different from the DAT or control groups. In conclusion, the Working Group's Autobiographical Memory Test may be useful as a dementia screening tool for individuals with moderate to severe ID from DS when validated with a large sample size study. However, it is questionable whether this test is a reliable dementia screening tool for individuals with moderate to severe ID from non-DS etiologies. This test has a significant psychometric weakness because of the restricted score variability among the participants.

A pilot study of a test for visual recognition memory in adults with moderate to severe intellectual disability

Objective assessment of memory functioning is an important part of evaluation for Dementia of Alzheimer Type (DAT). The revised Picture Recognition Memory Test (r-PRMT) is a test for visual recognition memory to assess memory functioning of persons with intellectual disabilities (ID), specifically targeting moderate to severe ID. A pilot study was performed to investigate whether the r-PRMT could differentiate DAT-related memory decline from pre-existing poor memory functioning of persons with moderate to severe ID. The r-PRMT scores were compared between 26 participants with DAT and moderate to severe ID and 33 controls with similar levels of ID. The results revealed that the controls with DS showed uniformly high scores in contrast to those with DAT on the r-PRMT and the score distributions of two groups were distinctly different with no overlap. On the other hand, the controls with non-DS etiologies scored much lower with a wider score spread, resulting in significant overlap with the score distribution of the participants with DAT. In conclusion, the r-PRMT may be effective in identifying persons with DAT among persons with moderate to severe ID from DS. However, the r-PRMT may result in a high false positive error rate in discriminating those with DAT among persons with moderate to severe ID from non-DS etiologies, if the judgment is based on a single point assessment.

Pediatric dosing of rituximab revisited: serum concentrations in opsoclonus-myoclonus syndrome

To longitudinally assess serum concentrations of rituximab, it was administered intravenously to 25 children with opsoclonus-myoclonus syndrome at 375 mg/m2 on each of 4 consecutive weeks with (Group I and II) or without (Group III) conventional immunotherapy. Serum rituximab levels, drawn before and after each infusion and at later intervals, were analyzed by enzyme-linked immunosorbent assay. Rituximab concentration increased stepwise with each infusion, dropping by the next infusion, thereby forming 4 discrete peaks (Cmax) and troughs (Cmin). It then fell precipitously to trace levels at 4 months. However, Cmax and Cmin curves differed significantly between groups. Compared with the youngest children (Group I), the oldest (Group III) had a 34% lower rituximab concentration at the fourth infusion, 45% less IgM depletion 1 month later, and received 20% less rituximab when the dose was recalculated as mg/kg. Serum IgM and rituximab levels were negatively correlated. Peak rituximab concentration did not correlate with adrenocorticotropic hormone dose. These results indicate that the degree of serum IgM depletion is a useful indicator for rituximab dose equivalency in children of different ages. They also suggest that pediatric rituximab dosing should be based on body weight, not surface area. (ClinicalTrials.gov NCT00244361).

Reports of the decline of empathy during medical education are greatly exaggerated: a reexamination of the research

PURPOSE

Research is said to show that empathy declines during medical school and residency training. These studies and their results were examined to determine the extent of the decline and the plausibility of any alternative explanations.

METHOD

Eleven studies published from 2000 to 2008 which reported empathy at various stages of physician training were reexamined. Their results were transformed back to the original units of the rating scales to make results more interpretable by reporting them in the metric of the original anchors. Next, the relationship between empathy ratings and response rates were examined to see whether response bias was a plausible threat to the validity of the empathy decline conclusion.

RESULTS

The changes in mean empathy ranged across the 11 studies from a 0.1-point increase in empathy to a 0.5-point decrease, with an average of a 0.2-point decline for the 11 studies (ratings were on 5-point, 7-point, and 9-point scales). Mean ratings were similar in medical school and residency. Response rates were low and-where reported-declined on average about 26 percentage points.

CONCLUSIONS

Reexamination revealed that the evidence does not warrant the strong, disturbing conclusion that empathy declines during medical education. Results show a very weak decline in mean ratings, and even the weak decline is questionable because of the low and varying response rates. Moreover, the empathy instruments are self-reports, and it isn't clear what they measure-or whether what they measure is indicative of patients' perceptions and the effectiveness of patient care.

Peer assessment of professionalism: a five-year experience in medical clerkship

INTRODUCTION

Faculty assessment of students' professionalism is often based upon sporadic exposure to students. Peers are in a unique position to provide valid judgments of these behaviors.

AIMS

(1) To learn if peer assessments of professional conduct correlate with traditional performance measures; (2) to determine if peer assessments of professionalism influence the designation of honors, and (3) to explore student and faculty opinions regarding peer assessment.

SETTING

Internal Medicine Clerkship at Southern Illinois University.

PROGRAM DESCRIPTION

Since 2001 anonymous student peer assessments of professionalism have been used in assigning clerkship grades.

PROGRAM EVALUATION

Peer assessments of professionalism had weak, though significant, correlations with faculty ratings (r = 0.29), performance on the NBME subject test (r = 0.28), and performance on a cumulative performance assessment (r = 0.30), and did not change the total number of honors awarded. A majority of students (71%) felt comfortable evaluating their peers, and 77% would keep the peer evaluation procedure in place. A majority of faculty (83%) indicated that peer assessments added valuable information.

DISCUSSION

Peer assessments of professional conduct have little correlation with other performance measures, are more likely to have a positive influence on final clerkship grades, and have little impact on awarding honors.

Decreased mortality associated with prompt Gram staining of blood cultures

Gram stains of positive blood cultures are the most important factor influencing appropriate therapy. The sooner appropriate therapy is initiated, the better. Therefore, it is reasonable to expect that the sooner Gram stains are performed, the better. To determine the value of timely Gram stains and whether improvement in Gram stain turnaround time (TAT) is feasible, we compared data for matched pairs of patients with cultures processed promptly (<1 hour TAT) with data for patients with cultures not processed promptly (> or =1 hour TAT) and then monitored TAT by control charting.In 99 matched pairs, average difference in time to detection of positive blood cultures within a pair of patients was less than 0.1 hour. For the less than 1 hour TAT group, the average TAT and crude mortality were 0.1 hour and 10.1%, respectively; for the 1 hour or longer TAT group, they were 3.3 hours and 19.2%, respectively (P < .0001 and P = .0389, respectively). After multifaceted efforts, we achieved significant improvement in the TAT for Gram stains.

Meta-analysis of quasi-experimental research: are systematic narrative reviews indicated?

CONTEXT

Meta-analyses are commonly performed on quasi-experimental studies in medical education and other applied field settings, with little or no apparent concern for biases and confounds present in the studies synthesised. The implicit assumption is that the biases and confounds are randomly distributed across the studies and are averaged or cancelled out by the synthesis.

OBJECTIVES

We set out to consider the possibility that the results and conclusions of meta-analyses in medical education are subject to biases and confounds and to illustrate this possibility with a re-examination of the studies synthesised in an important, recently published meta-analysis of problem-based learning.

METHODS

We carefully re-examined the studies in the meta-analysis. Our aims were to identify obvious biases and confounds that provided plausible alternative explanations of each study's results and to determine whether these threats to validity were considered and convincingly ruled out as plausible rival hypotheses.

RESULTS

Ten of the 11 studies in the meta-analysis used quasi-experimental designs; all 10 were subject to constant biases and confounds that favoured the intervention condition. Threats to validity were not ruled out in the individual studies, nor in the meta-analysis itself.

CONCLUSIONS

Our re-examination of the results and conclusions of the meta-analysis illustrates our concerns about the validity of meta-analyses based primarily on quasi-experimental studies. Our tentative conclusion is that the field of medical education might be better served in most instances by systematic narrative reviews that describe and critically evaluate individual studies and their results in light of threats to their validity.

Characteristics of smokers calling a national reactive telephone helpline

PURPOSE

Although reactive telephone helplines for quitting smoking are increasingly popular in the United States, the characteristics of callers using this resource have not been adequately studied. The objective of this study was to describe the characteristics of the current smokers calling a national reactive telephone helpline (i.e., study population).

DESIGN AND SETTING

In this cross-sectional study, information was obtained from eligible participants telephonically.

SUBJECTS

The study included 890 adult current smokers who were new callers to a national reactive helpline.

MEASURES

The information collected included selected demographic and smoking-related characteristics.

ANALYSIS

The proportions of the above characteristics were analyzed.

RESULTS

There was a significant overepresentation of blacks, non-Hispanics, women, and urban residents, as well as poorer, older, less educated, and heavier smokers in the study population (p < .01 for all comparisons).

CONCLUSIONS

Reactive telephone helplines may be preferentially used by population segments who are disadvantaged or smoke heavily and thus are in greatest need for assistance. These helplines may therefore fill a much-needed niche in the marketplace of smoking cessation strategies.

Using indirect questions to detect intimate partner violence: the SAFE-T questionnaire

A screening instrument for detecting intimate partner violence (IPV) was developed using indirect questions. The authors identified 5 of 18 items studied that clearly distinguished victims of IPV from a random group of health conference attendees with a sensitivity of 85% and a specificity of 87%. This 5-item instrument (SAFE-T) was then tested on 435 women presenting to three emergency departments and the results compared to a direct question regarding current abuse. The SAFE-T questions detected only 54% of the women who admitted being abused and correctly classified 81% of the women who said they were not victims. The 1-year prevalence of IPV in this sample of women presenting to an emergency department was 11.6%. The authors conclude that indirect questioning of women appears to be more effective at ruling out IPV in an emergency department population and may be less useful for women "early" in an abusive relationship.

Prevention of noise- and drug-induced hearing loss with D-methionine

A number of otoprotective agents are currently being investigated. Various types of agents have been found in animal studies to protect against hearing loss induced by cisplatin, carboplatin, aminoglycosides, or noise exposure. For over a decade we have been investigating D-methionine (D-met) as an otoprotective agent. Studies in our laboratory and others around the world have documented D-met's otoprotective action, in a variety of species, against a variety of ototoxic insults including cisplatin-, carboplatin-, aminoglycoside- and noise-induced auditory threshold elevations and cochlear hair cell loss. For cisplatin-induced ototoxicity, protection of the stria vascularis has also been documented. Further D-met has an excellent safety profile. D-met may act as both a direct and indirect antioxidant. In this report, we provide the results of three experiments, expanding findings in D-met protection in three of our translational research areas: protection from platinum based chemotherapy-, aminoglycoside- and noise-induced hearing loss. These experiments demonstrate oral D-met protection against cisplatin-induced ototoxicity, D-met protection against amikacin-induced ototoxicity, and D-met rescue from permanent noise-induced hearing loss when D-met is initiated 1h after noise exposure. These studies demonstrate some of the animal experiments needed as steps to translate a protective agent from bench to bedside.

A longitudinal study of students' perceptions of using deep breathing meditation to reduce testing stresses

BACKGROUND

Stress can impact student performance. Yet few medical schools provide students with a consistent opportunity to develop and regularly practice stress reduction techniques to aid them academically.

DESCRIPTION

A curriculum component designed to assist 64 postbaccalaureate minority students in developing and practicing a stress-management technique was implemented on a regular basis from June 2004 to April 2006. Students participated in Deep Breathing Meditation exercises in two classes and completed pre-, post-, and follow-up surveys each academic year.

EVALUATION

Students reported having perceptions of decreased test anxiety, nervousness, self-doubt, and concentration loss, using the technique outside of the two classes, and believing it helped them academically and would help them as a physician.

CONCLUSIONS

The Deep Breathing Meditation technique was successfully implemented each academic year, and it provided students with a promising solution for meeting challenging academic and professional situations.

Association of excess weight and degree of airway responsiveness in asthmatics and non-asthmatics

It is unclear whether obesity is associated with increasing degree of airway responsiveness in asthmatics. In this study, methacholine challenge test results of 1,725 subjects with respiratory symptoms were reviewed. Obesity was associated with asthma with an odds ratio of 1.72 (95% C.I. 1.36, 2.17). Although there was a significant difference in the degree of airway responsiveness between various body mass index categories of non-asthmatics (p = 0.01), no significant difference was noted among asthmatics (p = 0.93). A weakly significant interaction between asthma status and body mass index on the degree of airway responsiveness was noted (p = 0.08).

B- and T-cell markers in opsoclonus-myoclonus syndrome: immunophenotyping of CSF lymphocytes

BACKGROUND

Although many lines of evidence suggest an autoimmune etiology, the pathophysiology of opsoclonus-myoclonus syndrome (OMS) remains poorly understood and no immunologic abnormalities have correlated with neurologic severity. Conventional immunotherapies often do not prevent relapse or permanent sequelae.

OBJECTIVE

To test the cellular immune hypothesis of OMS in a cross-sectional study and determine if CSF lymphocyte subset analysis provides biomarkers of disease activity.

METHODS

The expression of lymphocyte surface antigens was investigated in CSF and blood of 36 children with OMS and 18 control subjects, using a comprehensive panel of monoclonal antibodies to adhesion and activation proteins in combination with anti-CD3 and anti-CD45 antibodies in four-color fluorescence-activated cell sorting.

RESULTS

Although most children with OMS had normal CSF cell counts, they exhibited expansion of CD19+ B-cell (up to 29%) and gammadelta T-cell (up to 26%) subsets and a lower percentage of CD4+ T-cells and CD4/CD8 ratio, which persisted even years after disease onset and conventional treatments. The percentage of activated CSF T-cells was also higher. Abnormalities correlated with neurologic severity, as scored blinded from videotapes using a 12-item motor scale, and disease duration. No significant differences were found between tumor and no-tumor groups. In children with neuroblastoma, tumor resection or cancer chemotherapy did not alter immunologic abnormalities.

CONCLUSIONS

CSF B- and T-cell recruitment is linked to neurologic signs in pediatric OMS, which may relate to relapses and disease progression.

Comparison of chlorhexidine and tincture of iodine for skin antisepsis in preparation for blood sample collection

Rates of contamination of blood cultures obtained when skin was prepared with iodine tincture versus chlorhexidine were compared. For iodine tincture, the contamination rate was 2.7%; for chlorhexidine, it was 3.1%. The 0.41% difference is not statistically significant. Chlorhexidine has comparable effectiveness and is safer, cheaper, and preferred by staff, so it is an alternative to iodine tincture.

CSF B-cell expansion in opsoclonus-myoclonus syndrome: A biomarker of disease activity

Lack of a biomarker of disease activity has hindered the therapy of childhood opsoclonus-myoclonus syndrome (OMS), which is purported to be mediated humorally. To determine if the cerebrospinal fluid (CSF) B lymphocyte, which may traffic into the central nervous system (CNS) to produce antibody locally, is one such biomarker, B lymphocytes were immunophenotyped in the CSF and blood of 56 children with OMS and 26 pediatric controls by dual-laser flow cytometry. Neurological severity was rated blindly from videotapes using a validated 12-item motor evaluation scale. Children with OMS manifested a 4- to 7-fold higher percentage of total B-cells in CSF (P < 0.0001), including CD5(+) (P = 0.001) and CD5(-) (P = 0.0004) B-cell subsets, compared with controls, in whom the percentages were negligible and unchanging with age. CSF expansion of both B-cell subsets increased with disease severity and decreased with disease duration (P </= 0.0001, ANOVA). Previous treatment with conventional immunotherapies, chemotherapy, or tumor resection had not normalized B-cell percentages in those with lingering symptoms. These studies reveal that CSF B-cell expansion in OMS is characteristic and often persistent. Presence of the autoreactive CD5(+) B-cell subset and correlations with neurological severity and disease duration suggest CSF B-cell expansion is a biomarker of disease activity and possible target for B-cell-specific therapy. Immunophenotyping of CSF lymphocytes by flow cytometry yields valuable clinical information missed by routine studies and allows crucial treatment decisions to be made rapidly.

Improved outcomes associated with limiting identification of Candida spp. in respiratory secretions

Pneumonia due to infection with Candida spp. is extremely rare even though these yeasts are commonly cultured from respiratory secretions. The diagnosis of pneumonia due to Candida spp. should be made only by demonstrating tissue invasion of a biopsy specimen. Physicians might misinterpret the presence of Candida spp. in respiratory secretions as being the etiological agent of pneumonia. This study describes the practice of limiting identification (ID) of rapidly growing yeasts (i.e., Candida spp.) in respiratory secretions and its impact on patients. Before November 2001, rapidly growing yeasts found in respiratory secretions were identified to the species level. After November, rapidly growing yeasts were reported as "yeasts, not Cryptococcus." The group of patients with respiratory secretions processed before November 2001 is called the full ID group (n = 267); the group with samples processed after that date is called the limited ID group (n = 77). Full ID patients had an average length of hospital stay of 12.1 days/patient; that of limited ID patients was 10.1 days/patient, a decrease of 2 days/patient (P = 0.02). The full ID patients had an average cost of 9,407 dollars/patient; that of limited ID patients was 6,973 dollars/patient, a decrease of 2,434 dollars/patient (P = 0.03). Antifungal medications were used in 103 of 267 (39%) full ID patients and in 16 of 77 (21%) limited ID patients, a decrease of 18% (P = 0.004). Limited ID patients had a mortality rate of 14.3%; that of full ID patients was 18.7%, a decrease of 4.4% (P = 0.37). This policy of limiting yeast ID did not impair the diagnosis of pneumonia. Rather, decreases in lengths of stay, costs, and administration of unnecessary antifungal therapy were observed after instituting this policy.

Strain differences in sleep patterns of healthy and influenza-infected inbred mice

Influenza-infected C57BL/6J and BALB/cByJ mice respectively develop increased slow-wave sleep (SWS) during the dark phase and reduced SWS during the light phase of the 24 hour circadian cycle. To determine whether similar or alternative variations in SWS develop after influenza infection in other inbred strains of mice, we characterized the sleep patterns of additional strains both before and after influenza infection. Three strains (A/J, BALB/cByJ, and C3H/HeJ) showed light-phase SWS suppression, two strains (C57BL/6J and DBA/2J) showed dark-phase SWS enhancement, and one strain (A/J) showed dark-phase SWS suppression. Three strains (AKR/J, C57BR/cdJ, and FVB/NJ) did not show significant changes in SWS time on day two post-inoculation. Core temperatures were correlated to change in SWS time after infection, but were not correlated to SWS during the baseline period. These data support and expand the existing literature that indicates genetic modulation of sleep both in healthy mice and in mice undergoing viral infection.

Small group learning in medical education: a second look at the Springer, Stanne, and Donovan meta-analysis

All in all, the evidence is not convincing. Only four of the nine randomized studies used the conventional small-group learning paradigm and qualify as studies of small-group learning, which are relevant to medical education. The results of one of the four are impossible to interpret because of the involvement of the investigator in teaching and test construction. The three remaining studies showed no effect, a negative effect, and a positive effect, respectively. The nonrandomized studies failed to establish the comparability of the groups. The evidence does not support the authors' call for "more widespread implementation of small-group learning in undergraduate SMET". Small-group learning has not been shown to support the acquisition of content any better [or worse] than large-group learning. In medical education, small-groups are employed in large part to develop team work skills, communication skills, and peer- and self-assessment skills. But these outcomes are not addressed in this meta-analysis. More seriously, our rereading of these studies raises general concerns about meta-analysis in education, which have important implications for evidence-based medical education. The meta-analysis under discussion at first appeared to be just the kind needed to guide an evidence-based educational enterprise. However, a closer look revealed both what is lacking in the meta-analysis and some of the ways educational research and reporting need to be changed if anything like evidence-based education is ever to become a reality. At the least, study design must be clearly described. In addition, if the design is nonrandomized, the groups should be described in sufficient detail to allow a meaningful interpretation of the role of preexisting differences on the outcome measures. (This is why we limited our discussion here to the randomized studies.) Also, effect-size measures should be reported for all comparisons that bear on the impact of the intervention, including preexisting differences. Reporting significance is not enough. This shows only whether sampling error can be ruled out (with a low probability of error, p < .05) as a possible explanation of the connection between the intervention and the outcome. The effect can still be trivial and the comparisons confounded. In addition, descriptions of the actual educational interventions employed need to be more comprehensive and precise. For the most part, the papers would have been strengthened by providing more information for replicating the studies and for deciding which should be included in a given meta-analysis. Perhaps most seriously, our rereading of these studies makes us wonder about the possibility of meaningfully synthesizing the results of educational studies, given their idiosyncrasies and their many extraneous, uncontrolled factors. The conclusions from most educational studies, then--whether randomized or not--must be highly qualified, with explicit warnings about preexisting differences and other confounding factors that plausibly account for the study results. However, these narrative qualifications do nothing to adjust the effect-size measures, which are typically pooled or synthesized across studies--confounds and all. The idiosyncrasies of the studies seem to preclude a blanket qualification that can be applied conceptually across the collection of studies to arrive at a sound conclusion from the synthesis. In brief, the meta-analysis considered here does not support the application of small-group learning in medical education and it raises questions about meta-analysis in education with implications for evidence-based education.

The prediction of breast reduction weight

Reimbursement for reduction mammaplasty has become more stringent because many insurers require specific documentation of patient symptoms and estimated weight of planned breast resection. The purpose of this study was to develop a simple, clinically useful method for predicting weight of breast tissue to be removed, using routine, easily obtained predictors (i.e., height, weight, age, measurements from sternal notch to nipple, and measurements from sternal notch to inframammary crease). Data were available from a retrospective review of 263 women undergoing reduction mammaplasty. Analyses were performed to predict resected weights obtained both in the operating room and by a pathologist for left and right breasts separately. Regression analyses showed that the sternal notch-to-nipple measurement accounted for nearly all of the explained variance in the resected weights, with correlations around 0.80 between sternal notch to nipple and resected weight. For sternal notch-to-nipple measurements > or 28.5 cm, predicted resected weights were approximately 600 g or more, and in general, 80 percent or more patients had specimen weights >500 grams. From 25.5 to 28 cm, the predicted weights ranged from about 400 to 600 g and the prediction rate of weights >500 g was 50 percent. The senior author predicted the resected breast weight to be >500 g 94 percent of the time. The equation alone did not produce an accurate prediction in the critical range, 400 to 600 g. The experienced surgeon more accurately predicted resected weights with use of practiced spatial relationship skills.

The effect of heel elevation on strain within the plantar aponeurosis: in vitro study

Mild, temporary reduction of symptoms from plantar fasciitis have been reported with the use of high heeled shoes (i.e. cowboy boots, ladies pumps). However, little is known on how heel elevation may contribute to a decrease in the pain and inflammation. The aim of this study was to quantify strain in the plantar aponeurosis in cadaveric feet with the use of various heel elevation configurations. An in vitro method that simulated "static" stance was used to determine the loading characteristics of the plantar aponeurosis (n = 12). Heel elevation was evaluated with blocks placed beneath the heel and with a contoured platform that simulated the arch profile of a shoe at three different heel heights (2.0, 4.0, 6.0 cm) with a level plane serving as the control. Strain in the plantar aponeurosis decreased with elevations of the heel that simulated the arch profile of a shoe at load levels (337, 450 N) (P < 0.05). Elevations of the heel with blocks did not significantly affect strain in the plantar aponeurosis (P < 0.05). Contrasting results of some specimen limbs compared with the overall means suggests that the influence of heel elevation on loading of the plantar aponeurosis may be dependent on individual variation and foot structure differences. Therefore, clinicians should be cautious in recommending heel elevation as a treatment for plantar fasciitis since some subjects may not achieve the desired decrease in plantar aponeurosis strain.

Predictive utility of the Bayley Infant Neurodevelopmental Screener (BINS) risk status classifications: clinical interpretation and application

Predictive validity and clinical implications of the increasingly popular Bayley Infant Neurodevelopmental Screener (BINS) risk status classifications have not been previously reported. In this longitudinal follow-up study, the BINS was administered to high-risk infants at 6, 12, and 24 months of age, and the McCarthy Scales at 3 years of age. Ninety-two children were evaluated at 6 and 36 months, 105 at 12 and 36 months, and 118 at 24 and 36 months; 190, 125, and 140 infants were included in the comparisons at 6 to 12, 6 to 24, and 12 to 24 months. BINS risk status was classified as low, moderate, or high; or as a binary variable, LOWRISK/HIGHRISK. The three BINS items groups were moderately correlated. Consistency was most variable in the moderate-risk group. BINS risk was predictive of 36-month function in 18 out of 18 comparisons. Odds ratios, ranging from 2.76 to 54.70, were significant in 15 out of 18 logistic models. An early high-risk classification was associated with increased probability of later developmental morbidity. The BINS offers an alternative to detailed assessment in high-volume clinical applications and has good concurrent and predictive validity.

Stabilization of eyelid height after aponeurotic ptosis repair

OBJECTIVE

To develop guidelines for revision of ptosis surgery in the early postoperative period by establishing what percentage of eyelids after anterior levator advancement have reached their final height by the first postoperative week.

DESIGN

Prospective noncomparative case series.

PARTICIPANTS

An analysis was performed on 164 eyelids in 97 patients with involutional aponeurotic ptosis.

INTERVENTION

Anterior levator advancement was performed on each of these 164 eyelids. Exclusion criterion consisted of a history or evidence of neurologic or muscular disease, preceding trauma, an anophthalmic socket, or prior eyelid surgery.

MAIN OUTCOME MEASURES

The marginal reflex distance, eyelid excursion, and degree of swelling were recorded perioperatively; additionally, photographs were obtained before surgery and at 1 and 6 weeks after surgery.

RESULTS

At 1 week after surgery, only 40% of eyelids had reached their final height; 52% continued to rise a mean of 1.1 mm. The percentage of eyelids continuing to rise after the first postoperative week varied with the amount of swelling present at 1 week, although a direct correlation did not exist (Pearson correlation, 0.22; P < 0.26). Although this increase ranged from 0.5 to 3.0 mm for 71% of eyelids, the subsequent increase was 1 mm or less. Maximal eyelid height was achieved almost universally by 6 weeks, after which 18% of eyelids subsequently dropped a mean of 0.8 mm.

CONCLUSIONS

Based on this study, the authors suggest revision at 1 week after anterior levator advancements in which minimal-to-moderate eyelid swelling exists for contour abnormalities, if the eyelid height is 0.5 mm or more above or more than 1.0 mm below the target height, or if asymmetry between the eyelids is 1.0 mm or more. The authors do not advise early revision for patients with excessive swelling still present 1 week after surgery.

Patellar tilt in total knee arthroplasty

Eighty-nine consecutive primary total knee arthroplasties performed for osteoarthrosis were evaluated to determine the effect of patellar thickness, alignment, joint line, patellar height, type of patellar prosthesis, and length of follow-up on patellar tilt. Preoperatively, 62% of the patellae were tilted neutrally and 38% tilted laterally on standard 45 degrees Merchant-view radiographs. At 3-week follow-up, 52% were neutral, 32% tilted laterally and 16% tilted medially. At the most recent follow-up (mean 36 months), 41% were neutral, 46% tilted laterally and 13% tilted medially. Five (5.6%) required reoperation for patellar complications. Change in joint line, in alignment, and in patellar height had no effect on postoperative patellar tilt. Patients who required a lateral release had postoperative patellar tilt measurements that were not statistically different from those who did not require a lateral release. Metal-back domed patellae were more likely to tilt laterally than all-polyethylene domed patellae; however, the metal-back patellae had a longer mean follow-up (41 months) compared with the all-polyethylene patellae (27 months). The positive correlation between preoperative patellar thickness and postoperative patellar tilt was statistically significant. The negative correlation between change in patellar thickness and postoperative patellar tilt also was statistically significant. Finally, postoperative medically tilted patellae moved toward neutral with time and laterally tilted patellae not only remained laterally tilted but also the tilt increased with time.

Serum prolactin levels and neonatal seizures

To assess the effects of neonatal seizures on the hypothalamus and to test clinical use of prolactin as a neonatal seizure marker, we studied postictal and recovery baseline serum prolactin levels in 19 neonates whose seizures were classified according to their clinical and EEG features. Postictal prolactin levels were obtained 30 min after the seizure, and recovery levels were ascertained 2-4 days later. The ratio of postictal prolactin level to recovery baseline level (prolactin ratio) was used as an indicator of postictal prolactin increase. The specificity and sensitivity of a prolactin ratio of > 2 was compared with the current standard of diagnosis (seizure discharges recorded by ictal EEG). Infants with electroclinical seizures had significantly higher prolactin ratios than control infants or infants with seizures without EEG correlation. Marked prolactin increases were noted only in infants with focal tonic seizures and temporal electrode involvement. A prolactin ratio of > 2 had a specificity of 100% and a sensitivity of 40%. We conclude that neonatal seizures have variable effects on the hypothalamus and that the low sensitivity and the need to await recovery levels limit the clinical value of prolactin ratio as a neonatal seizure marker.