Comparison of the levels of quality of inpatient care delivered by pediatrics residents and by private, community pediatricians at one hospital

It All Depends on Who Does What: A Survey of Patient and Family Member Comfort With Surgical Trainees Operating

OBJECTIVE

To measure patient and family member comfort with surgical trainees of varying levels performing different portions of surgery.

DESIGN, SETTING, AND PARTICIPANTS

An electronic survey dividing surgery into 6 steps (prepping and positioning, initial incision, deep dissection, critical portions, deep suturing, and closing incision), differentiating surgical trainees by 4 levels of experience (medical student, intern, resident, and fellow), and specifying whether or not an attending surgeon is in the operating room (OR) was given to 200 patients and family members in the surgical waiting area of a single academic medical center. Responses were on a 7-point Likert scale from "Not Comfortable at All" to "Completely Comfortable".

RESULTS

Patient and family member comfort significantly increased as trainee experience increased. It reached a nadir for all trainees performing "critical portions" of surgery. However, their average response was "Comfortable" for residents and fellows performing any surgical step when the attending surgeon is present in the OR. The percentage of "Comfortable" responses was significantly lower for all trainee levels performing any surgical step when the attending surgeon is absent from the OR.

CONCLUSIONS

Patient and family member comfort with surgical trainees operating varies based on the trainee's level of experience, the step the trainee performs, and whether or not the attending surgeon is present in the OR. Patients and family members are on average "Comfortable" with surgical residents and fellows performing any surgical step when the attending surgeon is present.

Mean Abnormal Result Rate: Proof of Concept of a New Metric for Benchmarking Selectivity in Laboratory Test Ordering

OBJECTIVES

There is a need to develop and validate new metrics to access the appropriateness of laboratory test requests.

METHODS

The mean abnormal result rate (MARR) is a proposed measure of ordering selectivity, the premise being that higher mean abnormal rates represent more selective test ordering. As a validation of this metric, we compared the abnormal rate of lab tests with the number of tests ordered on the same requisition. We hypothesized that requisitions with larger numbers of requested tests represent less selective test ordering and therefore would have a lower overall abnormal rate.

RESULTS

We examined 3,864,083 tests ordered on 451,895 requisitions and found that the MARR decreased from about 25% if one test was ordered to about 7% if nine or more tests were ordered, consistent with less selectivity when more tests were ordered. We then examined the MARR for community-based testing for 1,340 family physicians and found both a wide variation in MARR as well as an inverse relationship between the total tests ordered per year per physician and the physician-specific MARR.

CONCLUSIONS

The proposed metric represents a new utilization metric for benchmarking relative selectivity of test orders among physicians.

Do patients treated at academic hospitals have better longitudinal outcomes after admission for non-ST-elevation myocardial infarction?

BACKGROUND

Prior studies have found that academic hospitals provide more consistent use of guideline-recommended therapies in patients with non-ST-segment myocardial infarction (NSTEMI) compared with nonacademic centers, yet it is unclear whether these care differences translate into longer-term outcome differences.

METHODS

Using data from the CRUSADE Registry linked to Center for Medicare & Medicaid Services claims, we compared 30-day and 1-year all-cause mortality among 12,194 older patients with NSTEMI (age ≥65 years) treated at 103 academic centers and 28,335 patients treated at 302 nonacademic centers from February 2003 to December 2006. Outcomes were first adjusted for clinical characteristics, followed by adjustment for hospital performance, on 13 acute and discharge guideline-recommended therapies using a shared frailty model (an extension of the Cox proportional hazard model).

RESULTS

Compared with older patients with NSTEMI treated at nonacademic hospitals, those treated at academic hospitals had greater and more consistent use of evidence-based acute and discharge therapies, were more likely to receive in-hospital revascularization (61.1% vs 54.2%; P < .0001), and had modestly lower risk-adjusted 30-day mortality after adjustment for patient-level clinical characteristics (8.9% vs 10.2%, adjusted hazard ratio [HR] 0.89, 95% CI 0.80-0.99). These differences were attenuated (HR 0.94, 95% CI 0.83-1.02) after further adjustment for hospital delivery of evidence-based treatments, yet did not persist out to 1 year (unadjusted HR 0.92, 95% CI 0.84-1.01, P = .089).

CONCLUSIONS

Patients with NSTEMI treated at academic centers are more likely to receive guideline-recommended therapies and had modestly better 30-day outcomes. Nevertheless, these differences do not persist out to 1 year.

Symptomatic fever management among 3 different groups of pediatricians in Northern Lombardy (Italy): results of an explorative cross-sectional survey

Background

In the care of feverish children, symptomatic management is pivotal. Thus, the Italian Pediatric Society has recently published guidelines on fever management in children. Our aim was to investigate whether pediatric hospitalists, community pediatricians and pediatric residents differ in their every-day clinical practice with respect to symptomatic management of feverish children.

Methods

79 out of 118 physicians involved in pediatric care in an area of Northern Lombardy (Italy) filled in a modified version of the questionnaire derived from the Swiss national survey on symptomatic fever management.

Results

Pediatric hospitalists (N = 29), community pediatricians (N = 30) and pediatric residents (N = 20) did not differ with respect to temperature threshold for symptomatic fever treatment, role of general appearance in modulating the threshold for fever management, first choice antipyretic drug, frequency of ibuprofen prescription, prescription of physical antipyresis, influence of exaggerated fear of fever on its management and potential to reassure families about this fear.

On the other side, some significant differences were found. Pediatric residents more frequently lower the treatment threshold in children with a past history of febrile seizures (P < 0.001) and prescribe an aggressive treatment for fever not responding to the first antipyretic drug (P < 0.01) than their more experienced colleagues. Community pediatricians represent the unique investigated group using homeopathic remedies, both in the acute setting (P < 0.001) as well as a prophylaxis (P < 0.0001). Finally, paediatric residents less often (P < 0.05) stated to encounter exaggerated fear of fever among parents than their more experienced colleagues.

Conclusions

The present explorative inquiry globally shows limited discordance among pediatric residents, community pediatricians and pediatric hospitalists with respect to symptomatic fever management.

Reduction in Clinical Variance Using Targeted Design Changes in Computerized Provider Order Entry (CPOE) Order Sets: Impact on Hospitalized Children with Acute Asthma Exacerbation

OBJECTIVES

Unwarranted variance in healthcare has been associated with prolonged length of stay, diminished health and increased cost. Practice variance in the management of asthma can be significant and few investigators have evaluated strategies to reduce this variance. We hypothesized that selective redesign of order sets using different ways to frame the order and physician decision-making in a computerized provider order entry system could increase adherence to evidence-based care and reduce population-specific variance.

PATIENTS AND METHODS

The study focused on the use of an evidence-based asthma exacerbation order set in the electronic health record (EHR) before and after order set redesign. In the Baseline period, the EHR was queried for frequency of use of an asthma exacerbation order set and its individual orders. Important individual orders with suboptimal use were targeted for redesign. Data from a Post-Intervention period were then analyzed.

RESULTS

In the Baseline period there were 245 patient visits in which the acute asthma exacerbation order set was selected. The utilization frequency of most orders in the order set during this period exceeded 90%. Three care items were targeted for intervention due to suboptimal utilization: admission weight, activity center use and peak flow measurements. In the Post-Intervention period there were 213 patient visits. Order set redesign using different default order content resulted in significant improvement in the utilization of orders for all 3 items: admission weight (79.2% to 94.8% utilization, p<0.001), activity center (84.1% to 95.3% utilization, p<0.001) and peak flow (18.8% to 55.9% utilization, p<0.001). Utilization of peak flow orders for children ≥8 years of age increased from 42.7% to 94.1% (p<0.001).

CONCLUSIONS

Details of order set design greatly influence clinician prescribing behavior. Queries of the EHR reveal variance associated with ordering frequencies. Targeting and changing order set design elements in a CPOE system results in improved selection of evidence-based care.

Patient satisfaction with residents vs attending following fluoroscopy-guided pain injections

OBJECTIVE

Patient satisfaction has been the object of interest in health care for some time and is now increasingly used as the basis for quality management and improvement. This study compares patient satisfaction between residents and attending in a pain clinic setting following fluoroscopy-guided steroid injections.

DESIGN

This is a retrospective cohort design study.

SETTING

The study was performed at an academic university pain management center.

SUBJECTS

A total of 242 patients (119 female and 123 male) presenting with low back pain were evaluated and offered fluoroscopically guided steroid injections as part of a conservative care treatment plan.

INTERVENTIONS

All injections were performed consecutively over a 4-month period by one attending and three senior residents (two anesthesia and one psychiatry resident). A staff member specifically asked each participant about their satisfaction following the procedure. Answers were documented as "Expected,""Better," or "Worse" than expected.

OUTCOME MEASURES

Two main outcome measures were recorded: 1) table and fluoroscopy time for residents and attending, and 2) patient satisfaction through subjective reporting.

RESULTS

Overall, residents had longer mean table time and mean fluoroscopy time as compared with the attending physician (P < 0.05). Patients treated by residents were more often likely to rate their experience as "worse" compared with those treated by the attending (P < 0.05). Otherwise, the proportion of patients rating their experience "as expected" or "better" was not significantly different statistically between the two groups. In addition, as table time increased, satisfaction level decreased in both resident and attending groups.

CONCLUSION

Patients treated by residents are more likely to rate their experience as worse compared with the attending. However, majority of patients in both groups were satisfied in that they perceived their procedure as expected or better than expected.

Parents' satisfaction concerning their child's hospital care

AIM

To explore parents' satisfaction concerning their child's care during hospitalization and its determinants.

METHODS

A descriptive, non-experimental correlational design was used. The data collection was based on interviews using a 63 item questionnaire, the Swedish Pyramid Questionnaire. The parents of 206 children (hospitalized in two pediatric and two surgical units) participated in the study.

RESULTS

The independent t-test results demonstrated that the parents showed greater satisfaction with staff attitudes and medical treatment, whereas they were less satisfied with the information concerning routines and the staff work environment. The stepwise multiple regression analysis revealed that adequacy of care, adequate pain management, parents' involvement in care, a trusting relationship, and staff attitudes were the most important determinants of parental satisfaction.

CONCLUSION

Interventions in pediatric care should include measurements of parental and child satisfaction as a tool to assess the quality of care.

Emergency contraception: are pediatric residents counseling and prescribing to teens?

STUDY OBJECTIVES

(1) To assess pediatric residents' attitudes and practices related to counseling about and prescribing emergency contraceptive pills (ECPs) for teens. (2) To determine whether attitudes, counseling, and prescribing practices vary among different levels of residency training.

DESIGN

Questionnaire.

SETTING

Two large inner-city academic medical centers in New York City.

PARTICIPANTS

Pediatric residents (PGY 1-3).

MAIN OUTCOME MEASURES

Attitudes, counseling and prescribing patterns of ECPs by the pediatric residents

RESULTS

101/120 residents participated in the survey; 35% PGY1, 38% PGY2, 28% PGY3. Less than a third (26%) reported counseling teens about the availability of ECPs during routine non-acute care visits and just over half (56%) provided ECP counseling during visits for contraception. Only 6% of pediatric residents reported that they prescribed ECPs often, while 42% never prescribed ECPs. The majority of the residents did not think that prescribing ECPs would encourage teens to practice unsafe sex or would discourage compliance with other contraceptive methods (70% and 68%, respectively). However, the majority (67%) also reported that they did not think that ECPs should be available over the counter, without prescription. Further analysis by year of training showed that more junior and senior residents than interns counseled adolescents about ECPs at both routine health care maintenance visits and at visits for contraception (32% vs 15%; 62% vs 42%, respectively), would provide adolescent girls with ECPs to have on hand prior to an episode of unprotected sex (52% vs 31%), and thought that ECPs should be available over the counter (39% vs 20%), P < 0.05.

CONCLUSIONS

Pediatric residents are missing opportunities to prevent unintended teenage pregnancy but they become more likely to counsel about and prescribe ECPs as they progress through residency training.

Does experience matter? A comparison of the practice of attendings and residents

OBJECTIVE

To compare the utilization of health care resources and patterns of chronic disease care by patients of medical residents and patients of their attending physicians.

MATERIALS AND METHODS

This study involved a longitudinal cohort of 14,554 patients seen over a 1-year period by 149 residents and 36 attendings located in an urban academic medical center. Data were acquired prospectively through a practice management system used to order tests, write prescriptions, and code ambulatory visits. We assessed resource utilization by measuring the total direct costs of care over a 1-year period, including ambulatory and inpatient costs, and the numbers and types of resources used.

RESULTS

Residents' patients were similar to attendings' patients in age and gender, but residents' patients were more likely to have Medicaid or Medicare and to have a higher burden of comorbidity. Total annual ambulatory care costs were almost 60% higher for residents' patients than for attendings' patients in unadjusted analyses, and 30% higher in analyses adjusted for differences in case mix (adjusted mean 888 dollars vs 750 dollars; P=.0001). The primary cost drivers on the outpatient side were consultations and radiological procedures. Total inpatient costs were almost twice as high for residents' patients compared to attendings' patients in unadjusted analyses, but virtually identical in analyses adjusted for case mix differences (adjusted mean of 849 dollars vs 860 dollars). Admission rates were almost double for residents' patients. Total adjusted costs for residents' patients were slightly, but not significantly, higher than for attendings' patients (adjusted mean 1,651 dollars vs 1,540 dollars; P>.05). Residents' and attendings' patients generally did not differ in the patterns of care for diabetes, asthma/chronic obstructive pulmonary disease (COPD), congestive heart failure, ischemic heart disease, and depression, except that residents' patients with asthma/COPD, ischemic heart disease, and diabetes were admitted more frequently than attendings' patients.

CONCLUSIONS

Our results indicate that residents' patients had higher costs than attendings' patients, but the differences would have been seriously overestimated without adjustment. We conclude that it costs about 7% more for residents to manage patients than for attendings. On the ambulatory side, the larger number of procedures and consults ordered for residents' patients appears to drive the higher costs.

Lengths of stay and costs associated with children's hospitals

OBJECTIVE

Because of the unique mission of freestanding children's hospitals, higher costs have generally been accepted; however, increasing health care costs and the impetus for outcomes data demand more accountability. For common diagnoses, with respect to quality care indicators, length of stay (LOS), and total charges, we propose to compare freestanding children's hospitals and other hospitals. Our hypothesis is that, for similar diagnoses, freestanding children hospitals will have longer LOSs and higher costs than other hospitals.

METHODS

Data were analyzed from the Healthcare Cost and Utilization Project Kids' Inpatient Database 2000. Encounters qualified for evaluation when 1 of the top 3 discharge codes was consistent with pneumonia, gastroenteritis, respiratory syncytial virus, dehydration, or asthma. Our outcomes were LOS and total charges per hospital admission; hospitals were categorized as children's hospitals and nonchildren's hospitals. We adjusted for the following potential confounders: number of diagnoses, insurance information, patient age in years, race of patient, admission source, procedures, teaching status of hospital, and hospital location. Because of the right skew of the outcomes, our primary analyses consisted of robust median regression; to support our final models, we also performed sensitivity analyses.

RESULTS

Of 252262 total inpatient encounters, 24322 met the inclusion criteria. There were 3408 encounters from 23 different freestanding children's hospitals and 20914 encounters from 1749 nonchildren's hospitals. Freestanding children's hospitals provided care to a higher risk population with more children transferred from other hospitals, a higher percentage of minorities, increased number of co-diagnoses, and a higher percentage on Medicaid. There was no statistically significant difference in LOS by hospital type. However, there was a significant difference in total costs, with the median cost of an admission at freestanding children's hospitals 1294 dollars more per hospitalization than at nonchildren's hospitals, after adjusting for confounders.

CONCLUSION

We found no significant difference in median LOS among freestanding children's hospitals and nonchildren's hospitals, but freestanding children's hospitals had higher total charges per admission, even after adjusting for differences in population characteristics. Additional studies are needed to elucidate whether these increased costs result in better health outcomes or are simply attributable to other characteristics of children's hospitals, in which not all patients may benefit.

A study of non-response in a questionnaire survey of parents' views of paediatric care

The aim of this study was to examine whether there were differences in quality ratings between respondents and non-respondents to a questionnaire concerning parents' views of paediatric care. This study also examined whether quality ratings differed when questionnaire respondents were asked to reassess certain aspects of hospital care in a follow-up questionnaire. A total of 1094 questionnaires were distributed to parents at the hospital. Three weeks later, follow-up questionnaires were sent home to a random sample of 140 parents who had visited the hospital during the 2 weeks when the main questionnaire was distributed. Forty-six per cent of respondents to the follow-up questionnaire had never received the original questionnaire in hospital, while only seven individuals in the follow-up sample were active non-respondents. Analysis of variance revealed that respondents to the follow-up questionnaire who had never received the main questionnaire did not differ significantly from respondents to the main questionnaire in their ratings of key quality domains. There were no statistically significant differences in quality ratings between parents who responded to both questionnaires and parents who responded to the main questionnaire. For hospital management, it is important to be able to trust questionnaire results. Non-response bias can jeopardize the validity of questionnaire results, which is why studies of non-response are important. The current study pinpoints a number of difficulties that need to be considered when conducting investigations of non-response.

Pediatric hospitalists: quality care for the underserved?

Despite the rapid growth in pediatric hospitalist services, there is little empiric information about the impact of pediatric hospitalists. This study compared process and outcome variables related to the inpatient care of 182 pediatric patients, half of whom were cared for by hospitalists and half by their primary care providers (PCP). Results indicated that, while hospitalists cared for patients of substantially lower socioeconomic status, they delivered care more economically for patients with asthma, with no significant differences in rates of return to the emergency room or rehospitalizations. Children in both services demonstrated equivalent levels of returning to their PCP for follow-up visits and were in equally good health 1 month after discharge. Additionally, no negative impact was evident on patient satisfaction at discharge; in fact, the hospitalists' patients were more satisfied with aspects of their care. Hospitalists may, therefore, provide a vital service by ensuring quality inpatient care for low-income children.

Measuring the costs of primary care education in the ambulatory setting

In 1995, the authors obtained cost, operations, and educational activity data from 98 ambulatory care sites across the United States in which primary care teaching was occurring and compared those data with the corresponding data from 84 ambulatory care sites where no teaching was going on. The teaching sites in the sample were found to have 24-36% higher operating costs than the non-teaching sites. This overall difference in costs is approximately the same difference in costs earlier estimated for university teaching hospitals compared with non-teaching hospitals. These costs are shared by all involved in the ambulatory education process: sponsors, sites, and faculty. In a related finding, the authors discovered that 30-50% of all ambulatory care sites thought not to be involved in education are in fact teaching at a high level of involvement. Further research into not only the costs but the value of education in the clinical setting is encouraged. The authors also hope that the publication of this report will encourage accrediting bodies and professional organizations to improve the information available about ambulatory care training in general.