Comparison of two methods for evaluating the occlusal marginal adaptation of posterior restorations

Two methods of evaluating the occlusal marginal adaptation of posterior restorations are compared: a direct and an indirect method. The direct method uses modified Ryge criteria and assessments are performed with mirror, probe and operating lamp. With the indirect method assessments are conducted using photographs of impressions of the restorations. For the purpose of the comparison a selected group of newly placed amalgam and composite restorations is used and attention is paid to a 'section method' of observation. This routine of localization the parts of the outline to be measured, permits independent comparison of the assessments. The two methods were applied by pairs of observers and the indirect photographic method appears to be more reliable (percentual agreement between observers 97 percent versus 80-91 percent for the direct method). The agreement between the indirect and direct methods is rather low. The indirect photographic method is more valid when compared to a yardstick, especially if few deficiencies of the margin are expected. It is not clear which method is preferable if more deficiencies occur with restorations of higher age.

Oregon's experiment

Oregon's systematic design for universal access to health care, known as the Oregon Basic Health Services Act, has provoked heated debate over its rationale, plan and process. It is a novel attempt to address inequities in the distribution of health care for those below the federal poverty level. Its controversial nature compels more informed discussion to guide further analysis. Accordingly, this report is primarily descriptive, aiming to provide a clear synopsis of the Oregon project's history, complex methodology, and strengths and weaknesses.

The Minnesota Clinical Comparison and Assessment Program: a resource for clinical quality improvement programs

Project Overview: MCCAP is a voluntary, statewide initiative of more than 50 hospitals designed to improve patient outcomes by reducing variation among healthcare providers. Elective cholecystectomy, both open and laparoscopic, has been one area of focus.

KEY FINDINGS

Physicians are particularly interested in information about patient care that they do not routinely receive in a standardized format, such as the time required for patients to return to normal activities. Patients who did not meet guideline criteria but who were given prophylactic antibiotics prior to surgery experienced the same, minimal infection rate as patients who received no antibiotics prior to surgery. Participating hospitals are shifting their focus from looking at average occurrence rates (LOS, resource use by procedure) to identifying appropriate resource use. Although 82 percent of elective cholecystectomies met guideline requirements, 25 percent of all patients continue to experience their most distressing symptoms six months after surgery. Many physicians continue to use routine intraoperative cholangiography; however, MCCAP's guideline did a good job of differentiating patients who were more likely to benefit from the procedure from those who were not.

The use of standardized indicators as quality improvement tools: an application in Pennsylvania nursing homes

The Institute of Medicine recommends the use of key quality indicators (resident outcomes that suggest the presence of good or bad care) as tools for interfacility comparison of the quality of care provided in nursing homes. In the spirit of this recommendation, the Health Care Financing Administration released selected results from its Medicare and Medicaid Annual Certification Survey to guide consumers in purchasing nursing home services. However, because this information is published without adjustment for resident characteristics that can influence the outcomes of nursing home care, its utility for policy-makers or consumers interested in variation in nursing home quality is limited. This research study utilizes federal and state survey data to evaluate variations in mortality, pressure ulcers, urethral catheterization, and physical restraint use in 438 Medicare-certified skilled nursing care facilities in Pennsylvania. A standardization function adjusting for resident characteristics known to influence outcomes is developed and estimated by ordinary least squares regression. Results suggest considerable variation in rates for these indicators across Pennsylvania nursing home facilities. Alternative uses for risk-adjusted key quality indicators as tools for improving nursing home quality and assisting potential consumers of nursing home care in making better informed choices are considered.

Serum albumin and prealbumin as predictors of clinical outcomes of hospitalized elderly nursing home residents

OBJECTIVE

To investigate the prevalence of hypoalbuminemia and hypoprealbuminemia in hospitalized, elderly, skilled nursing facility residents and to correlate these findings with clinical outcomes.

DESIGN

Prospective cohort study.

SETTING

A 300-bed community hospital.

PARTICIPANTS

Eighty-one hospitalized, skilled nursing facility patients, average age 83.1 years.

INTERVENTIONS

None.

OUTCOME MEASURES

Serum albumin and prealbumin (transthyretin) were measured at admission, mid-week, 1 week, and 1 month. Patients were followed for 90 days for the outcomes of length of hospitalization and mortality.

RESULTS

The prevalence of hypoalbuminemia was 99% and of hypoprealbuminemia, 79%. Both means dropped significantly from admission to midweek nadirs of 25 g/L for albumin and 14 mg/L for prealbumin. Severe hypoalbuminemia at mid-week predicted mortality (RR = 4.1 95%, CI 2.0-8.5) and extended length of hospitalization (RR = 5.2 95%, CI 2.8-9.8). Severe hypoprealbuminemia predicted extended hospitalization (RR = 3.2, CI 1.5-6.7) but not mortality.

CONCLUSIONS

Hypoalbuminemia and hypoprealbuminemia are very common in this clinical setting and vary in parallel fashion over time. Severe hypoalbuminemia was a stronger predictor than hypoprealbuminemia of 90-day mortality and extended length of stay. Serum albumin on admission was not as strong a predictor of outcomes as serum albumin at mid-week.

The HIV quality audit marker (HIV-QAM): an outcome measure for hospitalized AIDS patients

The development and validation of the HIV-Quality Audit Marker (HIV-QAM), an instrument designed to measure changes in the status of hospitalized AIDS patients due to nursing care, is reported. The HIV-QAM is designed to capture the nurse data-collector's judgment of the status of the patient based upon observations, interviews, record reviews, and listening to inter-shift report. The final version of the 10 item HIV-QAM includes three scales, Self-care (six items; Cronbach's alpha = 0.89), Ambulation (two items, alpha = 0.88), and Psychological Distress (two items, alpha = 0.84). Content validity was supported by selection of items from pre-existing scales, generation of items based on care plans for HIV/AIDS patients, and review and critique of items by a panel of nurse experts. Construct validity was supported by principal components factor analysis and multi-trait scaling analysis. Convergent and divergent concurrent validity with patient symptoms and intensity of nursing care required was demonstrated. The predictive validity of the HIV-QAM for mortality at 3 and 6 months after hospital treatment for Pneumocystis carinii pneumonia was also shown.

Can resident-centred inspection of nursing homes work with very sick residents?

This paper seeks to address the issue of whether a resident-centred inspection process can be effective in a nursing home environment dominated by residents who require high levels of care. Two fundamental criticisms of the current Australian monitoring process are its reliance on standards that are subjective resident-centred standards and its reliance on the views of residents concerning the quality of care provided in the home. These criticisms are becoming all the more important as survival rates for the aged increase and the average level of disability of nursing home residents continues to worsen. Our data suggest that the resident-centred process, despite some difficulties, is both reliable and practical, regardless of the care needs of residents in the home. Data collected from inspection teams show that inspectors use a variety of sources to validate information, with residents being one component. These sources vary little in importance between homes with different levels of care needs or behavioural problems. Perhaps of more importance is the finding that a home's overall performance across 31 resident-centred standards is not affected by either the home's average level of total care needs or the number of residents with severe behavioural problems. There are some significant effects (in both directions) of resident disability on compliance with particular standards. Most notable is the finding that the standard requiring appropriate use of restraint is less likely to be met when there are large numbers of residents with high levels of disability or behavioural problems.

Scott & White measures "quality of health" in outcomes studies. Interview by Donald E.L. Johnson

"Although Scott & White has been involved in outcomes studies for several years, we feel it's time that health care be truly accountable. In order to do this, we need to measure the results of what we're doing in our everyday practice," explained Kermit B. Knudsen, MD, director of the Scott & White Center for Outcomes Studies in Temple, Texas. Knudsen shares his perspective with Health Care Strategic Management publisher Donald E.L. Johnson, Knudsen's goal for the center is to have outcomes studies become a routine part of medical practice, measuring the actual "quality of health" outcomes for patients treated at Scott & White.

Measuring the impact of nursing interventions in the community: a selective review of the literature

In a resource conscious environment, it is imperative that nurses use their skills and knowledge to provide an optimum service. It is suggested that nurses working in the community must measure the impact of their nursing interventions to guide their own role development and to inform the purchasing process. This literature review has revealed, however, that little progress has been made in this area by nurses within the community setting. Indeed, it is suggested that research is needed to test reliable and valid methods of outcome measurement.

Nursing intervention studies require outcome measures that are sensitive to change: Part Two

Ohis article is the second and concluding part of a discussion of the importance of sensitivity to change in selecting an outcome measure for a study evaluating a nursing intervention. In Part One of the discussion, (Stewart & Archbold, 1992) the relative lack of attention to measurement sensitivity in the nursing and measurement literature was described. Three factors to consider in selecting an outcome measure for an intervention study were reviewed: the conceptual link between the intervention and the outcome variable, the extent to which the outcome variable is amenable to change, and content validity. In Part Two, four additional factors are discussed: construct validity, distribution of scores on the outcome measure, reliability, and correlational stability over time.

The Utstein style for uniform reporting of data from out-of-hospital cardiac arrest

The Utstein style for uniform reporting of data from out-of-hospital cardiac arrest was developed to solve a major problem in resuscitation research. Outcome measures related to cardiac arrest are difficult to evaluate or compare because there have been no uniform definitions or uniform agreements on what data to report. Widespread acceptance of the Utstein style will lead to a better understanding of out-of-hospital cardiac arrest.

Challenges in cardiac arrest research: data collection to assess outcomes

To enhance comparability in reports on survival from out-of-hospital cardiac arrest, an international task force recently developed a set of guidelines for uniform terminology, definitions, and data collection for outcome research on cardiac arrest--the Utstein style. Because the data collection recommended is limited to information available through emergency medical services systems, the potential for bias in comparisons of cardiac arrest outcomes remains. By expanding data collection to include the identification of all cases of cardiac arrest in the community, including patients who do not present for care by an emergency medical services system, a population-based approach can be achieved. We review the strengths and limitations of both emergency medical services-based and population-based data collection to assess outcomes of cardiac arrest, outline practical steps required to implement a population-based approach, and suggest that extension of the Utstein style guidelines to include all cardiac arrest cases within a defined population is needed to minimize potential bias in comparisons of cardiac arrest outcomes across communities or over time.

The critical path method in stroke rehabilitation: lessons from an experiment in cost containment and outcome improvement

This study tested the effects of a project network technique called the Critical Path Method (CPM) on the costs and outcomes of inpatient team stroke rehabilitation. On admission to a large, academic, inpatient rehabilitation hospital adults who had a recent (< 120 days) stroke were randomly assigned to receive rehabilitation services from a team trained in CPM (N = 53) or from usual care teams (N = 68). Results showed no significant difference between groups in length of stay, hospital charges, or functional status at discharge. CPM may be effective in patient care services that are less influenced by specialization, professional issues, and external regulation and in settings where patient outcomes are relatively fixed and predictable, and medical care is integrated across institutions.

Nursing intervention studies require outcome measures that are sensitive to change: Part One

In selecting an outcome measure for a study evaluating a nursing intervention, the criterion of sensitivity to change should predominate. Researchers commonly justify their choice of outcome measures for experiments based on such psychometric criteria as high internal consistency reliability and patterns of correlations reflecting convergent and discriminant validity. Although such criteria are appropriate for measures to assess individual differences, they are insufficient when the measures will be used for intervention studies. Researchers may need to develop new measures that are tailored for experimental studies if existing measures are valid mainly for the assessment of individual differences. In this first portion of a two-part article, three of seven factors to consider in selecting an outcome measure for an intervention study are outlined and recommendations for application of principles of reliability and validity in the context of sensitivity to change are given.

Assessing providers of coronary revascularization: a method for peer review organizations

OBJECTIVES

Current methods to evaluate quality of care are usually limited to reviews of individual cases or comparisons of hospital mortality rates. We present an alternative method that compares complication rates adjusted for patient characteristics.

METHODS

Detailed clinical data that were specifically designed for quality comparisons of providers of revascularization procedures were abstracted from the medical records of 1998 Medicare patients, in 16 hospitals, who had coronary artery bypass surgery and 2091 patients, in 16 hospitals, who had angioplasty. Providers were ranked on the basis of an unadjusted risk, a risk adjusted for detailed clinical information, and a risk adjusted only for patient comorbidities.

RESULTS

Complication rates differed significantly and substantially among the hospitals. Clinical adjustment changed the hospital rankings for the bypass surgery hospitals, but not for the angioplasty hospitals. Adjustment for comorbidities did not affect hospital rankings for either procedure.

CONCLUSIONS

When sample sizes are limited, adverse outcome rates may be a more sensitive measure of quality of care than mortality rates. Rates that are unadjusted or adjusted only for comorbidities may be inadequate for evaluating some providers of bypass surgery.

Conceptual and methodological issues in nurse case management research

Conceptual and methodological issues facing researchers who are studying the process and outcomes of nurse case management are identified. The evolution of a research program designed to understand and evaluate one model of nurse case management is described as an example of responding to these issues. The development of a body of knowledge around nurse case management is essential to assure the expansion of this role and to justify reimbursement through current and evolving insurance mechanisms.

Program outcome and QA: a new approach to evaluation

Health care providers and managers are familiar with the limitations of current quality assurance (QA) practices, which do little to indicate the overall effectiveness of health care programs. This article discusses a comprehensive method of evaluating program effectiveness, efficiency, cost, client satisfaction, and adherence to standards. The authors present the Brockville Psychiatric Hospital's experience in evaluating a new program with data collected from a multi-faceted QA perspective, and suggest that combining program evaluation with QA could become the standard for future program assessments.

The relation between experience and outcome in heart transplantation

BACKGROUND

Current policies related to organ transplantation in the United States are designed to ensure that centers and physicians with experience in transplantation perform these procedures. It is essential to confirm the validity of such policies, since they may limit access to transplantation services.

METHODS

To determine the relation between experience with heart transplantation and mortality after the procedure, we merged data from the registry of the International Society for Heart and Lung Transplantation with data from a survey that provided additional information about patients and transplantation centers. Our study included 1123 patients who received a heart transplant at one of 56 hospitals in the United States from 1984 through 1986. We used univariate and bivariate techniques, as well as logistic regression, to analyze our data.

RESULTS

We observed an institutional learning curve for heart transplantation. Patients who received one of a center's first five transplants had higher mortality rates than patients who received a subsequent transplant (20 percent vs. 12 percent; P = 0.002; relative risk = 2.2; 95 percent confidence interval, 1.6 to 3.4). In addition, we found a correlation between the training of key personnel on the transplantation team and mortality at new transplantation centers. For example, new centers staffed by cardiologists with previous training in heart transplantation had lower mortality rates among heart-transplant recipients than centers without experienced cardiologists (7 percent vs. 16 percent; P = 0.001; relative risk = 2.7; 95 percent confidence interval, 1.3 to 5.9). By contrast, the previous training of the surgeons who performed transplantations was not related to the mortality rate associated with the procedure.

CONCLUSIONS

Experience with heart transplantation is associated with a better outcome for patients after that procedure. Opportunities exist to refine transplantation policies on the basis of the experience of a center and its transplantation team and to develop similar policies for other forms of organ transplantation.

An initial assessment of the Veterans Affairs occurrence screening program

The Department of Veterans Affairs (VA) established a computerized occurrence screening program in its medical centers in October 1988. Data collected from these hospitals suggest that occurrence screening has been a useful component of the VA's overall quality assurance effort; opportunities for improvement were found in 4.2% of all occurrences. When asked to name the three most effective criteria, there was strong agreement among participating hospitals--50% or more of the facilities ranked readmissions, death, and admission within three days of an unscheduled outpatient visit as the most effective. A majority of facilities (56%) named occurrence screening as one of the more effective elements in identifying quality-of-care issues. These findings must be balanced against important limitations of the occurrence screening process; however, guided by the data it collected, the VA has recently made several changes in its occurrence screening program to address these limitations.

A new measure of quality of life in depression: testing the reliability and construct validity of the QLDS

Our previous paper described the development of a new quality of life scale for use with people suffering from depression; the Quality of Life in Depression Scale (QLDS). This paper reports on the testing of the scale for reliability and construct validity. Reliability was assessed by giving the questionnaire to the same set of patients on two occasions 2 weeks apart. This test-retest technique yielded a correlation of 0.94, with high internal consistency at both time 1 and time 2. A test of split-half reliability also indicated very high reliability. Construct validity was measured by comparing scores on the QLDS with those on an established scale of well-being from the same group of patients. The results gave a correlation between the two measures of 0.79, giving a satisfactory validity. It is concluded that the QLDS is a reliable and valid measure which is easy to use and acceptable to patients. Further tests of discriminative, concurrent and criterion validity are planned.

Maternal health and the measurement trap

This paper focuses on the contribution of measurement-related factors to the neglect of maternal health in resource allocation for programmes and in public health research. As the recent interest in maternal health has now progressed beyond the need for information primarily for the purpose of advocacy, measurement-related factors have emerged as powerful constraints on programme action. Three outstanding needs for information can be identified: first, to establish the levels and trends of specific maternal health outcomes; secondly, to identify the characteristics and determinants of health outcomes; and thirdly, to monitor and evaluate the effectiveness of programmes designed to influence health outcomes. In order to meet these needs, the emphasis placed on operational research by the current major initiatives in maternal health must be complemented by an equivalent emphasis on methodological studies. The call for improved information by international and national agencies should be made in unison with the call for action. Inadequate information is a reality that has to be faced throughout the world, but particularly in developing countries. The quality, quantity and scope of health-related data are the elements of this inadequacy and may be discussed in terms of four factors: the indicators, the data sources, the measurement techniques, and the conceptual framework. In this paper, the neglect of maternal health and the lack of information are shown to be self-reinforcing and constitute a measurement trap sprung by these four factors. Dismantling this trap has revealed a weak conceptual framework to lie at the very centre. Maternal health has tended to be conceptualized as a discrete, negative state, characterized by physical rather than social or mental manifestations, and by a narrow time-perspective focusing on pregnancy, delivery and the puerperium. The need to broaden this perspective and to develop equally broad operational definitions represent important steps forward that must be taken.

Clinical versus administrative data bases for CABG surgery. Does it matter?

This study compared the ability of a clinical and administrative data base in New York State to predict in-hospital mortality and to assess hospital performance for coronary artery bypass graft surgery. The results indicated that the clinical data base, the Cardiac Surgery Reporting System, is substantially better at predicting case-specific mortality than the administrative data base, the Statewide Planning and Research Cooperative System. Also, correlations between hospital mortality rates that are risk-adjusted using the two systems were only moderately high (0.75 to 0.80). The addition of new risk factors from the Statewide Planning and Research Cooperative System improved the predictive power of both systems but did not diminish the difference in effectiveness of the two systems. The three unique clinical risk factors in the Cardiac Surgery Reporting System (ejection fraction, reoperation, and more than 90% narrowing of the left main trunk) seemed to account for much of the difference in effectiveness of the two systems.

The QLDS: a scale for the measurement of quality of life in depression

It has been apparent for some time that utilisation of health services is more influenced by how people feel than by their 'objective' symptoms. Research has also shown that compliance with treatment regimens is dependent on the impact of that treatment on the patient's well-being. Such findings highlight the need to assess the patient's view of his or her progress through the health care system. This has led to a growing interest in quality of life assessment and, in particular, to the impact of illness and its treatment on the quality of life of the patient. Perhaps surprisingly, interest in quality of life measures for outcome assessment in Psychiatry has been slower to develop than in other specialties. While a number of clinician- and patient-completed measures of the severity of depressive symptoms exist, no measure of the quality of life of depressed patients is available. This paper describes the development and testing of the Quality of Life in Depression Scale (QLDS), a new measure designed to fill this gap. The theoretical basis for the instrument is that life gains its quality from the ability and capacity of the individual to satisfy his or her needs. The items included in the QLDS were derived from 30 qualitative interviews with depressed or recently recovered patients. Further interviews were held with depressed patients to establish the face and content validity of the instrument. Respondents had little trouble completing the questionnaire and found the content to be relevant to their experience of depression. The QLDS represents an important advance in our ability to understand the impact of depression on quality of life.

Patient satisfaction as a measure of quality in the care of the elderly

This article examines the relevance of obtaining patients' views in the measurement of quality in nursing care. The literature on the selection of instruments that measure quality in the care of older people is reviewed.

The health assessment questionnaire 1992: status and review

Over 100 papers describing and utilizing the Stanford Health Assessment Questionnaire (HAQ) have been published since 1980. A brief overview of the HAQ is presented along with a guide to the accumulated literature. The topics covered include: studies using the disability, pain, economic, and drug side effect dimensions of the HAQ; reliability and validity studies; applications to various rheumatic diseases; language adaptations; modifications and derivative scales; studies correlating the HAQ with sociodemographic, health status, laboratory, and physical measures; and randomized controlled trials and observational studies using the HAQ. A few comments regarding future directions for research are also presented.

Quality of life and policy analysis in arthritis

Problems in the American health care system have stimulated interest in cost-effectiveness methodologies. However, there is little consensus on how to define a common unit of health outcome. Many measures used in policy studies consider only mortality and do not fully capture the significant impact of disease-related dysfunction. The impact of conditions, such as osteoarthritis, that have little impact on mortality rates but substantial impact on functioning and well-being may be underestimated in these analyses. In this article, we propose a measurement and policy model that is based on a theoretical conceptualization of health outcome. The model considers the impact of disease and its treatment in terms of both morbidity and mortality. The value of the model for clinical trials, population assessments, and policy analysis is reviewed. A public policy application of the model in Oregon is briefly described.

Scoring methods and application of the activity record (ACTRE) for patients with musculoskeletal disorders

The National Institutes of Health (NIH) Activity Record (ACTRE) has been used to document daily activities in patients with musculoskeletal disorders. Quantification of the amount of time spent resting and physically active, the intensity of pain and fatigue associated with patterns of activities, and motivational considerations are possible with the ACTRE. Scoring has been streamlined to permit identification of the amount of pain, fatigue, and motivational factors as they relate to activity patterns (e.g., rest and physical activity). The ACTRE provides a performance-based, quantifiable measure of daily activity.