Challenges of using quality improvement methods in nursing homes that "need improvement"

OBJECTIVES

Qualitatively describe the adoption of strategies and challenges experienced by intervention facilities participating in a study targeted to improve quality of care in nursing homes "in need of improvement". To describe how staff use federal quality indicator/quality measure (QI/QM) scores and reports, quality improvement methods and activities, and how staff supported and sustained the changes recommended by their quality improvement teams.

DESIGN/SETTING/PARTICIPANTS

A randomized, two-group, repeated-measures design was used to test a 2-year intervention for improving quality of care and resident outcomes in facilities in "need of improvement". Intervention group (n = 29) received an experimental multilevel intervention designed to help them: (1) use quality-improvement methods, (2) use team and group process for direct-care decision-making, (3) focus on accomplishing the basics of care, and (4) maintain more consistent nursing and administrative leadership committed to communication and active participation of staff in decision-making.

RESULTS

A qualitative analysis revealed a subgroup of homes likely to continue quality improvement activities and readiness indicators of homes likely to improve: (1) a leadership team (nursing home administrator, director of nurses) interested in learning how to use their federal QI/QM reports as a foundation for improving resident care and outcomes; (2) one of the leaders to be a "change champion" and make sure that current QI/QM reports are consistently printed and shared monthly with each nursing unit; (3) leaders willing to involve all staff in the facility in educational activities to learn about the QI/QM process and the reports that show how their facility compares with others in the state and nation; (4) leaders willing to plan and continuously educate new staff about the MDS and federal QI/QM reports and how to do quality improvement activities; (5) leaders willing to continuously involve all staff in quality improvement committee and team activities so they "own" the process and are responsible for change.

CONCLUSIONS

Results of this qualitative analysis can help allocate expert nurse time to facilities that are actually ready to improve. Wide-spread adoption of this intervention is feasible and could be enabled by nursing home medical directors in collaborative practice with advanced practice nurses.

Randomized multilevel intervention to improve outcomes of residents in nursing homes in need of improvement

OBJECTIVES

A comprehensive multilevel intervention was tested to build organizational capacity to create and sustain improvement in quality of care and subsequently improve resident outcomes in nursing homes in need of improvement.

DESIGN/SETTING/PARTICIPANTS

Intervention facilities (N = 29) received a 2-year multilevel intervention with monthly on-site consultation from expert nurses with graduate education in gerontological nursing. Attention control facilities (N = 29) that also needed to improve resident outcomes received monthly information about aging and physical assessment of elders.

INTERVENTION

The authors conducted a randomized clinical trial of nursing homes in need of improving resident outcomes of bladder and bowel incontinence, weight loss, pressure ulcers, and decline in activities of daily living. It was hypothesized that following the intervention, experimental facilities would have higher quality of care, better resident outcomes, more organizational attributes of improved working conditions than control facilities, higher staff retention, similar staffing and staff mix, and lower total and direct care costs.

RESULTS

The intervention did improve quality of care (P = .02); there were improvements in pressure ulcers (P = .05) and weight loss (P = .05). Organizational working conditions, staff retention, staffing, and staff mix and most costs were not affected by the intervention. Leadership turnover was surprisingly excessive in both intervention and control groups.

CONCLUSION AND IMPLICATIONS

Some facilities that are in need of improving quality of care and resident outcomes are able to build the organizational capacity to improve while not increasing staffing or costs of care. Improvement requires continuous supportive consultation and leadership willing to involve staff and work together to build the systematic improvements in care delivery needed. Medical directors in collaborative practice with advanced practice nurses are ideally positioned to implement this low-cost, effective intervention nationwide.

Field testing, refinement, and psychometric evaluation of a new measure of nursing home care quality

The primary aim of this NINR-NIH-funded field test in 407 nursing homes in 3 states was to complete the development of and conduct psychometric testing for the Observable Indicators of Nursing Home Care Quality Instrument (Observable Indicators, OIQ). The development of the OIQ was based on extensive qualitative and iterative quantitative work that described nursing home care quality and did initial validity and reliability field testing of the instrument in 123 nursing homes in 1 state. The scale is meant for researchers, consumers, and regulators interested in directly observing and quickly evaluating (within 30 minutes of observation) the multiple dimensions of care quality in nursing homes. After extensive testing in this study, the Observable Indicators instrument has been reduced to 30 reliable and discriminating items that have a conceptually coherent hierarchical factor structure that describes nursing home care quality. Seven first-order factors group together into two second-order factors of Structure (includes Environment: Basics and Odors) and Process (includes Care Delivery, Grooming, Interpersonal Communication, Environment: Access, and Environment: Homelike) that are classic constructs of Quality, which was the third-order factor. Internal consistency reliability for the 7 first-order factors ranged from .77 to .93. Construct validity analyses revealed an association between survey citations and every subscale as well as the total score of the OIQ instrument. Known groups analysis revealed expected trends in the OIQ scores. The Observable Indicators instrument as a whole shows acceptable interrater and test-retest reliabilities, and strong internal consistency. Scale subscales show acceptable reliability as well. Generalizability Theory analyses revealed that dependability of scores can be improved by including a second site observer, or by revisiting a site. There is a small additional benefit from increasing observers or visits beyond two.

Entrepreneurial program of research and service to improve nursing home care

This is a methodological article intended to demonstrate the integration of multiple goals, multiple projects with diverse foci, and multiple funding sources to develop an entrepreneurial program of research and service to directly affect and improve the quality of care of older adults, particularly nursing home residents. Examples that illustrate how clinical ideas build on one another and how the research ideas and results build on one another are provided. Results from one study are applied to the next and are also applied to the development of service delivery initiatives to test results in the real world. Descriptions of the Quality Improvement Program for Missouri and the Aging in Place Project are detailed to illustrate real-world application of research to practice.

Developing a residential care facility version of the observable indicators of Nursing Home Care Quality Instrument

The last decade has seen a substantial growth in the development of residential care facilities (assisted living facilities). Evaluation of the quality of care in this service delivery sector has been hampered by the lack of a consensus definition of quality and the lack of reliable instruments to measure quality. Founded on extensive research on nursing home care quality, a field test of the Residential Care Facility Version of the Observable Indicators of Nursing Home Care Quality Instrument was conducted in 35 residential care facilities in Missouri. Content validity of the 34 items was rated by 4 expert raters as 3.4 on a 4-point scale of relevance. Test-retest was 0.94, interrater reliability was 0.73, and internal consistency was 0.90 for the total scale, indicating excellent results for initial field-testing. A focus group confirmed the 5 dimensions of quality of care measured by the instrument as important in residential care settings.

Randomized clinical trial of a quality improvement intervention in nursing homes

PURPOSE

The purpose of the study was to determine if simply providing nursing facilities with comparative quality performance information and education about quality improvement would improve clinical practices and subsequently improve resident outcomes, or if a stronger intervention, expert clinical consultation with nursing facility staff, is needed.

DESIGN AND METHODS

Nursing facilities (n = 113) were randomly assigned to one of three groups: workshop and feedback reports only, workshop and feedback reports with clinical consultation, and control. Minimum Data Set (MDS) Quality Indicator (QI) feedback reports were prepared and sent quarterly to each facility in intervention groups for a year. Clinical consultation by a gerontological clinical nurse specialist (GCNS) was offered to those in the second group.

RESULTS

With the exception of MDS QI 27 (little or no activity), no significant differences in resident assessment measures were detected between the groups of facilities. However, outcomes of residents in nursing homes that actually took advantage of the clinical consultation of the GCNS demonstrated trends in improvements in QIs measuring falls, behavioral symptoms, little or no activity, and pressure ulcers (overall and for low-risk residents).

IMPLICATIONS

Simply providing comparative performance feedback is not enough to improve resident outcomes. It appears that only those nursing homes that sought the additional intensive support of the GCNS were able to effect enough change in clinical practice to improve resident outcomes significantly.

Development of health care delivery systems that are sensitive to the needs of stroke survivors and their caregivers

The life-altering event of a stroke has long-term effects not only on stroke survivors but also on their caregivers, health care professionals, and health care delivery systems. The nurse administrator is faced with an obvious challenge to organize nursing systems to meet the multiple needs of the stroke survivor. The article presents data on the perceived needs of stroke survivors and their caregivers that provide direction and assistance to nursing administrators in organizing nursing services to address these perceived needs.

Initial field testing of an instrument to measure: observable indicators of nursing home care quality

The "Observable Indicators of Nursing Home Care Quality" instrument was developed as a new measure of nursing home care quality. The instrument is based on a theoretical model of quality nursing home care grounded in data from provider and consumer focus groups. The instrument was piloted in 10 Missouri nursing homes. Subsequent versions were tested in 109 Missouri and 11 Icelandic nursing homes. Content validity was established using experts. Concurrent and known groups validity was evaluated using Minimum Data Set quality indicators, survey citations, and a process of care measure. Interrater and test-retest reliabilities were calculated as well as coefficient alpha. The "Observable Indicators of Nursing Home Care Quality" instrument is a new measure that can be used by researchers, and potentially by regulators, consumers, or providers, to observe and score specific indicators of quality care following a 20- to 30-minute inspection of a nursing home.

Setting thresholds for quality indicators derived from MDS data for nursing home quality improvement reports: an update

BACKGROUND

Determining meaningful thresholds to reinforce excellent performance and flag potential problem areas in nursing home care is critical for preparing reports for nursing homes to use in their quality improvement programs. This article builds on the work of an earlier panel of experts that set thresholds for quality indicators (QIs) derived from Minimum Data Set (MDS) assessment data. Thresholds were now set for the revised MDS 2.0 two-page quarterly form and Resource Utilization Groups III (RUGS III) quarterly instrument.

SETTING THRESHOLDS

In a day-long session in October 1998, panel members individually determined lower (good) and upper (poor) threshold scores for each QI, reviewed statewide distributions of MDS QIs, and completed a follow-up Delphi of the final results.

REPORTING MDS QIS FOR QUALITY IMPROVEMENT

The QI reports compiled longitudinal data for all residents in the nursing home during each quarter and cumulatively displayed data for five quarters for each QI. A resident roster was provided to the nursing home so that the quality improvement team could identify the specific residents who developed the problems defined by each QI during the last quarter. Quality improvement teams found the reports helpful and easy to interpret.

SUMMARY AND CONCLUSIONS

As promised in an earlier report, to ensure that thresholds reflect current practice, research using experts in a panel to set thresholds was repeated as needed. As the MDS instrument or recommended calculations for the MDS QIs change, thresholds will be reestablished to ensure a fit with the instrument and data.

The future of long-term care for the chronically ill

Consumers want a range of services and care available for them if and when they may need them. They want long-term care that addresses six areas of concern: community-based services, continuity, coordination, caring, convenience, and cost. To develop new perspectives and new ways of providing the needed long-term services, it is time for health care leaders to work cooperatively with consumers to redesign long-term care, both community-based and institutional. Consumers and consumer advocates, working cooperatively with health care leaders, could reinvent home health care, nursing home care, and other long-term services such as "aging in place" for older people.

Nursing home care quality: a multidimensional theoretical model integrating the views of consumers and providers

This exploratory study was undertaken to discover the defining dimensions of nursing home care quality from the viewpoint of consumers of nursing home care. Eleven focus groups were conducted in five Missouri communities. The seven dimensions of the consumer multidimensional model of nursing home care quality are: staff, care, family involvement, communication, environment, home, and cost. The views of consumers and families are compared with the results of a previous study of providers of nursing home services. An integrated, multidimensional theoretical model is presented for testing and evaluation. An instrument based on the model is being tested to observe and score the dimensions of nursing home care quality.

Minimum Data Set and Resident Assessment Instrument. Can using standardized assessment improve clinical practice and outcomes of care?

Regulating and standardizing the assessment of residents was envisioned by the 1986 Committee on Nursing Home Reform to have many advantages for facility management, government regulatory agencies, and clinical staff to evaluate changes in resident status and adjust the care plans accordingly. Standardized assessment data was viewed as a source of management information to be used to track case mix (i.e., acuity) of residents, allocate resources such as staff, and evaluate care quality. The Resident Assessment Instrument is a clinically relevant assessment process that can facilitate effective care planning, interventions, and quality improvement. It is a clinically complex process requiring care delivery systems developed by RNs to support the implementation of individualized care.

Nursing home care quality: a multidimensional theoretical model

This exploratory study was undertaken to discover the defining dimensions of nursing home care quality and to propose a conceptual model to guide nursing home quality research and the development of instruments to measure nursing home care quality. Three focus groups were conducted in three central Missouri communities. A naturalistic inductive analysis of the transcribed content was completed. Two core variables (interaction and odor) and several related concepts emerged from the data. Using the core variables, related concepts, and detailed descriptions from participants, three models of nursing home care quality emerged from the analysis: (1) a model of a nursing home with good quality care; (2) a model of a nursing home with poor quality care; and (3) a multidimensional model of nursing home care quality. The seven dimensions of the multidimensional model of nursing home care quality are: central focus, interaction, milieu, environment, individualized care, staff, and safety. To pursue quality, the many dimensions must be of primary concern to nursing homes. We are testing an instrument based on the model to observe and score the dimensions of nursing home care quality.

Verifying nursing home care quality using minimum data set quality indicators and other quality measures

Researchers, providers and government agencies have devoted time and resources to the development of a set of Quality Indicators derived from Minimum Data Set (MDS) data. Little effort has been directed toward verifying that Quality Indicators derived from MDS data accurately measure nursing home quality. Researchers at the University of Missouri-Columbia have independently verified the accuracy of QI derived from MDS data using four different methods; 1) structured participative observation, 2) QI Observation Scoring Instrument, 3) Independent Observable Indicators of Quality Instrument, and 4) survey citations. Our team was able to determine that QIs derived from MDS data did differentiate nursing homes of good quality from those of poorer quality.

Setting thresholds for MDS (Minimum Data Set) quality indicators for nursing home quality improvement reports

BACKGROUND

Determining meaningful thresholds to reinforce excellent performance and flag potential problem areas is critical for quality improvement reports. Without thresholds, an organization may interpret its performance as superior to others because it is "better than average" and falsely assume it does not have care problems in certain areas.

SETTING THRESHOLDS

The Minimum Data Set (MDS) assessment instrument is mandated for use nationwide in all nursing homes participating in Medicaid or Medicare programs. Since 1993 a research team at the University of Missouri-Columbia has been developing and testing quality indicators (QIs) derived from MDS data as a foundation for quality improvement activities. In July 1996, a cross-section of 13 clinical care personnel from nursing homes participated on an expert panel for threshold setting for QIs derived from MDS assessment data. Panel members individually determined good and poor threshold scores for each QI, reviewed statewide distributions of MDS QIs, and, two weeks later, completed a follow-up Delphi round. Three members of the research team reviewed the results of the expert panel and set the final thresholds. With thresholds established for good and poor scores, MDS QI scores are reported to a sample of Missouri nursing homes using the thresholds.

CONCLUSIONS

To ensure that thresholds reflect current practice, threshold setting with another panel of experts will be repeated as needed, but at least biannually. The report format will be revised on the basis of user input, and a statewide study testing different educational support methods for quality improvement using MDS QIs is now underway.