Facilitators and barriers for implementing screening brief intervention and referral for health promotion in a rural hospital in Alberta: using consolidated framework for implementation research

BACKGROUND

Screening, brief intervention, and referral (SBIR) is an evidence-based, comprehensive health promotion approach commonly implemented to reduce alcohol and substance use. Implementation research on SBIR demonstrate that patients find it acceptable, reduces hospital costs, and it is effective. However, SBIR implementation in hospital settings for multiple risk factors (fruit and vegetable consumption, physical activity, alcohol and tobacco use) is still emergent. More evidence is needed to guide SBIR implementation for multiple risk factors in hospital settings.

OBJECTIVE

To explore the facilitators and barriers of SBIR implementation in a rural hospital using the Consolidated Framework for Implementation Research (CFIR).

METHODS

We conducted a descriptive qualitative investigation consisting of both inductive and deductive analyses. We conducted virtual, semi-structured interviews, guided by the CFIR framework. All interviews were audio-recorded, and transcribed verbatim. NVivo 12 Pro was used to organize and code the raw data.

RESULTS

A total of six key informant semi-structured interviews, ranging from 45 to 60 min, were carried out with members of the implementation support team and clinical implementers. Implementation support members reported that collaborating with health departments facilitated SBIR implementation by helping (a) align health promotion risk factors with existing guidelines; (b) develop training and educational resources for clinicians and patients; and (c) foster leadership buy-in. Conversely, clinical implementers reported several barriers to SBIR implementation including, increased and disrupted workflow due to SBIR-related documentation, a lack of knowledge on patients' readiness and motivation to change, as well as perceived patient stigma in relation to SBIR risk factors.

CONCLUSION

The CFIR provided a comprehensive framework to gauge facilitators and barriers relating to SBIR implementation. Our pilot investigation revealed that future SBIR implementation must address organizational, clinical implementer, and patient readiness to implement SBIR at all phases of the implementation process in a hospital.

Screening, brief intervention, and referral to treatment for tobacco consumption, alcohol misuse, and physical inactivity: an equity-informed rapid review

OBJECTIVE

This rapid review systematically synthesizes evidence of the effectiveness of the Screening, Brief Intervention, and Referral (SBIR/T) approach for tobacco use, alcohol misuse, and physical inactivity.

STUDY DESIGN

This was a rapid review.

METHODS

We searched primary studies between 2012 and 2022 in seven electronic databases. The search strategy used concepts related to alcohol-related disorders, intoxication, cigarette, nicotine, physical activity, exercise, sedentary, screening, therapy, and referral. We reviewed both title/abstract and full-text using a priori set inclusion and exclusion criteria to identify the eligible studies. We appraised study quality, extracted data, and summarized the characteristics of the included studies. We applied health equity lenses in the synthesis.

RESULTS

Of the 44 included studies, most focused on alcohol misuse. SBIR/T improved patients' attitudes toward alcohol behavior change, improved readiness and referral initiation for change, and effectively reduced alcohol consumption. Few studies pertained to smoking and physical inactivity. Most studies on smoking demonstrated effectiveness pertaining to patients' acceptance of referral recommendations, improved readiness and attempts to quitting smoking, and reduced or cessation of smoking. Findings were mixed about the effectiveness of SBIR/T in improving physical activity. Minimal studies exist on the impacts of SBIR/T for these three risk factors on healthcare resource use or costs. Studies considering diverse population characteristics in the design and effectiveness assessment of the SBIR/T intervention are lacking.

CONCLUSIONS

More research on the impacts of SBIR/T on tobacco use, alcohol misuse, and physical inactivity is required to inform the planning and delivery of SBIR/T for general and disadvantaged populations.

Implementing Screening, Brief Intervention and Referral Intervention for Health Promotion and Disease Prevention in Hospital Settings in Alberta: A Pilot Study

Objective: This study assessed the feasibility of implementing screening, brief intervention and referral (SBIR) intervention in hospital settings. Methods: This cross-sectional study evaluated the implementation of the SBIR intervention in a hospital in Alberta for tobacco use, alcohol intake, physical inactivity, and insufficient vegetable and fruit consumption. Patients were interviewed approximately 4-month later to collect data on the acceptability and effectiveness of the intervention received (n = 108). The data were primarily analyzed using descriptive statistics. Results: Of 108 patients, >80% agreed that "they were ok with being screened" for the risk factors during their hospital visit. Up to 68% of patients recalled the provider's brief education. At the follow-up, 20% of patients quit tobacco, 50% reduced alcohol use, 30% increased physical activity, and 25% increased vegetable and fruit intake. Conclusion: Risk factor screening was acceptable for patients. Patients recalled the brief education they received from healthcare providers. Patients reported risk-reducing changes in their risk factors. Our future work will integrate the SBIR approach within the Electronic Clinical Information System and use robust research methods to investigate the impact of SBIR on patients' behavior change.

Patterns of up-to-date status for colorectal cancer screening in Alberta: a cross-sectional study using survey data

BACKGROUND

Regular screening for colorectal cancer (CRC) reduces its mortality. We explored patterns of use of different CRC screening modalities and quantified the association between having a regular primary care provider and being up to date for CRC screening in a community-based population in Alberta, Canada.

METHODS

We conducted a cross-sectional study of adults between 50 and 74 years of age in Alberta, using Canadian Community Health Survey data (2015-2016). We defined being up to date for CRC screening as having completed a fecal occult blood test (FOBT) or fecal immunochemical test (FIT) within the previous 2 years, or having a colonoscopy or sigmoidoscopy in the previous 5 years before the survey. We analyzed data using multivariable logistic regression models.

RESULTS

Of 4600 surveyed adults, 62.6% were up to date for CRC screening, with 45.1% having completed a FIT or FOBT (45.1%), and 34.1% having undergone a colonoscopy or sigmoidoscopy. The adjusted odds ratio of being up to date for CRC screening was 0.25 (95% confidence interval 0.17-0.38) and the absolute probability of being up to date for CRC screening was 34.4% lower for adults who had no regular primary care provider, compared with those who had. This pattern was observed in both male and female subgroups.

INTERPRETATION

Our findings suggest a suboptimal uptake of CRC screening overall in Alberta, with high disparity between adults with and without a regular primary care provider. The use of customized, multicomponent intervention strategies that are shown to be effective in increasing participation in CRC screening may address this issue.

How Does the Facilitation Effort of Clinical Educators Interact With Aspects of Organizational Context to Affect Research Use in Long-term Care? Evidence From CHAID Analysis

PURPOSE

Organizational context influences the effect of facilitation efforts on research use in care settings. The interactions of these factors are complex. Therefore, the use of traditional statistical methods to examine their interrelationships is often impractical. Big Data analytics can automatically detect patterns within the data. We applied the chi-squared automatic interaction detection (CHAID) algorithm and classification tree technique to explore the dynamic and interdependent relationships between the implementation science concepts-context, facilitation, and research use.

DESIGN

Observational, cross-sectional study based on survey data collected from a representative sample of nursing homes in western Canada.

METHODS

We assessed three major constructs: (a) Conceptual research utilization (CRU) using the CRU scale; (b) facilitation of research use measured by the frequency of contacts between the frontline staff and a clinical educator, or person who brings new ideas to the care unit; and (c) organizational context at the unit level using the Alberta Context Tool (ACT). CHAID analysis was performed to detect the interactions between facilitation and context variables. Results were illustrated in a classification tree to provide a straightforward visualization.

FINDINGS

Data from 312 care units in three provinces were included in the final analysis. Results indicate significant multiway interactions between facilitation and various aspects of the organizational context, including leadership, culture, evaluation, structural resources, and organizational slack (staffing). Findings suggested the preconditions of the care settings where research use can be maximized.

CONCLUSIONS

CHAID analysis helped transform data into usable knowledge. Our findings provide insight into the dynamic relationships of facilitators' efforts and organizational context, and how these factors' interplay and their interdependence together may influence research use.

CLINICAL RELEVANCE

Knowledge of the combined effects of facilitators' efforts and various aspects of organizational context on research use can contribute to effective strategies to narrow the evidence-practice gap in care settings.

Bringing Together Research and Quality Improvement: The Saskatchewan Approach

Improving health and health services requires both better knowledge (a key function of research) and better action to adapt and use what is already known (quality improvement). However, organizational and cultural divides between academic research institutions and health system organizations too often result in missed opportunities to integrate research and improvement. The Saskatchewan Health Quality Council's experience and relationships, from linking research, quality improvement and patient engagement in its leadership of the province's healthcare quality improvement journey, provided core support and leadership in the development of Saskatchewan's Strategy for Patient-Oriented Research SUPPORT Unit. The vision is for the SUPPORT Unit to integrate research and quality improvement into a continuous learning health system.

Importance of clinical educators to research use and suggestions for better efficiency and effectiveness: results of a cross-sectional survey of care aides in Canadian long-term care facilities

OBJECTIVE

This study explored the effect of clinical educators as facilitators of research use and how it may be modified by organisational context in the settings.

DESIGN

Cross-sectional observational study.

SETTING

A representative sample of 91 residential long-term care (LTC) facilities across Western Canada.

PARTICIPANTS

We used surveys to collect data from the frontline care aides and information about the organisational context of the care units.

OUTCOME MEASURE AND EXPLANATORY VARIABLES

We assessed research use (the outcome) with the Conceptual Research Utilization (CRU) scale. Explanatory variables in the multiple regression analysis were facilitation, organisational context and the interaction terms. Facilitation was measured by the frequency of contacts between care aides and clinical educator or person who brings new ideas about resident care. Three core organisational context variables were measured using the Alberta Context Tool.

RESULTS

We included data of 3873 care aides from 294 care units in the LTC facilities. We found significant associations between CRU and facilitation, leadership, culture and evaluation. Interactions of facilitation x leadership and facilitation x culture were negative. The coefficient of the facilitation x evaluation term in the regression model was positive (0.019, 95% CI 0.012 to 0.026), suggesting synergistic effects between facilitation and a well-developed process to evaluate care quality using relevant data.

CONCLUSIONS

Findings indicate clinical educators are effective facilitators of research use among the care aides, but the effect is modified by organisational context. For greatest impact, managers can direct efforts of the clinical educators to care units where leadership and culture ratings are lowest, but a proficient feedback and evaluation process is in place. This understanding enables managers to deploy clinical educators (a scarce resource in LTC settings) most efficiently.

Impact of an Integrated Model of Care on Outcomes of Patients With Inflammatory Bowel Diseases: Evidence From a Population-Based Study

BACKGROUND AND AIMS

Studies evaluating the impact of integrated models of care [IMC] for inflammatory bowel disease [IBD] on disease-related outcomes are needed. We compared the risk of IBD-related outcomes and prescription medication claims between patients exposed and non-exposed to an IMC.

METHODS

A retrospective population-based matched cohort study was conducted between 2009 and 2015, using administrative health data of Saskatchewan, Canada. Patients aged 18+ years with a diagnosis of IBD were identified with a validated administrative definition. Cases were classified as exposed and non-exposed to the IMC for IBD and matched based on propensity scores and disease duration. IBD-related hospitalisations, surgeries, prescription medication claims, and corticosteroid dependency [CsDep] were measured. Cox and logistic regression models evaluated differences between the groups, estimating hazard [HRs] and odds [ORs] ratios with corresponding confidence intervals [CIs].

RESULTS

In total, 2312 matched patients were included; 24.3% were exposed individuals. Compared with non-exposed, exposed patients had a lower risk of IBD-related surgeries [HR = 0.78, 95% CI 0.61-0.99], higher risk of prescriptions of immune modulators [HR = 1.68, 95% CI 1.42-1.99], and biologics [HR = 1.85, 95% CI 1.52-2.27], and a lower risk of 5-aminosalicylic acid prescriptions [HR = 0.81, 95% CI 0.69-0.95]. A lower risk of IBD-related hospitalisations among exposed ulcerative colitis [UC] patients [HR = 0.66, 95% CI 0.49-0.89] was identified in stratified analyses. The odds of CsDep among exposed UC patients was 0.39 [95% CI 0.15-0.98].

CONCLUSIONS

The observed differences in disease-related outcomes and use of steroid-sparing maintenance therapies between exposed and non-exposed individuals support the concept that enhanced quality of care can be achieved within IMC for IBD.

Trends in Blood Glucose Test Strip Utilization: A Population-Wide Analysis in Saskatchewan, Canada

OBJECTIVES

To describe trends in blood glucose test strip (TS) utilization and cost in Saskatchewan.

METHODS

A retrospective analysis of TS use between January 1, 1996, and December 31, 2013, was conducted using population-based health administrative databases in Saskatchewan. The prescription drug database was used to describe the annual number of TS dispensations, the number of strips dispensed, the number of unique beneficiaries and the total costs. A patient-level analysis was also carried out to describe the patterns of TS use (i.e. light, moderate or heavy) by the entire cohort and by diabetes treatments. Potential cost savings due to a newly implemented restriction policy were estimated based on the most recent data (2013).

RESULTS

TS utilization increased dramatically between 1996 and 2013 in terms of the number of users and the average number of TSs received. The percentage of TS users receiving fewer than 4 TSs per week (i.e. light users) decreased by 20%, while the percentage of heavy users (i.e. those receiving more than 8 TSs per week) increased by 19%. During the same period, the use of high-risk oral hypoglycemic medications declined by 30% among all TS users. Heavy TS use was observed in at least one-third of all users, irrespective of treatment type.

CONCLUSIONS

If Saskatchewan's newly imposed coverage limits had been applied in 2013, the costs of strips exceeding those limits would have totalled $2.5 million. Although TS use aligns with chronic disease care paradigms, the substantial costs and lack of evidence of patient outcomes demand better strategies to help reduce unnecessary use.

Comparison of the accuracy of classification models to estimate healthcare use and costs associated with COPD exacerbations in Saskatchewan, Canada: A retrospective cohort study

OBJECTIVE

COPD is a high-cost disease and results in frequent contacts with the healthcare system. The study objective was to compare the accuracy of classification models with different covariates for classifying COPD patients into cost groups.

METHODS

Linked health administrative databases from Saskatchewan, Canada, were used to identify a cohort of newly diagnosed COPD patients (April 1, 2007 to March 31, 2011) and their episodes of healthcare encounters for disease exacerbations. Total costs of the first and follow-up episodes were computed and patients were categorized as persistently high cost, occasionally high cost, and persistently low cost based on cumulative cost distribution ranking using the 75th percentile cutoff for high-cost status. Classification accuracy was compared for seven multinomial logistic regression models containing socio-demographic characteristics (i.e., base model), and socio-demographic and prior healthcare use characteristics (i.e., comparator models).

RESULTS

Of the 1182 patients identified, 8.5% were classified as persistently high cost, 26.1% as occasionally high cost, and the remainder as persistently low cost. The persistently high-cost and occasionally high-cost patients incurred 10 times ($12 449 vs $1263) and seven times ($9334 vs $1263) more costs in their first exacerbation episode than persistently low-cost patients, respectively. Classification accuracy was 0.67 for the base model, whereas the comparator model containing socio-demographic and number of prior hospital admissions had the highest accuracy (0.72).

CONCLUSIONS

Costs associated with COPD exacerbation episodes are substantial. Adding prior hospitalization to socio-demographic characteristics produced the highest improvements in classification accuracy. Accurate classification models are important for identifying potential healthcare cost management strategies.

Measuring care trajectories using health administrative databases: a population-based investigation of transitions from emergency to acute care

Background

A patient’s trajectory through the healthcare system affects resource use and outcomes. Data fields in population-based administrative health databases are potentially valuable resources for constructing care trajectories for entire populations, provided they can capture patient transitions between healthcare services. This study describes patient transitions from the emergency department (ED) to other healthcare settings, and ascertains whether the discharge disposition field recorded in the ED data was a reliable source of patient transition information from the emergency to the acute care settings.

Methods

Administrative health databases from the province of Saskatchewan, Canada (population 1.1 million) were used to identify patients with at least one ED visit to provincial teaching hospitals (n = 5) between April 1, 2006 and March 31, 2012. Discharge disposition from ED was described using frequencies and percentages; and it includes categories such as home, transfer to other facilities, and died. The kappa statistic with 95 % confidence intervals (95 % CIs) was used to measure agreement between the discharge disposition field in the ED data and hospital admission records.

Results

We identified N = 1,062,861 visits for 371,480 patients to EDs over the six-year study period. Three-quarters of the discharges were to home, 16.1 % were to acute care in the same facility in which the ED was located, and 1.6 % resulted in a patient transfer to a different acute care facility. Agreement between the discharge disposition field in the ED data and hospital admission records was good when the emergency and acute care departments were in the same facility (κ = 0.77, 95 % CI 0.77, 0.77). For transfers to a different acute care facility, agreement was only fair (κ = 0.36, 95 % CI 0.35, 0.36).

Conclusions

The majority of patients who attended EDs did not transition to another healthcare setting. For those who transitioned to acute care, accuracy of the discharge disposition field depended on whether the two services were provided in the same facility. Using the hospital data as reference, we conclude that the discharge disposition field in the ED data is not reliable for measuring transitions from ED to acute care.

Association Between Incretin-Based Drugs and the Risk of Acute Pancreatitis

IMPORTANCE

The association between incretin-based drugs, such as dipeptidyl peptidase 4 (DPP-4) inhibitors and glucagon-like peptide 1 (GLP-1) agonists, and acute pancreatitis is controversial.

OBJECTIVE

To determine whether the use of incretin-based drugs, compared with the use of 2 or more other oral antidiabetic drugs, is associated with an increased risk of acute pancreatitis.

DESIGN, SETTING, AND PARTICIPANTS

A large, international, multicenter, population-based cohort study was conducted using combined health records from 7 participating sites in Canada, the United States, and the United Kingdom. An overall cohort of 1 532 513 patients with type 2 diabetes initiating the use of antidiabetic drugs between January 1, 2007, and June 30, 2013, was included, with follow-up until June 30, 2014.

EXPOSURES

Current use of incretin-based drugs compared with current use of at least 2 oral antidiabetic drugs.

MAIN OUTCOMES AND MEASURES

Nested case-control analyses were conducted including hospitalized patients with acute pancreatitis matched with up to 20 controls on sex, age, cohort entry date, duration of treated diabetes, and follow-up duration. Hazard ratios (HRs) and 95% CIs for hospitalized acute pancreatitis were estimated and compared current use of incretin-based drugs with current use of 2 or more oral antidiabetic drugs. Secondary analyses were performed to assess whether the risk varied by class of drug (DPP-4 inhibitors and GLP-1 agonists) or by duration of use. Site-specific HRs were pooled using random-effects models.

RESULTS

Of 1 532 513 patients included in the analysis, 781 567 (51.0%) were male; mean age was 56.6 years. During 3 464 659 person-years of follow-up, 5165 patients were hospitalized for acute pancreatitis (incidence rate, 1.49 per 1000 person-years). Compared with current use of 2 or more oral antidiabetic drugs, current use of incretin-based drugs was not associated with an increased risk of acute pancreatitis (pooled adjusted HR, 1.03; 95% CI, 0.87-1.22). Similarly, the risk did not vary by drug class (DPP-4 inhibitors: pooled adjusted HR, 1.09; 95% CI, 0.86-1.22; GLP-1 agonists: pooled adjusted HR, 1.04; 95% CI, 0.81-1.35) and there was no evidence of a duration-response association.

CONCLUSIONS AND RELEVANCE

In this large population-based study, use of incretin-based drugs was not associated with an increased risk of acute pancreatitis compared with other oral antidiabetic drugs.

Measurement of quality and safety in healthcare: the past decade and the next

The author calls for a critical assessment of the impact of investments made in the measurement of quality and safety, and reflects on whether a reorientation of some of this investment is required to realize the healthcare quality and safety improvement the system seeks. This article also reflects on several Canadian initiatives that have been typical and draws on the experience of health systems that have used measurement to great effect to suggest how investments in healthcare quality and safety measurement should be focused in the future.

Identifying Distinct Healthcare Pathways During Episodes of Chronic Obstructive Pulmonary Disease Exacerbations

Healthcare pathways are important to measure because they are expected to affect outcomes. However, they are challenging to define because patients exhibit heterogeneity in their use of healthcare services. The objective of this study was to identify and describe healthcare pathways during episodes of chronic obstructive pulmonary disease (COPD) exacerbations. Linked administrative databases from Saskatchewan, Canada were used to identify a cohort of newly diagnosed COPD patients and their episodes of healthcare use for disease exacerbations. Latent class analysis (LCA) was used to classify the cohort into homogeneous pathways using indicators of respiratory-related hospitalizations, emergency department (ED) visits, general and specialist physician visits, and outpatient prescription drug dispensations. Multinomial logistic regression models tested patients' demographic and disease characteristics associated with pathway group membership. The most frequent healthcare contact sequences in each pathway were described. Tests of mean costs across groups were conducted using a model-based approach with χ² statistics. LCA identified 3 distinct pathways for patients with hospital- (n = 963) and ED-initiated (n = 364) episodes. For the former, pathway group 1 members followed complex pathways in which multiple healthcare services were repeatedly used and incurred substantially higher costs than patients in the other pathway groups. For patients with an ED-initiated episode, pathway group 1 members also had higher costs than other groups. Pathway groups differed with respect to patient demographic and disease characteristics. A minority of patients were discharged from ED or hospital, but did not have any follow-up care during the remainder of their episode.Patients who followed complex pathways could benefit from case management interventions to streamline their journeys through the healthcare system. The minority of patients whose pathways were not consistent with recommended follow-up care should be further investigated to fully align COPD treatment in the province with recommended care practices.

Incidence and prevalence of dementia in linked administrative health data in Saskatchewan, Canada: a retrospective cohort study

BACKGROUND

Determining the epidemiology of dementia among the population as a whole in specific jurisdictions - including the long-term care population-is essential to providing appropriate care. The objectives of this study were to use linked administrative databases in the province of Saskatchewan to determine the 12-month incidence and prevalence of dementia for the 2012/13 period (1) among individuals aged 45 and older in the province of Saskatchewan, (2) according to age group and sex, and (3) according to diagnosis code and other case definition criteria.

METHODS

We used a population-based retrospective cohort study design and extracted data from 10 provincial health databases linked by a unique health services number. The cohort included individuals 45 years and older at first identification of dementia between April 1, 2001 and March 31, 2013 based on case definitions met within any one of four administrative health databases (Hospital Discharge Abstracts, Physician Service Claims, Prescription Drug, and RAI-MDS, i.e., Long-term Care).

RESULTS

A total of 3,270 incident cases of dementia (7.28 per 1,000 PAR) and 13,012 prevalent cases (28.16 per 1,000 PAR) were identified during 2012/13. This study found the incidence rate increased by 2.8 to 5.1 times and the prevalence rate increased by 2.6 to 4.6 times every 10 years after 45 years of age. Overall, the age-standardised incidence rate was significantly lower among females than males (7.04 vs. 7.65 per 1,000 PAR) and the age-standardised prevalence rate was significantly higher among females than males (28.92 vs. 26.53 per 1,000 PAR). Over one-quarter (28 %) of all incident cases were admitted to long-term care before a diagnosis was formally recorded in physician or hospital data, and nearly two-thirds of these cases were identified at admission with impairment at the moderate to very severe level or a disease category of Alzheimer's disease/other dementia.

CONCLUSIONS

Linking multiple sources of registry data contributes to our understanding of the epidemiology of dementia across multiple segments of the population, inclusive of individuals residing in long-term care. This information is foundational for public awareness and policy recommendations, health promotion and prevention strategies, appropriate health resource planning, and research priorities.

Agreement between administrative data and the Resident Assessment Instrument Minimum Dataset (RAI-MDS) for medication use in long-term care facilities: a population-based study

Background

Prescription medication use, which is common among long-term care facility (LTCF) residents, is routinely used to describe quality of care and predict health outcomes. Data sources that capture medication information, which include surveys, medical charts, administrative health databases, and clinical assessment records, may not collect concordant information, which can result in comparable prevalence and effect size estimates. The purpose of this research was to estimate agreement between two population-based electronic data sources for measuring use of several medication classes among LTCF residents: outpatient prescription drug administrative data and the Resident Assessment Instrument Minimum Data Set (RAI-MDS) Version 2.0.

Methods

Prescription drug and RAI-MDS data from the province of Saskatchewan, Canada (population 1.1 million) were linked for 2010/11 in this cross-sectional study. Agreement for anti-psychotic, anti-depressant, and anti-anxiety/hypnotic medication classes was examined using prevalence estimates, Cohen’s κ, and positive and negative agreement. Mixed-effects logistic regression models tested resident and facility characteristics associated with disagreement.

Results

The cohort was comprised of 8,866 LTCF residents. In the RAI-MDS data, prevalence of anti-psychotics was 35.7%, while for anti-depressants it was 37.9% and for hypnotics it was 27.1%. Prevalence was similar in prescription drug data for anti-psychotics and anti-depressants, but lower for hypnotics (18.0%). Cohen’s κ ranged from 0.39 to 0.85 and was highest for the first two medication classes. Diagnosis of a mood disorder and facility affiliation was associated with disagreement for hypnotics.

Conclusions

Agreement between prescription drug administrative data and RAI-MDS assessment data was influenced by the type of medication class, as well as selected patient and facility characteristics. Researchers should carefully consider the purpose of their study, whether it is to capture medication that are dispensed or medications that are currently used by residents, when selecting a data source for research on LTCF populations.

Electronic supplementary material

The online version of this article (doi:10.1186/s12877-015-0023-2) contains supplementary material, which is available to authorized users.

An international cross-sectional survey on the Quality and Costs of Primary Care (QUALICO-PC): recruitment and data collection of places delivering primary care across Canada

Background

Performance reporting in primary health care in Canada is challenging because of the dearth of concise and synthesized information. The paucity of information occurs, in part, because the majority of primary health care in Canada is delivered through a multitude of privately owned small businesses with no mechanism or incentives to provide information about their performance. The purpose of this paper is to report the methods used to recruit family physicians and their patients across 10 provinces to provide self-reported information about primary care and how this information could be used in recruitment and data collection for future large scale pan-Canadian and other cross-country studies.

Methods

Canada participated in an international large scale study-the QUALICO-PC (Quality and Costs of Primary Care) study. A set of four surveys, designed to collect in-depth information regarding primary care activities was collected from: practices, providers, and patients (experiences and values). Invitations (telephone, electronic or mailed) were sent to family physicians. Eligible participants were sent a package of surveys. Provincial teams kept records on the number of: invitation emails/letters sent, physicians who registered, practices that were sent surveys, and practices returning completed surveys. Response and cooperation rates were calculated.

Results

Invitations to participate were sent to approximately 23,000 family physicians across Canada. A total of 792 physicians and 8,332 patients from 772 primary care practices completed the surveys, including 1,160 participants completing a Patient Values survey and 7,172 participants completing a Patient Experience survey. Overall, the response rate was very low ranging from 2% (British Columbia) to 21% (Nova Scotia). However, the participation rate was high, ranging from 72% (Ontario) to 100% (New Brunswick/Prince Edward Island and Newfoundland & Labrador).

Conclusions

The difficulties obtaining acceptable response rates by family physicians for survey participation is a universal challenge. This response rate for the QUALICO-PC arm in Canada was similar to rates found in other countries such as Australia and New Zealand. Even though most family physicians operate as self-employed small businesses, they could be supported to routinely submit data through a collective effort and provincial mandate. The groundwork in setting up pan-Canadian collaboration in primary care has been established through this study.

Higher potency statins and the risk of new diabetes: multicentre, observational study of administrative databases

OBJECTIVE

To evaluate the incremental increase in new onset diabetes from higher potency statins compared with lower potency statins when used for secondary prevention.

DESIGN

Eight population based cohort studies and a meta-analysis.

SETTING

Six Canadian provinces and two international databases from the UK and US.

PARTICIPANTS

136,966 patients aged ≥ 40 years newly treated with statins between 1 January 1997 and 31 March 2011.

METHODS

Within each cohort of patients newly prescribed a statin after hospitalisation for a major cardiovascular event or procedure, we performed as-treated, nested case-control analyses to compare diabetes incidence in users of higher potency statins with incidence in users of lower potency statins. Rate ratios of new diabetes events were estimated using conditional logistic regression on different lengths of exposure to higher potency versus lower potency statins; adjustment for confounding was achieved using high dimensional propensity scores. Meta-analytic methods were used to estimate overall effects across sites.

MAIN OUTCOME MEASURES

Hospitalisation for new onset diabetes, or a prescription for insulin or an oral antidiabetic drug.

RESULTS

In the first two years of regular statin use, we observed a significant increase in the risk of new onset diabetes with higher potency statins compared with lower potency agents (rate ratio 1.15, 95% confidence interval 1.05 to 1.26). The risk increase seemed to be highest in the first four months of use (rate ratio 1.26, 1.07 to 1.47).

CONCLUSIONS

Higher potency statin use is associated with a moderate increase in the risk of new onset diabetes compared with lower potency statins in patients treated for secondary prevention of cardiovascular disease. Clinicians should consider this risk when prescribing higher potency statins in secondary prevention patients.

Proton pump inhibitors and the risk of hospitalisation for community-acquired pneumonia: replicated cohort studies with meta-analysis

OBJECTIVE

Previous observational studies suggest that the use of proton pump inhibitors (PPIs) may increase the risk of hospitalisation for community-acquired pneumonia (HCAP). However, the potential presence of confounding and protopathic biases limits the conclusions that can be drawn from these studies. Our objective was, therefore, to examine the risk of HCAP with PPIs prescribed prophylactically in new users of non-steroidal anti-inflammatory drugs (NSAIDs).

DESIGN

We formed eight restricted cohorts of new users of NSAIDs, aged ≥40 years, using a common protocol in eight databases (Alberta, Saskatchewan, Manitoba, Ontario, Quebec, Nova Scotia, US MarketScan and the UK's General Practice Research Database (GPRD)). This specific patient population was studied to minimise bias due to unmeasured confounders. High-dimensional propensity scores were used to estimate site-specific adjusted ORs (aORs) for HCAP at 6 months in PPI patients compared with unexposed patients. Fixed-effects meta-analytic models were used to estimate overall effects across databases.

RESULTS

Of the 4,238,504 new users of NSAIDs, 2.3% also started a PPI. The cumulative 6-month incidence of HCAP was 0.17% among patients prescribed PPIs and 0.12% in unexposed patients. After adjustment, PPIs were not associated with an increased risk of HCAP (aOR=1.05; 95% CI 0.89 to 1.25). Histamine-2 receptor antagonists yielded similar results (aOR=0.95, 95% CI 0.75 to 1.21).

CONCLUSIONS

Our study does not support the proposition of a pharmacological effect of gastric acid suppressors on the risk of HCAP.

Facility versus unit level reporting of quality indicators in nursing homes when performance monitoring is the goal

OBJECTIVES

To demonstrate the benefit of defining operational management units in nursing homes and computing quality indicators on these units as well as on the whole facility.

DESIGN

Calculation of adjusted Resident Assessment Instrument - Minimum Data Set 2.0 (RAI-MDS 2.0) quality indicators for: PRU05 (prevalence of residents with a stage 2-4 pressure ulcer), PAI0X (prevalence of residents with pain) and DRG01 (prevalence of residents receiving an antipsychotic with no diagnosis of psychosis), for quarterly assessments between 2007 and 2011 at unit and facility levels. Comparisons of these risk-adjusted quality indicators using statistical process control (control charts).

SETTING

A representative sample of 30 urban nursing homes in the three Canadian Prairie Provinces.

MEASUREMENTS

Explicit decision rules were developed and tested to determine whether the control charts demonstrated improving, worsening, unchanging or unclassifiable trends over the time period. Unit and facility performance were compared.

RESULTS

In 48.9% of the units studied, unit control chart performance indicated different changes in quality over the reporting period than did the facility chart. Examples are provided to illustrate that these differences lead to quite different quality interventions.

CONCLUSIONS

Our results demonstrate the necessity of considering facility-level and unit-level measurement when calculating quality indicators derived from the RAI-MDS 2.0 data, and quite probably from any RAI measures.

Validity of the RAI-MDS for ascertaining diabetes and comorbid conditions in long-term care facility residents

BACKGROUND

This study assessed the validity of the Resident Assessment Instrument Minimum Data Set (RAI-MDS) Version 2.0 for diagnoses of diabetes and comorbid conditions in residents of long-term care facilities (LTCFs).

METHODS

Hospital inpatient, outpatient physician billing, RAI-MDS, and population registry data for 1997 to 2011 from Saskatchewan, Canada were used to ascertain cases of diabetes and 12 comorbid conditions. Prevalence estimates were calculated for both RAI-MDS and administrative health data. Sensitivity, specificity, and positive and negative predictive values (PPV and NPV) were calculated using population-based administrative health data as the validation data source. Cohen's κ was used to estimate agreement between the two data sources.

RESULTS

23,217 LTCF residents were in the diabetes case ascertainment cohort. Diabetes prevalence was 25.3% in administrative health data and 21.9% in RAI-MDS data. Overall sensitivity of a RAI-MDS diabetes diagnoses was 0.79 (95% CI: 0.79, 0.80) and the PPV was 0.92 (95% CI: 0.91, 0.92), when compared to administrative health data. Sensitivity of the RAI-MDS for ascertaining comorbid conditions ranged from 0.21 for osteoporosis to 0.92 for multiple sclerosis; specificity was high for most conditions.

CONCLUSIONS

RAI-MDS clinical assessment data are sensitive to ascertain diabetes cases in LTCF populations when compared to administrative health data. For many comorbid conditions, RAI-MDS data have low validity when compared to administrative data. Risk-adjustment measures based on these comorbidities might not produce consistent results for RAI-MDS and administrative health data, which could affect the conclusions of studies about health outcomes and quality of care across facilities.

Predictive performance of comorbidity measures in administrative databases for diabetes cohorts

BACKGROUND

The performance of comorbidity measures for predicting mortality in chronic disease populations and using ICD-9 diagnosis codes in administrative health data has been investigated in several studies, but less is known about predictive performance with ICD-10 data and for other health outcomes. This study investigated predictive performance of five comorbidity measures for population-based diabetes cohorts in administrative data. The objectives were to evaluate performance for: (a) disease-specific and general health outcomes, (b) data based on the ICD-9 and ICD-10 diagnoses, and (c) different age groups.

METHODS

Performance was investigated for heart attack, stroke, amputation, renal disease, hospitalization, and death in all-age and age-specific cohorts. Hospital records, physician billing claims, and prescription drug records from one Canadian province were used to identify diabetes cohorts and measure comorbidity. The data were analysed using multiple logistic regression models and summarized using measures of discrimination, accuracy, and fit.

RESULTS

In Cohort 1 (n = 29,058), for which only ICD-9 diagnoses were recorded in administrative data, the Elixhauser index showed good or excellent prediction for amputation, renal disease, and death and performed better than the Charlson index. Number of diagnoses was a good predictor of hospitalization. Similar results were obtained for Cohort 2 (n = 41,925), in which both ICD-9 and ICD-10 diagnoses were recorded in administrative data, although predictive performance was sometimes higher. For age-specific models of mortality, the Elixhauser index resulted in the largest improvement in predictive performance in all but the youngest age group.

CONCLUSIONS

Cohort age and the health outcome under investigation, but not the diagnosis coding system, may influence the predictive performance of comorbidity measure for studies about diabetes populations using administrative health data.

Use of high potency statins and rates of admission for acute kidney injury: multicenter, retrospective observational analysis of administrative databases

OBJECTIVE

To quantify an association between acute kidney injury and use of high potency statins versus low potency statins.

DESIGN

Retrospective observational analysis of administrative databases, using nine population based cohort studies and meta-analysis. We performed as treated analyses in each database with a nested case-control design. Rate ratios for different durations of current and past statin exposure to high potency or low potency statins were estimated using conditional logistic regression. Ratios were adjusted for confounding by high dimensional propensity scores. Meta-analytic methods estimated overall effects across participating sites.

SETTING

Seven Canadian provinces and two databases in the United Kingdom and the United States.

PARTICIPANTS

2,067,639 patients aged 40 years or older and newly treated with statins between 1 January 1997 and 30 April 2008. Each person hospitalized for acute kidney injury was matched with ten controls.

INTERVENTION

A dispensing event was new if no cholesterol lowering drug or niacin prescription was dispensed in the previous year. High potency statin treatment was defined as ≥ 10 mg rosuvastatin, ≥ 20 mg atorvastatin, and ≥ 40 mg simvastatin; all other statin treatments were defined as low potency. Statin potency groups were further divided into cohorts with or without chronic kidney disease.

MAIN OUTCOME MEASURE

Relative hospitalization rates for acute kidney injury.

RESULTS

Of more than two million statin users (2,008,003 with non-chronic kidney disease; 59,636 with chronic kidney disease), patients with similar propensity scores were comparable on measured characteristics. Within 120 days of current treatment, there were 4691 hospitalizations for acute kidney injury in patients with non-chronic kidney injury, and 1896 hospitalizations in those with chronic kidney injury. In patients with non-chronic kidney disease, current users of high potency statins were 34% more likely to be hospitalized with acute kidney injury within 120 days after starting treatment (fixed effect rate ratio 1.34, 95% confidence interval 1.25 to 1.43). Users of high potency statins with chronic kidney disease did not have as large an increase in admission rate (1.10, 0.99 to 1.23). χ(2) tests for heterogeneity confirmed that the observed association was robust across participating sites.

CONCLUSIONS

Use of high potency statins is associated with an increased rate of diagnosis for acute kidney injury in hospital admissions compared with low potency statins. The effect seems to be strongest in the first 120 days after initiation of statin treatment.

An evaluation of data quality in Canada's Continuing Care Reporting System (CCRS): secondary analyses of Ontario data submitted between 1996 and 2011

Background

Evidence informed decision making in health policy development and clinical practice depends on the availability of valid and reliable data. The introduction of interRAI assessment systems in many countries has provided valuable new information that can be used to support case mix based payment systems, quality monitoring, outcome measurement and care planning. The Continuing Care Reporting System (CCRS) managed by the Canadian Institute for Health Information has served as a data repository supporting national implementation of the Resident Assessment Instrument (RAI 2.0) in Canada for more than 15 years. The present paper aims to evaluate data quality for the CCRS using an approach that may be generalizable to comparable data holdings internationally.

Methods

Data from the RAI 2.0 implementation in Complex Continuing Care (CCC) hospitals/units and Long Term Care (LTC) homes in Ontario were analyzed using various statistical techniques that provide evidence for trends in validity, reliability, and population attributes. Time series comparisons included evaluations of scale reliability, patterns of associations between items and scales that provide evidence about convergent validity, and measures of changes in population characteristics over time.

Results

Data quality with respect to reliability, validity, completeness and freedom from logical coding errors was consistently high for the CCRS in both CCC and LTC settings. The addition of logic checks further improved data quality in both settings. The only notable change of concern was a substantial inflation in the percentage of long term care home residents qualifying for the Special Rehabilitation level of the Resource Utilization Groups (RUG-III) case mix system after the adoption of that system as part of the payment system for LTC.

Conclusions

The CCRS provides a robust, high quality data source that may be used to inform policy, clinical practice and service delivery in Ontario. Only one area of concern was noted, and the statistical techniques employed here may be readily used to target organizations with data quality problems in that (or any other) area. There was also evidence that data quality was good in both CCC and LTC settings from the outset of implementation, meaning data may be used from the entire time series. The methods employed here may continue to be used to monitor data quality in this province over time and they provide a benchmark for comparisons with other jurisdictions implementing the RAI 2.0 in similar populations.

Secondary prevention of stroke in Saskatchewan, Canada: hypertension control

BACKGROUND

In the province of Saskatchewan, Canada, stroke is the third leading cause of death as well as the major cause of adult disability. Once a person suffers a stroke or transient ischemic attack (TIA), they are at high risk for having a secondary stroke. Hypertension (elevated blood pressure) is the single most important modifiable risk factor for both first and recurrent stroke, and is thus an important risk factor to be controlled. According to the Canadian Stroke Strategy (CSS) Best Practice Recommendations, blood pressure lowering treatment should be initiated before discharge from hospital for all stroke/TIA patients. The purpose of this study was to examine the quality of medically driven secondary stroke prevention care in Saskatchewan as applied to hypertension control.

AIMS

The objectives of the study were to: (1) develop methodology and calculate a secondary stroke process of care measure using available data in Saskatchewan, based on an appropriate hypertension therapy indicator recommendation from the CSS Performance Measurement Manual; (2) examine variation in secondary stroke prevention hypertensive care among the Saskatchewan Regional Health Authorities; and (3) investigate factors associated with receiving evidence-based hypertensive secondary stroke prevention.

METHODS

This multi-year cross-sectional study was an analysis of deidentified health data derived from linkage of administrative health data. A select indicator from the CSS Performance Measurement Manual that measures adherence to a CSS Best Practice Guidelines concerning use of antihypertensive medications for secondary stroke prevention was calculated. Logistic regression was used to quantify the association of patient demographic and socioeconomic characteristics and geographic location of care with receipt of guideline-recommended hypertensive secondary stroke prevention. The target population was all Saskatchewan residents who were hospitalized in Saskatchewan for a stroke or TIA between April 1, 2001 and March 31, 2008.

RESULTS

The results of this study indicate that the management of hypertension for secondary stroke prevention is sub-optimal in Saskatchewan. Although there was some improvement over the time period, approximately 40% of patients were not taking antihypertensives at 90 days after discharge from acute care. The correlates, urban/non-urban, previous use of antihypertensive drugs and effect of age modified by sex, were found to be significantly associated with receiving hypertensive secondary stroke prevention, suggesting there are modifiable factors that contribute to variations in this form of secondary stroke care quality in Saskatchewan.

CONCLUSIONS

The results of this study suggest that there is a need for province-wide improvement to secondary stroke prevention in Saskatchewan, Canada.

Should we feed back research results in the midst of a study?

Background

This report is an introduction to a series of three research papers that describe the evolution of the approaches taken by the Translating Research in Elder Care (TREC) research team during its first four years to feed back the research findings to study participants. TREC is an observational multi-method health services research project underway in 36 nursing homes in the prairie provinces of Canada. TREC has actively involved decision makers from the sector in all stages from initial planning, through data collection to dissemination activities. However, it was not planned as a fully integrated knowledge translation project. These three papers describe our progress towards fully integrated knowledge translation—with respect to timely and requested feedback processes. The first paper reports on the process and outcomes of creating and evaluating the feedback of research findings to healthcare aides (unregulated health professionals). These aides provide over 80% of the direct care in our sample and actively requested the feedback as a condition of their continued cooperation in the data acquisition process. The second paper describes feedback from nursing home administrators on preliminary research findings (a facility annual report) and evaluation of the reports’ utility. The third paper discusses an approach to providing a more in-depth form of feedback (expanded feedback report) at one of the TREC nursing homes.

Findings

Survey and interview feedback from healthcare aides is presented in the first paper. Overall, healthcare aides’ opinions about presentation of the feedback report and the understand ability, usability, and usefulness of the content were positive. The second paper describes the use of telephone interviews with facility administrators and indicates that the majority of contextual areas (e.g., staff job satisfaction) addressed in facility annual report to be useful, meaningful, and understandable. More than one-half of the administrators would have liked to have received information on additional areas. The third paper explores how a case study that examined how involvement with the TREC study influenced management and staff at one of the TREC nursing homes. The importance of understanding organizational routines and the impact of corporate restructuring were key themes emerging from the case study. In addition, the Director of Care suggested changes to the structure and format of the feedback report that would have improved its usefulness.

Conclusions

We believe that these findings will inform others undertaking integrated knowledge translation activities and will encourage others to become more engaged in feedback processes.

Prioritizing information for quality improvement using resident assessment instrument data: experiences in one canadian province

PURPOSE

To elicit priority rankings of indicators of quality of care among providers and decision-makers in continuing care in Alberta, Canada.

METHODS

We used modified nominal group technique to elicit priorities and criteria for prioritization among the quality indicators and resident/client assessment protocols developed by the interRAI consortium for use in long-term care and home care.

RESULTS

The top-ranked items from the long-term care assessment data were pressure ulcers, pain and incontinence. The top-ranked items from the home care data were pain, falls and proportion of clients at high risk for residential placement. Participants considered a variety of issues in deciding how to rank the indicators.

IMPLICATIONS

This work reflects the beginning of a process to better understand how providers and policy makers can work together to assess priorities for quality improvement within continuing care.

Comparing comorbidity measures for predicting mortality and hospitalization in three population-based cohorts

Background

Multiple comorbidity measures have been developed for risk-adjustment in studies using administrative data, but it is unclear which measure is optimal for specific outcomes and if the measures are equally valid in different populations. This research examined the predictive performance of five comorbidity measures in three population-based cohorts.

Methods

Administrative data from the province of Saskatchewan, Canada, were used to create the cohorts. The general population cohort included all Saskatchewan residents 20+ years, the diabetes cohort included individuals 20+ years with a diabetes diagnosis in hospital and/or physician data, and the osteoporosis cohort included individuals 50+ years with diagnosed or treated osteoporosis. Five comorbidity measures based on health services utilization, number of different diagnoses, and prescription drugs over one year were defined. Predictive performance was assessed for death and hospitalization outcomes using measures of discrimination (c-statistic) and calibration (Brier score) for multiple logistic regression models.

Results

The comorbidity measures with optimal performance were the same in the general population (n = 662,423), diabetes (n = 41,925), and osteoporosis (n = 28,068) cohorts. For mortality, the Elixhauser index resulted in the highest c-statistic and lowest Brier score, followed by the Charlson index. For hospitalization, the number of diagnoses had the best predictive performance. Consistent results were obtained when we restricted attention to the population 65+ years in each cohort.

Conclusions

The optimal comorbidity measure depends on the health outcome and not on the disease characteristics of the study population.

Differences in glycemic control and survival predict higher ESRD rates in diabetic First Nations adults

PURPOSE

Diabetic First Nations people (FN) have higher ESRD rates than other Canadians but the reasons remain unclear. We sought to better understand this disparity by comparing demographic, laboratory and survival features of diabetic FN and other Saskatchewan residents (OSK) by renal function stage.

METHODS

Prevalent diabetes cases in 2005/06 were identified in Saskatchewan's two largest health regions using administrative databases, and linked with centralized laboratory tests. They were sub-divided into five stages of renal function using estimated glomerular filtration rates (eGFR) that were determined in 992 of 2,321 FN (42.7%) and 14,054 of 21,886 OSK (64.2%). Age, sex, urine microalbumin (MA), glycosylated hemoglobin (A1C), low density lipoprotein cholesterol (LDL-C) and two year mortality risk was compared for all subjects.

RESULTS

Diabetic FN were younger (mean age 52.7 vs. 64.2, p < 0.0001), more likely to be female (59.6% vs.45.4%, p < 0.001), had increased MA (56.6% vs. 48.4%, p < 0.0001) and displayed higher mean A1C levels (8.16% vs.7.36%, p < 0.0001) than OSK. Despite a larger proportion having eGFR's > 60 ml/min (87.0% vs.77.3%, p < 0.001), FN were also more likely to have ESRD (2.3% vs.0.8%, p < 0.001). Although FN with eGFR's > 30 ml/min experienced higher age/sex adjusted mortality risk than OSK, the trends for both adjusted and unadjusted mortality risks for those with advanced pre-ESRD renal failure were lower for FN than for OSK.

CONCLUSIONS

Elevated rates of ESRD experienced by FN with diabetes are related to poorer glycemic control at all levels of renal function, and lower age-related mortality at advanced stages of chronic kidney disease.

Measuring quality of diabetes care by linking health care system administrative databases with laboratory data

BACKGROUND

Chronic complications of diabetes can be reduced through optimal glycemic and lipid control as evaluated through measurement of glycosylated hemoglobin (A1C) and low-density lipoprotein cholesterol (LDL-C). We aimed to produce measures of quality of diabetes care in Saskatchewan and to identify sub-groups at particular risk of developing complications.

FINDINGS

Prevalent adult cases of diabetes in 2005/06 were identified from administrative databases and linked with A1C and LDL-C tests measured in centralized laboratories. A1C results were performed in 33,927 of 50,713 (66.9%) diabetes cases identified in Saskatchewan, and LDL-C results were performed in 12,031 of 24,207 (49.7%) cases identified within the province's two largest health regions. The target A1C of <= 7.0% and the target LDL-C of <2.5 mmol/L were achieved in 48.3% and 45.1% of diabetes cases respectively. The proportions were lower among those who were female, First Nations, non-urban, younger and in lower income quintiles. The same groups experienced poorer glycemic control (exception females), and poorer lipid control (exception First Nations people). Among non-Aboriginal people, younger diabetic females were least likely to receive lipid lowering agents.

CONCLUSIONS

Linkage of laboratory with administrative data is an effective method of assessing quality of diabetes care on a population basis and to identify sub-groups requiring particular attention. We found that less than 50% of Saskatchewan people with diabetes achieved optimal glycemic and lipid control. Disparities were most evident among First Nations people and young women. The indicators described can be used to provide standardized information that would support quality improvement initiatives.

Spanning the know-do gap: understanding knowledge application and capacity in long-term care homes

Using a multiple case study design, this article explores the translation process that emerges within Ontario long-term care (LTC) homes with the adoption and implementation of evidence-based clinical practice guidelines (CPGs). Within-organization knowledge translation is referred to as knowledge application. We conducted 28 semi-structured interviews with a range of administrative and care staff within 7 homes differentiated by size, profit status, chain membership, and rural/urban location. We further undertook 7 focus groups at 5 locations, involving a total of 35 senior clinical staff representing 15 homes not involved in earlier structured interviews. The knowledge application process that emerges across our participant organizations is highly complex, iterative, and reliant upon a facility's knowledge application capacity, or absorptive capacity to effect change through learning. Knowledge application capacity underpins the emergence of the application process and the advancement of knowledge through it. We find that different elements of capacity are important to different stages of the knowledge application process. Capacity can pre-exist, or can be acquired. The majority of the capacity elements required for successful knowledge application in the LTC contexts we studied were organizational. It is essential for managers and practitioners therefore to conceptualize and orchestrate knowledge application initiatives at the organization level; organizational leaders (including clinical leaders) have a vital role to play in the success of knowledge application processes.

Study protocol for the translating research in elder care (TREC): building context - an organizational monitoring program in long-term care project (project one)

Background

While there is a growing awareness of the importance of organizational context (or the work environment/setting) to successful knowledge translation, and successful knowledge translation to better patient, provider (staff), and system outcomes, little empirical evidence supports these assumptions. Further, little is known about the factors that enhance knowledge translation and better outcomes in residential long-term care facilities, where care has been shown to be suboptimal. The project described in this protocol is one of the two main projects of the larger five-year Translating Research in Elder Care (TREC) program.

Aims

The purpose of this project is to establish the magnitude of the effect of organizational context on knowledge translation, and subsequently on resident, staff (unregulated, regulated, and managerial) and system outcomes in long-term care facilities in the three Canadian Prairie Provinces (Alberta, Saskatchewan, Manitoba).

Methods/Design

This study protocol describes the details of a multi-level – including provinces, regions, facilities, units within facilities, and individuals who receive care (residents) or work (staff) in facilities – and longitudinal (five-year) research project. A stratified random sample of 36 residential long-term care facilities (30 urban and 6 rural) from the Canadian Prairie Provinces will comprise the sample. Caregivers and care managers within these facilities will be asked to complete the TREC survey – a suite of survey instruments designed to assess organizational context and related factors hypothesized to be important to successful knowledge translation and to achieving better resident, staff, and system outcomes. Facility and unit level data will be collected using standardized data collection forms, and resident outcomes using the Resident Assessment Instrument-Minimum Data Set version 2.0 instrument. A variety of analytic techniques will be employed including descriptive analyses, psychometric analyses, multi-level modeling, and mixed-method analyses.

Discussion

Three key challenging areas associated with conducting this project are discussed: sampling, participant recruitment, and sample retention; survey administration (with unregulated caregivers); and the provision of a stable set of study definitions to guide the project.

A review of evidence on the reliability and validity of Minimum Data Set data

This paper reviews the reliability and validity of the Minimum Data Set (MDS) assessment, which is being used increasingly in Canadian nursing homes and continuing care facilities. The central issues that surround the development and implementation of a standardized assessment such as the MDS are presented, including implications for health care managers in how to approach data quality concerns. With other sectors such as home care and inpatient psychiatry using MDS for national reporting, these issues have importance in and beyond residential care management.

Cost and Quality

BACKGROUND

Although both quality and cost are important concerns for long term care (LTC) facility management and policy, the relationship between cost and quality is poorly understood. Such knowledge is necessary to guide facility management and policy action.

OBJECTIVE

We sought to determine the net effect of quality on cost in LTC hospital settings.

STUDY SAMPLE

A 4-year panel dataset from April 1997 through March 2002 comprising observations from 99 LTC hospitals were included in this analysis.

METHODS

We examined the relationship between direct resident costs and 7 indicators of quality for long-stay residents. We used panel data methods to control for unobserved facility-level characteristics.

RESULTS

We found that increases in restraint use and incident pressure/skin ulcers were associated with lower per diem costs, whereas incontinence prevalence was associated with higher per diem costs.

CONCLUSIONS

Our results point to different implications regarding cost and quality for different quality indicators. Although facilities have a strong internal business case to improve quality in incontinence, policy-makers may need to provide financial incentives to encourage reductions in restraint use and incident skin ulcers so as to defray potential higher costs associated with improving quality in these areas.

The contingencies of organizational learning in long-term care: factors that affect innovation adoption

We apply the theoretical frameworks of knowledge transfer and organizational learning, and findings from studies of clinical practice guideline (CPG) implementation in health care, to develop a contingency model of innovation adoption in long-term care (LTC) facilities. Our focus is on a particular type of innovation, CPGs designed to improve the quality of LTC. Our interest in this area is founded on the premise that the ability of LTC organizations to adopt and sustain the use of innovations like CPGs is contingent on the initial capacity these institutions have to learn about them, and on the presence of factors that contribute to capacity building at each stage of innovation adoption. Based on our review of relevant theory, we develop a set of fifteen testable propositions that relate factors operating at the guideline, individual, organizational, and environmental levels in LTC institutions to stages of guideline adoption/transfer. Our model offers insights into the complexities of adopting and sustaining innovations in LTC facilities particularly, in health care organizations specifically, and in service organizations generally.

Skilled nursing facility rehabilitation and discharge to home after stroke

OBJECTIVE

To determine the relation between rehabilitation therapy (RT) intensity and time to discharge home for stroke patients in skilled nursing facilities (SNFs).

DESIGN

Retrospective cohort study. We used regression analyses, stratified by expected outcome, and propensity score adjustment. Setting All SNFs in Ohio, Michigan, and Ontario, Canada.

PARTICIPANTS

A cohort of residents, aged 65 and over, admitted from hospitals to SNFs with a diagnosis of stroke (N=23,824).

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURE

Time to discharge home from an SNF.

RESULTS

RT was given to more than 95% of residents for whom discharge was expected within 90 days and to more than 60% of residents for whom discharge was uncertain or not expected. RT increased the likelihood of discharge to the community for all groups except those expected to be discharged within 30 days. The dose-response relation was strongest for residents with either an uncertain discharge prognosis or no discharge expected.

CONCLUSIONS

Postacute residents with an uncertain prognosis are an important target population for intensive RT.

The MDS-CHESS scale: a new measure to predict mortality in institutionalized older people

OBJECTIVES

To develop a scale predicting mortality and other adverse outcomes associated with frailty.

DESIGN

Observational study based on Minimum Data Set (MDS) 2.0 and mortality data.

SETTING

Ontario chronic hospitals.

PARTICIPANTS

All chronic hospital patients (N = 28,495) assessed with the MDS 2.0 after mandatory implementation in July 1996 followed until May 1999.

MEASUREMENTS

MDS 2.0 assessments done as part of normal practice mainly by registered nurses or multidisciplinary teams in a chronic hospital. Mortality data are available from the accompanying discharge tracking form.

RESULTS

The MDS-Changes in Health, End-stage disease and Symptoms and Signs (CHESS) score is a composite measure addressing changes in health, end-stage disease, and symptoms and signs of medical problems. It is a strong predictor of mortality (P <.0001) independent of the effects of age, sex, activities of daily living impairment, cognition, and do-not-resuscitate orders. It is also strongly associated with physician activity, complex medical procedures, and pain (P <.001 for each dependent variable).

CONCLUSIONS

The CHESS score provides a useful new MDS-based test to predict mortality and to measure instability in health as a clinical outcome.

A new assessment for elders admitted to acute care: reliability of the MDS-AC

Assessment of older people rarely includes functional domains critical for ensuring optimum outcome of treatment in acute hospital care. We report the development of a new assessment instrument, and illustrate how differences between pre-hospital and hospital admission status can be systematically evaluated using the Minimum Data Set for Acute Care (MDS-AC). Content was developed by literature review and consultation with professionals working in acute areas. Dual independent assessments were conducted on hospital in-patients in 4 countries. Inter-assessor reliability coefficients were calculated for each item. Kappa was calculated for all binary and multi-level nominal variables. Quadratically weighted Kappa was estimated for all ordinal multi-level variables. Where one level of the variable contained 90% or more of the subjects, total observed agreement is reported. Separate reliability estimates were calculated for pre-hospitalization and inpatient items. Subjects had a mean age of 78. Completion of pre-hospitalization and hospital period assessment (combined) required 20 and 30 minutes. Excluding items for which 90% or more of subjects were classified into a single scoring level, average inter-assessor reliability coefficient for the pre-hospital period items was 0.57 and for in hospital 0.58. Overall exact agreement was 83% for pre-hospitalization assessment items, and 79% for the in-hospital items. The reliability achieved in the highly unstable situation of the acute admission phase is sufficient for use in clinical care and research. Differences in pre-hospital and admission status necessary for case-mix adjusted comparison of outcomes were illustrated. Development of a means for systematically comparing changes in older people during the course of illness is of increasing importance when addressing questions of the appropriate and inappropriate use of medical technology.

Group-level factors associated with chemotherapeutic treatment regimens in land-based trout farms in Ontario, Canada

The lowest level at which fish farmers ordinarily make management decisions is the individual holding unit. To identify factors associated with chemotherapeutic treatment initiation at the holding-unit level, we created a unit of measurement called the "farm-tank-lot" (FTL), which allowed the movements and mixing of groups of fish to be followed during an entire production cycle. Each FTL was comprised of fish with a common history housed in a specific holding unit. Our 21-month prospective observational study (conducted on 14 land-based trout farms in Ontario, Canada) showed that the FTL was a biologically meaningful unit of concern and a feasible unit of measurement on land-based trout farms.Multivariable logistic and Poisson regressions revealed that fish size and growth rate both were associated negatively with the probability and frequency of treatment. FTLs that existed for longer periods of time were more likely to be treated and treated more often. There was a significant farm effect. Future field studies of disease in cultured fish should incorporate these factors into their design and analysis.

The relationship between E. coli indicator bacteria in well-water and gastrointestinal illnesses in rural families

OBJECTIVES

To determine the relationship between consumption of E. coli contaminated well-water and gastrointestinal illness in rural families.

METHODS

One hundred and eighty-one families with well-water as a drinking source participated in a one-year follow-up study. Water was tested for E. coli bacteria and health outcomes were monitored for house-hold members.

RESULTS

E. coli in well-water was significantly associated with gastrointestinal illness in family members, however the relationship was modified by the distance from the septic tank to the well. E. coli had an odds ratio of 2.16 [95% CI 1.04, 4.42] if the septic tank was greater than 20 metres from the well and 0.46 [95% CI 0.07, 2.95] if the septic tank was within 20 metres.

CONCLUSIONS

Consumption of contaminated well-water is associated with gastrointestinal illness. E. coli can be a useful marker for detecting wells that pose a potential public health problem in rural areas.

The relationship between E. coli indicator bacteria in well-water and gastrointestinal illnesses in rural families

OBJECTIVES

To determine the relationship between consumption of E. coli contaminated well-water and gastrointestinal illness in rural families.

METHODS

One hundred and eighty-one families with well-water as a drinking source participated in a one-year follow-up study. Water was tested for E. coli bacteria and health outcomes were monitored for house-hold members.

RESULTS

E. coli in well-water was significantly associated with gastrointestinal illness in family members, however the relationship was modified by the distance from the septic tank to the well. E. coli had an odds ratio of 2.16 [95% CI 1.04, 4.42] if the septic tank was greater than 20 metres from the well and 0.46 [95% CI 0.07, 2.95] if the septic tank was within 20 metres.

CONCLUSIONS

Consumption of contaminated well-water is associated with gastrointestinal illness. E. coli can be a useful marker for detecting wells that pose a potential public health problem in rural areas.

Long-term tracking of lymphocytes in vivo: the migration of PKH-labeled lymphocytes

Studies of in vivo cell migration using cell markers such as 51Cr, 111In, FITC, or XRITC have been limited to short time periods due to the elution, toxicity, or rapid loss of label detectability. We have labeled sheep lymphocytes in vitro with PKH-2, a new fluorescent cell membrane label, and, after their intravenous injection back into donor sheep, have been able to detect them in efferent lymph, using flow cytometry, for longer than 38 days. The PKH-2-labeled lymphocytes migrated with similar kinetics, efficiency, and tissue specificity as lymphocytes labeled with cell markers used previously. PKH-2-labeled cells mediated graft versus host reactions indistinguishable from those mediated by unlabeled cells, and cell surface antigens were equally detectable on the surface of labeled and unlabeled lymphocytes. According to the slow, consistent loss of fluorescence intensity of the labeled cells in vivo, we predict that labeled lymphocytes could remain detectable by flow cytometry for greater than 7 weeks with the labeling protocol used in these experiments.

The relevance of lymphoid cell migration to immunodeficiency syndromes

It has been known for some time that antigen stimulation can alter lymphocyte traffic patterns and that viruses are particularly potent in this respect; such alterations may be a consequence of host-derived factors. The retention of lymphocytes in lymph nodes can be sustained for several hours with locally administered interferon (IFN)alpha. The extravasation of lymphocytes from blood into non-lymphoid tissues can be induced in the skin with IFN gamma and particularly tumor necrosis factor (TNF)alpha. Recent evidence supports the concept that the migratory capacity of CD4+ cells differs from the capacity of CD8+ cells. Agents (cytokines?) which differentially affect the traffic of these two sub-sets have not yet been described but such a possibility has not been adequately tested. Several new molecules have been defined which alter the interactions between lymphocytes and blood vascular endothelial cells, and these may be important in the critical adhesive event in lymphocyte traffic. In both rat and sheep, it has been possible to cultivate post-capillary endothelial cells from lymphoid tissue, and this may be a helpful approach to studying the mechanisms and molecules involved in adhesion. New cell tracking dyes recently available (Zynaxis Cell Science) permit more significant, long-term studies on the life span of lymphocyte sub-sets and their migratory status. In our experiments, labeled lymphocytes can be followed in vivo for over 30 days. Traffic alterations may explain some of the abnormalities in immunodeficiency states.