Does nonresponse bias the results of retrospective surveys of end-of-life care?

Understanding end-of-life doula care provision: reporting on the design of a bereavement survey to evaluate doula support

Background

Delivery of consistent patient-centred care at end-of-life care continues to challenge healthcare providers and research continues to suggest that peoples' needs are not being reliably met. Consequently, healthcare services are looking to innovate how support is provided, such as commissioning doulas to support dying people and those close to them.

Objective

Within the United Kingdom, there is little existing research about peoples' experience of receiving end-of-life doula support. This paper outlines the design of a survey for the family or friends of a person who received end-of-life doula support.

Design

To evaluate the role of an end-of-life doula in supporting the dying person and those who care for them, we designed a post-bereavement survey as part of a wider evaluation strategy of doula services. Following multiple literature reviews and an iterative process of consulting with the professional organisation and previous service users, a questionnaire was developed to collect this data. This survey is hosted online, with paper copies available to widen accessibility.

Conclusion

End-of-life doula support is a relatively new area of provision for dying people and those important to them, such as family and friends. It is even more innovative to have doula support commissioned as part of a locality's healthcare service. There is a dire need for empirical research to understand the impact of this further. The process of researching the area and designing the evaluation survey for this service revealed the complexity of the role and the difficulty of capturing what was found to be helpful for the dying person and those around them.

Effects of Caregiver and Decedent Characteristics on CAHPS Hospice Survey Scores

CONTEXT

The Consumer Assessment of Healthcare Providers and Systems (CAHPS^®) Hospice Survey assesses the care experiences of hospice patients and their families. Public reporting of hospice performance on these survey measures began in February 2018.

OBJECTIVES

Develop an appropriate case-mix adjustment (CMA) model to allow for fair comparisons between hospices.

METHODS

We analyzed CAHPS Hospice Survey data reflecting experiences of 915,442 patients who received care from 2513 hospice programs between April 2015 and March 2016. Decedent and caregiver characteristics were identified for inclusion in CMA based on their variation across hospices (as measured by intraclass correlation coefficients [ICCs]) and how predictive they were of responses to survey questions (as assessed by linear regression).

RESULTS

The final CMA model included decedent age, payer for hospice care, primary diagnosis, length of final episode of hospice care, caregiver age, caregiver education, relationship to decedent, survey language/language spoken at home, and response percentile. The characteristics that varied most across hospices were language (ICC = 0.48 for Spanish survey or home language) and payer for hospice care (ICC = 0.42 for Medicare only; ICC = 0.35 for Medicare and private insurance). The characteristics that were most predictive of caregivers' survey responses were payer for hospice care, caregiver education, and survey language/language spoken at home. Lack of appropriate adjustment would incorrectly rank hospices by 1.2-5.4 percentile points.

CONCLUSION

To ensure fair comparisons across hospices, CAHPS Hospice Survey measure scores should be adjusted for several caregiver and decedent characteristics.

Associations between Timing of Palliative Care Consults and Family Evaluation of Care for Veterans Who Die in a Hospice/Palliative Care Unit

BACKGROUND

Palliative care consultations (PCC) improve end-of-life (EOL) care, although they may occur too late in an illness to effect the best outcomes. Evidence about the optimal timing of PCC is limited.

OBJECTIVE

To examine the associations between PCC timing and bereaved families' evaluation of care.

METHODS

A retrospective, cross-sectional analysis of data collected between October 2011 and September 2014 was conducted with 5,592 patients who died in a Veterans Affairs inpatient hospice/palliative care unit. The independent measure was the date of first documented PCC within 180 days of death. Outcomes came from the validated Bereaved Family Survey (BFS) and included one global and three subscale scores characterizing EOL care in the last month of life.

RESULTS

After adjustment for patient and facility characteristics, family members of veterans whose first PCC occurred 91-180 days before death were more likely to rate overall care as "excellent" compared with those whose PCC occurred 0-7 days before death, 67.9% versus 62.1%, respectively (adjusted odds ratio = 1.37; confidence interval [95% CI] 1.08-1.73). Mean scores on two of the three subscales also were significantly higher for veterans receiving PCC 31-90 days before the veteran's death compared with those who had their first PCC 0-7 days before death: Respectful Care and Communication, 13.6 versus 13.4, respectively (β = 0.26; 95% CI 0.11-0.41), and Emotional and Spiritual Support, 7.6 versus 7.4, respectively (β = 0.22; 95% CI 0.03-0.41).

CONCLUSIONS

Earlier PCC is associated with greater family satisfaction with care. Strategies that are aimed at conducting PCC earlier in life-limiting illness are needed.

Does Mode of Survey Administration Matter? Using Measurement Invariance to Validate the Mail and Telephone Versions of the Bereaved Family Survey

CONTEXT

The Veterans Health Administration evaluates outcomes of end-of-life (EOL) care using the Bereaved Family Survey (BFS). Originally, the BFS was administered as a telephone survey but was transitioned to a mail survey beginning October 2012. The transition necessitated an evaluation of the tool's validity using this new mode of administration.

OBJECTIVES

The objective of this study was to validate the mail version and to test for measurement invariance (MI) across the two administration modes.

METHODS

Telephone and mail versions of the BFS were validated separately between October 2009 and September 2013. MI was evaluated using a series of confirmatory factor analyses (CFAs). Construct validity was evaluated by calculating Cronbach alpha coefficients and examining differences between BFS factor scores for groups with and without quality care indicators (e.g., receipt of a palliative care consult).

RESULTS

Our sample consisted of 35,682 decedent BFS scores (27,109 telephone surveys; 8573 mail surveys). BFS item scores were slightly skewed, with a predominance of higher scores for both the telephone and mail version. The average missing rate for each BFS item was minimal, just 2% for each version. The CFA models demonstrated dimensional, configural, metric, and factor mean invariance across administration modes. BFS factor scores were consistently higher when a patient received EOL quality care indicators regardless of mode of administration.

CONCLUSION

These findings demonstrate the MI and robust psychometric properties for the BFS across administration modes.

Factors Associated with Participation, Active Refusals and Reasons for Not Taking Part in a Mortality Followback Survey Evaluating End-of-Life Care

BACKGROUND

Examination of factors independently associated with participation in mortality followback surveys is rare, even though these surveys are frequently used to evaluate end-of-life care. We aimed to identify factors associated with 1) participation versus non-participation and 2) provision of an active refusal versus a silent refusal; and systematically examine reasons for refusal in a population-based mortality followback survey.

METHODS

Postal survey about the end-of-life care received by 1516 people who died from cancer (aged ≥18), identified through death registrations in London, England (response rate 39.3%). The informant of death (a relative in 95.3% of cases) was contacted 4-10 months after the patient died. We used multivariate logistic regression to identify factors associated with participation/active refusals and content analysis to examine refusal reasons provided by 205 nonparticipants.

FINDINGS

The odds of partaking were higher for patients aged 90+ (AOR 3.48, 95%CI: 1.52-8.00, ref: 20-49yrs) and female informants (AOR 1.70, 95%CI: 1.33-2.16). Odds were lower for hospital deaths (AOR 0.62, 95%CI: 0.46-0.84, ref: home) and proxies other than spouses/partners (AORs 0.28 to 0.57). Proxies of patients born overseas were less likely to provide an active refusal (AOR 0.49; 95% CI: 0.32-0.77). Refusal reasons were often multidimensional, most commonly study-related (36.0%), proxy-related and grief-related (25.1% each). One limitation of this analysis is the large number of nonparticipants who did not provide reasons for refusal (715/920).

CONCLUSIONS

Our survey better reached proxies of older patients while those dying in hospitals were underrepresented. Proxy characteristics played a role, with higher participation from women and spouses/partners. More information is needed about the care received by underrepresented groups. Study design improvements may guide future questionnaire development and help develop strategies to increase response rates.

Exploring End-of-Life Care in Veterans Affairs Community Living Centers

OBJECTIVES

To compare quality of end-of-life (EOL) care indicators and family evaluation of care in community living centers (CLCs) with that of EOL care in acute, intensive, and hospice and palliative care units.

DESIGN

Retrospective chart review and survey with next of kin of recently deceased inpatients.

SETTING

Inpatient Veterans Affairs (VA) Medical Centers (N = 145), including 132 CLCs, across the United States.

PARTICIPANTS

The chart review included all individuals who died in VA inpatient units (n = 57,397). Family survey results included data for 33,497 veterans.

MEASUREMENTS

Indicators of optimal EOL care: palliative consultation in the last 90 days of life, contact with a chaplain, family contact with a chaplain, and emotional support given to family after death. The main outcome was a single Bereaved Family Survey item in which respondents provided a global evaluation of quality of EOL care (excellent to very good, good, fair to poor).

RESULTS

Family evaluations of overall EOL care and quality of EOL care indicators for veterans who died in CLCs were better than those of veterans dying in acute or intensive care units but worse than those dying in hospice or palliative care units.

CONCLUSION

Care in CLCs can be enhanced through the integration of palliative care practices. Future research should identify critical elements of enhancing EOL care in nursing homes.

Organization of nursing and quality of care for veterans at the end of life

CONTEXT

The Veterans Health Administration (VA) has improved the quality of end-of-life (EOL) care over the past several years. Several structural and process variables are associated with better outcomes. Little is known, however, about the relationship between the organization of nursing care and EOL outcomes.

OBJECTIVES

To examine the association between the organization of nursing care, including the nurse work environment and nurse staffing levels, and quality of EOL care in VA acute care facilities.

METHODS

Secondary analysis of linked data from the Bereaved Family Survey (BFS), electronic medical record, administrative data, and the VA Nursing Outcomes Database. The sample included 4908 veterans who died in one of 116 VA acute care facilities nationally between October 2010 and September 2011. Unadjusted and adjusted generalized estimating equations were used to examine associations between nursing and BFS outcomes.

RESULTS

BFS respondents were 17% more likely to give an excellent overall rating of the quality of EOL care received by the veteran in facilities with better nurse work environments (P ≤ 0.05). The nurse work environment also was a significant predictor of providers listening to concerns and providing desired treatments. Nurse staffing was significantly associated with an excellent overall rating, alerting of the family before death, attention to personal care needs, and the provision of emotional support after the patient's death.

CONCLUSION

Improvement of the nurse work environment and nurse staffing in VA acute care facilities may result in enhanced quality of care received by hospitalized veterans at the EOL.

Family involvement at the end-of-life and receipt of quality care

CONTEXT

Most patients will lose decision-making capacity at the end of life. Little is known about the quality of care received by patients who have family involved in their care.

OBJECTIVES

To evaluate differences in the receipt of quality end-of-life care for patients who died with and without family involvement.

METHODS

We retrospectively reviewed the charts of 34,290 decedents from 146 acute and long-term care Veterans Affairs facilities between 2010 and 2011. Outcomes included: (1) palliative care consult, (2) chaplain visit, and 3) death in an inpatient hospice or palliative care unit. We also assessed "do not resuscitate" (DNR) orders. Family involvement was defined as documented discussions with the health care team in the last month of life. We used logistic regression adjusted for demographics, comorbidity, and clustered by facility. For chaplain visit, hospice or palliative care unit death, and DNR, we additionally adjusted for palliative care consults.

RESULTS

Mean (SD) age was 74 (±12) years, 98% were men, and 19% were nonwhite. Most decedents (94.2%) had involved family. Veterans with involved family were more likely to have had a palliative care consult, adjusted odds ratio (AOR) 4.31 (95% CI 3.90-4.76); a chaplain visit, AOR 1.18 (95% CI 1.07-1.31); and a DNR order, AOR 4.59 (95% CI 4.08-5.16) but not more likely to die in a hospice or palliative care unit.

CONCLUSION

Family involvement at the end of life is associated with receipt of palliative care consultation and a chaplain visit and a higher likelihood of a DNR order. Clinicians should support early advance care planning for vulnerable patients who may lack family or friends.

Feasibility of assessing quality of care at the end of life in two cluster trials using an after-death approach with multiple assessments

BACKGROUND

In 2009 two randomised cluster trials took place to assess the introduction of the Italian Version of the Liverpool Care Pathway in hospitals and hospices. Before and after data were gathered. The primary aim of this study is to evaluate the feasibility of using a combination of assessment methods aimed at different proxy respondents to create a means of measuring quality of care at the end of life. We also aim to explore whether there are differences in response to this approach between the hospice and hospital inpatient settings.

METHODS

A retrospective design was used. Eligible deaths were traced through death registries, and proxies were used to give information. Four procedures of assessment were used to measure different dimensions. Feasibility was assessed through compliance and adherence to the study instruments, and measured against standards derived from previous after-death studies. The proxy caregiver's rating of the study tools was also measured, to gauge feasibility and effectiveness. All consecutive cancer deaths that occurred in the study period were eligible. In both trials, deaths were excluded if the patient was a relative of hospital/hospice staff. 145 patients were recruited from the Hospital setting, and 127 from Hospice.

RESULTS

A high proportion of non-professional caregivers were interviewed - in both hospital (76.6%) and hospice (74.8%). There was no significant difference in the median number of days in each setting. 89.0% of hospital patients' GPs and 85.0% of hospice patients' GPs were interviewed. Care procedures were recorded in all hospice cases, and were missing in only 1 hospital case.52.7% of Hospital patients' relatives and 64.12% Hospice relatives were assessed to have been caused a low level of distress through the study.

CONCLUSIONS

The data shows high levels of compliance and adherence to the study instruments. This suggests that this approach to assessing quality of care is feasible, and this coupled with low levels of distress caused by the study instruments suggest effectiveness. There were no substantial differences between the hospice and hospital settings.

A nationwide study comparing end-of-life care for men and women veterans

BACKGROUND

The quality of end-of-life (EOL) care at Veterans Affairs Medical Centers (VAMC) has improved. To date, however, the quality and outcomes of end-of-life care delivered to women veterans have not been examined.

OBJECTIVE

The goal of this study was to evaluate gender differences in the quality of EOL care received by patients in VAMCs nationwide.

DESIGN

The study was conducted via retrospective medical chart review and telephone survey with next of kin of recently deceased inpatients.

SETTING/SUBJECTS

The chart review included records for all patients who died in acute and long-term care units in 145 VAMCs nationwide (n=36,618). For the survey, the documented next of kin were invited to respond on behalf of the deceased veteran; a total of 25,638 next of kin completed the survey.

MEASUREMENTS

Chart review measures included five indicators of optimal end-of-life care. Bereaved family survey items included one global and nine specific items (e.g., bereavement care, pain management) describing care in the last month of life.

RESULTS

Receipt of optimal end-of-life care did not differ significantly between women and men with respect to frequency of discussion of treatment goals with a family member, receipt of palliative consult, bereavement contact, and chaplain contact with a family member. Family members of women were more likely than those of men to report that the overall care provided to the veteran had been "excellent" (adjusted proportions: 63% versus 56%; odds ratio (OR)=1.33; 95% confidence interval (CI) 1.10-1.61; p=0.003).

CONCLUSIONS

In this nationwide study of all inpatient deaths in VAMCs, women received comparable and on some metrics better quality EOL care than that received by male patients.

Second-stage non-response in the Swiss health survey: determinants and bias in outcomes

Background

Unit non-response occurs in sample surveys when a target subject does not respond to a survey. Potential implications are decreased power, increased standard error, and non-response bias. The objective of this study was to assess the factors associated with participation in a written survey (MSHS) of subjects who had previously participated in the Swiss Health Survey (SHS) and to evaluate to what extent non-participation could impact the estimation of various MSHS health outcomes.

Methods

Multivariate logistic regression was used to assess the factors associated with MSHS participation (n=14,393) by eligible SHS participants (n=17,931). Crude participation rates and the adjusted odds ratios of participation (OR) were reported. In order to report potential bias in MSHS outcomes, the average age-standardized and sex-specific outcome values in non-participants were predicted based on several different linear regression models which had been previously fitted on MSHS participants.

Results

Adjusting for all other variables, women (OR=1.63) as compared with men, subjects with a secondary (OR=1.48) or tertiary education (OR=1.76) as compared with those with primary education, white-collar workers (high level non-manual workers OR=1.29, medium and low level non-manual workers OR=1.26 and OR=1.25 respectively) as compared with unskilled manual workers, Swiss nationals (OR=1.60) as compared to non-Swiss, and subjects with very good or good self-rated health (OR=1.35) were more likely to participate in the MSHS. People who work full-time were less likely to participate than those without paid work (OR=0.76). There were no statistically significant differences in the likelihood of participation between rural and urban areas, different geographic regions of Switzerland and household income quartiles.

Except for myocardial infarction, all age-standardized and sex-specific average outcomes (influenza vaccination, arthrosis, osteoporosis, high blood pressure, depression, mastery, and sense of coherence) were significantly different between MSHS non-participants and participants.

Conclusions

Subjects who participated in the MSHS had a higher socio-economic status, reported a better subjective health, and were more likely to be Swiss nationals. Small to moderate bias was found for most age-adjusted and sex-specific average outcomes. Consequently, these MSHS outcomes should be used and interpreted with care.