The Kaiser Permanente Research Bank Cancer Cohort: a collaborative resource to improve cancer care and survivorship

Background

The Kaiser Permanente Research Bank (KPRB) is collecting biospecimens and surveys linked to electronic health records (EHR) from approximately 400,000 adult KP members. Within the KPRB, we developed a Cancer Cohort to address issues related to cancer survival, and to understand how genetic, lifestyle and environmental factors impact cancer treatment, treatment sequelae, and prognosis. We describe the Cancer Cohort design and implementation, describe cohort characteristics after 5 years of enrollment, and discuss future directions.

Methods

Cancer cases are identified using rapid case ascertainment algorithms, linkage to regional or central tumor registries, and direct outreach to KP members with a history of cancer. Enrollment is primarily through email invitation. Participants complete a consent form, survey, and donate a blood or saliva sample. All cancer types are included.

Results

As of December 31, 2020, the cohort included 65,225 cases (56% female, 44% male) verified in tumor registries. The largest group was diagnosed between 60 and 69 years of age (31%) and are non-Hispanic White (83%); however, 10,076 (16%) were diagnosed at ages 18–49 years, 4208 (7%) are Hispanic, 3393 (5%) are Asian, and 2389 (4%) are Black. The median survival time is 14 years. Biospecimens are available on 98% of the cohort.

Conclusions

The KPRB Cancer Cohort is designed to improve our understanding of treatment efficacy and factors that contribute to long-term cancer survival. The cohort’s diversity - with respect to age, race/ethnicity and geographic location - will facilitate research on factors that contribute to cancer survival disparities.

Abstract PO-178: The Kaiser Permanente Research Bank cancer cohort: A diverse resource to improve cancer care

Kaiser Permanente (KP) is an ideal environment to study the spectrum of cancer prevention and control because it provides comprehensive cancer care to a large and diverse community. The Kaiser Permanente Research Bank (KPRB) is collecting biospecimens and a survey of health-related behaviors and other risk factors from about 400,000 adults aged 18 years and older across all eight KP regions. The KPRB includes a cancer cohort and cases are identified from KP region-specific algorithms designed to identify cancer cases within days of diagnosis, and from linkage with regional tumor registries. KPRB participation involves completing an online informed consent and survey, and providing a blood or saliva sample. KPRB participants consent to linkage to their electronic health record (EHR), which includes comprehensive information about cancer screening, diagnosis and treatment. A key strength of this cohort is its diversity with respect to age, race/ethnicity, and geographic location (Hawai’i, Oregon, Washington state, California, Colorado, Georgia, and the Washington, DC area). To date, the KPRB includes 68,000 cancer cases, 56% are women, and 30% are non-white. Over 8,500 cases were diagnosed before the age of 50 and the cohort includes substantial numbers of cancer cases among Asian and Pacific Islanders (n=8,941), Hispanics (n=7,678), and non-Hispanic blacks (n=5,367). Although all cohort members have insurance, and thus, presumably access to care, we observed disparities in stage at diagnosis. Compared to non- Hispanic whites, non-Hispanic Blacks are more likely to be diagnosed at stage 4 (5% versus 16%, respectively, of all cases); participants describing themselves as multi- racial or “other” race similarly have a very high proportion (25%) of cases diagnosed at stage 4. Research is planned to examine the factors associated with this disparity. The extensive EHR, access to stored tissue specimens, detailed treatment data, and ability to follow patients over time for recurrence and mortality make the KPRB Cancer Cohort an exceptional resource for exploring the factors that contribute to cancer etiology, progression, and survival. We invite investigators to apply to use the KPRB (https://researchbank.kaiserpermanente.org/) to accelerate progress toward improving cancer care.

Citation Format: Heather S. Feigelson, Christina Clarke, Andrea Burnett- Hartman, Stephen Van Den Eeden, Sheila Weinmann, Monica Ter-Minassian, Stacey Honda, Deborah Young, Aruna Kamineni, Sarah Rowell, Alan Bauck, Elizabeth McGlynn. The Kaiser Permanente Research Bank cancer cohort: A diverse resource to improve cancer care [abstract]. In: Proceedings of the AACR Virtual Conference: Thirteenth AACR Conference on the Science of Cancer Health Disparities in Racial/Ethnic Minorities and the Medically Underserved; 2020 Oct 2-4. Philadelphia (PA): AACR; Cancer Epidemiol Biomarkers Prev 2020;29(12 Suppl):Abstract nr PO-178.

Pragmatic (trial) informatics: a perspective from the NIH Health Care Systems Research Collaboratory

Pragmatic clinical trials (PCTs) are research investigations embedded in health care settings designed to increase the efficiency of research and its relevance to clinical practice. The Health Care Systems Research Collaboratory, initiated by the National Institutes of Health Common Fund in 2010, is a pioneering cooperative aimed at identifying and overcoming operational challenges to pragmatic research. Drawing from our experience, we present 4 broad categories of informatics-related challenges: (1) using clinical data for research, (2) integrating data from heterogeneous systems, (3) using electronic health records to support intervention delivery or health system change, and (4) assessing and improving data capture to define study populations and outcomes. These challenges impact the validity, reliability, and integrity of PCTs. Achieving the full potential of PCTs and a learning health system will require meaningful partnerships between health system leadership and operations, and federally driven standards and policies to ensure that future electronic health record systems have the flexibility to support research.

The impact of continued intervention on weight: Five-year results from the weight loss maintenance trial

OBJECTIVE

In the Weight Loss Maintenance (WLM) Trial, a personal contact (PC) intervention sustained greater weight loss relative to a self-directed (SD) group over 30 months. This study investigated the effects of continued intervention over an additional 30 months and overall weight change across the entire WLM Trial.

METHODS

WLM had 3 phases. Phase 1 was a 6-month weight loss program. In Phase 2, those who lost ≥4 kg were randomized to a 30-month maintenance trial. In Phase 3, PC participants (n = 196, three sites) were re-randomized to no further intervention (PC-Control) or continued intervention (PC-Active) for 30 more months; 218 SD participants were also followed.

RESULTS

During Phase 3, weight increased 1.0 kg in PC-Active and 0.5 kg in PC-Control (mean difference 0.6 kg; 95% CI:-1.4 to 2.7; P = 0.54). Mean weight change over the entire study was -3.2 kg in those originally assigned to PC (PC-Combined) and -1.6 kg in SD (mean difference -1.6 kg; 95% CI:-3.0 to -0.1; P = 0.04).

CONCLUSIONS

After 30 months of the PC maintenance intervention, continuation for another 30 months provided no additional benefit. However, across the entire study, weight loss was slightly greater in those originally assigned to PC.

Preparing for the ICD-10-CM Transition: Automated Methods for Translating ICD Codes in Clinical Phenotype Definitions

Background:

The national mandate for health systems to transition from ICD-9-CM to ICD-10-CM in October 2015 has an impact on research activities. Clinical phenotypes defined by ICD-9-CM codes need to be converted to ICD-10-CM, which has nearly four times more codes and a very different structure than ICD-9-CM.

Methods:

We used the Centers for Medicare & Medicaid Services (CMS) General Equivalent Maps (GEMs) to translate, using four different methods, condition-specific ICD-9-CM code sets used for pragmatic trials (n=32) into ICD-10-CM. We calculated the recall, precision, and F score of each method. We also used the ICD-9-CM and ICD-10-CM value sets defined for electronic quality measure as an additional evaluation of the mapping methods.

Results:

The forward-backward mapping (FBM) method had higher precision, recall and F-score metrics than simple forward mapping (SFM). The more aggressive secondary (SM) and tertiary mapping (TM) methods resulted in higher recall but lower precision. For clinical phenotype definition, FBM was the best (F=0.67), but was close to SM (F=0.62) and TM (F=0.60), judging on the F-scores alone. The overall difference between the four methods was statistically significant (one-way ANOVA, F=5.749, p=0.001). However, pairwise comparisons between FBM, SM, and TM did not reach statistical significance. A similar trend was found for the quality measure value sets.

Discussion:

The optimal method for using the GEMs depends on the relative importance of recall versus precision for a given use case. It appears that for clinically distinct and homogenous conditions, the recall of FBM is sufficient. The performance of all mapping methods was lower for heterogeneous conditions. Since code sets used for phenotype definition and quality measurement can be very similar, there is a possibility of cross-fertilization between the two activities.

Conclusion:

Different mapping approaches yield different collections of ICD-10-CM codes. All methods require some level of human validation.

Developing a data infrastructure for a learning health system: the PORTAL network

The Kaiser Permanente & Strategic Partners Patient Outcomes Research To Advance Learning (PORTAL) network engages four healthcare delivery systems (Kaiser Permanente, Group Health Cooperative, HealthPartners, and Denver Health) and their affiliated research centers to create a new national network infrastructure that builds on existing relationships among these institutions. PORTAL is enhancing its current capabilities by expanding the scope of the common data model, paying particular attention to incorporating patient-reported data more systematically, implementing new multi-site data governance procedures, and integrating the PCORnet PopMedNet platform across our research centers. PORTAL is partnering with clinical research and patient experts to create cohorts of patients with a common diagnosis (colorectal cancer), a rare diagnosis (adolescents and adults with severe congenital heart disease), and adults who are overweight or obese, including those with pre-diabetes or diabetes, to conduct large-scale observational comparative effectiveness research and pragmatic clinical trials across diverse clinical care settings.

Self-reported health and functional status information improves prediction of inpatient admissions and costs

OBJECTIVES

To determine whether adding selfreported health and functional status data to a diagnostic risk-score model explains additional variance in predicting inpatient admissions and costs.

STUDY DESIGN

Retrospective observational analysis.

METHODS

We used data from a Health Status Questionnaire (HSQ), completed by 6407 Kaiser Permanente Northwest Medicare patients between December 2006 and October 2008. We used answers from 3 items on the HSQ: (1) General Self-rated Health score, (2) needing help with 1 or more activities of daily living, and (3) having a bothersome health condition. We calculated a DxCG relative risk score from utilization information in the year prior to the survey, using electronic medical records. We compared: (1) DxCG as the sole independent variable and (2) DxCG plus the 3 items as independent variables. We estimated area under the curve (AUC) for each model. Any inpatient admission (yes/no) and being in the top 10% of costs (in the year after survey) were the dependent variables for the first and second logistic regression models, respectively.

RESULTS

The 3 items explained an additional 2.8% and 4.0% of variance for inpatient admissions and top 10% of costs,respectively, in addition to the variance explained by the DxCG score alone. For DxCG alone, the AUC was 0.686 (95% confidence interval [CI] 0.663-0.710) and 0.741 (95% CI 0.719- 0.764), respectively, for inpatient admissions and top 10% of costs and improved to 0.709 (95% CI 0.687-0.730) and 0.770 (95% CI 0.749-0.790) when the 3 self-reported items were added.

CONCLUSIONS

Using self-reported health information improved the predictive power of a DxCG model to forecast inpatient admissions and patient cost-tier.

Development and Implementation of a Tailored Self-assessment Tool in an Internet-based Weight Loss Maintenance Program

BACKGROUND

Using the Internet to replicate client/counselor interactions provides a tremendous opportunity to disseminate interventions at relatively low cost per participant. However, there are substantial challenges with this approach. The Weight Loss Maintenance Trial (WLM) compared two long-term weight-maintenance interventions: (1) a personal contact arm and (2) an Internet arm, to a third self-directed control arm. The Internet arm focused on use of an interactive website for support of long-term weight maintenance. This paper describes a highly interactive self-assessment tool developed for use in the WLM trial Internet intervention arm.

METHODS

The Tailored Self-Assessment (TSA) website tool was an interactive resource for those WLM participants assigned to the Internet arm to review their personal weight-management progress and make choices about future weight-management actions. The TSA was highly tailored and ended with a suggested list of personalized action plans. While the participant could complete the TSA at any time, criteria-based reminder messages prompted participation.

RESULTS

The TSA was one of 27 interactive tools on the WLM website. Over the course of the 28 months, the TSA was completed 800 times by the 348 randomized participants. Fifty-three percent of the participants (185/348) used the TSA at least once (range: 0, 110) and 72% of the 185 participants who did complete the TSA at least once, completed it more than once.

CONCLUSION

The Internet has great potential to impact health behavior by attempting to replicate personal counseling. We learned that while development is complex and appears costly, tailored strategies based on client feedback are likely worthwhile and should be formally tested.

Associations of internet website use with weight change in a long-term weight loss maintenance program

Background

The Weight Loss Maintenance Trial (WLM) compared two long-term weight-maintenance interventions, a personal contact arm and an Internet arm, with a no-treatment control after an initial six-month Phase I weight loss program. The Internet arm focused on use of an interactive website for support of long-term weight maintenance. There is limited information about patterns of website use and specific components of an interactive website that might help promote maintenance of weight loss.

Objective

This paper presents a secondary analysis of the subset of participants in the Internet arm and focuses on website use patterns and features associated with long-term weight maintenance.

Methods

Adults at risk for cardiovascular disease (CVD) who lost at least 4 kilograms in an initial 20-week group-based, behavioral weight-loss program were trained to use an interactive website for weight loss maintenance. Of the 348 participants, 37% were male and 38% were African American. Mean weight loss was 8.6 kilograms. Participants were encouraged to log in at least weekly and enter a current weight for the 30-month study period. The website contained features that encouraged setting short-term goals, creating action plans, and reinforcing self-management habits. The website also included motivational modules, daily tips, and tailored messages. Based on log-in and weight-entry frequency, we divided participants into three website use categories: consistent, some, and minimal.

Results

Participants in the consistent user group (n = 212) were more likely to be older (P = .002), other than African American (P = .02), and more educated (P = .01). While there was no significant difference between website use categories in the amount of Phase I change in body weight (P = .45) or income (P = .78), minimal website users (n = 75) were significantly more likely to have attended fewer Phase I sessions (P = .001) and had a higher initial body mass index (BMI) (P < .001). After adjusting for baseline characteristics including initial BMI, variables most associated with less weight regain included: number of log-ins (P = .001), minutes on the website (P < .001), number of weight entries (P = .002), number of exercise entries (P < .001), and sessions with additional use of website features after weight entry (P = .002).

Conclusion

Participants defined as consistent website users of an interactive behavioral website designed to promote maintenance of weight loss were more successful at maintaining long-term weight loss.

Trial Registration

NCT00054925; http://clinicaltrials.gov/ct2/show/NCT00054925 (Archived by WebCite at http://www.webcitation.org/5rC7523ue)

Comparison of strategies for sustaining weight loss: the weight loss maintenance randomized controlled trial

CONTEXT

Behavioral weight loss interventions achieve short-term success, but re-gain is common.

OBJECTIVE

To compare 2 weight loss maintenance interventions with a self-directed control group.

DESIGN, SETTING, AND PARTICIPANTS

Two-phase trial in which 1032 overweight or obese adults (38% African American, 63% women) with hypertension, dyslipidemia, or both who had lost at least 4 kg during a 6-month weight loss program (phase 1) were randomized to a weight-loss maintenance intervention (phase 2). Enrollment at 4 academic centers occurred August 2003-July 2004 and randomization, February-December 2004. Data collection was completed in June 2007.

INTERVENTIONS

After the phase 1 weight-loss program, participants were randomized to one of the following groups for 30 months: monthly personal contact, unlimited access to an interactive technology-based intervention, or self-directed control. Main Outcome Changes in weight from randomization.

RESULTS

Mean entry weight was 96.7 kg. During the initial 6-month program, mean weight loss was 8.5 kg. After randomization, weight regain occurred. Participants in the personal-contact group regained less weight (4.0 kg) than those in the self-directed group (5.5 kg; mean difference at 30 months, -1.5 kg; 95% confidence interval [CI], -2.4 to -0.6 kg; P = .001). At 30 months, weight regain did not differ between the interactive technology-based (5.2 kg) and self-directed groups (5.5 kg; mean difference -0.3 kg; 95% CI, -1.2 to 0.6 kg; P = .51); however, weight regain was lower in the interactive technology-based than in the self-directed group at 18 months (mean difference, -1.1 kg; 95% CI, -1.9 to -0.4 kg; P = .003) and at 24 months (mean difference, -0.9 kg; 95% CI, -1.7 to -0.02 kg; P = .04). At 30 months, the difference between the personal-contact and interactive technology-based group was -1.2 kg (95% CI -2.1 to -0.3; P = .008). Effects did not differ significantly by sex, race, age, and body mass index subgroups. Overall, 71% of study participants remained below entry weight.

CONCLUSIONS

The majority of individuals who successfully completed an initial behavioral weight loss program maintained a weight below their initial level. Monthly brief personal contact provided modest benefit in sustaining weight loss, whereas an interactive technology-based intervention provided early but transient benefit.

TRIAL REGISTRATION

clinicaltrials.gov Identifier: NCT00054925.

Design and implementation of an interactive website to support long-term maintenance of weight loss

Background

For most individuals, long-term maintenance of weight loss requires long-term, supportive intervention. Internet-based weight loss maintenance programs offer considerable potential for meeting this need. Careful design processes are required to maximize adherence and minimize attrition.

Objective

This paper describes the development, implementation and use of a Web-based intervention program designed to help those who have recently lost weight sustain their weight loss over 1 year.

Methods

The weight loss maintenance website was developed over a 1-year period by an interdisciplinary team of public health researchers, behavior change intervention experts, applications developers, and interface designers. Key interactive features of the final site include social support, self-monitoring, written guidelines for diet and physical activity, links to appropriate websites, supportive tools for behavior change, check-in accountability, tailored reinforcement messages, and problem solving and relapse prevention training. The weight loss maintenance program included a reminder system (automated email and telephone messages) that prompted participants to return to the website if they missed their check-in date. If there was no log-in response to the email and telephone automated prompts, a staff member called the participant. We tracked the proportion of participants with at least one log-in per month, and analyzed log-ins as a result of automated prompts.

Results

The mean age of the 348 participants enrolled in an ongoing randomized trial and assigned to use the website was 56 years; 63% were female, and 38% were African American. While weight loss data will not be available until mid-2008, website use remained high during the first year with over 80% of the participants still using the website during month 12. During the first 52 weeks, participants averaged 35 weeks with at least one log-in. Email and telephone prompts appear to be very effective at helping participants sustain ongoing website use.

Conclusions

Developing interactive websites is expensive, complex, and time consuming. We found that extensive paper prototyping well in advance of programming and a versatile product manager who could work with project staff at all levels of detail were essential to keeping the development process efficient.

Trial Registration

clinicaltrials.gov NCT00054925