Interview Administration of PROMIS Depression and Anxiety Short Forms

Pharmacist-facilitated Patient Reported Outcome Measure (PROM) monitoring: developing an EHR SmartForm© to monitor side effects of oral oncolytics during routine telehealth encounters

PURPOSE

Patient reported outcome measures (PROMs) are increasingly used in oncology care, but pharmacists providing direct patient care have been overlooked. We engaged pharmacists and adults receiving oral oncolytics (chemotherapy medication taken by mouth) to develop a SmartForm© in the electronic health record (EHR) for PROM monitoring. Pharmacists verbally ask the patient side effect questions during routine telehealth encounters and enter responses in real time.

METHODS

Our development process was guided by the Knowledge to Action Framework. In phase 1 (Knowledge Inquiry), we prioritized side effects to assess in the EHR SmartForm© via interviews with patients and a Delphi panel with pharmacists. Adults receiving oral oncolytics for breast (n = 12), thoracic (n = 12), or hematological (n = 12) cancer were interviewed, with purposeful sampling for adults who were aged 65 + years or Black. Interviews were coded with content analysis. We conducted three Delphi rounds, with 11/19, 13/19, and 19/19 pharmacists, respectively. In phase 2 (Knowledge Synthesis), PROM items were selected and the EHR SmartForm© programmed. In phase 3 (Knowledge Tailoring), we conducted usability testing with pharmacists.

RESULTS

Pharmacists and patients were consistent in prioritizing side effects of oral oncolytics and 10 were retained. Patients advocated asking whether they can do their usual activities, while pharmacists added medication adherence. Usability testing yielded suggestions to simplify the SmartForm©.

CONCLUSION

By presenting screenshots of our SmartForm©, our findings are useful to other healthcare systems looking for a PROM solution integrated in the EHR, with a reasonable pharmacist/clinician workload, and no requirement for patients to have internet access/comfort.

Prevalence of Anxiety and Depressive Disorders in a Sample of Moscow Residents: Comparison of the GAD-7 and HADS Results with a Clinical Assessment

BACKGROUND

Anxiety and depressive disorders are the most common mental disorders. Detecting a disorder at an early stage can prevent the development of severe disorders and preserve the patient's functioning ability. Simple and reliable screening tools based on self-completion of questionnaires can be used for this purpose. However, it is not always the case that the scores of the self-questionnaire align with those of the clinician.

AIM

To estimate the prevalence of anxiety-depressive disorders using the GAD-7 and HADS self-report questionnaires compared to psychiatrist assessment.

METHODS

The study included individuals aged 18 to 65 years, living in Moscow, Russia, without psychiatric disorders, who participated in an online study using the HADS (Hospital Anxiety and Depression Scale, HADS-A and HADS-D) and GAD-7 (Generalized Anxiety Disorder 7-item scale). Anxiety disorder was diagnosed when the total score was ≥10 on the GAD-7 and/or ≥10 on the HADS-A scale, and depression was defined when the total score was ≥9 on the HADS-D scale. Then, 82 randomly selected participants attended an anonymous consultation with a psychiatrist.

RESULTS

The study included 1,097 individuals (72% female), median age 29 (23; 37) years. As a result of testing, anxiety disorder was found in 168 (15%); depressive disorder - in 152 (14%) respondents. At medical verification, anxiety was diagnosed in 18 (22%); depression - in 19 (23%) people. The sensitivity of the HADS-D subscale for physician-diagnosed cases of depression was 61%, and specificity was 73%. The sensitivity of the HADS-A and GTR-7 subscale in identifying cases of anxiety disorder was 58%, specificity 59%. Sixteen percent were first diagnosed with a personality disorder or schizotypal disorder.

CONCLUSION

The level of anxiety and depression in our sample of the population of Moscow, Russia, was higher than the global level. Self-assessment based on the questionnaire seems to not fully reflect the real state of a patient, as evidenced by the differences with the psychiatrist's assessment.

Oral Microbiome, Mental Health, and Sleep Outcomes During the COVID-19 Pandemic: An Observational Study in Chinese and Korean American Immigrants

COVID-19 is a systemic disease whose effects are not limited to the respiratory system. The oral microbiome (OM)-brain axis is of growing interest in understanding the broader, neuropsychiatric, impacts of the COVID-19 pandemic through a systems biology lens. In this context, mental health and sleep disturbance are often reported by Asian Americans. In a cross-sectional observational study design, we examined the associations of the oral microbiome with mental health among Asian Americans during the COVID-19 pandemic (between November 2020 and April 2021). Participants (n = 20) were adult Chinese and Korean American immigrants in Atlanta, Georgia, and primarily born outside the United States (60%) with a mean age of 34.8 years ±14 (standard deviation). Participants reported depressive symptoms, anxiety, and sleep disturbance, as measured by standard questionnaires. The OM was characterized by 16S rRNA V3-V4 gene using saliva. Depressive symptoms and anxiety were reported by 60% (n = 12) of participants, whereas 35% (n = 7) reported sleep disturbance. The α-diversity was significantly associated with depressive symptoms, and marginally with anxiety. Participants with depressive symptoms and anxiety had enriched Rothia and Scardovia, respectively, whereas those without symptoms had enriched Fusobacterium. Individuals with sleep disturbance had enriched Kingella. In conclusion, this study suggests significant associations of the OM diversity with certain mental health dimensions such as depressive symptoms and anxiety. Specific taxa were associated with these symptoms. The present observations in a modest sample size suggest the possible relevance of the OM-brain axis in studies of mental health during COVID-19.

A Pilot Study of the Gut Microbiota Associated With Depressive Symptoms and Sleep Disturbance Among Chinese and Korean Immigrants in the United States

CONTEXT

Depression is prevalent among Asian Americans (AsA) during the COVID-19 pandemic, and depression often leads to sleep disturbance in this population. The gut microbiota (GM) plays a critical role in mental health and sleep quality, and the composition of the GM is largely unknown among AsA.

OBJECTIVES

Examine associations of the GM with depressive symptoms and sleep disturbance among Chinese and Korean American immigrants.

METHODS

Depressive symptoms (PROMIS Short Form-Depression) and sleep quality (Pittsburgh Sleep Quality Index [PSQI]) were collected via surveys. PROMIS measure T-score > 55 indicates positive depressive symptoms, and a total PSQI score > 5 indicates sleep disturbance. 16S rRNA V3-V4 gene regions were sequenced from fecal specimens to measure GM. Permutational multivariate analysis of variance and linear discriminant analysis effect size were applied to examine associations of the GM with symptoms.

RESULTS

Among 20 participants, 55% (n = 11) reported depressive symptoms and 35% (n = 7) reported sleep disturbance. A higher α-diversity was marginally associated with lower depressive symptoms: Chao1 (r = -0.39, p = 0.09) and Shannon index (r = -0.41, p = 0.08); β-diversity distinguished participants between categories of depressive symptoms (weighted UniFrac, p=0.04) or sleep disturbance (Jaccard, p=0.05). Those with depressive symptoms showed a higher abundance of Actinobacteria, while those without depressive symptoms had a higher abundance of Bacteroidetes. No significant taxa were identified for sleep disturbance.

CONCLUSIONS

Gut microbial diversity showed promising associations with depressive symptoms and sleep disturbance among Chinese and Korean immigrants. Specific taxa were identified as associated with depressive symptoms. Future studies with a larger sample size are warranted to confirm our findings.

The Impact of Education on Depression Assessment: Differential Item Functioning Analysis

A person's level of education can affect their access to health care, and their health outcomes. Increasing rates of depression are another looming public health concern. Therefore, vulnerability is compounded for individuals who have a lower level of education and depression. Assessment of depressive symptoms is integral to many domains of health care including primary care and mental health specialty care. This investigation examined the degree to which education influences the psychometric properties of self-report items that measure depressive symptoms. This study was a secondary data analysis derived from three large internet panel studies. Together, the studies included the Beck Depression Inventory-II, the Center for Epidemiologic Studies Depression Scale, the Patient Health Questionnaire, and the Patient Reported Outcomes Measurement Information System measures of depression. Using a differential item functioning (DIF) approach, we found evidence of DIF such that some items on each of the questionnaires were flagged for DIF with effect sizes ranging from McFadden's Pseudo R2 = .005 to .022. For example, results included several double-barreled questions flagged for DIF. Overall, questionnaires assessing depression vary in level of complexity, which interacts with the respondent's level of education. Measurement of depression should include consideration of possible educational disparities, to identify people who may struggle with a written questionnaire, or may be subject to subtle psychometric biases associated with education.

Health Literacy, Education, and Internal Consistency of Psychological Scales

Background:

Measurement error might lead to biased estimates, causing ineffective interventions and service delivery. Identifying measurement error of health-related instruments helps develop accurate assessment of health-related constructs.

Objective:

We compared the internal consistency of eight psychological scales used in health research in groups with adequate versus limited health literacy and in groups with higher versus lower education.

Methods:

Participants (N = 1,005) from a nationally representative internet panel completed eight self-report scales: (1) information avoidance, (2) cognitive causation, (3) unpredictability, (4) perceived severity, (5) time orientation, (6) internal health locus of control, (7) need for cognition, and (8) social desirability. The first four assess beliefs about diabetes and colon cancer. We used the Newest Vital Sign to categorize participants' health literacy (limited vs. adequate). We also categorized participants' education (high school or less vs. more than high school). We compared the Cronbach's alpha for each psychological scale between groups with different health literacy and education levels using the Feldt test.

Key Results:

Among all the 13 subscales, scale internal consistency was significantly lower among people with limited health literacy than those with adequate health literacy for five subscales: information avoidance for colon cancer (0.80 vs. 0.88), unpredictability of diabetes (0.84 vs. 0.88), perceived severity for diabetes (0.66 vs. 0.75), need for cognition (0.63 vs. 0.82), and social desirability (0.52 vs. 0.68). Internal consistency was significantly lower among people who had a high school education or less than among those with more than a high school education for four scales: perceived severity of diabetes (0.70 vs. 0.75), present orientation (0.60 vs. 0.66), need for cognition (0.73 vs. 0.80), and social desirability (0.61 vs. 0.70).

Conclusions:

Several psychological instruments demonstrated significantly lower internal consistency when used in a sample with limited health literacy or education. To advance health disparities research, we need to develop new scales with alternative conceptualizations of the constructs to produce a measure that is reliable among multiple populations. [HLRP: Health Literacy Research and Practice. 2021;5(3):e244–e255.]

Plain Language Summary:

We compared the internal consistency of several psychological scales in groups with adequate versus limited health literacy and higher versus lower education. For several scales, internal consistency was significantly lower among (1) people with limited health literacy compared those who have adequate health literacy and/or (2) people who had a high school education or less compared to those with more than a high school education.

Patient perspectives on digital patient reported outcomes in routine care of inflammatory bowel disease

Background

Digital patient reported outcomes are used increasingly in daily care and treatment of inflammatory bowel disease. Their purpose includes increased focus on patient wellbeing, reduction in avoidable follow-up consultations and increased patient self-management. However, implementation issues occur and studies indicate patients may have concerns, particularly regarding having fewer face-to-face consultations. This study aims to explore patients’ perspectives of use and non-use of digital patient reported outcomes and to understand the mechanisms underpinning patient reluctance to engage with this health technology.

Results

Sixteen patients with inflammatory bowel disease at a regional hospital in Denmark were interviewed about their experiences of, and perspectives on, digital patient reported outcomes. A certain level of eHealth literacy was found to be a fundamental condition for use, while other factors were barriers or facilitators for use of digital PROs. Patients’ main concerns were about potential consequences for their care and relationship with the clinic. Most patients in stable remission were satisfied with the hospital being a “life-line” if their symptoms worsened, and perceived digital patient reported outcomes to be an efficient tool to establish that “life-line”. Patients with severe symptoms and a high degree of emotional distress related to their disease valued the potential for digital patient reported outcomes to increase their clinicians’ focus on mental health and extra-intestinal symptoms.

Conclusion

This study found that if patients had sufficient digital literacy, they perceived digital patient reported outcomes to be a useful replacement for face-to-face consultations. However, they were concerned about digital patient reported outcomes’ effect on the patient–clinician relationship and its ability to detect worsening of symptoms. These concerns may be mitigated by good patient–clinician relationships, and the option for patients to maintain direct telephone contact with their gastroenterology specialist.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41687-021-00366-2.

‘Digital patient reported outcomes’ refer to systems by which health professionals collect health information from patients between consultations, mostly via self-completed online questionnaires. This approach aims to support treatment and disease management, and reduce avoidable face-to-face consultations between doctor and patient. However, patients may have concerns about using digital systems to communicate with their clinicians, particularly regarding having fewer face-to-face consultations. To find out more, we interviewed sixteen patients at an Inflammatory Bowel Disease outpatient clinic in Denmark, where digital Patient Reported Outcomes have been used since 2017. We found out that patients needed to have enough familiarity with technology to be able to use these online systems. Patients were worried about how this new way of communicating with the clinic affected their care and their relationship with their doctors and nurses. People with Inflammatory Bowel Disease can have long periods of time with very little disease activity, and in these stable periods, a lot of patients found that a digital Patient Reported Outcomes system was a good way to stay in touch with the clinic and keep reporting their symptoms online– as long as they still had the possibility of contacting the clinic by telephone if needed. During disease flare-ups, patients believed that digital patient reported outcomes’ could be used to give broader insight into their health situation, and trusted their clinicians to use their self-reported data to improve their care.

Differential Item Functioning Analyses of the Patient-Reported Outcomes Measurement Information System (PROMIS®) Measures: Methods, Challenges, Advances, and Future Directions

Several methods used to examine differential item functioning (DIF) in Patient-Reported Outcomes Measurement Information System (PROMIS®) measures are presented, including effect size estimation. A summary of factors that may affect DIF detection and challenges encountered in PROMIS DIF analyses, e.g., anchor item selection, is provided. An issue in PROMIS was the potential for inadequately modeled multidimensionality to result in false DIF detection. Section 1 is a presentation of the unidimensional models used by most PROMIS investigators for DIF detection, as well as their multidimensional expansions. Section 2 is an illustration that builds on previous unidimensional analyses of depression and anxiety short-forms to examine DIF detection using a multidimensional item response theory (MIRT) model. The Item Response Theory-Log-likelihood Ratio Test (IRT-LRT) method was used for a real data illustration with gender as the grouping variable. The IRT-LRT DIF detection method is a flexible approach to handle group differences in trait distributions, known as impact in the DIF literature, and was studied with both real data and in simulations to compare the performance of the IRT-LRT method within the unidimensional IRT (UIRT) and MIRT contexts. Additionally, different effect size measures were compared for the data presented in Section 2. A finding from the real data illustration was that using the IRT-LRT method within a MIRT context resulted in more flagged items as compared to using the IRT-LRT method within a UIRT context. The simulations provided some evidence that while unidimensional and multidimensional approaches were similar in terms of Type I error rates, power for DIF detection was greater for the multidimensional approach. Effect size measures presented in Section 1 and applied in Section 2 varied in terms of estimation methods, choice of density function, methods of equating, and anchor item selection. Despite these differences, there was considerable consistency in results, especially for the items showing the largest values. Future work is needed to examine DIF detection in the context of polytomous, multidimensional data. PROMIS standards included incorporation of effect size measures in determining salient DIF. Integrated methods for examining effect size measures in the context of IRT-based DIF detection procedures are still in early stages of development.

Profiles of instrumental, emotional, and informational support in Chinese breast cancer patients undergoing chemotherapy: a latent class analysis

Background

To date, few studies have assessed social relationships in patients with breast cancer during their chemotherapy process. This study aimed to explore profiles of instrumental, emotional, and informational support in Chinese breast cancer patients undergoing chemotherapy.

Methods

In a cross-sectional study performed between September 2018 and September 2020 in China, 638 patients with breast cancer completed demographic information questionnaires, the PROMIS-Social Relationships Short Forms, the PROMIS-Anxiety Short Form, and the PROMIS-Depression Short Form. Analysis of variance and chi-square tests were performed to examine between-group differences in demographic characteristics, anxiety, and depression outcomes across the identified latent classes. Multinomial logistic regression was performed to identify the correlation of significant variables among the identified classes.

Results

Three profiles of social relationships were identified: Class 1-low social relationships group (14.3%), Class 2-high instrumental support, medium emotional and informational support group (24.6%), and Class 3-high social relationships group (61.1%). The findings revealed the heterogeneity of instrumental, emotional, and informational support in Chinese breast cancer patients undergoing chemotherapy, which was significantly correlated with educational background, monthly family income, health insurance, and employment status. Additionally, patients with low instrumental, emotional, and informational support were more likely to report high levels of anxiety and depression.

Conclusions

When conducting interventions to promote social relationships during the chemotherapy process, healthcare providers should consider the sociodemographic characteristics, anxiety levels, and depression symptoms of patients with breast cancer and identify high-risk patients for tailored interventions.

Confirmatory Factor Analyses and Differential Item Functioning of the Patient Experience with Treatment and Self-Management (PETS vs. 2.0): A Measure of Treatment Burden

Purpose

To examine the factor structure and differential item functioning (DIF) of the Patient Experience with Treatment and Self-management (PETS version 2.0), a measure of treatment burden.

Patients and Methods

Version 2.0 of the PETS has 60 items, extending the previously-validated 48-item version 1.0 by three domains (nine items) and three additional items in an existing domain. We conducted confirmatory factor analyses (CFA) on survey responses of 439 community-dwelling adults living with multiple chronic conditions who completed PETS version 2.0, using R packages, "lavaan" and "semTools." We tested fit of second-order factors to explore simplifying the reporting of PETS scores. We examined DIF for the two second-order factors with "lordif" R package, testing groups by gender, education, and health literacy, using the McFadden pseudo R ² change criterion of ≥0.02 to flag items with DIF. Cronbach's alpha and the intraclass correlation coefficient (ICC) were used to determine the reliability of PETS domains.

Results

The first-order CFA model featuring 12 multi-item domains had an excellent fit (Comparative Fit Index [CFI]=0.989), as did the second-order CFA model (CFI=0.987), specifying two superordinate factors of treatment burden (workload and impact). Items in the workload and impact second-order factors did not show any DIF across gender, education, and health literacy groups as shown by McFadden pseudo R ² changes <0.02. Cronbach's alphas for all multi-item domain scales were ≥0.80, and ICCs of ten scales were ≥0.70, meeting the threshold for adequate test-retest reliability.

Conclusion

Findings support the construct validity and reliability of PETS version 2.0. The fit of a factor model featuring superordinate (ie, second-order) factors of workload and impact supports index scoring that will simplify reporting of PETS scores. DIF analyses indicate that items from these indices can be interpreted in the same way, regardless of gender, education, or health literacy.

Impact of Limited Health Literacy on Patient-Reported Outcomes in Systemic Lupus Erythematosus

OBJECTIVE

Health disparities in patient-reported outcomes by income and education are well documented; however, the impact of health literacy on patient-reported outcomes has received less attention. We examined independent effects of income, education, and health literacy on patient-reported outcomes in systemic lupus erythematosus (SLE).

METHODS

Data from the California Lupus Epidemiology Study (n = 323 participants) were used. Health literacy was assessed with a validated 3-item measure (ability to understand written information, reliance on others to understand written information, confidence in completing written forms). Patient-reported outcomes were administered by interview in English, Spanish, Cantonese, or Mandarin. Generic and disease-specific patient-reported outcomes were examined using the following: 10 Patient-Reported Outcomes Measurement Information System (PROMIS) short forms; the 8 Short Form 36 (SF-36) health survey subscales; and 3 patient-reported SLE disease activity and damage measures. We conducted 2 sets of multivariable analyses: the first examined education, income, or health literacy individually; the second included all 3 simultaneously. All multivariable models included age, sex, race/ethnicity, language, disease duration, and physician-assessed disease activity and damage.

RESULTS

More than one-third of participants (38%) had limited health literacy (LHL), including >25% with greater than high school education. In multivariable analyses simultaneously considering education, income, and health literacy, LHL was associated with significantly worse scores on all patient-reported outcomes except disease damage. In contrast, disparities by income were seen in only 3 PROMIS scales, 3 SF-36 subscales, and 1 disease activity measure. No disparities by education level were noted.

CONCLUSION

We found significantly worse patient-reported outcome scores among individuals with LHL, even after controlling for disease activity and damage. Whether disparities are due to actual differences in health or measurement issues requires further study.