Measurement properties of questionnaires measuring continuity of care: a systematic review

Continuity of primary care for type 2 diabetes and hypertension and its association with health outcomes and disease control: insights from Central Vietnam

BACKGROUND

Vietnam is undergoing a rapid epidemiological transition with a considerable burden of non-communicable diseases (NCDs), especially hypertension and diabetes (T2DM). Continuity of care (COC) is widely acknowledged as a benchmark for an efficient health system. This study aimed to determine the COC level for hypertension and T2DM within and across care levels and to investigate its associations with health outcomes and disease control.

METHODS

A cross-sectional study was conducted on 602 people with T2DM and/or hypertension managed in primary care settings. We utilized both the Nijmegen continuity of care questionnaire (NCQ) and the Bice - Boxerman continuity of care index (COCI) to comprehensively measure three domains of COC: interpersonal, informational, and management continuity. ANOVA, paired-sample t-test, and bivariate and multivariable logistic regression analysis were performed to examine the predictors of COC.

RESULTS

Mean values of COC indices were: NCQ: 3.59 and COCI: 0.77. The proportion of people with low NCQ levels was 68.8%, and that with low COCI levels was 47.3%. Primary care offered higher informational continuity than specialists (p < 0.01); management continuity was higher within the primary care team than between primary and specialist care (p < 0.001). Gender, living areas, hospital admission and emergency department encounters, frequency of health visits, disease duration, blood pressure and blood glucose levels, and disease control were demonstrated to be statistically associated with higher levels of COC.

CONCLUSIONS

Continuity of primary care is not sufficiently achieved for hypertension and diabetes mellitus in Vietnam. Strengthening robust primary care services, improving the collaboration between healthcare providers through multidisciplinary team-based care and integrated care approach, and promoting patient education programs and shared decision-making interventions are priorities to improve COC for chronic care.

Development of the PREMIUM computerized adaptive testing for measuring the access and care coordination for patients with severe mental illness

Severe mental illness (SMI) patients often have complex health needs, which makes it difficult to access and coordinate their care. This study aimed to develop a computerized adaptive testing (CAT) tool, PREMIUM CAT-ACC, to measure SMI patients' experience with access and care coordination. This multicenter and cross-sectional study included 496 adult in- and out-patients with SMI (i.e., schizophrenia, bipolar disorder, or major depressive disorder). Psychometric analysis of the 13-item bank showed adequate properties, with preliminary evidence of external validity and no substantial differential item functioning for sex, age, care setting, and diagnosis, making it suitable for CAT administration. A post-hoc CAT simulation demonstrated that the tool was efficient and accurate, with an average of seven items, compared to the full item bank administration. Its use by clinicians can contribute to optimizing patient care pathways and transitioning towards more person-centered healthcare.

Barriers and facilitators to continuity and co-ordination of healthcare for under 18 years old: a systematic review

OBJECTIVE

To determine views and experiences of babies, children and young people relating to continuity of their healthcare.

DESIGN

Qualitative systematic review.

SETTING

Primary research from UK settings where NHS-commissioned or local authority-commissioned healthcare is provided. Systematic reviews from UK and non-UK high-income countries.

POPULATION

Babies, children and young people under 18 years old with experience of healthcare. Parental and/or carer perspectives only included if children are under 5 years old or unable to express their own view.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Thematic analysis of the benefits and facilitators to continuity of care for babies, children and young people.

RESULTS

20 047 abstracts were screened; 186 full-text articles were reviewed; 11 papers fulfilled the review criteria. From these, four main themes and 14 subthemes were identified. The theme 'individuals' had four subthemes: 'knowledge of healthcare system', 'support', 'personal lives' and 'results'. The theme 'healthcare professionals' had four subthemes: 'interservice communication', 'collaboration with babies, children and young people', 'communications' and 'relationships with healthcare professionals'. The theme 'practical' had four subthemes: 'colocation', 'appointment times', 'referrals' and 'waiting times'. The theme 'technological' had two subthemes: 'ease of use' and 'complements current healthcare management'.

CONCLUSIONS

Continuity of healthcare for babies, children and young people can enhance clinical outcomes but requires active facilitation by healthcare providers and services, especially in circumstances where individuals or their families are less able to advocate for themselves. A range of barriers and facilitators were identified together with recommendations for enhancing continuity of care.

PROSPERO REGISTRATION NUMBER

CRD42019145566.

Association of Continuity of General Practitioner Care with Utilisation of General Practitioner and Specialist Services in China: A Mixed-Method Study

Background: Continuity of general practitioner (GP) care, widely known as the core value of high-quality patient care, has a positive association with health outcomes. Evidence about the relationship between continuity and health service utilisation has so far been lacking in China. This study aimed to analyse the association of continuity of GP care with utilisation of general practitioner and specialist services in China. Method: A cross-sectional mixed methods study was conducted in 10 urban communities in Hangzhou. Quantitative data were collected from a random sample of 624 residents adopting the self-developed questionnaire. Measurement of continuity of GP care included informational continuity (IC), managerial continuity (MC) and relational continuity (RC). With adjustment for characteristics of residents, multivariate regression models were established to examine the association of continuity of GP care with the intention to visit GP, frequency of GP and specialist visitations. Qualitative data were collected from 26 respondents using an in-depth interview, and thematic content analysis for qualitative data was conducted. Results: Quantitative analysis showed that the IC was positively associated with the intention to visit GP and frequency of GP visitations. Those people who gave a high rating for RC also used GP services more frequently than their counterparts. MC was negatively associated with frequency of specialist visitations. Qualitative analysis indicated that service capabilities, doctor-patient interaction and time provision were regarded as three important reasons why patients chose GPs or specialists. Conclusions: Overall, high IC and RC are independently associated with more GP service utilisation, but a high MC might reduce specialist visitations. Continuity of GP care should be highlighted in designing a Chinese GP system.

Linking Scores with Patient-Reported Health Outcome Instruments:A VALIDATION STUDY AND COMPARISON OF THREE LINKING METHODS

The psychometric process used to establish a relationship between the scores of two (or more) instruments is generically referred to as linking. When two instruments with the same content and statistical test specifications are linked, these instruments are said to be equated. Linking and equating procedures have long been used for practical benefit in educational testing. In recent years, health outcome researchers have increasingly applied linking techniques to patient-reported outcome (PRO) data. However, these applications have some noteworthy purposes and associated methodological questions. Purposes for linking health outcomes include the harmonization of data across studies or settings (enabling increased power in hypothesis testing), the aggregation of summed score data by means of score crosswalk tables, and score conversion in clinical settings where new instruments are introduced, but an interpretable connection to historical data is needed. When two PRO instruments are linked, assumptions for equating are typically not met and the extent to which those assumptions are violated becomes a decision point around how (and whether) to proceed with linking. We demonstrate multiple linking procedures-equipercentile, unidimensional IRT calibration, and calibrated projection-with the Patient-Reported Outcomes Measurement Information System Depression bank and the Patient Health Questionnaire-9. We validate this link across two samples and simulate different instrument correlation levels to provide guidance around which linking method is preferred. Finally, we discuss some remaining issues and directions for psychometric research in linking PRO instruments.

Traditional versus extended hybrid cardiac rehabilitation based on the continuous care model for coronary artery bypass surgery patients in a middle-income country: A Randomized Clinical Trial

OBJECTIVE

To compare traditional (1-month supervised) versus hybrid cardiac rehabilitation (CR; usual care) with an additional 3 months offered remotely based on the continuous care model (CCM; intervention), in coronary artery bypass graft (CABG) patients.

DESIGN

randomized controlled trial, with blinded outcome assessment.

SETTING

A major heart center in a middle-income country.

PARTICIPANTS

Of 107 eligible patients that were referred to CR during the period of study, 88 (82.2%) were enrolled (target sample size). Participants were randomly assigned 1:1 (concealed; 44 per parallel arm). There was 92.0% retention.

INTERVENTION

After CR, participants were given an app and communicated biweekly with the nurse from months 1-4 to control risk factors.

MAIN OUTCOME MEASURES

Quality of life (QoL; SF-36; primary outcome), functional capacity (treadmill test), depression, anxiety and stress (DASS-21) were evaluated pre-CR, after one month, and three months after CR (end of intervention), as well as re-hospitalization.

RESULTS

The analysis of variance interaction effects for the physical and mental component summary scores of QoL were <.001, favoring intervention (per protocol); there were also significant increases from pre-CR to 1 month, and from 1 month to the final assessment in the intervention arm (p-values<.001), with change in the control arm only to 1 month. The effect sizes were 0.115 and 0.248, respectively. Similarly, the interaction effect for functional capacity was significant (p<.001), with a clinically-significant 1.5 MET increase in the intervention arm. There were trends for group effects for the psychosocial indicators, with paired t-tests revealing significant increases in each at both assessment points in the intervention arm. At 4 months, there were 4 (10.3%) re-hospitalizations in the control arm, and none in intervention (p=.049). Intended theoretical mechanisms were also impacted by the intervention.

CONCLUSION

Extending CR in this accessible manner, rendering it more comprehensive, was effective in improving outcomes.

Continuity of care experienced by patients in a multi-institutional pancreatic care network: a pilot study

Background

Over the past decades, health care services for pancreatic surgery were reorganized. Volume norms were applied with the result that only a limited number of expert centers perform pancreatic surgery. As a result of this centralization of pancreatic surgery, the patient journey of patients with pancreatic tumors has become multi-institutional. To illustrate, patients are referred to a center of expertise for pancreatic surgery whereas other parts of pancreatic care, such as chemotherapy, take place in local hospitals. This fragmentation of health care services could affect continuity of care (COC). The aim of this study was to assess COC perceived by patients in a pancreatic care network and investigate correlations with patient-and care-related characteristics.

Methods

This is a pilot study in which patients with (pre) malignant pancreatic tumors discussed in a multidisciplinary tumor board in a Dutch tertiary hospital were asked to participate. Patients were asked to fill out the Nijmegen Continuity of Care-questionnaire (NCQ) (5-point Likert scale). Additionally, their patient-and care-related data were retrieved from medical records. Correlations of NCQ score and patient-and care-related characteristics were calculated with Spearman’s correlation coefficient.

Results

In total, 44 patients were included (92% response rate). Pancreatic cancer was the predominant diagnosis (32%). Forty percent received a repetition of diagnostic investigations in the tertiary hospital. Mean scores for personal continuity were 3.55 ± 0.74 for GP, 3.29 ± 0.91 for the specialist and 3.43 ± 0.65 for collaboration between GPs and specialists. Overall COC was scored with a mean 3.38 ± 0.72. No significant correlations were observed between NCQ score and certain patient-or care-related characteristics.

Conclusion

Continuity of care perceived by patients with pancreatic tumors was scored as moderate. This outcome supports the need to improve continuity of care within multi-institutional pancreatic care networks.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06431-2.

Design and psychometric evaluation of epilepsy-related apathy scale (E-RAS) in adults with epilepsy: a sequential exploratory mixed methods design

Background

Apathy in patients with epilepsy is associated with a wide range of consequences that reduce the patient’s ability to perform social functions and participate in self-care and rehabilitation programs. Therefore, apathy is one of the important diagnoses of the healthcare team in the process of caring for epileptic patients and its dimensions need to be examined and recognized. Therefore, appropriate instruments with the sociocultural milieu of each community should be provided to health care providers. The aim of the present study was to design and measure epilepsy–related apathy scale (E-RAS) in adults with epilepsy.

Methods

This study of sequential exploratory mixed methods design was conducted in Iran from April 2019 to December 2019. In the Item generation stage, two inductive (face-to-face and semi-structured interviews with 17 adult epileptic patients) and deductive (literature review) were used. In item reduction, integration of qualitative and literature reviews and scale evaluation were accomplished. For Scale Evaluation, face, content, construct [exploratory factor analysis (EFA) (n = 360) and confirmatory factor analysis (CFA) (n = 200)], convergent and divergent Validity and reliability (internal consistency and stability) were investigated.

Results

The results of EFA showed that E-RAS has four factors, namely, motivation; self-regulatory; cognition and emotional-effective. These four latent factors accounted for a total of 48.351% of the total variance in the E-RAS construct. The results of CFA showed that the 4-factor model of E-RAS has the highest fit with the data. The results of convergent and divergent validity showed that the values of composite reliability (CR) and average variance extracted (AVE) for the four factors were greater than 0.7 and 0.5, respectively, and the value of AVE for each factor was greater than CR. The Cronbach’s alpha coefficient for the whole scale was obtained 0.815. The results of the test-retest showed that there was a significant agreement between the test and retest scores (P < 0.001).

Conclusion

E-RAS is a multidimensional construct consisting of 24 items, and has acceptable validity and reliability for the study of epilepsy-related apathy in adult epileptic patients.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12883-021-02139-2.

Towards a New System for the Assessment of the Quality in Care Pathways: An Overview of Systematic Reviews

Clinical or care pathways are developed by a multidisciplinary team of healthcare practitioners, based on clinical evidence, and standardized processes. The evaluation of their framework/content quality is unclear. The aim of this study was to describe which tools and domains are able to critically evaluate the quality of clinical/care pathways. An overview of systematic reviews was conducted, according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses, using Medline, Embase, Science Citation Index, PsychInfo, CINAHL, and Cochrane Library, from 2015 to 2020, and with snowballing methods. The quality of the reviews was assessed with Assessment the Methodology of Systematic Review (AMSTAR-2) and categorized with The Leuven Clinical Pathway Compass for the definition of the five domains: processes, service, clinical, team, and financial. We found nine reviews. Three achieved a high level of quality with AMSTAR-2. The areas classified according to The Leuven Clinical Pathway Compass were: 9.7% team multidisciplinary involvement, 13.2% clinical (morbidity/mortality), 44.3% process (continuity-clinical integration, transitional), 5.6% financial (length of stay), and 27.0% service (patient-/family-centered care). Overall, none of the 300 instruments retrieved could be considered a gold standard mainly because they did not cover all the critical pathway domains outlined by Leuven and Health Technology Assessment. This overview shows important insights for the definition of a multiprinciple framework of core domains for assessing the quality of pathways. The core domains should consider general critical aspects common to all pathways, but it is necessary to define specific domains for specific diseases, fast pathways, and adapting the tool to the cultural and organizational characteristics of the health system of each country.

Toward Sustainable ICT-Supported Neighborhood Development—A Maturity Model

Scientists promote the fostering of caring communities as a means of sustainably coping with demographic changes. They consider community-based technologies to have a high potential for supporting the establishment of caring communities. However, implementing community-based technologies is a complex endeavor, making sustainable adoption difficult. We have developed a maturity model aimed at standardizing the monitoring and evaluation of neighborhood projects. Based on a maturity model for integrated care, we conducted a Delphi study, to develop a maturity model for information and communication technology (ICT)-supported neighborhood development. In eight case studies, the model was validated and subsequently adapted to the specific needs and requirements of neighborhood projects. These studies emphasized the importance of at least 12 decisive dimensions and showed that the maturity model could be applied at different stages of a project. The current form of the maturity model can be used to help orient, as well as monitor and evaluate, neighborhood development projects. Future work will be necessary to further develop accompanying materials and services and to foster the exchange of best practices and experience between projects.

Information before discharge in geriatric patients in Italy: cultural adaptation and validation of the Patient Continuity of Care Questionnaire

Our aim is to culturally adapt the first section of the Patient Continuity of Care Questionnaire (PCCQ) for use among older Italian patients with chronic diseases and to test its psychometric properties. The PCCQ was translated, adapted to the Italian context, and completed by 236 older inpatients with chronic diseases at the point of discharge through a cross-sectional multi-centre validation study. Face and content validity were assessed. Exploratory factor analysis (EFA) with Mplus MLr estimator was conducted. Internal consistency was analysed through Cronbach's alpha and factor score determinacy coefficients. The overall content validity index of the 15-item Italian version of the questionnaire was 0.9. The EFA revealed a four-factor model yielding adequate fit indices. The factor score determinacy coefficients ranged from 0.87 to 0.94. The Cronbach's alpha coefficients ranged from 0.71 to 0.86 showing good reliability. The study provides health professionals with an instrument with adequate psychometric properties to assess patients' perception of the information received before hospital discharge.

Systematic review: measurement properties of patient-reported outcome measures evaluated with childhood brain tumor survivors or other acquired brain injury

Background

Survivors of childhood brain tumors or other acquired brain injury (ABI) are at risk of poor health-related quality of life (HRQoL); its valid and reliable assessment is essential to evaluate the effect of their illness on their lives. The aim of this review was to critically appraise psychometric properties of patient-reported outcome measures (PROMs) of HRQoL for these children, to be able to make informed decisions about the most suitable PROM for use in clinical practice.

Methods

We searched MEDLINE, EMBASE, and PsycINFO for studies evaluating measurement properties of HRQoL PROMs in children treated for brain tumors or other ABI. Methodological quality of relevant studies was evaluated using the consensus-based standards for the selection of health status measurement instruments checklist.

Results

Eight papers reported measurement properties of 4 questionnaires: Health Utilities Index (HUI), PedsQL Core and Brain Tumor Modules, and Child and Family Follow-up Survey (CFFS). Only the CFFS had evidence of content and structural validity. It also demonstrated good internal consistency, whereas both PedsQL modules had conflicting evidence regarding this. Conflicting evidence regarding test-retest reliability was reported for the HUI and PedsQL Core Module only. Evidence of measurement error/precision was favorable for HUI and CFFS and absent for both PedsQL modules. All 4 PROMs had some evidence of construct validity/hypothesis testing but no evidence of responsiveness to change.

Conclusions

Valid and reliable assessment is essential to evaluate impact of ABI on young lives. However, measurement properties of PROMs evaluating HRQoL appropriate for this population require further evaluation, specifically construct validity, internal consistency, and responsiveness to change.

Factors Associated with Perceived Continuity of Care Among Patients Suffering from Mental Disorders

This cross-sectional study identified variables associated with continuity of care among 327 patients with mental disorders receiving services from a variety of professionals in different Quebec settings. Based on the Andersen's Behavioral Model, a linear regression analysis was performed. Attention deficit and mood disorders were negatively associated with continuity of care, while substance use disorders and quality of life revealed positive associations. Consulting a psychologist was linked to weaker continuity of care whereas visiting a drug rehabilitation center, social support, and satisfaction with services were positively related. Fostering social support, comprehensive and integrated care, and facilitating access to psychologists could lead to improved continuity of care.

Communication between general practitioners and medical specialists in the referral process: a cross-sectional survey in 34 countries

Background

The communication of relevant patient information between general practitioners (GPs) and medical specialists is important in order to avoid fragmentation of care thus achieving a higher quality of care and ensuring physicians’ and patients’ satisfaction. However, this communication is often not carried out properly. The objective of this study is to assess whether communication between GPs and medical specialists in the referral process is associated with the organisation of primary care within a country, the characteristics of the GPs, and the characteristics of the primary care practices themselves.

Methods

An analysis of a cross-sectional survey among GPs in 34 countries was conducted. The odds ratios of the features that were expected to relate to higher rates of referral letters sent and communications fed back to GPs were calculated using ordered logistic multilevel models.

Results

A total of 7183 GPs from 34 countries were surveyed. Variations between countries in referral letters sent and feedback communication received did occur. Little of the variance between countries could be explained. GPs stated that they send more referral letters, and receive more feedback communications from medical specialists, in countries where they act as gatekeepers, and when, in general, they interact more with specialists. GPs reported higher use of referral letters when they had a secretary and/or a nurse in their practice, used health information technologies, and had greater job satisfaction.

Conclusions

There are large differences in communication between GPs and medical specialists. These differences can partly be explained by characteristics of the country, the GP and the primary care practice. Further studies should also take the organisation of secondary care into account.

Continuity of care and its associations with self-reported health, clinical characteristics and follow-up services after percutaneous coronary intervention

AIMS

Complexity of care in patients with coronary artery disease is increasing, due to ageing, improved treatment, and more specialised care. Patients receive care from various healthcare providers in many settings. Still, few studies have evaluated continuity of care across primary and secondary care levels for patients after percutaneous coronary intervention (PCI). This study aimed to determine multifaceted aspects of continuity of care and associations with socio-demographic characteristics, self-reported health, clinical characteristics and follow-up services for patients after PCI.

METHODS

This multi-centre prospective cohort study collected data at baseline and two-month follow-up from medical records, national registries and patient self-reports. Univariable and hierarchical regressions were performed using the Heart Continuity of Care Questionnaire total score as the dependent variable.

RESULTS

In total, 1695 patients were included at baseline, and 1318 (78%) completed the two-month follow-up. Patients stated not being adequately informed about lifestyle changes, medication and follow-up care. Those experiencing poorer health status after PCI scored significantly worse on continuity of care. Patients with ST-segment elevation myocardial infarction scored significantly better on informational and management continuity than those with other cardiac diagnoses. The regression analyses showed significantly better continuity (P ≤ 0.034) in patients who were male, received written information from hospital, were transferred to another hospital before discharge, received follow-up from their general practitioner or had sufficient consultation time after discharge from hospital.

CONCLUSION

Risk factors for sub-optimal continuity were identified. These factors are important to patients, healthcare providers and policy makers. Action should be taken to educate patients, reconcile discharge plans and organise post-discharge services. Designing pathways with an interdisciplinary approach and shared responsibility between healthcare settings is recommended.

[Questionnaires of person centered care in primary care. A systematic review]

Objetivo

Pese a la importancia de la «atención centrada en la persona» (ACP), hay evidentes limitaciones para valorarla y medirla, debidas probablemente a la dificultad para definirla. El objetivo del estudio fue identificar herramientas validadas que midiesen la ACP o algunos de sus aspectos en el ámbito de la atención primaria.

Diseño

Revisión sistemática.

Fuentes de datos

MEDLINE, Embase, Cochrane, PSYCinfo, IME-Biomedicina, LILACS y TESEO hasta del 31 de mayo de 2018.

Selección de estudios

Los criterios de inclusión fueron: a) estudios de validación de cuestionarios, revisiones sistemáticas sobre estudios de validación u otros estudios descriptivos, b) realizados todos ellos en el ámbito de la atención primaria y c) que midieran aspectos de la ACP en profesionales y/o pacientes. Dos investigadores revisaron de forma independiente los artículos y sus discrepancias fueron resueltas por un tercer investigador.

Extracción de datos

Se recogieron datos sobre los aspectos de la ACP medidos, población a la que se dirige, tipo de cuestionario, y datos sobre validez y fiabilidad.

Resultados

Se localizaron 1.415 artículos a los que se añadieron 54 referencias adicionales identificadas a través de referencias de los artículos de la revisión sistemática. Tras una depuración finalmente fueron 75 los artículos que cumplieron todos los criterios y 39 las herramientas identificadas y clasificadas según las dimensiones analizadas.

Conclusiones

Debido a la dificultad de medir la ACP en su conjunto, la mayor parte de los artículos hacen referencia solo a alguno de sus aspectos o dimensiones, predominando la perspectiva del paciente frente a la del profesional. Estas herramientas son, no obstante, un importante punto de partida para futuros cuestionarios que intenten valorar de forma integral la ACP.

Patients' perception of communication at the interface between primary and secondary care: a cross-sectional survey in 34 countries

BACKGROUND

Poor communication between general practitioners (GPs) and medical specialists can lead to poorer quality, and continuity, of care. Our study aims to assess patients' perceptions of communication at the interface between primary and secondary care in 34 countries. It will analyse, too, whether this communication is associated with the organisation of primary care within a country, and with the characteristics of GPs and their patients.

METHODS

We conducted a cross-sectional survey among patients in 34 countries. Following a GP consultation, patients were asked two questions. Did they take to understand that their GP had informed medical specialists about their illness upon referral? And, secondly, did their GP know the results of the treatment by a medical specialist? We used multi-response logistic multilevel models to investigate the association of factors related to primary care, the GP, and the patient, with the patients' perceptions of communication at the interface between primary and secondary care.

RESULTS

In total, 61,931 patients completed the questionnaire. We found large differences between countries, in both the patients' perceptions of information shared by GPs with medical specialists, and the patients' perceptions of the GPs' awareness of the results of treatment by medical specialists. Patients whose GPs stated that they 'seldom or never' send referral letters, also less frequently perceived that their GP communicated with their medical specialists about their illness. Patients with GPs indicating they 'seldom or never' receive feedback from medical specialists, indicated less frequently that their GP would know the results of treatment by a medical specialist. Moreover, patients with a personal doctor perceived higher rates of communication in both directions at the interface between primary and secondary care.

CONCLUSION

Generally, patients perceive there to be high rates of communication at the interface between primary and secondary care, but there are large differences between countries. Policies aimed at stimulating personal doctor arrangements could, potentially, enhance the continuity of care between primary and secondary care.

Psychometric Properties of Patient-Reported Outcome Measures for Use in Patients with Anterior Cruciate Ligament Injuries: A Systematic Review

BACKGROUND

Despite the high costs of anterior cruciate ligament (ACL) injuries to patients and society, we are not aware of any systematic reviews that have been performed on patient-reported outcome instruments designed for this patient population. The purpose of the present review is to identify currently available patient-reported outcome questionnaires for patients with ACL injuries, to appraise and assess the methodological quality and psychometric evidence of the evaluations of identified instruments, and to summarize the overall evidence for each included questionnaire.

METHODS

A computerized literature search was performed to identify articles appropriate for inclusion in this systematic review. Search terms were related to outcome instruments, ACL injuries, and psychometric properties. Two independent reviewers assessed the suitability of articles for inclusion. The methodological quality of instrument evaluation was assessed with use of the Consensus-based Standards for the Selection of Health Status Measurement Instruments (COSMIN) checklist. Psychometric properties were assessed with use of the quality criteria established by Terwee et al. The 2 assessments were synthesized to obtain an overall rating of the psychometric evidence for each questionnaire.

RESULTS

Forty-one studies investigating 24 instruments were included. The International Knee Documentation Committee (IKDC) Form and the Knee injury and Osteoarthritis Outcome Score (KOOS) were the most frequently assessed instruments. The ACL-Return to Sport after Injury (ACL-RSI) scale had 6 properties with positive evidence and was the highest-quality instrument overall.

CONCLUSIONS

Many of the included studies had low COSMIN ratings. The ACL-RSI is a reliable and valid scale to measure outcomes for patients with ACL injuries. Further assessments with improved methodological quality are needed to determine the psychometric properties of other instruments.

Validation of the Rainbow Model of Integrated Care Measurement Tools (RMIC-MTs) in renal care for patient and care providers

INTRODUCTION

Integrated service delivery is considered to be an essential condition for improving the management and health outcomes of people with chronic kidney disease (CKD). However, research on the assessment of integrated care by patients and care providers is hindered by the absence of brief, reliable, and valid measurement tools.

OBJECTIVE

The aim of this study was to develop survey instruments for healthcare professionals and patients based on the Rainbow Model of Integrated Care (RMIC), and to evaluate their psychometric properties.

DESIGN

The development process was based on the US Food and Drug Administration guidelines. This included item generation from systematic reviews of existing tools and expert opinion on clarity and content validity, involving renal care providers and chronic kidney patients. A cross-sectional, multi-centre design was used to test for internal consistency and construct validity.

SETTING

Outpatient clinics in a large renal network.

PARTICIPANTS

A sample of 30.788 CKD patients, and 8.914 renal care providers.

METHODS AND ANALYSIS

Both survey instruments were developed using previous qualitative work and published literature. A multidisciplinary expert panel assessed the face and content validity of both instruments and following a pilot study, the psychometric properties of both instruments were explored. Exploratory factor analysis with principal axis factoring and with promax rotation was used to assess the underlying dimensions of both instruments; Cronbach's alpha was used to determine the internal constancy reliability.

RESULTS

17.512 patients (response rate: 56.9%) and 8.849 care providers (response rate: 69.5%) responded to the questionnaires. Factor analysis of the patient questionnaire yielded three internally consistent (Cronbach's alpha > 0.7) factors: person-centeredness, clinical coordination, and professional coordination. Factor analysis of the provider questionnaire produced eight internally consistent (Cronbach's alpha > 0.7) factors: person-centeredness, community centeredness, clinical coordination, professional coordination, organisational coordination, system coordination, technical and cultural competence. As hypothesised, care coordination patient and providers scores significantly correlated with questions about quality of care, treatment involvement, reported health, clinics' organisational readiness, and external care coordination capacity.

CONCLUSION

This study provides evidence for the reliability and validity of the RMIC patient and provider questionnaires as generic tools to assess the experience with or perception of integrated renal care delivery. The instruments are recommended in future applications testing test-retest reliability, convergent and predictive validity, and responsiveness.

Social support network and continuity of care: an ego-network study of psychiatric service users

PURPOSE

For severely mentally ill (SMI) users, continuity of care requires consistency between the supports provided by the members of their social support network. However, we know little about their network cohesion and its association with continuity of care. We set out to investigate this association and hypothesised that it would depend on the severity of the user's situation and on his/her living arrangements.

METHODS

We conducted face-to-face interviews with 380 SMI users recruited in outpatient and inpatient mental health services in three areas in Belgium. Data regarding users' social networks were collected using an ego-network mapping technique and analysed with social network analysis. The cohesion indicators were density (frequency of connections between network members), centralisation (having a small number of central people), and egobetweenness (the user's centrality in his/her own network). Participants' perception of continuity of care was measured by the Alberta Continuity of Services Scale.

RESULTS

Results show that cohesion indicators were associated with continuity of care only for users with high-severity problems, regardless of their living arrangements. The numbers of network members, professionals, and services in the network were all negatively associated with continuity of care for all the users.

CONCLUSIONS

Satisfactory continuity of care requires fewer professionals or services in a user's network and a dense network for users with the most severe problems. This implies that those providing care must not only be able to increase cohesion within a network, but also to adapt their interventions to support the transition to a different, individualised network structure when severity decreases.

Adaptation and psychometric properties of the Norwegian version of the heart continuity of care questionnaire (HCCQ)

Background

Continuity of cardiac care after hospital discharge is a priority, especially as healthcare systems become increasingly complex and fragmented. There are few available instruments to measure continuity of cardiac care, especially from the patient perspective. The aim of this study was (1) to translate and adapt the Heart Continuity of Care Questionnaire (HCCQ) to conditions in Norway, and (2) to determine its psychometric properties in self-report format administered to patients after percutaneous coronary intervention (PCI).

Methods

The HCCQ was first translated into Norwegian from the original English version, following a widely used cross-cultural adaptation process. Data were collected before hospital discharge and in a follow-up after 2 months. To assess psychometric properties, a confirmatory factor analysis (CFA) was performed and three aspects of construct validity were evaluated: structural validity, hypotheses testing and cross-cultural validation. Internal consistency of the HCCQ subscales was calculated using Cronbach’s alpha, while intra-class correlation (ICC) was used to assess test-retest reliability. Additionally, socio-demographic and patient-reported data were collected to correlate with HCCQ scores.

Results

Of those included at baseline, 436 (76%) completed the questionnaires after 2 months. CFA suggested that the fit of the HCCQ data to a 3-factor model was modest (RMSEA = 0.11, CFI = 0.90, TLI = 0.90). However, convergent validity was satisfactory, based on existing research. Internal consistency was good, as indicated by its Cronbach’s alphas: total continuity of care (0.95); informational (0.93), relational (0.87), and management (0.89) continuity. The ICC for the total HCCQ score was 0.80 (95% CI [0.71, 0.87] p < 0.001). As indicated by negative care experiences (rated as 1 or 2 on the five-point scale), patients seemed to have limited knowledge about medical treatment, lifestyle modification and follow-up after PCI. Participation in cardiac rehabilitation and longer consultations with the general practitioner after hospital discharge were positively correlated with better continuity of care.

Conclusions

Implementation of the HCCQ will likely support healthcare providers and researchers in identifying problem areas of continuity of cardiac care and in evaluating interventions aimed at improving continuity of care.

Typology of patients with mental health disorders and perceived continuity of care

Background: While multiple socio-demographic, clinical and service use variables have been associated with continuity of care (CoC) in patients diagnosed with mental health disorders (MHDs), little is known about how these variables may inform clinical practice and service planning.Aim: This article identified profiles of patients with MHDs to better understand their perceptions of CoC.Method: The sample for this cross-sectional study comprised 327 patients recruited by staff or self-referred from four local health networks in Quebec (Canada). Data were collected using standardized instruments, and patient medical records. A three-factor conceptual framework based on Andersen's Behavioral Model was used, integrating predisposing, needs and enabling factors.Results: Cluster analyses identified five patient profiles. Profiles that included relatively more patients with common MHDs reported less continuity than those with patients primarily affected by severe MHDs.Conclusions: Service planning and delivery should be better adapted to patient profiles in order to improve CoC, and increased access to services prioritized.

How have researchers defined and used the concept of 'continuity of care' for chronic conditions in the context of resource-constrained settings? A scoping review of existing literature and a proposed conceptual framework

Background

Within the context of the growing burden of non-communicable diseases (NCDs) globally, there is limited evidence on how researchers have explored the response to chronic health needs in the context of health policy and systems in low- and middle-income countries. Continuity of care (CoC) is one concept that represents several elements of a long-term model of care. This scoping review aims to map and describe the state of knowledge regarding how researchers in resource-constrained settings have defined and used the concept of CoC for chronic conditions in primary healthcare.

Methods

This scoping review adopted the modified framework for interpretive scoping literature reviews. A systematic literature search in PubMed was performed, followed by a study selection process and data extraction, analysis and synthesis. Extracted data regarding the context of using CoC and the definition of CoC were analysed inductively to identify similar patterns; based on this, articles were divided into groups. MaxQDA was then used to re-code each article with themes according to the CoC definition to perform a cross-case synthesis under each identified group.

Results

A total of 55 peer-reviewed articles, comprising reviews or commentaries and qualitative or quantitative studies, were included. The number of articles has increased over the years. Five groups were identified as those (1) reflecting a change across stages or systems of care, (2) mentioning continuity or lack of continuity without a detailed definition, (3) researching CoC in HIV/AIDS programmes and its scaling up to support management of NCDs, (4) researching CoC in NCD management, and (5) measuring CoC with validated questionnaires.

Conclusion

Research or policy documents need to provide an explicit definition of CoC when this terminology is used. A framework for CoC is suggested, acknowledging three components for CoC (i.e. longitudinal care, the nature of the patient–provider relationship and coordinated care) while considering relevant contextual factors, particularly access and quality.

Electronic supplementary material

The online version of this article (10.1186/s12961-019-0426-1) contains supplementary material, which is available to authorized users.

Adaption and validation of Nijmegen continuity questionnaire to recognize the influencing factors of continuity of care for hypertensive patients in China

Background

Continuity of care (COC) has become a primary point of concern for care providers in both developed and developing countries, which is regarded as the “cornerstone of care” and an “essential element” of good health care. A robust and proper instrument is of necessity to identify problems and evaluate intervention aimed at improving continuity of care. This study aimed to adapt Nijmegen continuity questionnaire (NCQ) into a Chinese version (NCQ-C) and to delineate the status of COC as well as explore its influencing factors for hypertensive patients in China.

Methods

A forward-back-translation procedure was adopted for the determination of the adaption of NCQ. Then a total of 448 patients completed questionnaires and 24-h ambulatory blood pressure monitoring (ABPM). Proper indexes were calculated to test the reliability and validity of NCQ-C. Logistic analysis were used to detect the influencing factors of COC.

Results

The NCQ-C had excellent intraclass correlation coefficient of 0.855 and internal consistency of seven dimensions varied from 0.907 to 0.944. The item-content validity index ranged from 0.71 to 1.00. For construct validity, seven-factor structure was confirmed as original questionnaire and all the fit indices indicated acceptable levels. Gender, education level, medical insurance and frequency of family visits, blood pressure level, depression status as well as general health perception were demonstrated to be statistically related to COC.

Conclusions

In addition, all the parameters of ABPM were negatively significant with COC. The NCQ-C has shown acceptable level of reliability and validity. The related factors of COC should arouse care providers’ attention.

Factors associated with delayed and late ART initiation among people living with HIV in BC: results from the engage study

We examined correlates of late and delayed initiation of antiretroviral therapy (ART) in British Columbia, Canada. From December 2013 to December 2015 we recruited treatment-naïve people living with HIV who initiated ART within the previous year. 'Late initiation' was defined as CD4 cell count ≤500 cells/µL at ART initiation and 'delayed initiation' as ≥1 year between HIV diagnosis and initiation. Multivariable logistic regression assessed independent correlates of late and delayed initiation. Of 87 participants, 44 (51%) initiated late and 22 (26%) delayed initiation. Delayed initiation was positively associated with older age (adjusted odds ratio [AOR]: 1.06 per year, 95% confidence interval [95% CI]: 1.01-1.12) and inversely associated with wanting to start ART at diagnosis (AOR: 0.06, 95% CI: 0.02-0.21). Variables associated with late initiation were older age (AOR: 1.09 per year, 95% CI: 1.03-1.15) and medical reason(s) for initiation (AOR: 5.00, 95% CI: 1.41-17.86). Late initiation was less likely among those with greater perceived ART efficacy (AOR 0.94, 95% CI: 0.90-0.98) and history of incarceration (AOR: 0.12, 95% CI: 0.03-0.56). Disparities in timing of initiation were observed for age, perceived ART efficacy, and history of incarceration. Enhanced health services that address these factors may facilitate earlier treatment initiation.

The quality of mental health literacy measurement tools evaluating the stigma of mental illness: a systematic review

AIMS

Stigma of mental illness is a significant barrier to receiving mental health care. However, measurement tools evaluating stigma of mental illness have not been systematically assessed for their quality. We conducted a systematic review to critically appraise the methodological quality of studies assessing psychometrics of stigma measurement tools and determined the level of evidence of overall quality of psychometric properties of included tools.

METHODS

We searched PubMed, PsycINFO, EMBASE, CINAHL, the Cochrane Library and ERIC databases for eligible studies. We conducted risk-of-bias analysis with the Consensus-based Standards for the Selection of Health Measurement Instruments checklist, rating studies as excellent, good, fair or poor. We further rated the level of evidence of the overall quality of psychometric properties, combining the study quality and quality of each psychometric property, as: strong, moderate, limited, conflicting or unknown.

RESULTS

We identified 117 studies evaluating psychometric properties of 101 tools. The quality of specific studies varied, with ratings of: excellent (n = 5); good (mostly on internal consistency (n = 67)); fair (mostly on structural validity, n = 89 and construct validity, n = 85); and poor (mostly on internal consistency, n = 36). The overall quality of psychometric properties also varied from: strong (mostly content validity, n = 3), moderate (mostly internal consistency, n = 55), limited (mostly structural validity, n = 55 and construct validity, n = 46), conflicting (mostly test-retest reliability, n = 9) and unknown (mostly internal consistency, n = 36).

CONCLUSIONS

We identified 12 tools demonstrating limited evidence or above for (+, ++, +++) all their properties, 69 tools reaching these levels of evidence for some of their properties, and 20 tools that did not meet the minimum level of evidence for all of their properties. We note that further research on stigma tool development is needed to ensure appropriate application.

Reliability and validity of the Hebrew version of the Nijmegen Continuity Questionnaire for measuring patients' perceived continuity of care in oral anticancer therapy

To assess the validity and reliability of the Nijmegen Continuity Questionnaire in Hebrew (NCQ-H) for measuring patients' perceived continuity of care in the multiprovider setting of oral anticancer therapy (OACT). Following forward-backward translation of the original instrument into Hebrew, the NCQ-H was administered to adult cancer patients in five oncology centres in Israel, 2-3 months after initiation of OACT (either targeted, hormonal or chemotherapy). Confirmatory factor analysis and Cronbach's alpha were used to assess the validity and reliability of the NCQ-H respectively. A total of 135 patients completed the questionnaire. The postanalysis models for measuring "personal continuity with care provider" (eight items for each provider: the oncology specialist and the primary care physician), and "team/cross-boundary continuity" (four items for each setting: within the oncology team, and between the oncology specialist and the primary care physician) showed good fit for the observed data (root-mean-square error of approximation (RMSEA) = 0.02; RMSEA = 0.015; for each model respectively). Cronbach's alpha was 0.79-0.95 for all subscales. Conclusions. This study provides preliminary evidence for the reliability and validity of the NCQ-H in assessing cancer patients' experience with continuity of care and for its usability in the context of OACT.

Relational coordination in interprofessional teams and its effect on patient-reported benefit and continuity of care: a prospective cohort study from rehabilitation centres in Western Norway

Background

Rehabilitation services depend on competent professionals who collaborate effectively. Well-functioning interprofessional teams are expected to positively impact continuity of care. Key factors in continuity of care are communication and collaboration among health care professionals in a team and their patients. This study assessed the associations between team functioning and patient-reported benefits and continuity of care in somatic rehabilitation centres.

Methods

This prospective cohort study uses survey data from 984 patients and from health care professionals in 15 teams in seven somatic rehabilitation centres in Western Norway. Linear mixed effect models were used to investigate associations between the interprofessional team communication and relationship scores (measured by the Relational Coordination [RC] Survey and patient-reported benefit and personal-, team- and cross-boundary continuity of care. Patient-reported continuity of care was measured using the Norwegian version of the Nijmegen Continuity Questionnaire.

Results

The mean communication score for healthcare teams was 3.9 (standard deviation [SD] = 0.63, 95% confidence interval [CI] = 3.78, 4.00), and the mean relationship score was 4.1 (SD = 0.56, 95% CI = 3.97, 4.18). Communication scores in rehabilitation teams varied from 3.4–4.3 and relationship scores from 3.6–4.5. Patients treated by teams with higher relationship scores experienced better continuity between health care professionals in the team at the rehabilitation centre (b = 0.36, 95% CI = 0.05, 0.68; p = 0.024). There was a positive association between RC communication in the team the patient was treated by and patient-reported activities of daily living benefit score; all other associations between RC scores and rehabilitation benefit scores were not significant.

Conclusion

Team function is associated with better patient-reported continuity of care and higher ADL-benefit scores among patients after rehabilitation. These findings indicate that interprofessional teams’ RC scores may predict rehabilitation outcomes, but further studies are needed before RC scores can be used as a quality indicator in somatic rehabilitation.

Electronic supplementary material

The online version of this article (10.1186/s12913-018-3536-5) contains supplementary material, which is available to authorized users.

Codesigning a Measure of Person-Centred Coordinated Care to Capture the Experience of the Patient: The Development of the P3CEQ

BACKGROUND

Person-centred coordinated care (P3C) is a priority for stakeholders (ie, patients, carers, professionals, policy makers). As a part of the development of an evaluation framework for P3C, we set out to identify patient-reported experience measures (PREMs) suitable for routine measurement and feedback during the development of services.

METHODS

A rapid review of the literature was undertaken to identity existing PREMs suitable for the probing person-centred and/or coordinated care. Of 74 measures identified, 7 met our inclusion criteria. We critically examined these against core domains and subdomains of P3C. Measures were then presented to stakeholders in codesign workshops to explore acceptability, utility, and their strengths/weaknesses.

RESULTS

The Long-Term Condition 6 questionnaire was preferred for its short length, utility, and tone. However, it lacked key questions in each core domain, and in response to requests from our codesign group, new questions were added to cover consideration as a whole person, coordination, care plans, carer involvement, and a single coordinator. Cognitive interviews, on-going codesign, and mapping to core P3C domains resulted in the refinement of the questionnaire to 11 items with 1 trigger question. The 11-item modified version was renamed the P3C Experiences Questionnaire.

CONCLUSIONS

Due to a dearth of brief measures available to capture people's experience of P3C for routine practice, an existing measure was modified using an iterative process of adaption and validation through codesign workshops. Next steps include psychometric validation and modification for people with dementia and learning difficulties.

Measurement tools and outcome measures used in transitional patient safety; a systematic review

BACKGROUND

Patients are at risk for harm when treated simultaneously by healthcare providers from different healthcare organisations. To assess current practice and improvements of transitional patient safety, valid measurement tools are needed.

AIM AND METHODS

To identify and appraise all measurement tools and outcomes that measure aspects of transitional patient safety, PubMed, Cinahl, Embase and Psychinfo were systematically searched. Two researchers performed the title and abstract and full-text selection. First, publications about validation of measurement tools were appraised for quality following COSMIN criteria. Second, we inventoried all measurement tools and outcome measures found in our search that assessed current transitional patient safety or the effect of interventions targeting transitional patient safety.

RESULTS

The initial search yielded 8288 studies, of which 18 assessed validity of measurement tools of different aspects of transitional safety, and 191 assessed current transitional patient safety or effect of interventions. In the validated measurement tools, the overall quality of content and structural validity was acceptable; other COSMIN criteria, such as reliability, measurement error and responsiveness, were mostly poor or not reported. In our outcome inventory, the most frequently used validated outcome measure was the Care Transition Measure (n = 9). The most frequently used non-validated outcome measures were: medication discrepancies (n = 98), hospital readmissions (n = 55), adverse events (n = 34), emergency department visits (n = 33), (mental or physical) health status (n = 28), quality and timeliness of discharge summary, and patient satisfaction (n = 23).

CONCLUSIONS

Although no validated measures exist that assess all aspects of transitional patient safety, we found validated measurement tools on specific aspects. Reporting of validity of transitional measurement tools was incomplete. Numerous outcome measures with unknown measurement properties are used in current studies on safety of care transitions, which makes interpretation or comparison of their results uncertain.

Measurement properties of the Health of the Nation Outcome Scales (HoNOS) family of measures: protocol for a systematic review

INTRODUCTION

The Health of the Nation Outcome Scales (HoNOS) for adults, and equivalent measures for children and adolescents and older people, are widely used in clinical practice and research contexts to measure mental health and functional outcomes. Additional HoNOS measures have been developed for special populations and applications. Stakeholders require synthesised information about the measurement properties of these measures to assess whether they are fit for use with intended service settings and populations and to establish performance benchmarks. This planned systematic review will critically appraise evidence on the measurement properties of the HoNOS family of measures.

METHODS AND ANALYSIS

Journal articles meeting inclusion criteria will be identified via a search of seven electronic databases: MEDLINE via EBSCOhost, PsycINFO via APA PsycNET, Embase via Elsevier, Cumulative Index to Nursing and Allied Health Literature via EBSCOhost, Web of Science via Thomson Reuters, Google Scholar and the Cochrane Library. Variants of 'Health of the Nation Outcome Scales' or 'HoNOS' will be searched as text words. No restrictions will be placed on setting or language of publication. Reference lists of relevant studies and reviews will be scanned for additional eligible studies. Appraisal of reliability, validity, responsiveness and interpretability will be guided by the COnsensus-based Standards for the selection of health Measurement INstruments checklist. Feasibility/utility will be appraised using definitions and criteria derived from previous reviews. For reliability studies, we will also apply the Guidelines for Reporting Reliability and Agreement Studies to assess quality of reporting. Results will be synthesised narratively, separately for each measure, and by subgroup (eg, treatment setting, rater profession/experience or training) where possible. Meta-analyses will be undertaken where data are adequate.

ETHICS AND DISSEMINATION

Ethics approval is not required as no primary data will be collected. Outcomes will be disseminated to stakeholders via reports, journal articles and presentations at meetings and conferences.

PROSPERO REGISTRATION NUMBER

CRD42017057871.

Alberta CancerBridges development of a care plan evaluation measure

Background

No standardized measures specifically assess cancer survivors' and healthcare providers' experience of Survivor Care Plans (scps). We sought to develop two care plan evaluation (cpe) measures, one for survivors (cpe-s) and one for healthcare providers (cpe-p), examine initial psychometric qualities in Alberta, and assess generalizability in Manitoba, Canada.

Methods

We developed the initial measures using convenience samples of breast (n = 35) and head and neck (n = 18) survivors who received scps at the end of active cancer-centre treatment. After assessing Alberta's scp concordance with Institute of Medicine (iom) recommendations using a published coding scheme, we examined psychometric qualities for the cpe-s and cpe-p. We examined generalizability in Manitoba, Canada, with colorectal survivors discharged to primary care providers for follow-up (n = 75).

Results

We demonstrated acceptable internal consistency for the cpe-s and cpe-p subscales and total score after eliminating one item per subscale for cpe-s, two for cpe-p, resulting in revised scales with four 7-item and 6-item subscales, respectively. Subscale scores correlated highly indicating that for each measure the total score may be the most reliable and valid. We provide initial cpe-s discriminant, convergent, and predictive validity using the total score. Using the Manitoba sample, initial psychometrics similarly indicated good generalizability across differences in tumour groups, scp, and location.

Conclusions

We recommend the revised cpe-s and cpe-p for further use and development. Studies documenting the creation and standardization of scp evaluations are few, and we recommend further development of patient experience measures to improve both clinical practice and the specificity of research questions.

An Instrument to Measure Maturity of Integrated Care: A First Validation Study

INTRODUCTION

Lessons captured from interviews with 12 European regions are represented in a new instrument, the B3-Maturity Model (B3-MM). B3-MM aims to assess maturity along 12 dimensions reflecting the various aspects that need to be managed in order to deliver integrated care. The objective of the study was to test the content validity of B3-MM as part of SCIROCCO (Scaling Integrated Care into Context), a European Union funded project.

METHODS

A literature review was conducted to compare B3-MM's 12 dimensions and their measurement scales with existing measures and instruments that focus on assessing the development of integrated care. Subsequently, a three-round survey conducted through a Delphi study with international experts in the field of integrated care was performed to test the relevance of: 1) the dimensions, 2) the maturity indicators and 3) the assessment scale used in B3-MM.

RESULTS

The 11 articles included in the literature review confirmed all the dimensions described in the original version of B3-MM. The Delphi study rounds resulted in various phrasing amendments of indicators and assessment scale. Full agreement among the experts on the relevance of the 12 B3-MM dimensions, their indicators, and assessment scale was reached after the third Delphi round.

CONCLUSION AND DISCUSSION

The B3-MM dimensions, maturity indicators and assessment scale showed satisfactory content validity. While the B3-MM is a unique instrument based on existing knowledge and experiences of regions in integrated care, further testing is needed to explore other measurement properties of B3-MM.

Patient perspectives on continuity of care: adaption and preliminary psychometric assessment of a Norwegian version of the Nijmegen Continuity Questionnaire (NCQ-N)

Background

Continuity of care is regarded as a core quality element in healthcare. Continuity can be related to one or more specific caregivers but also applies to collaboration within a team or across boundaries of healthcare. Measuring continuity is important to identify problems and evaluate quality improvement of interventions.

This study aimed to assess the feasibility and psychometric properties of a Norwegian version of the Nijmegen Continuity Questionnaire (NCQ).

Methods

The NCQ was developed in The Netherlands. It measures patients’ experienced continuity of care across multiple care settings and as a multidimensional concept regardless of morbidity. The NCQ comprises 28 items categorised into three subscales; two personal continuity scales, “care giver knows me” and “shows commitment”, asked regarding the patient’s general practitioner (GP) and the most important specialist; and one “team/cross boundary continuity” scale, asked regarding primary care, specialised care and cooperation between GP and specialist, with a total of seven factors. The NCQ was translated and adapted to Norwegian (NCQ-N) and distributed among patients referred to somatic rehabilitation (N = 984, response rate 34.5%). Confirmatory factor analyses (CFA), Cronbach’s alpha, intra-class correlation (ICC) and Bland–Altman plots were used to assess psychometric properties.

Results

All patients (N = 375) who had responded to all parts of the NCQ-N were included in CFA. The CFA fit indices (CFI 0.941, RMSEA 0.064 (95% CI 0.059–0.070), SRMR 0.041) support a seven-factor structure in the NCQ-N based on the three subscales of the original NCQ. Cronbach’s alpha showed internal consistency (0.84–0.97), and was highest for the team/cross-boundary subscales. The NCQ-N showed overall high reliability with ICC 0.84–91 for personal continuity factors and 0.67–0.91 for team factors, with the lowest score for team continuity within primary care.

Conclusions

Psychometric assessment of the NCQ-N supports that this instrument, based on the three subscales of the original Dutch NCQ, captures the concept of “continuity of care” among adult patients with a variety of longstanding medical conditions who use healthcare on a regular basis. However, its usefulness among varied patient groups, including younger people, patients with acute disorders and individuals with mental health problems, should be further evaluated.

Electronic supplementary material

The online version of this article (10.1186/s12913-017-2706-1) contains supplementary material, which is available to authorized users.

Psychometric Properties of Language Assessments for Children Aged 4-12 Years: A Systematic Review

Introduction: Standardized assessments are widely used by speech pathologists in clinical and research settings to evaluate the language abilities of school-aged children and inform decisions about diagnosis, eligibility for services and intervention. Given the significance of these decisions, it is important that assessments have sound psychometric properties. Objective: The aim of this systematic review was to examine the psychometric quality of currently available comprehensive language assessments for school-aged children and identify assessments with the best evidence for use. Methods: Using the PRISMA framework as a guideline, a search of five databases and a review of websites and textbooks was undertaken to identify language assessments and published material on the reliability and validity of these assessments. The methodological quality of selected studies was evaluated using the COSMIN taxonomy and checklist. Results: Fifteen assessments were evaluated. For most assessments evidence of hypothesis testing (convergent and discriminant validity) was identified; with a smaller number of assessments having some evidence of reliability and content validity. No assessments presented with evidence of structural validity, internal consistency or error measurement. Overall, all assessments were identified as having limitations with regards to evidence of psychometric quality. Conclusions: Further research is required to provide good evidence of psychometric quality for currently available language assessments. Of the assessments evaluated, the Assessment of Literacy and Language, the Clinical Evaluation of Language Fundamentals-5th Edition, the Clinical Evaluation of Language Fundamentals-Preschool: 2nd Edition and the Preschool Language Scales-5th Edition presented with most evidence and are thus recommended for use.

Concepts, models and measurement of continuity of care in mental health services: A systematic appraisal of the literature

WHAT IS KNOWN ON THE SUBJECT?: Care continuity is considered to be a cornerstone of modern mental health care. As community mental health services have become increasingly fragmented and complex, the crucial criterion for best quality care has become the degree to which treatment delivered by separate services and professionals is continuous and well coordinated. However, clarification of the key elements of continuity has proved challenging and a consensus has not been reached. Recent research has shown significant levels of variation in the quality of care coordination across England and Wales, with potentially detrimental consequences for individuals. WHAT THIS PAPER ADDS TO EXISTING KNOWLEDGE?: Studies on care continuity identified in this review are grouped into three categories: studies defining concepts of care continuity, studies providing models of continuity and studies describing development of questionnaires about care continuity. There are many similarities and parallels between concepts of continuity described in the studies under review. Therefore, there is potential for developing a consensus on the nature of care continuity as a multidimensional concept. The priority placed upon the patient's experience of care continuity is identified as a major focus in these studies. WHAT ARE THE IMPLICATIONS FOR PRACTICE?: A consensus on the nature of care continuity would benefit both theory and practice in mental health nursing. It would provide a firmer foundation for new research seeking to improve continuity for people using services, and enable mental health nurses working as care coordinators to have a better understanding of the elements of their role that are most effective.

ABSTRACT

Introduction The increased complexity of community mental health services, and associated fragmentation of traditional dividing lines between services, has underscored the centrality of care continuity and coordination in modern mental health care. However, clarification of the key features of the care continuity concept has proved difficult and a consensus has not been reached. Aim/Question This review draws together and critically examines latest evidence concerning concepts, models and scales based on a multidimensional understanding of care continuity. Method Databases ASSIA, PubMed, MEDLINE and Cochrane were searched for papers dating from January 2005 to July 2016, of which 21 articles met the inclusion criteria. These were subjected to quality appraisal based on CASP and COSMIN checklists. Studies were grouped into three thematic categories describing concepts, models and scales of care continuity. Results/Discussion Synthesis indicated correspondence between independent, multidimensional models of care continuity, providing greater clarity regarding the essential features of the concept. Association, although not causation, between care continuity factors and health outcomes is supported by current evidence. Implications for practice Clarification of care continuity in mental health services may enable nurses working as care coordinators to develop a better understanding of key elements of their role, and provide guidance for future service development.

Survey Instruments to Assess Patient Experiences With Access and Coordination Across Health Care Settings: Available and Needed Measures

BACKGROUND

Improving access can increase the providers a patient sees, and cause coordination challenges. For initiatives that increase care across health care settings, measuring patient experiences with access and care coordination will be crucial.

OBJECTIVES

Map existing survey measures of patient experiences with access and care coordination expected to be relevant to patients accessing care across settings. Preliminarily examine whether aspects of access and care coordination important to patients are represented by existing measures.

RESEARCH DESIGN

Structured literature review of domains and existing survey measures related to access and care coordination across settings. Survey measures, and preliminary themes from semistructured interviews of 10 patients offered VA-purchased Community Care, were mapped to identified domains.

RESULTS

We identified 31 existing survey instruments with 279 items representing 6 access and 5 care coordination domains relevant to cross-system care. Domains frequently assessed by existing measures included follow-up coordination, primary care access, cross-setting coordination, and continuity. Preliminary issues identified in interviews, but not commonly assessed by existing measures included: (1) acceptability of distance to care site given patient's clinical situation; (2) burden on patients to access and coordinate care and billing; (3) provider familiarity with Veteran culture and VA processes.

CONCLUSIONS

Existing survey instruments assess many aspects of patient experiences with access and care coordination in cross-system care. Systems assessing cross-system care should consider whether patient surveys accurately reflect the level of patients' concerns with burden to access and coordinate care, and adequately reflect the impact of clinical severity and cultural familiarity on patient preferences.

Instruments Measuring Integrated Care: A Systematic Review of Measurement Properties

Policy Points: Investigations on systematic methodologies for measuring integrated care should coincide with the growing interest in this field of research. A systematic review of instruments provides insights into integrated care measurement, including setting the research agenda for validating available instruments and informing the decision to develop new ones. This study is the first systematic review of instruments measuring integrated care with an evidence synthesis of the measurement properties. We found 209 index instruments measuring different constructs related to integrated care; the strength of evidence on the adequacy of the majority of their measurement properties remained largely unassessed.

CONTEXT

Integrated care is an important strategy for increasing health system performance. Despite its growing significance, detailed evidence on the measurement properties of integrated care instruments remains vague and limited. Our systematic review aims to provide evidence on the state of the art in measuring integrated care.

METHODS

Our comprehensive systematic review framework builds on the Rainbow Model for Integrated Care (RMIC). We searched MEDLINE/PubMed for published articles on the measurement properties of instruments measuring integrated care and identified eligible articles using a standard set of selection criteria. We assessed the methodological quality of every validation study reported using the COSMIN checklist and extracted data on study and instrument characteristics. We also evaluated the measurement properties of each examined instrument per validation study and provided a best evidence synthesis on the adequacy of measurement properties of the index instruments.

FINDINGS

From the 300 eligible articles, we assessed the methodological quality of 379 validation studies from which we identified 209 index instruments measuring integrated care constructs. The majority of studies reported on instruments measuring constructs related to care integration (33%) and patient-centered care (49%); fewer studies measured care continuity/comprehensive care (15%) and care coordination/case management (3%). We mapped 84% of the measured constructs to the clinical integration domain of the RMIC, with fewer constructs related to the domains of professional (3.7%), organizational (3.4%), and functional (0.5%) integration. Only 8% of the instruments were mapped to a combination of domains; none were mapped exclusively to the system or normative integration domains. The majority of instruments were administered to either patients (60%) or health care providers (20%). Of the measurement properties, responsiveness (4%), measurement error (7%), and criterion (12%) and cross-cultural validity (14%) were less commonly reported. We found <50% of the validation studies to be of good or excellent quality for any of the measurement properties. Only a minority of index instruments showed strong evidence of positive findings for internal consistency (15%), content validity (19%), and structural validity (7%); with moderate evidence of positive findings for internal consistency (14%) and construct validity (14%).

CONCLUSIONS

Our results suggest that the quality of measurement properties of instruments measuring integrated care is in need of improvement with the less-studied constructs and domains to become part of newly developed instruments.

A Systematic Review of Measurement Properties of Patient-Reported Outcome Measures Used in Patients Undergoing Total Knee Arthroplasty

BACKGROUND

While clinical research on total knee arthroplasty (TKA) outcomes is prevalent in the literature, studies often have poor methodological and reporting quality. A high-quality patient-reported outcome instrument is reliable, valid, and responsive. Many studies evaluate these properties, but none have done so with a systematic and accepted method. The objectives of this study were to identify patient-reported outcome measures (PROMs) for TKA, and to critically appraise, compare, and summarize their psychometric properties using accepted methods.

METHODS

MEDLINE, EMBASE, SCOPUS, Web of Science, PsycINFO, and SPORTDiscus were systematically searched for articles with the following inclusion criteria: publication before December 2014, English language, non-generic PRO, and evaluation in the TKA population. Methodological quality and evidence of psychometric properties were assessed with the COnsensus-based standards for the selection of health Status Measurement INstruments (COSMIN) checklist and criteria for psychometric evidence proposed by the COSMIN group and Terwee et al.

RESULTS

One-hundred fifteen studies on 32 PROMs were included in this review. Only the Work, Osteoarthritis or joint-Replacement Questionnaire, the Oxford Knee Score, and the Western Ontario and McMaster Universities Arthritis Index had 4 or more properties with positive evidence.

CONCLUSION

Most TKA PROMs have limited evidence for their psychometric properties. Although not all the properties were studied, the Work, Osteoarthritis or joint-Replacement Questionnaire, with the highest overall ratings, could be a useful PROM for evaluating patients undergoing TKA. The methods and reporting of this literature can improve by following accepted guidelines.

Measurement properties of mental health literacy tools measuring help-seeking: a systematic review

BACKGROUND

Mental health literacy is important to improve help-seeking behaviors. However, the quality of mental health help-seeking tools remains unknown.

AIMS

We conducted a systematic review to appraise the quality of such tools.

METHODS

We searched databases for English publications addressing psychometrics of help-seeking tools. We included help-seeking tools addressing mental health in general and tools on four mental disorders: anxiety, depression, attention deficit hyperactivity disorder (ADHD) and schizophrenia. We determined the methodological quality of studies as "excellent", "good", "fair", or "indeterminate". We ranked the level of evidence of each measurement property as "strong", "moderate", "limited", "conflicting" or "unknown".

RESULTS

We found 12 help-seeking tools in 24 studies that assessed related psychometrics. The methodological quality of included studies ranged from "poor" to "excellent" with four studies on the content validity, structural validity or internal consistency demonstrating "excellent" quality. Three tools demonstrated overall strong evidence (content or structural validity); eight tools demonstrated moderate evidence (internal consistency, structural or construct validity); and eight tools demonstrated limited evidence (reliability, construct validity or internal consistency).

CONCLUSIONS

We recommend the application of tools with strong or moderate evidence for their psychometric properties. Future research may focus on the generalizability of the tools across diverse settings.

Development and Preliminary Validation of the Scale for Evaluation of Psychiatric Integrative and Continuous Care-Patient's Version

This pilot study aimed to evaluate and examine an instrument that integrates relevant aspects of cross-sectoral (in- and outpatients) mental health care, is simply to use and shows satisfactory psychometric properties. The development of the scale comprised literature research, held 14 focus groups and 12 interviews with patients and health care providers, item-pool generation, content validation by a scientific expert panel, and face validation by 90 patients. The preliminary scale was tested on 385 patients across seven German hospitals with cross-sectoral mental health care (CSMHC) as part of their treatment program. Psychometric properties of the scale were evaluated using genuine and transformed data scoring. To check reliability and postdictive validity of the scale, Cronbach's α coefficient and multivariable linear regression were used. This development process led to the development of an 18-item scale called the "Scale for Evaluation of Psychiatric Integrative and Continuous Care (SEPICC)" with a two-point and five-point response options. The scale consists of two sections. The first section assesses the presence or absence of patients' experiences with various CSMHC' relevant components such as home treatment, flexibility of treatments' switching, case management, continuity of care, cross-sectoral therapeutic groups, and multidisciplinary teams. The second section evaluates the patients' opinions about these relevant components. Using raw and transformed scoring resulted into comparable results. However, data distribution using transformed scoring showed a smaller deviation from normality. For the overall scale, the Cronbach's α coefficient was 0.82. Self-reported experiences with relevant components of the CSMHC were positively associated with the patients approval of these components. In conclusion, the new scale provides a good starting point for further validation. It can be used as a tool to evaluate CSMHC. Methodologically, using transformed data scoring appeared to be preferable because of a smaller deviation from normality and a higher reliability measured by Cronbach's α.

Effect of continuity of care on health-related quality of life in adult patients with hypertension: a cohort study in China

Background

Continuity of care is widely considered a principle of primary care that decreases healthcare utilization and mortality. However, the effect of continuity of care on health-related quality of life (HRQoL) for adult patients with hypertension remains unclear.

Methods

To further evaluate the effect of continuity of care, we implemented a cohort study among hypertensive patients aged over 35 years (n = 1200) in six townships in Qianjiang District, Chongqing, China, between 2012 and 2014. The study ultimately included 1079 participants. The continuity of care index was calculated using claim-based longitudinal data obtained from hypertension follow-up service records. The baseline and endline survey-based data, tested by the SF-36 scale, were used to assess HRQoL. To control selection bias and examine the effect of continuity of care, a kernel-based propensity score matching difference-in-differences (DID) method was used. Additionally, descriptive statistics, chi-squared test, and Mann–Whitney nonparametric test were used to summarize characteristics, evaluate proportional differences, and analyze statistical differences, respectively.

Results

Our results showed that patients in the high continuity of care group presented greater improvement in both Physical Component Summary (PCS, DID = 5.192 ± 1.970, p < 0.001) and Mental Component Summary (MCS, DID = 7.900 ± 1.815, p = 0.008) than those in the low continuity of care group. Moreover, patients in the high continuity of care group showed significant improvement in physical functioning, role-physical, general health, role-emotional, and mental health.

Conclusions

Our findings indicate that a long-term physician-patient relationship may improve HRQoL in patients with hypertension. However, more unified measurement tools are needed to evaluate continuity of care. Further studies should include more study settings.

Measurement properties of tools measuring mental health knowledge: a systematic review

BACKGROUND

Mental health literacy has received great attention recently to improve mental health knowledge, decrease stigma and enhance help-seeking behaviors. We conducted a systematic review to critically appraise the qualities of studies evaluating the measurement properties of mental health knowledge tools and the quality of included measurement properties.

METHODS

We searched PubMed, PsycINFO, EMBASE, CINAHL, the Cochrane Library, and ERIC for studies addressing psychometrics of mental health knowledge tools and published in English. We applied the COSMIN checklist to assess the methodological quality of each study as "excellent", "good", "fair", or "indeterminate". We ranked the level of evidence of the overall quality of each measurement property across studies as "strong", "moderate", "limited", "conflicting", or "unknown".

RESULTS

We identified 16 mental health knowledge tools in 17 studies, addressing reliability, validity, responsiveness or measurement errors. The methodological quality of included studies ranged from "poor" to "excellent" including 6 studies addressing the content validity, internal consistency or structural validity demonstrating "excellent" quality. We found strong evidence of the content validity or internal consistency of 6 tools; moderate evidence of the internal consistency, the content validity or the reliability of 8 tools; and limited evidence of the reliability, the structural validity, the criterion validity, or the construct validity of 12 tools.

CONCLUSIONS

Both the methodological qualities of included studies and the overall evidence of measurement properties are mixed. Based on the current evidence, we recommend that researchers consider using tools with measurement properties of strong or moderate evidence that also reached the threshold for positive ratings according to COSMIN checklist.

Evaluating Continuity During Transfer to Adult Care: A Systematic Review

CONTEXT

Appropriate outcomes are required to evaluate transition programs' ability to maintain care continuity during the transfer to adult care of youths with a chronic condition.

OBJECTIVE

To identify the outcomes used to measure care continuity during transfer, and to analyze current evidence regarding the efficacy of transition programs.

DATA SOURCES

PubMed (1948-2014), Web of Science (1945-2014), Embase (1947-2014), and the reference lists of the studies identified.

STUDY SELECTION

Screening on titles and abstracts; full-text assessment by 2 reviewers independently.

DATA EXTRACTION

By 2 reviewers independently, by using a Cochrane form adapted to observational studies, including bias assessment.

RESULTS

Among the 23 studies retrieved, all but 5 were monocentric, 16 were cohorts (15 retrospective), 6 cross-sectional studies, and 1 randomized trial. The principal disease studied was diabetes (n = 11). We identified 24 indicators relating to 2 main aspects of continuity of care: engagement and retention in adult care. As designed, most studies probably overestimated engagement. A lack of adjustment for confounding factors was the main limitation of the few studies evaluating the efficacy of transition programs.

LIMITATIONS

The assessment of bias was challenging, due to the heterogeneity and observational nature of the studies.

CONCLUSIONS

This review highlights the paucity of knowledge about the efficacy of transition programs for ensuring care continuity during the transfer from pediatric to adult care. The outcomes identified are relevant and not specific to a disease. However, the prospective follow-up of patients initially recruited in pediatric care should be encouraged to limit an overestimation of care continuity.

Time to manage: patient strategies for coping with an absence of care coordination and continuity

This paper examines how people with chronic illnesses respond to absences of continuity and coordination of care. Little work has been done on how the ill person might mitigate flaws in a less than optimal system. Our qualitative research, carried out among 91 participants in Australia, reveals that people with chronic illnesses create strategies to facilitate the management of their care. These strategies included efforts to improve communication between themselves and their health care practitioners; keeping personal up-to-date medication lists; and generating their own specific management plans. While we do not submit that it is patients' responsibility to attend to gaps in the health system, our data suggests that chronically ill people can, in and through such strategies, exert a measure of agency over their own care; making it effectively more continuous and coordinated. Participants crafted strategies according to the particular social and bodily rhythms that their ongoing illnesses had lent to their lives. Our analysis advances the view that the ill body itself is capable of enfolding the health system into the rhythms of illness - rather than the ill body always fitting into the overarching structural tempo. This entails an agent-centric view of time in illness experience. A Virtual Abstract of this paper can be found at: https://youtu.be/UwbxlEJOTx8.

Evaluation of the Measurement Properties of Self-reported Medication Adherence Instruments Among People at Risk for Metabolic Syndrome: A Systematic Review

PURPOSE

The purpose of this study was to present a systematic review of available published studies that evaluated the measurement properties of self-reported instruments assessing global medication adherence in adults at risk for metabolic syndrome.

METHODS

The authors searched PubMed, EMBASE, PsycINFO, and CINAHL in January 2015 for appropriate studies. The methodological quality (based on reliability, validity, responsiveness, and interpretability) of selected studies was assessed with the COSMIN checklist (Consensus-Based Standards for the Selection of Health Measurement Instruments).

RESULTS

Of the 44 studies reviewed, 32 used classical test theory, and 14 used self-reported medication adherence instruments. More than half the studies included patients with hypertension, followed by diabetes, dyslipidemia, and increased body mass index. Among the measurement properties, internal consistency, hypothesis testing, and structural validity were frequently assessed items, whereas only 1 study evaluated responsiveness, and none evaluated measurement error. The MMAS-8 (Morisky Medication Adherence Scale-8 items) and the Hill-Bone scale were the most frequently used instruments. They were found to be well validated, with strong evidence for internal consistency and strong positive evidence for reliability, structural validity, hypothesis testing, and criterion validity.

CONCLUSIONS

The MMAS-8 and Hill-Bone scale seem to be well-validated instruments for assessing medication adherence in adults at risk for metabolic syndrome. These findings may assist clinicians with selecting the appropriate instruments for assessing medication adherence in this population. However, further studies might be needed to define concepts to better understand the dimensions of each medication adherence instrument.

Measurement properties of multidimensional patient-reported outcome measures in neurodisability: a systematic review of evaluation studies

AIM

To identify and appraise the quality of studies that primarily assessed the measurement properties of English language versions of multidimensional patient-reported outcome measures (PROMs) when evaluated with children with neurodisability, and to summarize this evidence.

METHOD

MEDLINE, Embase, PsycINFO, CINAHL, AMED, and the National Health Service Economic Evaluation Database were searched. The methodological quality of the papers was assessed using the COnsensus-based Standards for selection of health Measurement INstruments checklist. Evidence of content validity, construct validity, internal consistency, test-retest reliability, proxy reliability, responsiveness, and precision was extracted and judged against standardized reference criteria.

RESULTS

We identified 48 studies of mostly fair to good methodological quality: 37 papers for seven generic PROMs (CHIP, CHQ, CQoL, KIDSCREEN, PedsQL, SLSS, and YQOL), seven papers for two chronic-generic PROMs (DISABKIDS and Neuro-QOL), and four papers for three preference-based measures (HUI, EQ-5D-Y, and CHSCS-PS).

INTERPRETATION

On the basis of this appraisal, the DISABKIDS appears to have more supportive evidence in samples of children with neurodisability. The overall lack of evidence for responsiveness and measurement error is a concern when using these instruments to measure change, or to interpret the findings of studies in which these PROMs have been used to assess change.