Psychometric properties of instruments measuring quality and satisfaction in mental health: A systematic review

User Satisfaction with Child and Adolescent Mental Health Services: Factor Structure of the Experience of Service Questionnaire (ESQ) in Norway and the UK

BACKGROUND

Child and Adolescent Mental Health Services (CAMHS) are expected to track user satisfaction routinely, and to this end, the Experience of Service Questionnaire (ESQ) is increasingly being adopted worldwide. The literature is inconsistent concerning the underlying factor structure of satisfaction measures, and debate is ongoing regarding the evidence of a general satisfaction factor.

AIM

This study aimed to examine the factor structure and dimensionality of the parent/carer and adolescent versions of the ESQ in the UK and Norway.

METHODS

Data were retrieved from routine CAMHS clinical practice in the UK and Norway. Three models suggested by the research group were tested through Confirmatory Factor Analysis (CFA) and reliability testing.

RESULTS

A series of CFAs revealed sound psychometric properties of the ESQ in all samples. A bifactor model with a general satisfaction factor and two specific factors of Satisfaction with Care and Satisfaction with Environment fitted the data best, except for the Norwegian adolescent version where a unidimensional model was kept.

CONCLUSION

The results support the continued use of the ESQ in CAMHS in the UK and Norway and significantly contribute to the literature on user satisfaction by adding evidence of a general satisfaction factor.

A Norwegian adaptation of the quality in psychiatric care - inpatient staff (QPC-IPS): psychometric evaluation and staff assessment of quality of care

BACKGROUND

The restructuring and decentralization of psychiatric services in Norway, aligning with global trends, has sparked debate on quality assurance. This study aimed to evaluate the psychometric properties of the Norwegian version of the Quality in Psychiatric Care - Inpatient Staff (QPC-IPS). Additionally, it sought to investigate the sociodemographic and work-related factors associated with staff perceptions of the quality of inpatient psychiatric care that they provide.

MATERIAL AND METHODS

The Swedish QPC-IPS, a 30-item, 6-dimension tool, was thoroughly translated for the Norwegian psychiatric care setting. A web survey, including the QPC-IPS and sociodemographic and work-related items, was distributed to the mental health staff of two Norwegian health trusts, yielding 117 responses.

RESULTS

The adapted version underwent confirmatory factor analysis, revealing a factor structure consistent with the original QPC-IPS and its versions in other languages. Staff generally reported high-quality care, with the highest for the secluded environment and the lowest for the secure environment. Positive associations were found between quality perceptions and factors, such as professional development, openness to quality assurance, and participation in quality work. Psychosocial environments and staff mental health were positively linked to quality-of-care dimensions and the staff recommendations correlated with their perception of patients' experiences of quality of care.

CONCLUSIONS

The Norwegian QPC-IPS demonstrated adequate psychometric properties, facilitating its use in assessing psychiatric care staff's perception of patients' experiences of quality of care. Insights from staff perspectives contribute to identifying areas for improvement in inpatient psychiatric care, thereby enhancing cross-cultural comparisons and theory development in this domain.

Introduction and Systematic Review of the Good Nursing Care Scale

AIM(S)

To provide an introduction to the Good Nursing Care Scale (GNCS) and systematically review the application of the scale in health research.

DESIGN

Systematic review.

METHODS

Empirical studies published in English or Finnish in peer-reviewed journals or as a summary of a PhD thesis where the scale was used for data collection amongst patients were included. Analysis was made by using descriptive statistics, narrative analysis, and evaluation of psychometric properties.

DATA SOURCES

PubMed, CINAHL, Cochrane, and Scopus in October 2023.

RESULTS

A total of 26 full-text studies and summaries of PhD theses were included in the review. The GNCS has been developed systematically, and the theoretical structure has remained stable. The studies indicate a high level of patient-centered quality of nursing care. Validity and reliability evaluation and reporting were systematic in the studies and mainly indicate sufficient level. Variations between countries are not large, supporting the international use of the GNCS.

CONCLUSIONS

Patient-centered quality of nursing care is predominantly at high levels. However, systematic evaluation is needed to provide longitudinal data. For that purpose, the GNCS is one potential instrument.

IMPLICATIONS FOR THE PROFESSION AND PATIENT CARE

Support for the use of existing, tested instruments is encouraged to provide critical ideas for the future needs of nurse practitioners, managers, teachers and researchers.

IMPACT

This paper impacts researchers interested in systematic evaluation of the patient-centered quality of nursing care and for practitioners taking care of patients. For researchers, it introduces a relevant instrument, the GNCS, for analysing the quality or for comparing the quality with other instruments. For practitioners, it produces evidence of the usability of the GNCS.

REPORTING METHOD

PRISMA guided the systematic review, and the COSMIN guideline was used for quality appraisal of included studies.

PATIENT OR PUBLIC CONTRIBUTION

No Patient or Public contribution.

Norwegian adaptation of the Quality in Psychiatric Care - In-Patient instrument: psychometric properties and factor structure

BACKGROUND

Validated instruments measuring the quality of mental healthcare from patients' perspectives are scarce, and available instruments have been requested. One of the few instruments measuring the quality of care from a patient's perspective is the Swedish Quality in Psychiatric Care-In-Patient (QPC-IP). This cross-sectional study aimed to translate and adapt the QPC-IP instrument for a Norwegian context and assess its psychometric properties.

METHODS

The QPC-IP was translated and adapted to a Norwegian context using a translation back-translation process model. A total of 169 inpatients from specialised mental health services responded to the questionnaire. The QPC-IP comprises six dimensions: Encounter (eight items), Participation (eight items), Discharge (four items), Support (four items), Secluded Environment (three items), and Secure Environment (three items), totalling 30 items. Confirmatory factor analysis was conducted to assess the instrument's factor structure. Additionally, Cronbach's alpha was used to establish the instrument's internal consistency.

RESULTS

The results indicated that the Norwegian adaptation of the QPC-IP possesses good psychometric properties, including internal consistency, content, and construct validity, as confirmed by the confirmatory factor analysis results. The confirmatory factor analysis demonstrated an adequate fit for the six-factor structure, consistent with the original Swedish instrument.

CONCLUSIONS

The QPC-IP is a user-friendly and easily implementable tool that assesses various dimensions of the quality of inpatient mental healthcare from a patient's perspective. Moreover, the Norwegian QPC-IP holds potential for use in comparative, cross-cultural studies within mental healthcare services to monitor the quality of the provided services.

The Spanish Adaptation of the Quality in Psychiatric Care-Forensic Inpatient (QPC-FIP) Instrument: Psychometric Properties

Background/Objectives: The quality of care in forensic mental health services is a factor that significantly impacts recovery and constitutes a right of the individuals receiving treatment. However, there is a lack of instruments to assess the perceived quality of care among individuals in this setting. Quality in Psychiatric Care-Forensic Inpatient (QPC-FIP) is a Swedish instrument that measures the perception of quality care from the perspectives of patients in the forensic setting. The aim of this study was to perform a cross-cultural adaptation of the QPC-FIP instrument into Spanish and to assess its reliability and validity. Methods: For the adaptation process, a translation-backtranslation of the instrument was performed. Regarding psychometric properties, the sample consisted of 120 inpatients in the forensic setting to whom the instrument was applied. To assess temporal stability, the instrument was readministered after 10 days (n = 98). Results: The confirmatory factor analysis showed an equivalent seven-factor structure with the original version, presenting a satisfactory model fit. Regarding reliability, the Cronbach's alpha value was 0.933, and the intraclass correlation coefficient was 0.836 (95% IC: 0.742-0.896), revealing results higher than 0.70 in six of the seven factors. Conclusions: The Spanish version of the QPC-FIP instrument showed adequate validity and reliability values, indicating that is a useful tool for measuring quality in psychiatric care in the forensic context.

Patients' perception of the quality of psychiatric inpatient care in the Faroe Islands

PURPOSE

Evaluating the quality of psychiatric care from the patient's perspective is crucial to measure the effectiveness of the provided care. This study aimed to translate the original Swedish Quality in Psychiatric Care - Inpatient (QPC-IP) instrument into Faroese, adapting it to the specific context of psychiatric inpatient care in the Faroe Islands, conducting a detailed evaluation of its psychometric properties, and to describe patients' perception of quality of psychiatric care.

MATERIALS AND METHODS

Following a thorough translation and back-translation, the content validity of the Faroese QPC-IP was confirmed by a group of Faroese patients. Subsequently, the instrument was completed by 61 psychiatric inpatients.

RESULTS

Item total correlations revealed that most items strongly correlated with their intended dimensions, mirroring the original Swedish version. However, a noteworthy exception was found in the discharge dimension, leading to the exclusion of an item related to helping find an occupation; this task was not performed by the ward. While the internal consistency of the overall scale was excellent, specific dimensions exhibited lower consistency.

CONCLUSIONS

The translation and cultural adaptation of the Faroese QPC-IP proved satisfactory. The psychometric evaluation affirmed a shared understanding of the quality of psychiatric care in both Faroese and Swedish cultural contexts. As a result, the Faroese QPC-IP emerges as a valuable instrument for assessing the quality of psychiatric care in the Faroe Islands. Its utility extends to quality assurance initiatives and contributes to cross-cultural research examining the quality of psychiatric care from the patient's perspective.

American Psychiatric Nurses Association Position: Staffing Inpatient Psychiatric Units

OBJECTIVE

An American Psychiatric Nurses Association (APNA) task force reviewed current staffing research to revise and update the 2011 APNA "Staffing inpatient psychiatric units" position paper and provide recommendations to the APNA Board of Directors on how psychiatric mental health (PMH) nurses might champion the staffing needs of inpatient psychiatric units.

METHODS

Current research on staffing and nursing practice in inpatient psychiatric units was reviewed as well as variables believed to influence staffing and nursing practice, such as consumer needs and workplace culture. Since current nurse staffing principles emphasize nursing value and how that value is connected to outcomes, the literature search included a focus on staffing and related patient outcomes.

RESULTS

PMH nurses are critical to the safety and quality of care in inpatient psychiatric units. However, there are little existing data on the relationship between staffing levels and even common adverse events such as staff injury and restraint of patients. Furthermore, there is scant research conducted on inpatient psychiatric units that informs optimal staffing models or establishes links between staffing and patient outcomes.

CONCLUSIONS

Consistent with current evidence, the universal use of a single method or model of determining staffing needs (e.g., nursing hours per, case mix index, or mandatory ratios) is not recommended. PMH nurses should champion systematic evaluation of staffing on their inpatient units against select patient, nurse, and system outcomes. A data repository of PMH nurse-sensitive outcomes is necessary to benchmark unit performance and staffing.

Patient experiences in psychiatric departments for the elderly (PEPDE): development, properties, and use of a brief questionnaire

BACKGROUND

Measuring patient experiences at psychiatric inpatient departments for the elderly need measurements adapted to the situation and challenges of the age group. We did not find any such instrument. The aim of this study then was to develop and document the measurement properties of a reliable and valid questionnaire about experiences of patients without severe neurocognitive disturbances at psychiatric inpatient departments for the elderly, which can be used in quality improvement and research.

METHODS

Aiming for good content validity, we developed a questionnaire with 37 questions based on a review of the literature on important aspects for the elderly in psychiatric inpatient departments and on feedback from elderly patients from other questionnaires developed for use in psychiatric departments for adults. Using this first questionnaire, we collected data from 151 patients in psychiatric departments for the elderly in nine health trusts. We then revised the questionnaire based on comments from patients and interviewers on the questions, and we decided which questions we would keep and which we needed to adjust to improve clarity. This resulted in a final questionnaire of 20 questions. We analyzed the internal structure (factors and their internal consistency) of this final questionnaire based on data collected from a new sample of 96 patients. To test the construct validity of the questionnaire, a sample of 26 service user representatives, clinicians and researchers were asked to sort the questions based on identified factors.

RESULTS

The final questionnaire consisted of 20 questions giving a valid and reliable measurement tool with four subscales: Patient-centered Interaction, Outcome, Care and Safety, and Information on Rights. Very few unanswered questions indicate that the questionnaire is feasible, as patients seemed to understand the questions and the response scales well. It is desirable that structural validity is confirmed with a larger sample.

CONCLUSION

Our final questionnaire "Patient Experiences in Psychiatric Departments for the Elderly" (PEPDE) has adequate measurement properties and seems to be well understood. It can be used as a questionnaire or an interview for quality improvement and research.

Validating Psychometric Properties of a Revised Patient Version of the Combined Assessment of Psychiatric Environments (CAPE)

BACKGROUND

Measuring patient experience is an essential challenge in the inpatient behavioral health population.

AIM

This initiative analyzed the psychometric properties of a revised version of the patient Combined Assessment of Psychiatric Environments (p-CAPE-R) survey.

METHODS

The p-CAPE was revised to encompass the interdisciplinary treatment team and implemented on five inpatient psychiatric units at an academic medical center. A psychometric analysis was performed on the p-CAPE-R.

RESULTS

Analysis of factor loadings with a large sample (n = 786) revealed a more coherent item structure under the "staff competency and engagement" and "treatment effectiveness" domains than presented in the original instrument development research.

CONCLUSIONS

Although the p-CAPE-R reflects a more useful and psychometrically sound instrument than the original p-CAPE, further analysis and revision to reflect the entire interdisciplinary team is warranted.

Latent structure and factor reliability of the National Health Service Community Mental Health Service User Questionnaire

BACKGROUND

National Health Service use the Community Mental Health Service User Questionnaire (NHS-CMH) to assess care quality. However, its reliability and internal validity is uncertain.

AIMS

To test the NHS-CMH structure, reliability and item-level characteristics.

METHODS

We used data from 11,373 participants who answered the 2017 NHS-CMH survey. First, we estimated the NHS-CMH structure using Exploratory Factor Analysis (EFA) in half of the dataset. Second, we tested the best EFA-derived model with Confirmatory Factor Analysis (CFA). We tested the internal validity, construct reliability (omega - ω), explained common variance of each factor (ECV), and item thresholds.

RESULTS

EFA suggested a 4-factor solution. The structure derived from the EFA was confirmed, demonstrating good reliability for the four correlated dimensions: "Relationship with Staff" (ω = 0.952, ECV = 40.1%), "Organizing Care" (ω = 0.855, ECV = 21.4%), "Medication and Treatments" (ω = 0.837, ECV = 13.3%), and "Support and Well-being" (ω = 0.928, ECV = 25.3%). A second-order model with a high-order domain of "Quality of Care" is also supported.

CONCLUSIONS

The NHS-CMH can be used to reliably assess four user-informed dimensions of mental health care quality. This model offers an alternative for its current use (item-level and untested sum scores analysis).

Spanish adaptation of the quality in psychiatric care-outpatient (QPC-OP) instrument community mental health patients’ version: psychometric properties and factor structure

Background

Health systems in the field of mental health are strongly committed to community models that allow patients to be attended in their own environment. This helps them to maintain their family and social ties while trying to avoid costly hospital admissions. The patients’ perspective is a key component in the assessment of the quality of psychiatric care and can even determine their adherence to the devices where they are treated. However, there are few instruments with adequate psychometric properties for the evaluation of the quality of psychiatric care in community mental health. The Quality in Psychiatric Care – Outpatient (QPC-OP) instrument has adequate psychometric properties to assess the quality of psychiatric care from the patients’ perspective. The aim of this study was to adapt and validate the Spanish version of the QPC-OP instrument.

Methods

A translation and back-translation of the instrument was carried out. To examine its psychometric properties, the instrument was administered to 200 patients attending various community mental health services. To assess test-retest reliability, the instrument was readministered after 7-14 days (n = 98).

Results

The Confirmatory Factor Analysis revealed a structure of 8 factors identical to the original version, with an adequate model fit. The internal consistency coefficient (Cronbach’s alpha) was 0.951. The intraclass correlation coefficient was 0.764 (95% IC: 0.649 – 0.842), and higher than 0.70 in 5 of the 8 factors. Additionally, an EFA was performed and revealed that the instrument could behave in a unifactorial or four factor manner in the sample analyzed.

Conclusions

Results show that the Spanish version of the QPC-OP instrument is valid and reliable for the assessment of quality of psychiatric care in the community setting.

Delineating Quality Indicators of Inpatient Psychiatric Hospitalization

BACKGROUND

Assuring quality care is critical to the well-being and recovery of individuals receiving inpatient psychiatric treatment, yet a comprehensive map of quality inpatient care does not exist.

AIMS

To isolate and describe quality elements of inpatient psychiatric treatment.

METHODS

A survey queried psychiatric inpatient nursing leaders on what they considered to be critical elements of quality. The survey was emailed to 40 American Psychiatric Nurses Association members, and 39 individuals responded. In the survey, participants were asked to comment on the importance of six dimensions of quality as well as quality indicators used on their units.

RESULTS

Data from this survey indicate how thought leaders conceptualized quality of inpatient care. A unifying philosophy of care was endorsed as a quality element as was structure that affords staff available time on the unit-engaging with patients. While staffing levels were viewed as important, the respondents commented on the nuances between staffing and quality. Participants endorsed the importance of involving individuals in their treatment planning as well as tapping into patients' perspectives on the treatment experience.

CONCLUSIONS

The participants' responses compliment the quality literature and reinforce the need to develop a comprehensive map of quality elements. These elements interact in complex way, for instance, staffing, engagement, and teamwork is tied to the organizational structure and philosophy of care, which in turn facilitates consumer involvement in care. Thus, gauging the impact of quality on outcomes will demand consideration of the interaction of factors not just the linear relationship of one element to an outcome.

Cross-cultural adaptation and psychometric properties of the Spanish Quality in Psychiatric Care Forensic Inpatient Staff (QPC-FIPS) instrument

"Quality in Psychiatric Care-Forensic Inpatient Staff (QPC-FIPS) is an instrument of Swedish origin validated to measure the perception of the quality of mental health care provided by forensic psychiatry professionals. The aim of this study was to cross-culturally adapt the QPC-FIPS instrument and to evaluate the psychometric properties of the Spanish version of the instrument. A psychometric study was carried out. For validity, content validity, convergent validity and construct validity were included. For reliability, the analysis of internal consistency and temporal stability was included. The sample consisted of 153 mental health professionals from four Forensic Psychiatry units. The adapted Spanish version of the QPC-FIPS scale was configured with the same number of items and dimensions as the original. The psychometric properties, in terms of temporal stability and internal consistency, were adequate and the factor structure, such as the homogeneity of the dimensions of the Spanish version of the QPC-FIPS, was equivalent to the original Swedish version. We found that the QPC_FIPS-Spanish is a valid, reliable and easy-to-apply instrument for assessing the self-perception of professionals regarding the care they provide.

The Quality in Psychiatric Care–Inpatient Staff Instrument: A Psychometric Evaluation

Much work has focused on the development of instruments that measure the quality of care, but few studies have been published for staff assessment of the quality of care provided by inpatient psychiatric care. Therefore, an instrument is needed to measure the quality of care from the perspective of facility staff. The aim of the present study was to evaluate the psychometric properties and factor structure of the Quality in Psychiatric Care-Inpatient Staff (QPC-IPS) instrument. A sample of 104 staff at seven wards in four regions in Sweden completed the QPC-IPS, which consists of 30 items covering six dimensions of quality. Confirmatory factor analysis confirmed the proposed six factor structure of the QPC-IPS. Internal consistency for the full QPC-IPS was adequate, but poor for some of the dimensions. Staff ratings of the quality of care were generally high. The highest rating was for the Support dimension and the lowest for the Secure environment dimension.

Adaption and Cultural Validation of the Quality in Psychiatric Care-Outpatient Staff (QPC-OPS) Instrument to a Norwegian Community Mental Health Context

The aim was to culturally adapt and validate the Swedish Quality in Psychiatric Care-Outpatient Staff (QPC-OPS) instrument for use in a Norwegian community mental health service context. The translated and culturally adapted instrument was named Quality in Psychiatric Care-Community Outpatient Staff (QPC-COPS). Three expert panels of mental health staff (n = 9) assessed the face and content validity. The internal consistency and test–retest reliability were assessed on a sample of community mental health staff (n = 64). The QCP-COPS had adequate face and content validity, and the full instrument showed excellent internal consistency (alpha = 0.90) and test–retest reliability (ICC = 0.87:0.94). In conclusion, the QPC-COPS is a valid and reliable instrument suitable for measuring staff’s perception of the quality of care they deliver in community mental health services.

Adaptation, psychometric properties and factor structure of the Spanish Quality in Psychiatric Care-Outpatient Staff (QPC-OPS) instrument

Quality of care is a multidimensional concept that should include the perspectives of all parties involved. There are few instruments with adequate psychometric properties for the assessment of the quality of psychiatric care in community mental health. Quality in Psychiatric Care-Outpatient Staff (QPC-OPS) instrument has adequate psychometric properties to evaluate the quality of psychiatric care from the perspective of professionals. The aim of this study was to validate the Spanish version of the QPC-OPS instrument. The instrument was translated and back-translated, and then was administered to 260 professionals from distinct community mental health services. To assess test–retest reliability, it was re-administered after 7–14 days (n = 157). Confirmatory factor analysis revealed an 8-factor-structure identical to the original version, showing the good fit of the model. The internal consistency coefficient (Cronbach’s alpha) was 0.885. The intraclass correlation coefficient was 0.847 (95% IC 0.790–0.888), which was higher than 0.70 in all factors bar one. The NT394 General Satisfaction Scale was used for analysis of convergent validity showing a rho correlation of 0.31 (p < 0.0001). Results show that the Spanish version of the QPC-OPS instrument is valid and reliable for the assessment of the quality of psychiatric care in the community setting.

The Forensic High and Intensive Care Monitor: Measurement Properties of a Model Fidelity Scale for Contact-Based Care in Forensic Psychiatry

Forensic High and Intensive Care (FHIC) has recently been developed as a new care model in Dutch forensic psychiatry. FHIC aims to provide contact-based care. To support Dutch forensic care institutions in the implementation of the model, a model fidelity scale was developed called the FHIC monitor. The aim of this study was to assess the inter-rater reliability, content validity, and construct validity of the FHIC monitor. A multi-methods design was used, combining qualitative and quantitative research. To collect data, audits and focus group meetings were organized to score care at individual wards with the monitor and get feedback from auditors and audit receiving teams about the quality of the monitor. In total, fifteen forensic mental healthcare institutions participated. The instrument showed acceptable inter-rater reliability and content validity, and a significant difference between expected high and low scoring institutions, supporting construct validity. The instrument can be used as a valid instrument to measure the level of implementation of the FHIC model on forensic psychiatric wards in the Netherlands.

Development and Validation of the Psychiatric Inpatient Experience (PIX) Survey: A Novel Measure of Patient Experience Quality Improvement

Objective: Managing patient experience is critical in transforming organizational cultures into high-quality patient-centered care systems. Patient experience measurement should ideally entail a framework for understanding a patient's interactions and perceptions across the continuum of care. The purpose of this study was to develop a psychometrically valid survey via a rigorous measurement development and validation process. Methods: An initial 28-item, five-domain survey with 2 additional open-ended prompts for narrative feedback was developed and piloted using exploratory and confirmatory factor analyses on a sample of 2438 individuals. A thematic analysis was subsequently performed based on the open-ended items to elucidate primary and secondary themes of patients’ narrative feedback. Results were used to further inform a conceptual framework and item design. Results: Factor analyses produced 4 factors (treatment team relationships, nursing team presence, treatment effectiveness, and healing environment). These 4 factors are associated with inpatient psychiatric patient experience, suggesting validity. Discussion: The Psychiatric Inpatient Experience (PIX) ysurvey integrates patient experience theory as well as aspects of patient-centered care that are important to psychiatric inpatients. It provides organization and discipline-specific feedback to facilitate opportunities for patient experience improvements.

A Spanish adaptation of the Quality in Psychiatric Care-Inpatient (QPC-IP) instrument: Psychometric properties and factor structure

Background and aim

Western countries share an interest in evaluating and improving quality of care in the healthcare field. The aim was to develop and examine the psychometric properties and factor structure of the Spanish version of the Quality in Psychiatric Care–Inpatient (QPC-IP) instrument.

Methods

A psychometric study was conducted, translating the QPC-IPS instrument into Spanish, revision of the instrument by a panel of experts, and assessing its psychometric properties. 150 psychiatric inpatients completed the QPC-IP. Test-retest reliability was assessed by re-administering the questionnaire to 75 of these patients.

Results

After conducting pilot testing and a cognitive interview with 30 inpatients, it was determined that the QPC-IPS was adequate and could be self-administered. A Cronbach’s alpha of 0.94 was obtained for the full instrument and values of 0.52–0.89 for the various dimensions of the questionnaire. Test re test reliability: The Intraclass Correlation Coefficient for the full questionnaire was 0.69, while for the individual dimensions values between 0.62 and 0.74 were obtained, indicating acceptable temporal stability. Convergent validity was analysed using 10-point numerical satisfaction scale, giving a positive correlation (0.49). Confirmatory factor analysis revealed six factors consistent with the original scale. The Spanish version yielded adequate results in terms of validity and reliability.

Conclusion

Our findings provide evidence of the convergent validity, reliability, temporal stability and construct validity of the Spanish QPC-IP for measuring patient quality in psychiatric care in Spanish hospitals. Hospital administrators can use this tool to assess and identify areas for improvement to enhance quality in psychiatric care.

Further Experience with the Practice Integration Profile: A Measure of Behavioral Health and Primary Care Integration

Valid measures of behavioral health integration have the potential to enable comparisons of various models of integration, contribute to the overall development of high-quality care, and evaluate outcomes that are strategically aligned with standard improvement efforts. The Practice Integration Profile has proven to discriminate among clinic types and integration efforts. We continued the validation of the measure's internal consistency, intra-rater consistency, and inter-rater consistency with a separate and larger sample from a broader array of practices. We found that the Practice Integration Profile demonstrated a high level of internal consistency, suggesting empirically sound measurement of independent attributes of integration, and high reliability over time. The Practice Integration Profile provides internally consistent and interpretable results and can serve as both a quality improvement and health services research tool.

Correlates of Patient Satisfaction in Psychiatric Inpatient Care: A Survey Study from a Tertiary Hospital in Turkey

In the current study, a questionnaire to evaluate satisfaction levels and related factors upon discharge was completed by 100 patients receiving care for mental illness in a tertiary care hospital in Turkey. The relationships among sociodemographic variables, nonpharmacological interventions, and participants' views about the treatment course and quality of care they received were investigated. Overall satisfaction levels of participants were good. Older participants reported more positive opinions. Involuntary hospitalization, use of restraints/seclusion, or electroconvulsive therapy did not change overall satisfaction. Participants who were hospitalized for the first time were more afraid of other patients, which may imply that this population needs special care from the treatment team. Spending an adequate amount of time and providing necessary information about their treatment plan impact patients' treatment experience positively. [Journal of Psychosocial Nursing and Mental Health Services, 59(4), 38-47.].

Measuring the Patient Experience of Mental Health Care: A Systematic and Critical Review of Patient-Reported Experience Measures

BACKGROUND

There is growing concern about measuring patient experience with mental health care. There are currently numerous patient-reported experience measures (PREMs) available for mental health care, but there is little guidance for selecting the most suitable instruments. The objective of this systematic review was to provide an overview of the psychometric properties and the content of available PREMs.

METHODS

A comprehensive review following the preferred reporting items for systematic reviews and meta-analysis (PRISMA) guidelines was conducted using the MEDLINE database with no date restrictions. The content of PREMs was analyzed using an inductive qualitative approach, and the methodological quality was assessed according to Pesudovs quality criteria.

RESULTS

A total of 86 articles examining 75 PREMs and totaling 1932 items were included. Only four PREMs used statistical methods from item response theory (IRT). The 1932 items covered seven key mental health care domains: interpersonal relationships (22.6%), followed by respect and dignity (19.3%), access and care coordination (14.9%), drug therapy (14.1%), information (9.6%), psychological care (6.8%) and care environment (6.1%). Additionally, a few items focused on patient satisfaction (6.7%) rather than patient experience. No instrument covered the latent trait continuum of patient experience, as defined by the inductive qualitative approach, and the psychometric properties of the instruments were heterogeneous.

CONCLUSION

This work is a critical step in the creation of an item library to measure mental health care patient-reported experience that will be used in France to develop, validate, and standardize item banks and computerized adaptive testing (CAT) based on IRT. It will also provide internationally replicable measures that will allow direct comparisons of mental health care systems.

TRIAL REGISTRATION

NCT02491866.

Satisfaction of family members with inpatient psychiatric care and its correlates: a national survey in China

BACKGROUND

Measuring family members' satisfaction with inpatient psychiatric care may help improve the quality of healthcare in psychiatric hospitals. This survey aimed to investigate the satisfaction of family members with inpatient psychiatric care and to explore its associated factors, using a newly-developed 5-item questionnaire.

METHODS

This study included 1598 family members of psychiatric inpatients in 32 tertiary public psychiatric hospitals in 29 provinces of China. Satisfaction and demographic data were collected by research staff while patient and hospital data were retrieved separately.

RESULTS

We found that the overall satisfaction level was 93.84% (23.46/25). The total satisfaction score in Northeast China was the highest, followed by the East, Middle and West regions (p < 0.001). There was no significant sex difference in total family satisfaction scores. Family members with a lower educational background (elementary school or less) had significantly lower satisfaction. Family members of patients who were diagnosed with schizophrenia were significantly less satisfied with doctor-family communication. In different treatment response subgroups, the marked improvement subgroup had significantly higher total satisfaction scores and subscores. Meanwhile, lower self-payment expenses and a higher number of psychologic treatments offered per day were significantly associated with higher total satisfaction scores and all subscores. Logistic regression showed a higher educational background, more psychologic treatments offered per day, adequacy of professional staffing (higher doctor/bed, nurse/bed and psychologist/bed ratio) were all significantly associated with higher family satisfaction.

CONCLUSIONS

We suggest government and hospital managers recruit more mental health professions to improve family satisfaction. If feasible, providing more psychologic treatments to inpatients may also improve families' satisfaction and involvement.

A psychometric evaluation of the Indonesian version of the Quality in Psychiatric Care-Inpatient Staff (QPC-IPS) instrument

AIM

The aim of the present study was to evaluate the psychometric properties and factor structure of the Indonesian version of the Quality of Psychiatric Care - Inpatient Staff (QPC-IPS) instrument.

METHODS

A sample of 192 permanently employed members of staff at two general psychiatric wards in Indonesia completed the QPC-IPS, which consists of 30 items covering six dimensions of quality.

RESULTS

Confirmatory factor analysis revealed that the factor structure of the Indonesian version was equivalent to that proposed from the original Swedish QPC-IPS. Internal consistency for the full QPC-IPS was adequate, but poor for some of the factors. The results thus demonstrate that the concept of quality of care expressed in the QPC-IPS is to a large extent equivalent among staff in fundamentally different health care systems and cultural contexts.

CONCLUSION

The Indonesian QPC-IPS is a useful instrument for evaluating staff perception of psychiatric inpatient care in Indonesia, and thus contributes to health care improvement in the field of psychiatry. The QPC-IPS can be used together with the Quality of Psychiatric Care- In-Patient (QPC-IP) instrument, which is completed by the inpatients themselves, to improve the quality of psychiatric inpatient care and national as well as international benchmarking.