1
|
Zhao Y, Summers R, Gathara D, English M. Conducting cross-cultural, multi-lingual or multi-country scale development and validation in health care research: A 10-step framework based on a scoping review. J Glob Health 2024; 14:04151. [PMID: 39024643 PMCID: PMC11257704 DOI: 10.7189/jogh.14.04151] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/20/2024] Open
Abstract
Background Valid, reliable and cross-cultural equivalent scales and measurement instruments that enable comparisons across diverse populations in different countries are important for global health research and practice. We developed a 10-step framework through a scoping review of the common strategies and techniques used for scale development and validation in a cross-cultural, multi-lingual, or multi-country setting, especially in health care research. Methods We searched MEDLINE, Embase, and PsycINFO for peer-reviewed studies that collected data from two or more countries or in two or more languages at any stages of scale development or validation and published between 2010-22. We categorised the techniques into three commonly used scale development and validation stages (item generation, scale development, and scale evaluation) as well as during the translation stage. We described the most commonly used techniques at each stage. Results We identified 141 studies that were included in the analysis. We summarised 14 common techniques and strategies, including focus groups or interviews with diverse target populations, and involvement of measurement experts and linguists for item content validity expert panel at the item generation stage; back-and-forth translation, collaborative team approach for the translation stage; cognitive interviews and different recruitment strategies and incentives in different settings for scale development stage; and three approaches for measurement invariance (multigroup confirmatory factor analysis, differential item functioning and multiple indicator multiple causes) for scale evaluation stage. Conclusions We provided a 10-step framework for cross-cultural, multi-lingual or multi-country scale development and validation based on these techniques and strategies. More research and synthesis are needed to make scale development more culturally competent and enable scale application to better meet local health and development needs.
Collapse
Affiliation(s)
- Yingxi Zhao
- Nuffield Department of Medicine Centre for Global Health Research, University of Oxford, Oxford, UK
| | - Richard Summers
- School of Social Policy, University of Birmingham, Birmingham, UK
| | - David Gathara
- KEMRI-Wellcome Trust Research Programme, Nairobi, Kenya
- Centre for Maternal, Adolescent, Reproductive, and Child Health (MARCH), London School of Hygiene and Tropical Medicine, London, UK
| | - Mike English
- Nuffield Department of Medicine Centre for Global Health Research, University of Oxford, Oxford, UK
- KEMRI-Wellcome Trust Research Programme, Nairobi, Kenya
| |
Collapse
|
2
|
Tian Z, Kuang K, Wilson SR, Buzzanell PM, Ye J, Mao X, Wei H. Measuring resilience for Chinese-speaking populations: a systematic review of Chinese resilience scales. Front Psychol 2024; 15:1293857. [PMID: 38605848 PMCID: PMC11007233 DOI: 10.3389/fpsyg.2024.1293857] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Accepted: 03/11/2024] [Indexed: 04/13/2024] Open
Abstract
Introduction Despite the rapid growth of interdisciplinary resilience research in Chinese contexts, no study has systematically reviewed individual-level measurement scales for Chinese-speaking populations. We report a systematic review of scales developed for or translated/adapted to Chinese-speaking contexts, where we assessed how widely used scales fare in terms of their psychometric qualities. Methods Studies included in this review must have been published in peer-reviewed English or Chinese journals between 2015-2020 and included self-reported resilience scales in Chinese-speaking populations. Searches were conducted in PsycINFO, CNKI (completed in May 2021), and PubMed (completed in January 2024). We developed coding schemes for extracting relevant data and adapted and applied an existing evaluation framework to assess the most frequently used resilience scales by seven methodological criteria. Results Analyses of 963 qualified studies suggested that Chinese resilience scales were used in a diverse range of study contexts. Among 85 unique kinds of resilience measures, we highlighted and evaluated the three most frequently used translated scales and three locally developed scales (nine scales in total including variations such as short forms). In short, resilience studies in Chinese contexts relied heavily on the translated 25-item Connor-Davidson Resilience Scale, which scored moderately on the overall quality. The locally developed Resilience Scale for Chinese Adolescents and Essential Resilience Scale received the best ratings but could use further development. Discussion We discussed how future work may advance widely used scales, and specified seven methodological recommendations for future resilience scale development with existing and new scales in and beyond the Chinese study contexts. We further addressed issues and challenges in measuring resilience as a process and called on researchers to further develop/evaluate process measures for Chinese-speaking populations.
Collapse
Affiliation(s)
- Zhenyu Tian
- Department of Communication Studies, College of Wooster, Wooster, OH, United States
| | - Kai Kuang
- School of Journalism and Communication, Tsinghua University, Beijing, China
| | - Steven R. Wilson
- Department of Communication, University of South Florida, Tampa, FL, United States
| | - Patrice M. Buzzanell
- Department of Communication, University of South Florida, Tampa, FL, United States
| | - Jinyi Ye
- School of Journalism and Communication, Tsinghua University, Beijing, China
| | - Xinyue Mao
- School of Journalism and Communication, Tsinghua University, Beijing, China
| | - Hai Wei
- School of Journalism and Communication, Tsinghua University, Beijing, China
| |
Collapse
|
3
|
Lau C, Swindall T, Chiesi F, Quilty LC, Chen HC, Chan YC, Ruch W, Proyer R, Bruno F, Saklofske DH, Torres-Marín J. Cultural Differences in How People Deal with Ridicule and Laughter: Differential Item Functioning between the Taiwanese Chinese and Canadian English Versions of the PhoPhiKat-45. Eur J Investig Health Psychol Educ 2023; 13:238-258. [PMID: 36826203 PMCID: PMC9955752 DOI: 10.3390/ejihpe13020019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 12/28/2022] [Accepted: 01/12/2023] [Indexed: 01/24/2023] Open
Abstract
The PhoPhiKat-45 measures three dispositions toward ridicule and laughter, including gelotophobia (i.e., the fear of being laughed at), gelotophilia (i.e., the joy of being laughed at), and katagelasticism (i.e., the joy of laughing at others). Despite numerous cultural adaptations, there is a paucity of cross-cultural studies investigating measurement invariance of this measure. Undergraduate students from a Canadian university (N = 1467; 71.4% females) and 14 universities in Taiwan (N = 1274; 64.6% females) completed the English and Chinese PhoPhiKat-45 measures, respectively. Item response theory and differential item functioning analyses demonstrated that most items were well-distributed across the latent continuum. Five of 45 items were flagged for DIF, but all values had negligible effect sizes (McFadden's pseudo R2 < 0.13). The Canadian sample was further subdivided into subsamples who identified as European White born in Canada (n = 567) and Chinese born in China, Hong Kong, or Taiwan (n = 180). In the subgroup analyses, no evidence of DIF was found. Findings support the utility of this measure across these languages and samples.
Collapse
Affiliation(s)
- Chloe Lau
- Centre for Addiction and Mental Health, Toronto, ON N6B 1Y6, Canada
| | - Taylor Swindall
- Department of Psychology, University of Western Ontario, London, ON N6A 3K7, Canada
- Correspondence:
| | - Francesca Chiesi
- Department of Neuroscience, Psychology, Drug, and Child’s Health (NEUROFARBA), Section of Psychology, University of Florence, 50135 Florence, Italy
| | - Lena C. Quilty
- Centre for Addiction and Mental Health, Toronto, ON N6B 1Y6, Canada
| | - Hsueh-Chih Chen
- Department of Educational Psychology and Counseling, National Taiwan Normal University, Taipei 106308, Taiwan
| | - Yu-Chen Chan
- Department of Educational Psychology and Counseling, National Tsing Hua University, Hsinchu 300044, Taiwan
| | - Willibald Ruch
- Department of Psychology, University of Zurich, 8006 Zurich, Switzerland
| | - René Proyer
- Institut für Psychologie, Martin-Luther-Universität Halle-Wittenberg, 06108 Halle, Germany
| | - Francesco Bruno
- Regional Neurogenetic Centre (CRN), Department of Primary Care, ASP Catanzaro, Viale A. Perugini, 88046 Lamezia Terme, Italy
- Association for Neurogenetic Research (ARN), 88046 Lamezia Terme, Italy
- Academy of Cognitive Behavioral Sciences of Calabria (ASCoC), 88046 Lamezia Terme, Italy
| | - Donald H. Saklofske
- Department of Psychology, University of Western Ontario, London, ON N6A 3K7, Canada
| | - Jorge Torres-Marín
- Department of Social Psychology and Quantitative Psychology, University of Barcelona, 08035 Barcelona, Spain
- Department of Research Methods in Behavioral Sciences, University of Granada, 18071 Granada, Spain
| |
Collapse
|
4
|
Lau C, Chiesi F, Li C, Saklofske DH. Measuring Italian Resilience. EUROPEAN JOURNAL OF PSYCHOLOGICAL ASSESSMENT 2022. [DOI: 10.1027/1015-5759/a000712] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Abstract. The Essential Resilience Scale (ERS) measures global trait resilience and three factors of physical, emotional, and social resilience. This study developed an Italian adaptation of the ERS and recruited participants from Italy ( N = 500) to complete the measure along with criterion validity measures of broad personality traits and related psychological concepts. Confirmatory factor analysis (CFA) demonstrated robust evidence for a well-fitting three-factor model of the ERS, with items strongly loading onto their respective latent factors. Utilizing Samejima’s graded response model, most item discrimination values were moderate-to-high, and category threshold parameters were well-distributed throughout the latent continuum. The ERS showed correlations in the expected directions with extraversion, emotionality, optimism, mastery, resilience, behavioral activation, behavioral inhibition, stress, and well-being. Cultural invariance was supported (at the scale- and item-level) with multigroup CFA and differential item functioning (DIF) with a sample of Canadian English speakers ( N = 874). Findings evinced the internal consistency (i.e., total MacDonald’s ω), factorial validity (i.e., three-factor CFA), criterion validity (i.e., personality, temperament), and convergent validity (i.e., trait resilience and well-being) of the Italian ERS. Results suggest the Italian ERS can be applied for measuring resilience for future research studies in Italian-speaking populations.
Collapse
Affiliation(s)
- Chloe Lau
- Department of Psychology, University of Western Ontario, London, Ontario, Canada
| | - Francesca Chiesi
- Department of Neuroscience, Psychology, Drug, and Child’s Health (NEUROFARBA), Section of Psychology, University of Florence, Italy
| | - Catherine Li
- Department of Psychology, University of Western Ontario, London, Ontario, Canada
| | - Donald H. Saklofske
- Department of Psychology, University of Western Ontario, London, Ontario, Canada
| |
Collapse
|
5
|
Qing Y, Bakker A, van der Meer CAI, Te Brake H, Olff M. Assessing psychological resilience: translation and validation of the Chinese version of the resilience evaluation scale (RES). Eur J Psychotraumatol 2022; 13:2133358. [PMID: 36325258 PMCID: PMC9621262 DOI: 10.1080/20008066.2022.2133358] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/06/2022] Open
Abstract
BACKGROUND The Resilience Evaluation Scale (RES) is a novel and freely available measure of psychological resilience (factored into self-confidence and self-efficacy). To date, psychometric properties were evaluated in Dutch and American samples, but not yet in a Chinese sample. OBJECTIVE We aimed to validate the RES in a Chinese sample by examining its factor structure, reliability, and construct validity. METHODS The RES was translated into Chinese following a cross-cultural translation and adaptation procedure. Self-report questionnaires including the RES, exposure to potentially traumatic events (PTE's), the PTSD checklist for DSM-5 (PCL-5), and scales for conceptually related constructs of psychological resilience were then administered via an online survey. RESULTS In total, 484 Chinese adults (females, 66.9%; age: 27.33 ± 6.86 years) participated. Parallel analysis results suggested a one-factor structure for the Chinese RES. The Chinese RES demonstrated good internal consistency (Cronbach's alpha = 0.88). Construct validity was demonstrated through significant associations with hypothesised related constructs and through a relation with lower levels of PTSD among the PTE-exposed subsample (n = 116) via the mediating role of avoidant coping strategies, i.e. behavioural disengagement and self-blame. CONCLUSION Our results suggest that the RES is a reliable and valid assessment of psychological resilience to use in Chinese, in addition to its Dutch and English versions. The RES could potentially be adopted to measure psychological resilience in cross-cultural contexts.
Collapse
Affiliation(s)
- Yulan Qing
- Department of Psychiatry, Amsterdam UMC location University of Amsterdam, Amsterdam, Netherlands.,Amsterdam Public Health Research Institute, Amsterdam, Netherlands.,Amsterdam Neuroscience Research Institute, Amsterdam, Netherlands
| | - Anne Bakker
- Department of Psychiatry, Amsterdam UMC location University of Amsterdam, Amsterdam, Netherlands.,Amsterdam Public Health Research Institute, Amsterdam, Netherlands.,Department of Trauma Care, OLVG, Amsterdam, Netherlands
| | | | - Hans Te Brake
- ARQ National Psychotrauma Centre, ARQ Centre of Excellence Impact, Diemen, Netherlands
| | - Miranda Olff
- Department of Psychiatry, Amsterdam UMC location University of Amsterdam, Amsterdam, Netherlands.,Amsterdam Public Health Research Institute, Amsterdam, Netherlands.,Amsterdam Neuroscience Research Institute, Amsterdam, Netherlands.,ARQ National Psychotrauma Centre, Diemen, Netherlands
| |
Collapse
|