A Strategy to Identify Critical Appraisal Criteria for Primary Mixed-Method Studies

Development and validation of the Cannabis Exposure in Pregnancy Tool (CEPT): a mixed methods study

BACKGROUND

Evidence of associations between prenatal cannabis use (PCU) and maternal and infant health outcomes remains conflicting amid broad legalization of cannabis across Canada and 40 American states. A critical limitation of existing evidence lies in the non-standardized and crude measurement of prenatal cannabis use (PCU), resulting in high risk of misclassification bias. We developed a standardized tool to comprehensively measure prenatal cannabis use in pregnant populations for research purposes.

METHODS

We conducted a mixed-methods, patient-oriented tool development and validation study, using a bias-minimizing process. Following an environmental scan and critical appraisal of existing prenatal substance use tools, we recruited pregnant participants via targeted social media advertising and obstetric clinics in Alberta, Canada. We conducted individual in-depth interviews and cognitive interviewing in separate sub-samples, to develop and refine our tool. We assessed convergent and discriminant validity internal consistency and 3-month test-retest reliability, and validated the tool externally against urine-THC bioassays.

RESULTS

Two hundred fifty four pregnant women participated. The 9-item Cannabis Exposure in Pregnancy Tool (CEPT) had excellent discriminant (Cohen's kappa = -0.27-0.15) and convergent (Cohen's kappa = 0.72-1.0) validity; as well as high internal consistency (Chronbach's alpha = 0.92), and very good test-retest reliability (weighted Kappa = 0.92, 95% C.I. [0.86-0.97]). The CEPT is valid against urine THC bioassay (sensitivity = 100%, specificity = 82%).

CONCLUSION

The CEPT is a novel, valid and reliable measure of frequency, timing, dose, and mode of PCU, in a contemporary sample of pregnant women. Using CEPT (compared to non-standardized tools) can improve measurement accuracy, and thus the quality of research examining PCU and maternal and child health outcomes.

Arts therapies for mental disorders in COVID-19 patients: a comprehensive review

Background and objective

The COVID-19 global pandemic has necessitated the urgency for innovative mental health interventions. We performed a comprehensive review of the available literature on the utility and efficacy of arts therapies in treating mental health problems, with special emphasis on their deployment during the COVID-19 pandemic, aiming to provide some evidence for the application of this therapy.

Methods

The potential studies were systematically sourced from five authoritative databases: PubMed, Embase, the Cochrane Library, Web of Science, and the CNKI database. The evaluation of these studies was conducted based on stringent criteria, including validity, suitability, therapeutic potential, and consistency. Each piece of included literature was meticulously scored in accordance with these criteria, thus ensuring the inclusion of only the most robust studies in this review. The data from these Randomized Controlled Trials (RCTs) were carefully extracted using the PICO(S) framework, ensuring a comprehensive and systemic approach to data collection. In order to emphasize the variability in the effects of differing arts therapies on COVID-19-induced psychiatric disturbances, the sourced literature was systematically categorized and scrutinized based on distinct modalities.

Results

Out of the 7,250 sourced articles, 16 satisfied the inclusion conditions. The therapies were predominantly meditation (n = 7), supplemented by individual studies on color therapy (n = 3), music therapy (n = 2), and single studies on horticultural therapy, dance therapy, mindfulness and music therapy, and yoga and music therapy (n = 4 collectively). These various forms of arts therapies had a positive short to medium-term impact on the mental health of COVID-19 patients. Besides improving patients' physical and mental health, these therapies can also be employed to mitigate mental health issues among healthcare professionals.

Conclusion

The COVID-19 pandemic has profound and long-lasting implications for public mental health. Diverse forms of arts therapies are potentially effective in addressing related psychiatric symptoms. The integration of artificial intelligence might further enhance the efficacy and scalability of arts therapies in future implementations.

Current Experiences, Expectations, and Future Roles of Faculty Development

Introduction

There is complexity to the success of faculty development (FD) programs at the departmental level, and many of the contributing factors can range from the individual to systems levels. The purpose of this study is to explore faculty perception of what FD encompasses, as well as their past/current experiences with FD, and perceptions regarding the importance, barriers, and facilitators to participating in FD.

Methods

This is a single center, qualitative descriptive study guided through a social constructionist perspective. Faculty from a pediatrics department were asked to participate in 1-h focus groups of 4-5 faculty per group. All sessions were done virtually and audio-recorded for transcription. Inductive reflexive thematic analysis was performed on the transcribed data.

Results

Overall, 5 major themes were identified: (1) purpose/meaning of FD for faculty, (2) perceptions of faculty regarding FD, (3) challenges that faculty encounter with FD, (4) designing and delivering FD to faculty, and (5) comparing FD and continuing professional development (CPD). Some of the main findings included (a) creating flexible and personalized FD curricula, (b) department focusing on bringing the faculty together as a community, and (c) department developing a broader definition of FD that could be used as a reference point in the whole department.

Discussion

Our findings suggest that barriers and challenges for accessing and making the most of FD opportunities still persist. Going forward, departments interested in improving their FD initiatives should focus on individualized, flexible, and technology enhanced FD approaches that motivate participation.

Adult safeguarding managers' understandings of self-neglect and hoarding

Self-neglect and hoarding are behaviours that are hard to define, measure and address. They are more prevalent among older people because of bio-psycho-social factors, which may be exacerbated by advancing age. This paper aims to further understandings of self-neglect and hoarding in England's Care Act 2014 context, drawing on a study involving qualitative interviews with local authority adult safeguarding managers who play an important role in determining interventions with individuals who self-neglect and/or hoard. Online interviews were conducted with adult safeguarding leads and managers from 31 English local authorities in 2021. Interview data were subject to thematic analysis. This paper explores the commonalities and differences in adult safeguarding managers' understandings of the causes and consequences of self-neglect and/or hoarding among older people, which are likely to have tangible impacts on service provision in their local authority, and influencing of wider changes to policies and procedures. Most participants understood these phenomena as caused by a range of bio-psycho-social factors, including chronic physical conditions, bereavement, isolation. A minority took a more clinical or psycho-medical perspective, focusing on mental ill-health, or referred to the social construction of norms of cleanliness and tidiness. Whatever their understanding, by the time such behaviours are brought to the attention of safeguarding professionals a crisis response may be all that is offered. The implications of the findings are that other agencies should be encouraged to provide more early help to older people at risk of self-neglect and/or of developing harmful hoarding behaviours, and that sustained engagement with those affected may help to understand some of the causes of these behaviours to enable effective support or practice interventions.

iKeyCriteria: A Qualitative and Quantitative Analysis Method to Infer Key Criteria since a Systematic Literature Review for the Computing Domain

A systematic literature review is a synthesis of the available evidence, in which a review of quantitative and qualitative aspects of primary studies is carried out, to summarize the existing information regarding a particular topic. The researchers extract key criteria from papers collected about their study area, answering research questions and conducting document analysis. Nonetheless, in some cases, these criteria are improperly justified, unknowing their true level of importance in the study subject. Hence, an additional study is necessary to explain the criteria relevance in the papers studied using qualitative and quantitative premises. The correct identification of these key criteria is a critical factor in prioritizing and achieving appropriate results in any scientific research work. In our paper, a new method to determine key criteria from a literature review is proposed, composed of three components: input-process-output. First, the inputs are a set of criteria to evaluate and a set of documents to analyze. Next, the process component examines the document set to indicate whether the criteria to be analyzed are found. The process component produces a Boolean matrix, which is the input of the mathematical logic process that will get the key criteria considered necessary and sufficient as the output component. The iKeyCriteria method has been applied in different computing domains, particularly for serious games design and virtual organizations, giving positive results in each context. Finally, we developed an online tool that provides global support to the execution of our method.

Exploring stakeholders and their requirements in the process of home hemodialysis: A literature review

Providing home hemodialysis (HHD) therapy is a complex process that not only requires the use of a complex technology but also involves a diverse group of stakeholders, and each stakeholder has their requirements and may not share a common interest. Bringing them together will require the alignment of their interests. A process management perspective can help to accomplish the alignment of their interests. To align their interests, it is crucial to identify interest groups and understand their interests. The main objective of this paper is to identify the stakeholders and represents their interests as a list of requirements in the HHD process. An extensive literature review has been carried out and PubMed was used for literature extraction. In total, 1848 articles were retrieved of which 80 have fulfilled the inclusion criteria. A large array of actors is identified and their interests/requirements at different stages of the HHD process are represented in the form of a list. They have both common and conflicting requirements in the HHD process. If these requirements are aligned and balanced, a stakeholder's driven treatment process will be developed and a real improvement will be achieved in the treatment process.

Gastrostomy uptake in motor neurone disease: a mixed-methods study of patients' decision making

OBJECTIVES

Gastrostomy decision making is a complicated, multifaceted process for people with motor neuron disease (MND). This study explored demographic and disease-related factors that may impact on gastrostomy uptake; and reasons why people with MND accepted or declined gastrostomy, with a focus on how perceptions of swallowing and nutrition may influence decision making.

DESIGN

Prospective, cross sectional, mixed methods.

SETTING

An Australian multidisciplinary, specialty MND Service.

PARTICIPANTS

33 patients were recommended gastrostomy by the treating medical specialist. 16 of 33 were invited to participate in the prospective decision making study; of whom 10 provided informed consent.

PRIMARY AND SECONDARY OUTCOME MEASURES

Demographic and disease-related factors contributing to uptake are described. A stepped approach was applied to gain a comprehensive understanding of why people with MND accept or decline gastrostomy. Instruments included standardised assessments, nutrition survey and semistructured interview. Data were collected at three separate appointments, spanning a 3-week period.

RESULTS

Gastrostomy uptake was 73% following medical specialist recommendation. Participants took days, weeks or months to consider their preferences, with lengthy hospital waiting times for the procedure. Gender, site of onset and rate of disease progression were observed to contribute to uptake. Age and symptom duration did not. Integration of quantitative and qualitative data suggests that patient perceptions of swallowing and nutrition contribute to gastrostomy acceptance; however, the decision making process is heterogeneous and these factors may not be the sole or primary reasons for acceptance. Other reported factors included: reducing carer burden, improving quality of life, increasing independence, continuing participation in social outings and gaining control.

CONCLUSIONS

Future research may give greater insight into how healthcare organisations can better facilitate gastrostomy decision making, to meet the needs of people living with MND. Larger, prospective, multisite studies may build on these findings to better inform clinical guidelines and minimise the impacts of delayed gastrostomy insertion.

Tele-delivered mindfulness-based cognitive therapy in chronic obstructive pulmonary disease: A mixed-methods feasibility study

INTRODUCTION

Mindfulness-based cognitive therapy has been shown to reduce psychological distress in chronic obstructive pulmonary disease, but uptake and attendance rates of hospital-based, face-to-face mindfulness-based cognitive therapy are low. The present mixed-methods study evaluates the clinical feasibility of home-based, tele-delivered mindfulness-based cognitive therapy in chronic obstructive pulmonary disease.

METHODS

Eight patients with chronic obstructive pulmonary disease (mean age: 72.6 years; 50% female) received a standardised eight-week mindfulness-based cognitive therapy programme delivered via home-based video-conferences in groups of four. Feasibility in relation to (a) clinical change, (b) attendance and (c) instructor-patient working alliance were evaluated with questionnaires and semi-structured interviews.

RESULTS

Statistically non-significant reductions in psychological distress (Cohen's d = 0.504; p = 0.399) and physical health status impairment (d = 0.743; p = 0.156) were observed from pre- to post-intervention. Participant narratives about clinical outcomes focused on changes in how to relate to unpleasant sensations, i.e. through attentional flexibility, taking a pause and acceptance. The average attendance rate was 7.5 (standard deviation = 0.8) out of eight sessions and no participants dropped out. The tele-based format appeared to accommodate participants' planning difficulties and promoted their ability and wish to participate. Although participant narratives suggested the tele-based format to be a barrier to developing a trusting and safe therapeutic environment, working alliance questionnaire scores were comparable to those found for face-to-face mindfulness-based cognitive therapy.

DISCUSSION

The preliminary results indicate that tele-delivered mindfulness-based cognitive therapy is a clinically feasible intervention in chronic obstructive pulmonary disease. Future large-scale, randomised controlled trials testing its efficacy on the outcomes of psychological distress and physical health status should include analyses of potential mediators and moderators of the effect as well as and careful monitoring of attendance and adverse events.

[Mixed methods studies in the health sciences. A critical map]

Mixed methods studies (MMS) play an increasingly important role in the health sciences. Its potential lies in the acquisition of causal conditions and in the intersubjective understanding of diverse and new phenomena. The holistic and multi-perspective analysis strategy of MMS also allows a subject-oriented and an evidence-based approach to clinical practice. The article reviews the use of MMS in the health sciences on the basis of various reviews, and it highlights current methodological developments and research gaps.

Methodological and practical viewpoints of qualitative-driven mixed method design: the case of decentralisation of primary healthcare services in Nepal

BACKGROUND

Although considerable attention has been paid to the use of quantitative methods in health research, there has been limited focus on decentralisation research using a qualitative-driven mixed method design. Decentralisation presents both a problematic concept and methodological challenges, and is more context-specific and is often multi-dimensional. Researchers often consider using more than one method design when researching phenomena is complex in nature. Aim To explore the effects of decentralisation on the provision of primary healthcare services.

METHODS

Qualitative-driven mixed method design, employing three methods of data collections: focus group discussions (FGDs), semi-structured interviews (SSIs) and participant observations under two components, that is, core component and supplementary components were used. Four FGDs with health service practitioners, three FGDs with district stakeholders, 20 SSIs with health service users and 20 SSIs with national stakeholders were carried out. These were conducted sequentially. NVivo10, a data management program, was utilised to code the field data, employing a content analysis method for searching the underlying themes or concepts in the text material. Findings Both positive and negative experiences related to access, quality, planning, supplies, coordination and supervision were identified.

CONCLUSION

This study suggests some evidence of the effects of decentralisation on health outcomes in general, as well as filling a gap of understanding and examining healthcare through a qualitative-driven mixed methods approach, in particular. Future research in the area of qualitative in-depth understanding of the problems (why decentralisation, why now and what for) would provoke an important data set that benefits the researchers and policy-makers for planning and implementing effective health services.

Art therapy for people with psychosis: a narrative review of the literature

Art therapy enables individuals to use art to creatively express themselves and communicate differently with themselves, others, and their reality. The National Institute for Health and Clinical Excellence guidelines for psychosis and schizophrenia suggest that arts therapies, which include art therapy, are considered to improve negative symptoms of psychosis. We examined the effectiveness of art therapy for people with psychosis and explored whether art therapy is a meaningful and acceptable intervention in this Review. Seven electronic databases were searched for empirical papers that concerned the use of art therapy for adults with psychosis that were published from 2007 onwards. The search identified 18 papers. High-quality quantitative articles provided inconclusive evidence for the effectiveness of art therapy in adults with psychosis. However, high-quality qualitative articles indicated that therapists and clients considered art therapy to be a beneficial, meaningful, and acceptable intervention, although this conclusion was based on a small number of studies. In this Review, we discuss the theoretical, clinical, and methodological issues in light of the development of more robust research, which is needed to corroborate individuals' experiences and guide evidence-based practice.

Mixed methods for telehealth research

Mixed methods research is important to health services research because the integrated qualitative and quantitative investigation can give a more comprehensive understanding of complex interventions such as telehealth than can a single-method study. Further, mixed methods research is applicable to translational research and program evaluation. Study designs relevant to telehealth research are described and supported by examples. Quality assessment tools, frameworks to assist in the reporting and review of mixed methods research, and related methodologies are also discussed.

Searching for rigour in the reporting of mixed methods population health research: a methodological review

The environments in which population health interventions occur shape both their implementation and outcomes. Hence, when evaluating these interventions, we must explore both intervention content and context. Mixed methods (integrating quantitative and qualitative methods) provide this opportunity. However, although criteria exist for establishing rigour in quantitative and qualitative research, there is poor consensus regarding rigour in mixed methods. Using the empirical example of school-based obesity interventions, this methodological review examined how mixed methods have been used and reported, and how rigour has been addressed. Twenty-three peer-reviewed mixed methods studies were identified through a systematic search of five databases and appraised using the guidelines for Good Reporting of a Mixed Methods Study. In general, more detailed description of data collection and analysis, integration, inferences and justifying the use of mixed methods is needed. Additionally, improved reporting of methodological rigour is required. This review calls for increased discussion of practical techniques for establishing rigour in mixed methods research, beyond those for quantitative and qualitative criteria individually. A guide for reporting mixed methods research in population health should be developed to improve the reporting quality of mixed methods studies. Through improved reporting, mixed methods can provide strong evidence to inform policy and practice.

The experience of nursing women with breastfeeding support: a qualitative inquiry

BACKGROUND

Breastfeeding difficulties are a common occurrence, are highly personal and can vary from one infant to the next for any mother. Multiple sources of support, help and advice for breastfeeding are available to nursing mothers. Evidence suggests that the experience of the quality of breastfeeding supports may play an important role in maternal mental health and well-being in the postpartum period. We sought to explore the experiences of nursing mothers with support they received for breastfeeding in order to better inform and optimize existing breastfeeding supports and interventions.

METHODS

We conducted a qualitative inquiry of nursing mothers' experiences with help, advice and support for breastfeeding. Participants were asked to provide open-ended, written accounts of their experiences with all sources of breastfeeding support received in the 6 months following the delivery of a healthy full-term infant in Calgary. We conducted qualitative thematic analysis, using constant comparison techniques.

RESULTS

The sample included 86 mothers. Our analyses uncovered 4 emergent themes that contributed to the perceived quality of breastfeeding support: knowledge, effectiveness, sensitivity/emotional support and accessible when sought.

INTERPRETATION

Our study provides a greater understanding of how mothers perceive the quality of the breastfeeding support that they receive, as well as what qualities of breastfeeding support are seen as beneficial or negative. The qualities contributing to the perception of breastfeeding support are important to inform and optimize perinatal care, and potentially reduce the risk of negative mental health outcomes for mothers.

Cultural challenges to implementation of formative assessment in Saudi Arabia: an exploratory study

BACKGROUND/PURPOSE

This study investigates challenges that students and faculty face to implement assessment for learning; and the activities, capabilities, enablers, and indicators which could impact performance.

METHOD

The study is a mixed methods research, cross-sectional, exploratory study. The study was organized through two phases of data collection and analysis (QUAL → quan). Based on qualitative focus group discussions (FGD), we first gathered data through field notes. Later, we engaged in analysis using techniques drawn from qualitative data including categorization, theme identification, and connection to existing literature. Based on this analysis, we developed a questionnaire that could provide quantitative measures based on the qualitative FGD. We then administered the questionnaire, and the quantitative data were analyzed to quantitatively test the qualitative findings. Twenty-four faculty and 142 students from the 4th and 5th clinical years participated voluntarily. Their perception of FA and the cultural challenges that hinder its adoption were evaluated through a FGD and a questionnaire.

RESULTS

The mean score of understanding FA concept was equal in faculty and students (p = 0.08). The general challenge that scored highest was the need to balance work and academic load in faculty and the need to balance study load and training and mental anxiety in students. There was no difference between faculty and students in perceiving "learning is teacher-centered" (p = 0.481); and "past learning and assessment experience" (p = 0.322). There was a significant difference between them regarding interaction with opposite gender (p <0.001). Students showed higher value as regards the "gap between learning theories and assessment practice", "grade as a priority", and "discrimination by same faculty gender".

CONCLUSION

The authors suggested a "Framework of Innovation in Endorsing Assessment for Learning". It emphasizes a holisitic approach through all levels of the System: Government, Accreditation Bodies, Policy makers; Institution, and Classroom levels.

Mixed Methods Use in Project Management Research

Mixed methods research is increasingly being used in business and management disciplines, in spite of positivist traditions. The aim of the study is twofold: (1) to examine the types of mixed methods approaches being used, and (2) to determine the quality of the reporting of mixed methods studies published in the field of project management. A retrospective content analysis of articles from three ranked project management journals was undertaken for a sample period of 2004 to 2010. Our findings suggest the field of project management is in need of capacity building in relation to the good reporting of mixed methods studies.

Mixed methods in business and management: A call to the ‘first generation’

Mixed methods is a youthful but increasingly robust methodological movement characterised by: a growing body of trans-disciplinary literature; prominent research methodologists/authorities; the emergence of mixed method specific journals, research texts, and courses; a growth in popularity amongst research funding bodies. Mixed methods is being utilised and reported within business and management fields, despite the quantitative traditions attached to certain business and management disciplines. This paper has utilised a multistrand conversion mixed model research design to undertake a retrospective content analysis of refereed papers (n = 281) from the 21st Australian and New Zealand Academy of Management (ANZAM) Conference 2007. The aim of the study is to provide a methodological map of the management research reported at the conference, and in particular the use, quality and acceptance level of mixed methods research within business and management fields. Implications for further research are discussed along with a call to the ‘first generation’ of business and management mixed method researchers to instigate mixed methods research training and capacity building within their respective business schools, relevant academies and associated professional forums and publications.

[Marxism as a theoretical and methodological framework in collective health: implications for systematic review and synthesis of evidence]

In this study, we discuss the integration in systematic reviews of research developed from a Marxist perspective of knowledge production and their results as evidence in healthcare. The study objectives are to review the assumptions of dialectical and historical materialism (DHM) and discuss the implications of dialectics for a literature review and the synthesis of evidence. DHM is a powerful framework for knowledge generation and transformation of policies and practices in healthcare. It assumes that social contradictions underlie the health-disease process, the fundamental theoretical construction in the field of collective health. Currently, we observe a considerable influence of the critical paradigm, of Marxist origin, in the construction of knowledge in health. Studies based on this critical paradigm incorporate complex methods, which are inherent to the guidelines of dialect, to identify the object and arrive at results that constitute evidence in healthcare. Systematic reviews should address the methodological difficulties associated with entirely integrating these results to healthcare.

Factors affecting the delivery, access, and use of interventions to prevent malaria in pregnancy in sub-Saharan Africa: a systematic review and meta-analysis

BACKGROUND

Malaria in pregnancy has important consequences for mother and baby. Coverage with the World Health Organization-recommended prevention strategy for pregnant women in sub-Saharan Africa of intermittent preventive treatment in pregnancy (IPTp) and insecticide-treated nets (ITNs) is low. We conducted a systematic review to explore factors affecting delivery, access, and use of IPTp and ITNs among healthcare providers and women.

METHODS AND RESULTS

We searched the Malaria in Pregnancy Library and Global Health Database from 1 January 1990 to 23 April 2013, without language restriction. Data extraction was performed by two investigators independently, and data was appraised for quality and content. Data on barriers and facilitators, and the effect of interventions, were explored using content analysis and narrative synthesis. We conducted a meta-analysis of determinants of IPTp and ITN uptake using random effects models, and performed subgroup analysis to evaluate consistency across interventions and study populations, countries, and enrolment sites. We did not perform a meta-ethnography of qualitative data. Ninety-eight articles were included, of which 20 were intervention studies. Key barriers to the provision of IPTp and ITNs were unclear policy and guidance on IPTp; general healthcare system issues, such as stockouts and user fees; health facility issues stemming from poor organisation, leading to poor quality of care; poor healthcare provider performance, including confusion over the timing of each IPTp dose; and women's poor antenatal attendance, affecting IPTp uptake. Key determinants of IPTp coverage were education, knowledge about malaria/IPTp, socio-economic status, parity, and number and timing of antenatal clinic visits. Key determinants of ITN coverage were employment status, education, knowledge about malaria/ITNs, age, and marital status. Predictors showed regional variations.

CONCLUSIONS

Delivery of ITNs through antenatal clinics presents fewer problems than delivery of IPTp. Many obstacles to IPTp delivery are relatively simple barriers that could be resolved in the short term. Other barriers are more entrenched within the overall healthcare system or socio-economic/cultural contexts, and will require medium- to long-term strategies. Please see later in the article for the Editors' Summary.

Investigating community ownership of a text message programme to improve adherence to antiretroviral therapy and provider-client communication: a mixed methods research protocol

INTRODUCTION

Mobile phone ownership and use are growing fastest in sub-Saharan Africa, and there is evidence that mobile phone text messages can be used successfully to significantly improve adherence to antiretroviral therapy and reduce treatment interruptions. However, the effects of many mobile health interventions are often reduced by human resource shortages within health facilities. Also, research projects generating evidence for health interventions in developing countries are most often conducted using external funding sources, with limited sustainability and adoption by local governments following completion of the projects. Strong community participation driven by active outreach programmes and mobilisation of community resources are the key to successful adoption and long-term sustainability of effective interventions. Our aim was to develop a framework for community ownership of a text messaging programme to improve adherence to antiretroviral therapy; improve communication between patients and doctors and act as a reminder for appointments.

METHODS AND ANALYSIS

We will use the exploratory sequential mixed methods approach. The first qualitative phase will entail focus group discussions with people living with HIV at the Yaoundé Central Hospital in Yaoundé, Cameroon (6-10 participants/group). The second quantitative phase will involve a cross-sectional survey (n=402). In this study, binary logistic regression techniques will be used to determine the factors associated with community readiness and acceptability of ownership. Data from both phases will be merged.

ETHICS AND DISSEMINATION

This study has been approved by the Yaoundé Central Hospital Institutional Review Board. The results of this paper will be disseminated as peer-reviewed publications at conferences and as part of a doctoral thesis.

Quality and rigor of the concept mapping methodology: a pooled study analysis

The use of concept mapping in research and evaluation has expanded dramatically over the past 20 years. Researchers in academic, organizational, and community-based settings have applied concept mapping successfully without the benefit of systematic analyses across studies to identify the features of a methodologically sound study. Quantitative characteristics and estimates of quality and rigor that may guide for future studies are lacking. To address this gap, we conducted a pooled analysis of 69 concept mapping studies to describe characteristics across study phases, generate specific indicators of validity and reliability, and examine the relationship between select study characteristics and quality indicators. Individual study characteristics and estimates were pooled and quantitatively summarized, describing the distribution, variation and parameters for each. In addition, variation in the concept mapping data collection in relation to characteristics and estimates was examined. Overall, results suggest concept mapping yields strong internal representational validity and very strong sorting and rating reliability estimates. Validity and reliability were consistently high despite variation in participation and task completion percentages across data collection modes. The implications of these findings as a practical reference to assess the quality and rigor for future concept mapping studies are discussed.

Rationale and procedures for nesting semi-structured interviews in surveys or censuses

Demographers who use survey data and census data from health and demographic surveillance areas can gain substantially from expanding their repertoire of methods to make use of qualitative methods. Similarly, those who conduct and analyse data primarily from semi-structured interviews or focus groups can benefit from information provided by survey research. This paper presents a systematic mixed-methods model—data-linked nested studies—for sampling respondents for semi-structured interviews from survey or census lists. The paper outlines how to conduct these types of study, and their technical and analytical advantages. It highlights the benefits of building on a strong foundation, the ability to compare samples, and the expansion of the range of evidence for, or against, the validity of the substantive findings. Case studies from two data-linked nested projects—in Malawi and South Africa—are used to describe in detail the nested-study approach.

Methodological reporting in qualitative, quantitative, and mixed methods health services research articles

OBJECTIVES

Methodologically sound mixed methods research can improve our understanding of health services by providing a more comprehensive picture of health services than either method can alone. This study describes the frequency of mixed methods in published health services research and compares the presence of methodological components indicative of rigorous approaches across mixed methods, qualitative, and quantitative articles.

DATA SOURCES

All empirical articles (n = 1,651) published between 2003 and 2007 from four top-ranked health services journals.

STUDY DESIGN

All mixed methods articles (n = 47) and random samples of qualitative and quantitative articles were evaluated to identify reporting of key components indicating rigor for each method, based on accepted standards for evaluating the quality of research reports (e.g., use of p-values in quantitative reports, description of context in qualitative reports, and integration in mixed method reports). We used chi-square tests to evaluate differences between article types for each component.

PRINCIPAL FINDINGS

Mixed methods articles comprised 2.85 percent (n = 47) of empirical articles, quantitative articles 90.98 percent (n = 1,502), and qualitative articles 6.18 percent (n = 102). There was a statistically significant difference (χ(2) (1) = 12.20, p = .0005, Cramer's V = 0.09, odds ratio = 1.49 [95% confidence interval = 1,27, 1.74]) in the proportion of quantitative methodological components present in mixed methods compared to quantitative papers (21.94 versus 47.07 percent, respectively) but no statistically significant difference (χ(2) (1) = 0.02, p = .89, Cramer's V = 0.01) in the proportion of qualitative methodological components in mixed methods compared to qualitative papers (21.34 versus 25.47 percent, respectively).

CONCLUSION

Few published health services research articles use mixed methods. The frequency of key methodological components is variable. Suggestions are provided to increase the transparency of mixed methods studies and the presence of key methodological components in published reports.

How to Conduct a Mixed Methods Study: Recent Trends in a Rapidly Growing Literature

The present article selectively reviews the large number of recent studies that have been described as based on mixed methods. I begin by discussing a body of work that has emerged to promote mixed methods research across the social sciences. I then review and critique empirical studies in each of two general approaches to mixed methods: mixed data–collection studies, which combine two or more kinds of data; and mixed data–analysis studies, which combine two or more analytical strategies, examine qualitative data with quantitative methods, or explore quantitative data with qualitative techniques. I argue that, although mixed methods research is by no means new, empirical studies today combine methods in more diverse and, at times, innovative ways. Nevertheless, important methodological tensions will likely surface as the research becomes more self-reflexive.

Mixed methods in business and management: A call to the ‘first generation’

Mixed methods is a youthful but increasingly robust methodological movement characterised by: a growing body of trans-disciplinary literature; prominent research methodologists/authorities; the emergence of mixed method specific journals, research texts, and courses; a growth in popularity amongst research funding bodies. Mixed methods is being utilised and reported within business and management fields, despite the quantitative traditions attached to certain business and management disciplines. This paper has utilised a multistrand conversion mixed model research design to undertake a retrospective content analysis of refereed papers (n = 281) from the 21st Australian and New Zealand Academy of Management (ANZAM) Conference 2007. The aim of the study is to provide a methodological map of the management research reported at the conference, and in particular the use, quality and acceptance level of mixed methods research within business and management fields. Implications for further research are discussed along with a call to the ‘first generation’ of business and management mixed method researchers to instigate mixed methods research training and capacity building within their respective business schools, relevant academies and associated professional forums and publications.

Satisfied carers of persons with enduring mental illness: who and why?

BACKGROUND

This secondary mixed-methods analysis was based on the interview data collected for an exploratory study of the experiences and needs of carers of persons with enduring mental illness. The aims were to identify and describe socio-demographic and contextual factors associated with the satisfaction of carers with family support.

METHOD

Content analysis and non-parametric tests were used for the exploration of qualitative and quantitative data collected from 38 carers.

RESULTS

The majority of the satisfied carers were male and from a higher socio-economic group than other carers. The ill relatives of all satisfied participants resided outside their family homes. Carer satisfaction was associated with such categories as: a caring service; supportive and unintrusive family relationships; being accepted as partners; supportive community; and suitable family services. All the identified categories were interrelated.

CONCLUSIONS

The identified categories and socio-demographic factors should be considered for inclusion in the planning and evaluation of family support services.

A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews

A new form of literature review has emerged, Mixed Studies Review (MSR). These reviews include qualitative, quantitative and mixed methods studies. In the present paper, we examine MSRs in health sciences, and provide guidance on processes that should be included and reported. However, there are no valid and usable criteria for concomitantly appraising the methodological quality of the qualitative, quantitative and mixed methods studies.

OBJECTIVE

To propose criteria for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies or study components.

DESIGN

A three-step critical review was conducted.

DATA SOURCES

2322 references were identified in MEDLINE, and their titles and abstracts were screened; 149 potentially relevant references were selected and the full-text papers were examined; 59 MSRs were retained and scrutinized using a deductive-inductive qualitative thematic data analysis. This revealed three types of MSR: convenience, reproducible, and systematic.

REVIEW METHODS

Guided by a proposal, we conducted a qualitative thematic data analysis of the quality appraisal procedures used in the 17 systematic MSRs (SMSRs).

RESULTS

Of 17 SMSRs, 12 showed clear quality appraisal procedures with explicit criteria but no SMSR used valid checklists to concomitantly appraise qualitative, quantitative and mixed methods studies. In two SMSRs, criteria were developed following a specific procedure. Checklists usually contained more criteria than needed. In four SMSRs, a reliability assessment was described or mentioned. While criteria for quality appraisal were usually based on descriptors that require specific methodological expertise (e.g., appropriateness), no SMSR described the fit between reviewers' expertise and appraised studies. Quality appraisal usually resulted in studies being ranked by methodological quality.

CONCLUSION

A scoring system is proposed for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies for SMSRs. This scoring system may also be used to appraise the methodological quality of qualitative, quantitative and mixed methods components of mixed methods research.

The quality of mixed methods studies in health services research

OBJECTIVES

To assess the quality of mixed methods studies in health services research (HSR).

METHODS

We identified 118 mixed methods studies funded by the Department of Health in England between 1994 and 2004, and obtained proposals and/or final reports for 75. We applied a set of quality questions to both the proposal and report of each study, addressing the success of the study, the mixed methods design, the individual qualitative and quantitative components, the integration between methods and the inferences drawn from completed studies.

RESULTS

Most studies were completed successfully. Researchers mainly ignored the mixed methods design and described only the separate components of a study. There was a lack of justification for, and transparency of, the mixed methods design in both proposals and reports, and this had implications for making judgements about the quality of individual components in the context of the design used. There was also a lack of transparency of the individual methods in terms of clear exposition of data collection and analysis, and this was more a problem for the qualitative than the quantitative component: 42% (19/45) versus 18% (8/45) of proposals (p = 0.011). Judgements about integration could rarely be made due to the absence of an attempt at integration of data and findings from different components within a study.

CONCLUSIONS

The HSR community could improve mixed methods studies by giving more consideration to describing and justifying the design, being transparent about the qualitative component, and attempting to integrate data and findings from the individual components.

Coping strategies and styles of family carers of persons with enduring mental illness: a mixed methods analysis

A qualitative exploratory study investigated the experiences and needs of family carers of persons with enduring mental illness in Ireland. The current mixed-methods secondary study used content analysis and statistical procedures to identify and explore the coping strategies emerging from the original interviews. The majority of family carers reported use of active behavioural coping strategies, sometimes combined with active cognitive or avoidance strategies. The percentage of cares reporting use of active cognitive strategies was the lowest among those whose ill relative lived in their home, and the highest among those whose relative lived independently. Participants with identified active cognitive strategies often reported that their relative was employed or in training. Participants who reported use of avoidance strategies were significantly younger than participants who did not report use of such strategies. The lowest percentage of avoidance strategies was among participants whose ill relative lived independently, whereas the highest was among carers whose relative lived in their home. The findings of this study highlight the importance of a contextual approach to studying coping styles and processes. Further research questions and methodological implications are discussed.

Using focus groups to improve the validity of cross-national survey research: a study of physician decision making

In this article, the authors demonstrate how qualitative methods can form a foundation for quantitative research by improving instrument validity, informing the data collection process, and improving cost-effectiveness in a study of physician decision making. To test terminology, applicability, and comprehension of a quantitative questionnaire for doctors in the United States and United Kingdom, each country's researchers conducted physician focus groups with questions organized around the experiment, including (a) validity of video vignettes of actor "patients," (b) population accessibility, (c) level of remuneration, (d) appropriate endorsement figure, and (e) question comprehension. Focus group data collected during instrument development and fieldwork planning streamlined processes and achieved cost efficiencies and effectiveness for the overall study. Beyond simply adding a post hoc qualitative component to an already free-standing quantitative methodology, focus groups were used in the study formulation, where the qualitative methodology was integrated into the process of developing a valid survey instrument.

Prospective integration of cultural consideration in biomedical research for patients with advanced cancer: recommendations from an international conference on malignant bowel obstruction in palliative care

In the setting of an international conference on malignant bowel obstruction as a model for randomized controlled trials (RCTs) in palliative care, we discuss the importance of incorporating prospective cultural considerations into research design. The approach commonly used in biomedical research has traditionally valued the RCT as the ultimate "way of knowing" about how to best treat a medical condition. The foremost limitation of this approach is the lack of recognition of the impact of cultural viewpoints on research outcomes. We propose that interest relevant to cultural viewpoints should be emphasized in conceptualizing and interpreting research questions, designs, and results. In addition to recognizing our cultural biases as individuals and researchers, we recommend two major shifts in designing and implementing RCTs: 1) inclusion of a multidisciplinary team of researchers to inform the diversity of perspectives and expertise brought to the research, and 2) use of mixed methods of inquiry, reflecting both deductive and inductive modes of inference.

Exploring the altered daily geographies and lifeworlds of women living with fibromyalgia syndrome: A mixed-method approach

In this paper I employ data triangulation in order to investigate the complex nature of the altered lifeworlds and daily geographies of women living with fibromyalgia syndrome (FMS). More specifically, I use the findings of in-depth interviews and a standardized test (the Sickness Impact Profile [SIP]) in a mixed-method approach to understanding how women's lives change after the onset of FMS and how their changing bodies and locations in society and space shape such altered lifeworlds. These data were collected from 55 women living with FMS in Ontario, Canada. The experiential evidence shared during the interviews is used to qualify or explain certain phenomena observed within the SIP dataset. I focus on four specific experiences in the women's lives; these are the: (1) onset of mental haziness and fatigue; (2) development of disrupted sleep/sleep disorders; (3) removal from paid labour; and (4) withdrawal from social and recreational activities. It is found that changes in the women's bodies precipitated some of the most significant life changes experienced, including altered identities and diminished incomes, and that altered bodily realities facilitated or denied access to socio-spatial life. At the same time, the women's changing locations in society and space also played a role in bringing about such changes.

Comparability work and the management of difference in research synthesis studies

The new imperative to be more methodologically inclusive has generated a burgeoning interest in synthesizing the findings of qualitative and quantitative studies, or mixed research synthesis. Yet, the very diversity seen to define the mixed research synthesis enterprise is also considered to defy it as it intensifies the problem of comparing the seemingly incomparable to enable the combination of the seemingly uncombinable. We propose here that the research synthesis enterprise, in general, and the mixed research synthesis enterprise, in particular, entail comparability work whereby reviewers impose similarity and difference on the studies to be reviewed. The very study diversity requiring management does not exist a priori but rather is itself an outcome of comparability work already done whereby judgments have been made about what constitutes methodological and topical diversity and uniformity. Conceiving the research synthesis process as defined by comparability work moves the backstage interpretive work of systematic review to center stage and, thereby, sets a new stage for addressing the methodological issues involved. These issues are explored by reference to the synthesis of empirical studies of antiretroviral adherence in HIV-positive women in the US.