Requirements for ethics committee review for studies submitted to Implementation Science

Estimation of the lost productivity to the GDP and the national cost of correcting visual impairment from refractive error in Kenya

BACKGROUND

In developing countries such as Kenya, minimal attention has been directed towards population based studies on uncorrected refractive error (URE). However, the absence of population based studies, warrants utilization of other avenues to showcase to the stakeholders in eye health the worth of addressing URE. Hence this study estimated the lost productivity to the Gross Domestic Product (GDP) as a result of URE and the national cost required to address visual impairment from URE in Kenya.

METHODS

The lost productivity to the GDP for the population aged 16-60 years was calculated. Thereafter the productivity loss of the caregivers of severe visual impaired individuals was computed as a product of the average annual productivity for each caregiver and a 5% productivity loss due to visual impairment. The productivity benefit of correcting refractive error was estimated based on the minimum wage for individuals aged between 16-60 years with URE. Estimation of the national cost of addressing URE was based on spectacle provision cost, cost of training functional clinical refractionists and the cost of establishing vision centres. A cost benefit analysis was undertaken based on the national cost estimates and a factor of 3.5 times.

RESULTS

The estimated lost productivity to the GDP due to URE in in Kenya is approximately US$ 671,455,575 -US$ 1,044,486,450 annually for population aged between 16-60 years. The productivity loss of caregivers for the severe visually impaired is approximately US$ 13,882,899 annually. Approximately US$ 246,750,000 is required to provide corrective devices, US$ 413,280- US$ 108,262,300 to train clinical refractionists and US$ 39,800,000 to establish vision centres. The productivity benefit of correcting visual impairment is approximately US$ 41,126,400 annually. Finally, a cost benefit analysis showed a return of US$ 378,918,050 for human resources, US$ 863,625,000 for corrective devices and US$ 139,300,000 for establishment of vision centres.

CONCLUSION

The magnitude of productivity loss due to URE in Kenya is significant warranting prioritization of refractive error services by the government and all stakeholders since any investment directed towards addressing URE has the potential to contribute a positive return.

Evaluating the translation of implementation science to clinical artificial intelligence: a bibliometric study of qualitative research

Introduction

Whilst a theoretical basis for implementation research is seen as advantageous, there is little clarity over if and how the application of theories, models or frameworks (TMF) impact implementation outcomes. Clinical artificial intelligence (AI) continues to receive multi-stakeholder interest and investment, yet a significant implementation gap remains. This bibliometric study aims to measure and characterize TMF application in qualitative clinical AI research to identify opportunities to improve research practice and its impact on clinical AI implementation.

Methods

Qualitative research of stakeholder perspectives on clinical AI published between January 2014 and October 2022 was systematically identified. Eligible studies were characterized by their publication type, clinical and geographical context, type of clinical AI studied, data collection method, participants and application of any TMF. Each TMF applied by eligible studies, its justification and mode of application was characterized.

Results

Of 202 eligible studies, 70 (34.7%) applied a TMF. There was an 8-fold increase in the number of publications between 2014 and 2022 but no significant increase in the proportion applying TMFs. Of the 50 TMFs applied, 40 (80%) were only applied once, with the Technology Acceptance Model applied most frequently (n = 9). Seven TMFs were novel contributions embedded within an eligible study. A minority of studies justified TMF application (n = 51,58.6%) and it was uncommon to discuss an alternative TMF or the limitations of the one selected (n = 11,12.6%). The most common way in which a TMF was applied in eligible studies was data analysis (n = 44,50.6%). Implementation guidelines or tools were explicitly referenced by 2 reports (1.0%).

Conclusion

TMFs have not been commonly applied in qualitative research of clinical AI. When TMFs have been applied there has been (i) little consensus on TMF selection (ii) limited description of selection rationale and (iii) lack of clarity over how TMFs inform research. We consider this to represent an opportunity to improve implementation science's translation to clinical AI research and clinical AI into practice by promoting the rigor and frequency of TMF application. We recommend that the finite resources of the implementation science community are diverted toward increasing accessibility and engagement with theory informed practices. The considered application of theories, models and frameworks (TMF) are thought to contribute to the impact of implementation science on the translation of innovations into real-world care. The frequency and nature of TMF use are yet to be described within digital health innovations, including the prominent field of clinical AI. A well-known implementation gap, coined as the "AI chasm" continues to limit the impact of clinical AI on real-world care. From this bibliometric study of the frequency and quality of TMF use within qualitative clinical AI research, we found that TMFs are usually not applied, their selection is highly varied between studies and there is not often a convincing rationale for their selection. Promoting the rigor and frequency of TMF use appears to present an opportunity to improve the translation of clinical AI into practice.

Applying Structural Equation Modelling to Understand the Implementation of Social Distancing in the Professional Lives of Healthcare Workers

This study, based on the normalization process theory (NPT), explores the implementation of nonpharmaceutical interventions (NPIs)-specifically social distancing (SD)-in the professional lives of healthcare workers in three Pakistani hospitals. We collected and analysed health workers' data using partial least squares structural equation modelling (PLS-SEM) and assessed the policy implications of the results. Violations of normality assumptions in the quantitative data and the need for scores of independent variables for follow-up analysis guided the researchers to adopt a structural equation modelling process that involved a stepwise evaluation process for convergent validity, individual item validity, discriminant validity, the structural model relationship, and overall model fitness. Theoretical constructs coherence, cognitive participation, collective action, and reflexive monitoring were found to influence the normalization of SD. The results show that SD was normalized in the professional lives of healthcare workers through strong collective action (resources required) and reflexive monitoring (appraisal) but weak cognitive participation (actors' engagement) and coherence (sense-making). Low and middle-income countries (LMICs) should work more on actors' sense-making and engagement in dealing with healthcare crises that require SD. The research findings can aid policy institutions in better understanding the loopholes in the implementation process and making better policies.

Prediction of gastrointestinal cancers in the ONCONUT cohort study: comparison between logistic regression and artificial neural network

Background

Artificial neural networks (ANNs) and logistic regression (LR) are the models of chosen in many medical data classification tasks. Several published articles were based on summarizing the differences and similarities of these models from a technical point of view and critically assessing the quality of the models. The aim of this study was to compare ANN and LR the statistical techniques to predict gastrointestinal cancer in an elderly cohort in Southern Italy (ONCONUT study).

Method

In 1992, ONCONUT was started with the aim of evaluating the relationship between diet and cancer development in a Southern Italian elderly population. Patients with gastrointestinal cancer (ICD-10 from 150.0 to 159.9) were included in the study (n = 3,545).

Results

This cohort was used to train and test the ANN and LR. LR was evaluated separately for macro- and micronutrients, and the accuracy was evaluated based on true positives and true negatives versus the total (97.15%). Then, ANN was trained and the accuracy was evaluated (96.61% for macronutrients and 97.06% for micronutrients). To further investigate the classification capabilities of ANN, k-fold cross-validation and genetic algorithm (GA) were used after balancing the dataset among classes.

Conclusions

Both LR and ANN had high accuracy and similar performance. Both models had the potential to be used as decision clinical support integrated into clinical practice, because in many circumstances, the use of a simple LR model was likely to be adequate for real-world needs, but in others in which there were large amounts of data, the application of advanced analytic tools such as ANNs could be indicated, and the GA optimizer needed to optimize the accuracy of ANN.

Accommodating quality and service improvement research within existing ethical principles

BACKGROUND

Quality and service improvement (QSI) research employs a broad range of methods to enhance the efficiency of healthcare delivery. QSI research differs from traditional healthcare research and poses unique ethical questions. Since QSI research aims to generate knowledge to enhance quality improvement efforts, should it be considered research for regulatory purposes? Is review by a research ethics committee required? Should healthcare providers be considered research participants? If participation in QSI research entails no more than minimal risk, is consent required? The lack of consensus on answers to these questions highlights the need for ethical guidance.

MAIN BODY

Three distinct approaches to classifying QSI research in accordance with existing ethical principles and regulations can be found in the literature. In the first approach, QSI research is viewed as distinct from other types of healthcare research and does not require regulation. In the second approach, QSI research falls within regulatory guidelines but is exempt from research ethics committee review. In the third approach, QSI research is deemed to be part of the learning healthcare system and, as such, is subject to a different set of ethical principles entirely. In this paper, we critically assess each of these views.

CONCLUSION

While none of these approaches is entirely satisfactory, we argue that use of the ethical principles governing research provides the best means of addressing the numerous questions posed by QSI research.

Interventions to improve gross motor performance in children with neurodevelopmental disorders: a meta-analysis

BACKGROUND

Gross motor skills are fundamental to childhood development. The effectiveness of current physical therapy options for children with mild to moderate gross motor disorders is unknown. The aim of this study was to systematically review the literature to investigate the effectiveness of conservative interventions to improve gross motor performance in children with a range of neurodevelopmental disorders.

METHODS

A systematic review with meta-analysis was conducted. MEDLINE, EMBASE, AMED, CINAHL, PsycINFO, PEDro, Cochrane Collaboration, Google Scholar databases and clinical trial registries were searched. Published randomised controlled trials including children 3 to ≤18 years with (i) Developmental Coordination Disorder (DCD) or Cerebral Palsy (CP) (Gross Motor Function Classification System Level 1) or Developmental Delay or Minimal Acquired Brain Injury or Prematurity (<30 weeks gestational age) or Fetal Alcohol Spectrum Disorders; and (ii) receiving non-pharmacological or non-surgical interventions from a health professional and (iii) gross motor outcomes obtained using a standardised assessment tool. Meta-analysis was performed to determine the pooled effect of intervention on gross motor function. Methodological quality and strength of meta-analysis recommendations were evaluated using PEDro and the GRADE approach respectively.

RESULTS

Of 2513 papers, 9 met inclusion criteria including children with CP (n = 2) or DCD (n = 7) receiving 11 different interventions. Only two of 9 trials showed an effect for treatment. Using the least conservative trial outcomes a large beneficial effect of intervention was shown (SMD:-0.8; 95% CI:-1.1 to -0.5) with "very low quality" GRADE ratings. Using the most conservative trial outcomes there is no treatment effect (SMD:-0.1; 95% CI:-0.3 to 0.2) with "low quality" GRADE ratings. Study limitations included the small number and poor quality of the available trials.

CONCLUSION

Although we found that some interventions with a task-orientated framework can improve gross motor outcomes in children with DCD or CP, these findings are limited by the very low quality of the available evidence. High quality intervention trials are urgently needed.

Co-design and implementation research: challenges and solutions for ethics committees

BACKGROUND

Implementation science research, especially when using participatory and co-design approaches, raises unique challenges for research ethics committees. Such challenges may be poorly addressed by approval and governance mechanisms that were developed for more traditional research approaches such as randomised controlled trials.

DISCUSSION

Implementation science commonly involves the partnership of researchers and stakeholders, attempting to understand and encourage uptake of completed or piloted research. A co-creation approach involves collaboration between researchers and end users from the onset, in question framing, research design and delivery, and influencing strategy, with implementation and broader dissemination strategies part of its design from gestation. A defining feature of co-creation is its emergent and adaptive nature, making detailed pre-specification of interventions and outcome measures impossible. This methodology sits oddly with ethics committee protocols that require precise pre-definition of interventions, mode of delivery, outcome measurements, and the role of study participants. But the strict (and, some would say, inflexible) requirements of ethics committees were developed for a purpose - to protect participants from harm and help ensure the rigour and transparency of studies. We propose some guiding principles to help square this circle. First, ethics committees should acknowledge and celebrate the diversity of research approaches, both formally (through training) and informally (by promoting debate and discussion); without active support, their members may not understand or value participatory designs. Second, ground rules should be established for co-design applications (e.g. how to judge when 'consultation' or 'engagement' becomes research) and communicated to committee members and stakeholders. Third, the benefits of power-sharing should be recognised and credit given to measures likely to support this important goal, especially in research with vulnerable communities. Co-design is considered best practice, for example, in research involving indigenous peoples in New Zealand, Australia and Canada.

Overcoming the barriers to the diagnosis and management of chronic fatigue syndrome/ME in primary care: a meta synthesis of qualitative studies

BACKGROUND

The NICE guideline for Chronic Fatigue Syndrome/Myalgic Encephalomyelitis (CFS/ME) emphasises the need for an early diagnosis in primary care with management tailored to patient needs. However, GPs can be reluctant to make a diagnosis and are unsure how to manage people with the condition.

METHODS

A meta synthesis of published qualitative studies was conducted, producing a multi-perspective description of barriers to the diagnosis and management of CFS/ME, and the ways that some health professionals have been able to overcome them. Analysis provided second-order interpretation of the original findings and developed third-order constructs to provide recommendations for the medical curriculum.

RESULTS

Twenty one qualitative studies were identified. The literature shows that for over 20 years health professionals have reported a limited understanding of CFS/ME. Working within the framework of the biomedical model has also led some GPs to be sceptical about the existence of the condition. GPs who provide a diagnosis tend to have a broader, multifactorial, model of the condition and more positive attitudes towards CFS/ME. These GPs collaborate with patients to reach agreement on symptom management, and use their therapeutic skills to promote self care.

CONCLUSIONS

In order to address barriers to the diagnosis and management of CFS/ME in primary care, the limitations of the biomedical model needs to be recognised. A more flexible bio-psychosocial approach is recommended where medical school training aims to equip practitioners with the skills needed to understand, support and manage patients and provide a pathway to refer for specialist input.

Coordination and resource-related difficulties encountered by Quebec's public health specialists and infectious diseases/medical microbiologists in the management of A (H1N1)--a mixed-method, exploratory survey

Background

In Quebec, the influenza A (H1N1) pandemic was managed using a top-down style that left many involved players with critical views and frustrations. We aimed to describe physicians' perceptions - infectious diseases specialists/medical microbiologists (IDMM) and public health/preventive medicine specialists (PHPMS) - in regards to issues encountered with the pandemics management at the physician level and highlight suggested improvements for future healthcare emergencies.

Methods

In April 2010, Quebec IDMM and PHPMS physicians were invited to anonymously complete a web-based learning needs assessment. The survey included both open-ended and multiple-choice questions. Descriptive statistics were used to report on the frequency distribution of multiple choice responses whereas thematic content analysis was used to analyse qualitative data generated from the survey and help understand respondents' experience and perceptions with the pandemics.

Results

Of the 102 respondents, 85.3% reported difficulties or frustrations in their practice during the pandemic. The thematic analysis revealed two core themes describing the problems experienced in the pandemic management: coordination and resource-related difficulties. Coordination issues included communication, clinical practice guidelines, decision-making, roles and responsibilities, epidemiological investigation, and public health expert advisory committees. Resources issues included laboratory resources, patient management, and vaccination process.

Conclusion

Together, the quantitative and qualitative data suggest a need for improved coordination, a better definition of roles and responsibilities, increased use of information technologies, merged communications, and transparency in the decisional process. Increased flexibility and less contradiction in clinical practice guidelines from different sources and increased laboratory/clinical capacity were felt critical to the proper management of infectious disease emergencies.