Systems approach to assessing and improving local human research Institutional Review Board performance

OBJECTIVE

To quantifying the interdependency within the regulatory environment governing human subject research, including Institutional Review Boards (IRBs), federally mandated Medicare coverage analysis and contract negotiations.

METHODS

Over 8000 IRB, coverage analysis and contract applications initiated between 2013 and 2016 were analyzed using traditional and machine learning analytics for a quality improvement effort to improve the time required to authorize the start of human research studies.

RESULTS

Staffing ratios, study characteristics such as the number of arms, source of funding and number and type of ancillary reviews significantly influenced the timelines. Using key variables, a predictive algorithm identified outliers for a workflow distinct from the standard process. Improved communication between regulatory units, integration of common functions, and education outreach improved the regulatory approval process.

CONCLUSIONS

Understanding and improving the interdependencies between IRB, coverage analysis and contract negotiation offices requires a systems approach and might benefit from predictive analytics.

Cross-sectional and longitudinal analysis of cancer vaccination trials registered on the US Clinical Trials Database demonstrates paucity of immunological trial endpoints and decline in registration since 2008

Introduction

Cancer vaccination has been researched as a means of treating and preventing cancer, but successful translational efforts yielding clinical therapeutics have been limited. Numerous reasons have been offered in explanation, pertaining both to the vaccine formulation, and the clinical trial methodology used. This study aims to characterize the tumor vaccine clinical trial landscape quantitatively, and explore the possible validity of the offered explanations including the translational obstacles posed by the current common endpoints.

Methods

We performed a detailed cross-sectional and longitudinal analysis of tumor vaccine trials (n=955) registered in the US Clinical Trials database.

Results

The number of tumor vaccine trials initiated per annum has declined 30% since a peak in 2008. In terms of vaccine formulation, 25% of trials use tumor cell/lysate preparations; whereas, 73% of trials vaccinate subjects against defined protein/peptide antigens. Also, 68% of trials do not use vectors for antigen delivery. Both these characteristics of tumor vaccines have remained unchanged since 1996. The top five types of cancer studied are: melanoma (22.6%); cervical cancer (13.0%); breast cancer (11.3%); lung cancer (9.5%); and prostate cancer (9.4%). In addition, 86% of the trials are performed where there is established disease rather than prophylactically, of which 67% are performed exclusively in the adjuvant setting. Also, 42% of Phase II trials do not measure any survival-related endpoint, and only 23% of Phase III trials assess the immune response to vaccination.

Conclusion

The clinical trial effort in tumor vaccination is declining, necessitating a greater urgency in identifying and removing the obstacles to clinical translation. These obstacles may include: 1) vaccination against a small range of antigens; 2) naked delivery of antigen; 3) investigation of less immunogenic cancer types; and 4) investigation in the setting of established disease. In addition, the prevalence of late phase failure may be due to inadequate assessment of survival-related endpoints in Phase II trials. The clinical trial development of tumor vaccines should include mechanism-based translational endpoints, as well as the discovery of immune biomarkers with which to stratify, monitor, and prognosticate patients.

Alive and well: the research imperative

Many features of the existing biomedical research enterprise rest on questionable judgments about the value of research. Policymakers and research ethicists make assumptions about research value that aren't necessarily warranted. A more balanced view of research value could contribute to more defensible decisions about research policy and practice.