Assessment of the DNA damaging potential of environmental chemicals using a quantitative high-throughput screening approach to measure p53 activation

Prediction of chemical-induced acute toxicity using in vitro assay data and chemical structure

Exposure to various chemicals found in the environment and in the context of drug development can cause acute toxicity. To provide an alternative to in vivo animal toxicity testing, the U.S. Tox21 consortium developed in vitro assays to test a library of approximately 10,000 drugs and environmental chemicals (Tox21 10K compound library) in a quantitative high-throughput screening (qHTS) approach. In this study, we assessed the utility of Tox21 assay data in comparison with chemical structure information in predicting acute systemic toxicity. Prediction models were developed using four machine learning algorithms, namely Random Forest, Naïve Bayes, eXtreme Gradient Boosting, and Support Vector Machine, and their performance was assessed using the area under the receiver operating characteristic curve (AUC-ROC). The chemical structure-based models as well as the Tox21 assay data demonstrated good predictive power for acute toxicity, achieving AUC-ROC values ranging from 0.83 to 0.93 and 0.73 to 0.79, respectively. We applied the models to predict the acute toxicity potential of the compounds in the Tox21 10K compound library, most of which were found to be non-toxic. In addition, we identified the Tox21 assays that contributed the most to acute toxicity prediction, such as acetylcholinesterase (AChE) inhibition and p53 induction. Chemical features including organophosphates and carbamates were also identified to be significantly associated with acute toxicity. In conclusion, this study underscores the utility of in vitro assay data in predicting acute toxicity.

High-Throughput Screening to Advance In Vitro Toxicology: Accomplishments, Challenges, and Future Directions

Traditionally, chemical toxicity is determined by in vivo animal studies, which are low throughput, expensive, and sometimes fail to predict compound toxicity in humans. Due to the increasing number of chemicals in use and the high rate of drug candidate failure due to toxicity, it is imperative to develop in vitro, high-throughput screening methods to determine toxicity. The Tox21 program, a unique research consortium of federal public health agencies, was established to address and identify toxicity concerns in a high-throughput, concentration-responsive manner using a battery of in vitro assays. In this article, we review the advancements in high-throughput robotic screening methodology and informatics processes to enable the generation of toxicological data, and their impact on the field; further, we discuss the future of assessing environmental toxicity utilizing efficient and scalable methods that better represent the corresponding biological and toxicodynamic processes in humans.

Identification of nonmonotonic concentration-responses in Tox21 high-throughput screening estrogen receptor assays

Environmental endocrine-disrupting chemicals (EDCs) interfere with the metabolism and actions of endogenous hormones. It has been well documented in numerous in vivo and in vitro studies that EDCs can exhibit nonmonotonic dose response (NMDR) behaviors. Not conforming to the conventional linear or linear-no-threshold response paradigm, these NMDR relationships pose practical challenges to the risk assessment of EDCs. In the meantime, the endocrine signaling pathways and biological mechanisms underpinning NMDR remain incompletely understood. The US Tox21 program has conducted in vitro cell-based high-throughput screening assays for estrogen receptors (ER), androgen receptors, and other nuclear receptors, and screened the 10 K-compound library for potential endocrine activities. Using 15 concentrations across several orders of magnitude of concentration range and run in both agonist and antagonist modes, these Tox21 assay datasets contain valuable quantitative information that can be explored to evaluate the nonlinear effects of EDCs and may infer potential mechanisms. In this study we analyzed the concentration-response curves (CRCs) in all 8 Tox21 ERα and ERβ assays by developing clustering and classification algorithms customized to the datasets to identify various shapes of CRCs. After excluding NMDR curves likely caused by cytotoxicity, luciferase inhibition, or autofluorescence, hundreds of compounds were identified to exhibit Bell or U-shaped CRCs. Bell-shaped CRCs are about 7 times more frequent than U-shaped ones in the Tox21 ER assays. Many compounds exhibit NMDR in at least one assay, and some EDCs well-known for their NMDRs in the literature were also identified, suggesting their nonmonotonic effects may originate at cellular levels involving transcriptional ER signaling. The developed computational methods for NMDR identification in ER assays can be adapted and applied to other high-throughput bioassays.

Search for the optimal genotoxicity assay for routine testing of chemicals: Sensitivity and specificity of conventional and new test systems

Many conventional in vitro tests that are currently widely used for routine screening of chemicals have a sensitivity/specificity in the range between 60 % and 80 % for the detection of carcinogens. Most procedures were developed 30-40 years ago. In the last decades several assays became available which are based on the use of metabolically competent cell lines, improvement of the cultivation conditions and development of new endpoints. Validation studies indicate that some of these models may be more reliable for the detection of genotoxicants (i.e. many of them have sensitivity and specificity values between 80 % and 95 %). Therefore, they could replace conventional tests in the future. The bone marrow micronucleus (MN) assay with rodents is at present the most widely used in vivo test. The majority of studies indicate that it detects only 5-6 out of 10 carcinogens while experiments with transgenic rodents and comet assays seem to have a higher predictive value and detect genotoxic carcinogens that are negative in MN experiments. Alternatives to rodent experiments could be MN experiments with hen eggs or their replacement by combinations of new in vitro tests. Examples for promising candidates are ToxTracker, TGx-DDI, multiplex flow cytometry, γH2AX experiments, measurement of p53 activation and MN experiments with metabolically competent human derived liver cells. However, the realization of multicentric collaborative validation studies is mandatory to identify the most reliable tests.

Identification of active or inactive agonists of tumor suppressor protein based on Tox21 library

Exposure of cells to xenobiotic human-made products can lead to genotoxicity and cause DNA damage. It is an urgent need to quickly identify the chemicals that cause DNA damage, and their toxicity should be predicted. In this study, recursive partitioning (RP), binary logistic regression, and one machine learning approach, namely, random forest (RF) classifier, were used to predict the active and inactive compounds of a total 5036 data based on the assay conducted by a β-lactamase reporter gene under control of the p53 response element (p53RE) from Tox21 library. Results show that the binary logistic regression model with a threshold of 0.5 has a high accuracy rate (83%) to distinguish active and inactive compounds. The RF classifier method has satisfactory results, with an accuracy rate (84.38%) approximately higher than that of binary logistic regression. The models established can identify compounds that induce DNA damage and activate p53, and provide a scientific basis for the risk assessment of organic chemicals in the environment.

Identification of environmental chemicals that activate p53 signaling after in vitro metabolic activation

Currently, approximately 80,000 chemicals are used in commerce. Most have little-to-no toxicity information. The U.S. Toxicology in the 21st Century (Tox21) program has conducted a battery of in vitro assays using a quantitative high-throughput screening (qHTS) platform to gain toxicity information on environmental chemicals. Due to technical challenges, standard methods for providing xenobiotic metabolism could not be applied to qHTS assays. To address this limitation, we screened the Tox21 10,000-compound (10K) library, with concentrations ranging from 2.8 nM to 92 µM, using a p53 beta-lactamase reporter gene assay (p53-bla) alone or with rat liver microsomes (RLM) or human liver microsomes (HLM) supplemented with NADPH, to identify compounds that induce p53 signaling after biotransformation. Two hundred and seventy-eight compounds were identified as active under any of these three conditions. Of these 278 compounds, 73 gave more potent responses in the p53-bla assay with RLM, and 2 were more potent in the p53-bla assay with HLM compared with the responses they generated in the p53-bla assay without microsomes. To confirm the role of metabolism in the differential responses, we re-tested these 75 compounds in the absence of NADPH or with heat-attenuated microsomes. Forty-four compounds treated with RLM, but none with HLM, became less potent under these conditions, confirming the role of RLM in metabolic activation. Further evidence of biotransformation was obtained by measuring the half-life of the parent compounds in the presence of microsomes. Together, the data support the use of RLM in qHTS for identifying chemicals requiring biotransformation to induce biological responses.

A Quantitative High-Throughput Screening Data Analysis Pipeline for Activity Profiling

The U.S. Tox21 program has developed in vitro assays to test large collections of environmental chemicals in a quantitative high-throughput screening (qHTS) format, using triplicate 15-dose titrations to generate over 100 million data points to date. Counterscreens are also employed to minimize interferences from non-target-specific assay artifacts, such as compound autofluorescence and cytotoxicity. New data analysis approaches are needed to integrate these data and characterize the activities observed from these assays. Here, we describe a complete analysis pipeline that evaluates these qHTS data for technical quality in terms of signal reproducibility. We integrate signals from repeated assay runs, primary readouts and counterscreens to produce a final call on on-target compound activity.

In Silico Approaches In Carcinogenicity Hazard Assessment: Current Status and Future Needs

Historically, identifying carcinogens has relied primarily on tumor studies in rodents, which require enormous resources in both money and time. In silico models have been developed for predicting rodent carcinogens but have not yet found general regulatory acceptance, in part due to the lack of a generally accepted protocol for performing such an assessment as well as limitations in predictive performance and scope. There remains a need for additional, improved in silico carcinogenicity models, especially ones that are more human-relevant, for use in research and regulatory decision-making. As part of an international effort to develop in silico toxicological protocols, a consortium of toxicologists, computational scientists, and regulatory scientists across several industries and governmental agencies evaluated the extent to which in silico models exist for each of the recently defined 10 key characteristics (KCs) of carcinogens. This position paper summarizes the current status of in silico tools for the assessment of each KC and identifies the data gaps that need to be addressed before a comprehensive in silico carcinogenicity protocol can be developed for regulatory use.

Mining of high throughput screening database reveals AP-1 and autophagy pathways as potential targets for COVID-19 therapeutics

The recent global pandemic of the Coronavirus disease 2019 (COVID-19) caused by the new coronavirus SARS-CoV-2 presents an urgent need for the development of new therapeutic candidates. Many efforts have been devoted to screening existing drug libraries with the hope to repurpose approved drugs as potential treatments for COVID-19. However, the antiviral mechanisms of action of the drugs found active in these phenotypic screens remain largely unknown. In an effort to deconvolute the viral targets in pursuit of more effective anti-COVID-19 drug development, we mined our in-house database of approved drug screens against 994 assays and compared their activity profiles with the drug activity profile in a cytopathic effect (CPE) assay of SARS-CoV-2. We found that the autophagy and AP-1 signaling pathway activity profiles are significantly correlated with the anti-SARS-CoV-2 activity profile. In addition, a class of neurology/psychiatry drugs was found to be significantly enriched with anti-SARS-CoV-2 activity. Taken together, these results provide new insights into SARS-CoV-2 infection and potential targets for COVID-19 therapeutics, which can be further validated by in vivo animal studies and human clinical trials.

Application of In Vitro Metabolism Activation in High-Throughput Screening

In vitro methods which incorporate metabolic capability into the assays allow us to assess the activity of metabolites from their parent compounds. These methods can be applied into high-throughput screening (HTS) platforms, thereby increasing the speed to identify compounds that become active via the metabolism process. HTS was originally used in the pharmaceutical industry and now is also used in academic settings to evaluate biological activity and/or toxicity of chemicals. Although most chemicals are metabolized in our body, many HTS assays lack the capability to determine compound activity via metabolism. To overcome this problem, several in vitro metabolic methods have been applied to an HTS format. In this review, we describe in vitro metabolism methods and their application in HTS assays, as well as discuss the future perspectives of HTS with metabolic activity. Each in vitro metabolism method has advantages and disadvantages. For instance, the S9 mix has a full set of liver metabolic enzymes, but it displays high cytotoxicity in cell-based assays. In vitro metabolism requires liver fractions or the use of other metabolically capable systems, including primary hepatocytes or recombinant enzymes. Several newly developed in vitro metabolic methods, including HepaRG cells, three-dimensional (3D) cell models, and organ-on-a-chip technology, will also be discussed. These newly developed in vitro metabolism approaches offer significant progress in dissecting biological processes, developing drugs, and making toxicology studies quicker and more efficient.

Bioactivity Signatures of Drugs vs. Environmental Chemicals Revealed by Tox21 High-Throughput Screening Assays

Humans are exposed to tens of thousands of chemicals over the course of a lifetime, yet there remains inadequate data on the potential harmful effects of these substances on human health. Using quantitative high-throughput screening (qHTS), we can test these compounds for potential toxicity in a more efficient and cost-effective way compared to traditional animal studies. Tox21 has developed a library of ~10,000 chemicals (Tox21 10K) comprising one-third approved and investigational drugs and two-thirds environmental chemicals. In this study, the Tox21 10K was screened in a qHTS format against a panel of 70 cell-based assays with 213 readouts covering a broad range of biological pathways. Activity profiles were compared with chemical structure to assess their ability to differentiate drugs from environmental chemicals, and structure was found to be a better predictor of which chemicals are likely to be drugs. Drugs and environmental chemicals were further analyzed for diversity in structure and biological response space and showed distinguishable, but not distinct, responses in the Tox21 assays. Inclusion of other targets and pathways to further diversify the biological response space covered by these assays is likely required to better evaluate the safety profile of drugs and environmental chemicals to prioritize for in-depth toxicological studies.

Genetic toxicology in silico protocol

In silico toxicology (IST) approaches to rapidly assess chemical hazard, and usage of such methods is increasing in all applications but especially for regulatory submissions, such as for assessing chemicals under REACH as well as the ICH M7 guideline for drug impurities. There are a number of obstacles to performing an IST assessment, including uncertainty in how such an assessment and associated expert review should be performed or what is fit for purpose, as well as a lack of confidence that the results will be accepted by colleagues, collaborators and regulatory authorities. To address this, a project to develop a series of IST protocols for different hazard endpoints has been initiated and this paper describes the genetic toxicity in silico (GIST) protocol. The protocol outlines a hazard assessment framework including key effects/mechanisms and their relationships to endpoints such as gene mutation and clastogenicity. IST models and data are reviewed that support the assessment of these effects/mechanisms along with defined approaches for combining the information and evaluating the confidence in the assessment. This protocol has been developed through a consortium of toxicologists, computational scientists, and regulatory scientists across several industries to support the implementation and acceptance of in silico approaches.

Identification of p53 Activators in a Human Microarray Compendium

Biomarkers predictive of molecular and toxicological effects are needed to interpret emerging high-throughput transcriptomic data streams. The previously characterized 63 gene TGx-DDI biomarker that includes 20 genes known to be regulated by p53 was previously shown to accurately predict DNA damage in chemically treated cells. We comprehensively evaluated whether the molecular basis of the DDI predictions was based on a p53-dependent response. The biomarker was compared to microarray data in a compendium derived from human cells using the Running Fisher test, a nonparametric correlation test. Using the biomarker, we identified conditions that led to p53 activation, including exposure to the chemical nutlin-3 which disrupts interactions between p53 and the negative regulator MDM2 or by knockdown of MDM2. The expression of most of the genes in the biomarker (75%) were found to depend on p53 activation status based on gene behavior after TP53 overexpression or knockdown. The biomarker identified DDI chemicals that were strong inducers of p53 in wild-type cells; these p53 responses were decreased or abolished in cells after p53 knockdown by siRNAs. Using the biomarker, we screened ∼1950 chemicals in ∼9800 human cell line chemical vs control comparisons and identified ∼100 chemicals that caused p53 activation. Among the positive chemicals were many that are known to activate p53 through direct and indirect DNA damaging mechanisms. These results contribute to the evidence that the TGx-DDI biomarker is useful for identifying chemicals that cause DDI and activate p53.

Identifying Compounds with Genotoxicity Potential Using Tox21 High-Throughput Screening Assays

Genotoxicity is a critical component of a comprehensive toxicological profile. The Tox21 Program used five quantitative high-throughput screening (qHTS) assays measuring some aspect of DNA damage/repair to provide information on the genotoxic potential of over 10 000 compounds. Included were assays detecting activation of p53, increases in the DNA repair protein ATAD5, phosphorylation of H2AX, and enhanced cytotoxicity in DT40 cells deficient in DNA-repair proteins REV3 or KU70/RAD54. Each assay measures a distinct component of the DNA damage response signaling network; >70% of active compounds were detected in only one of the five assays. When qHTS results were compared with results from three standard genotoxicity assays (bacterial mutation, in vitro chromosomal aberration, and in vivo micronucleus), a maximum of 40% of known, direct-acting genotoxicants were active in one or more of the qHTS genotoxicity assays, indicating low sensitivity. This suggests that these qHTS assays cannot in their current form be used to replace traditional genotoxicity assays. However, despite the low sensitivity, ranking chemicals by potency of response in the qHTS assays revealed an enrichment for genotoxicants up to 12-fold compared with random selection, when allowing a 1% false positive rate. This finding indicates these qHTS assays can be used to prioritize chemicals for further investigation, allowing resources to focus on compounds most likely to induce genotoxic effects. To refine this prioritization process, models for predicting the genotoxicity potential of chemicals that were active in Tox21 genotoxicity assays were constructed using all Tox21 assay data, yielding a prediction accuracy up to 0.83. Data from qHTS assays related to stress-response pathway signaling (including genotoxicity) were the most informative for model construction. By using the results from qHTS genotoxicity assays, predictions from models based on qHTS data, and predictions from commercial bacterial mutagenicity QSAR models, we prioritized Tox21 chemicals for genotoxicity characterization.

Investigating the Generalizability of the MultiFlow ® DNA Damage Assay and Several Companion Machine Learning Models With a Set of 103 Diverse Test Chemicals

The in vitro MultiFlow DNA Damage assay multiplexes p53, γH2AX, phospho-histone H3, and polyploidization biomarkers into 1 flow cytometric analysis (Bryce, S. M., Bernacki, D. T., Bemis, J. C., and Dertinger, S. D. (2016). Genotoxic mode of action predictions from a multiplexed flow cytometric assay and a machine learning approach. Environ. Mol. Mutagen. 57, 171-189). The work reported herein evaluated the generalizability of the method, as well as several data analytics strategies, to a range of chemical classes not studied previously. TK6 cells were exposed to each of 103 diverse chemicals, 86 of which were supplied by the National Toxicology Program (NTP) and selected based upon responses in genetic damage assays conducted under the Tox21 program. Exposures occurred for 24 h over a range of concentrations, and cell aliquots were removed at 4 and 24 h for analysis. Multiplexed response data were evaluated using 3 machine learning models designed to predict genotoxic mode of action based on data from a training set of 85 previously studied chemicals. Of 54 chemicals with sufficient information to make an a priori call on genotoxic potential, the prediction models' accuracies were 79.6% (random forest), 88.9% (logistic regression), and 90.7% (artificial neural network). A majority vote ensemble of the 3 models provided 92.6% accuracy. Forty-nine NTP chemicals were not adequately tested (maximum concentration did not approach assay's cytotoxicity limit) and/or had insufficient conventional genotoxicity data to allow their genotoxic potential to be defined. For these chemicals MultiFlow data will be useful in future research and hypothesis testing. Collectively, the results suggest the MultiFlow assay and associated data analysis strategies are broadly generalizable, demonstrating high predictability when applied to new chemicals and classes of compounds.

Next generation high throughput DNA damage detection platform for genotoxic compound screening

Methods for quantifying DNA damage, as well as repair of that damage, in a high-throughput format are lacking. Single cell gel electrophoresis (SCGE; comet assay) is a widely-used method due to its technical simplicity and sensitivity, but the standard comet assay has limitations in reproducibility and throughput. We have advanced the SCGE assay by creating a 96-well hardware platform coupled with dedicated data processing software (CometChip Platform). Based on the original cometchip approach, the CometChip Platform increases capacity ~200 times over the traditional slide-based SCGE protocol, with excellent reproducibility. We tested this platform in several applications, demonstrating a broad range of potential uses including the routine identification of DNA damaging agents, using a 74-compound library provided by the National Toxicology Program. Additionally, we demonstrated how this tool can be used to evaluate human populations by analysis of peripheral blood mononuclear cells to characterize susceptibility to genotoxic exposures, with implications for epidemiological studies. In summary, we demonstrated a high level of reproducibility and quantitative capacity for the CometChip Platform, making it suitable for high-throughput screening to identify and characterize genotoxic agents in large compound libraries, as well as for human epidemiological studies of genetic diversity relating to DNA damage and repair.