Harmonization of the intracellular cytokine staining assay

CytoPheno: Automated descriptive cell type naming in flow and mass cytometry

Advances in cytometry have led to increases in the number of cellular markers that are routinely measured. The resulting complexity of the data has prompted a shift from manual to automated analysis methods. Currently, numerous unsupervised methods are available to cluster cells based on marker expression values. However, phenotyping the resulting clusters is typically not part of the automated process. Manually identifying both marker definitions (e.g. CD4+, CCR7+, CD45RA+, CD19-) and descriptive cell type names (e.g. naïve CD4+ T cells) based on marker expression values can be time-consuming, subjective, and error-prone. In this work we propose an algorithm that addresses these problems through the creation of an automated tool, CytoPheno, that assigns marker definitions and cell type names to unidentified clusters. First, post-clustered expression data undergoes per-marker calculations to assign markers as positive or negative. Next, marker names undergo a standardization process to match to Protein Ontology identifier terms. Finally, marker descriptions are matched to cell type names within the Cell Ontology. Each part of the tool was tested with benchmark data to demonstrate performance. Additionally, the tool is encompassed in a graphical user interface (R Shiny) to increase user accessibility and interpretability. Overall, CytoPheno can aid researchers in timely and unbiased phenotyping of post-clustered cytometry data.

Improving Reliability of Immunological Assays by Defining Minimal Criteria for Cell Fitness

Human PBMC-based assays are often used as biomarkers for the diagnosis and prognosis of disease, as well as for the prediction and tracking of response to biological therapeutics. However, the development and use of PBMC-based biomarker assays is often limited by poor reproducibility. Complex immunological assays can be further complicated by variation in cell handling before analysis, especially when using cryopreserved cells. Variation in postthaw viability is further increased if PBMC isolation and cryopreservation are done more than a few hours after collection. There is currently a lack of evidence-based standards for the minimal PBMC viability or "fitness" required to ensure the integrity and reproducibility of immune cell-based assays. In this study, we use an "induced fail" approach to examine the effect of thawed human PBMC fitness on four flow cytometry-based assays. We found that cell permeability-based viability stains at the time of thawing did not accurately quantify cell fitness, whereas a combined measurement of metabolic activity and early apoptosis markers did. Investigation of the impact of different types and levels of damage on PBMC-based assays revealed that only when cells were >60-70% live and apoptosis negative did biomarker values cease to be determined by cell fitness rather than the inherent biology of the cells. These data show that, to reproducibly measure immunological biomarkers using cryopreserved PBMCs, minimal acceptable standards for cell fitness should be incorporated into the assay protocol.

Proficiency tests to evaluate the impact on assay outcomes of harmonized influenza-specific Intracellular Cytokine Staining (ICS) and IFN-ɣ Enzyme-Linked ImmunoSpot (ELISpot) protocols

The magnitude and quality of cell-mediated immune responses elicited by natural infection or vaccination are commonly measured by Interferon-ɣ (IFN-ɣ) Enzyme-Linked ImmunoSpot (ELISpot) and Intracellular Cytokine Staining (ICS). To date, laboratories apply a variety of in-house procedures which leads to diverging results, complicates interlaboratory comparisons and hampers vaccine evaluations. During the FLUCOP project, efforts have been made to develop harmonized Standard Operating Procedures (SOPs) for influenza-specific IFN-ɣ ELISpot and ICS assays. Exploratory pilot studies provided information about the interlaboratory variation before harmonization efforts were initiated. Here we report the results of two proficiency tests organized to evaluate the impact of the harmonization effort on assay results and the performance of participating FLUCOP partners. The introduction of the IFN-ɣ ELISpot SOP reduced variation of both background and stimulated responses. Post-harmonization background responses were all lower than an arbitrary threshold of 50 SFU/million cells. When stimulated with A/California and B/Phuket, a statistically significant reduction in variation (p < 0.0001) was observed and CV values were strongly reduced, from 148% to 77% for A/California and from 126% to 73% for B/Phuket. The harmonizing effect of applying an ICS SOP was also confirmed by an increased homogeneity of data obtained by the individual labs. The application of acceptance criteria on cell viability and background responses further enhanced the data homogeneity. Finally, as the same set of samples was analyzed by both the IFN-ɣ ELISpot and the ICS assays, a method comparison was performed. A clear correlation between the two methods was observed, but they cannot be considered interchangeable. In conclusion, proficiency tests show that a limited harmonization effort consisting of the introduction of SOPs and the use of the same in vitro stimulating antigens leads to a reduction of the interlaboratory variation of IFN-ɣ ELISpot data and demonstrate that substantial improvements for the ICS assay are achieved as comparable laboratory datasets could be generated. Additional steps to further reduce the interlaboratory variation of ICS data can consist of standardized gating templates and detailed data reporting instructions as well as further efforts to harmonize reagent and instrument use.

Determination of CAR T cell metabolism in an optimized protocol

Adoptive transfer of T cells modified to express chimeric antigenic receptors (CAR) has emerged as a solution to cure refractory malignancies. However, although CAR T cell treatment of haematological cancers has now shown impressive improvement in outcome, solid tumours have been more challenging to control. The latter type is protected by a strong tumour microenvironment (TME) which might impact cellular therapeutic treatments. Indeed, the milieu around the tumour can become particularly inhibitory to T cells by directly affecting their metabolism. Consequently, the therapeutic cells become physically impeded before being able to attack the tumour. It is therefore extremely important to understand the mechanism behind this metabolic break in order to develop TME-resistant CAR T cells. Historically, the measurement of cellular metabolism has been performed at a low throughput which only permitted a limited number of measurements. However, this has been changed by the introduction of real-time technologies which have lately become more popular to study CAR T cell quality. Unfortunately, the published protocols lack uniformity and their interpretation become confusing. We herein tested the essential parameters to perform a metabolic study on CAR T cells and propose a check list of factors that should be set in order to draw sound conclusion.

Staining of activated ß2-integrins in combination with CD137 and CD154 for sensitive identification of functional antigen-specific CD4+ and CD8+ T cells

Common flow cytometry-based methods used for functional assessment of antigen-specific T cells rely on de novo expression of intracellular cytokines or cell surface activation induced markers. They come with some limitations such as complex experimental setting, loss of cell viability and often high unspecific background which impairs assay sensitivity. We have previously shown that staining of activated ß₂-integrins either with multimers of their ligand ICAM-1 or with a monoclonal antibody can serve as a functional marker detectable on T cells after minutes (CD8⁺) or few hours (CD4⁺) of activation. Here, we present a simple method for detection of activated ß₂-integrins in combination with established cell surface activation induced markers. We observed that activated ß₂-integrins were still detectable after 14 hours of stimulation, allowing their detection together with CD137 and CD154. Combinatorial gating of cells expressing activated ß₂-integrins and CD137 or CD154 reduced background in unstimulated samples, increasing the signal-to-noise ratio and allowing improved assessment of low-frequency T cell responses. Extracellular staining of these markers highly correlated with production of intracellular cytokines IL-2, TNF or IFNγ in CD4⁺ and CD8⁺ T cells. As an exemplary application, SARS-CoV-2 spike-specific T cell responses were assessed in individuals after COVID-19 vaccination. This method should be useful for epitope discovery projects and for the simultaneous monitoring of low-frequency antigen-specific CD4⁺ and CD8⁺ T cell responses in various physiological situations.

Telomerase-based GX301 cancer vaccine in patients with metastatic castration-resistant prostate cancer: a randomized phase II trial

Debate is around the optimal immunization regimen for cancer vaccines since too intense vaccination schedules may exhaust reactive lymphocytes. GX301 is a telomerase-based cancer vaccine whose safety and immunological effects were tested in a phase I trial applying an eight administrations schedule. Main objective of this study was to comparatively analyse safety and immunological response to three GX301 regimens in metastatic castration-resistant prostate cancer patients with response/disease stability after docetaxel chemotherapy. This was a multicentre, randomized, parallel-group, open-label trial registered with EudraCT (2014-000095-26) and ClinicalTrials.gov (NCT02293707, 2014). Ninety-eight patients were randomized to receive either eight (regimen 1), four (regimen 2) or two (regimen 3) vaccine administrations. Sixty-three patients were assessable for the primary immunological end-point. Vaccine-specific immune responses were evaluated by intracellular staining for IFN, elispot and cytotoxic assay at 90 and 180 days from baseline. No major side effects were recorded. A 54% overall immune responder rate was observed with 95% of patients showing at least one vaccine-specific immune response. Rate of immunological responders and number of immunizations were proportionally related, suggesting superiority of regimens 1 and 2 over regimen 3. Overall survival did not differ among regimens in both immunological responders and non-responders and was inversely associated (P = 0.002) with increase in the number of circulating CD8 + T regulatory cells at 180 days. These data indicate that GX301 cancer vaccine is safe and immunogenic in metastatic castration-resistant prostate cancer patients. Schedules with high number of administrations should be preferred in future studies due to their better immunological outcome.

Unsupervised Analysis of Flow Cytometry Data in a Clinical Setting Captures Cell Diversity and Allows Population Discovery

Data obtained with cytometry are increasingly complex and their interrogation impacts the type and quality of knowledge gained. Conventional supervised analyses are limited to pre-defined cell populations and do not exploit the full potential of data. Here, in the context of a clinical trial of cancer patients treated with radiotherapy, we performed longitudinal flow cytometry analyses to identify multiple distinct cell populations in circulating whole blood. We cross-compared the results from state-of-the-art recommended supervised analyses with results from MegaClust, a high-performance data-driven clustering algorithm allowing fast and robust identification of cell-type populations. Ten distinct cell populations were accurately identified by supervised analyses, including main T, B, dendritic cell (DC), natural killer (NK) and monocytes subsets. While all ten subsets were also identified with MegaClust, additional cell populations were revealed (e.g. CD4⁺HLA-DR⁺ and NKT-like subsets), and DC profiling was enriched by the assignment of additional subset-specific markers. Comparison between transcriptomic profiles of purified DC populations and publicly available datasets confirmed the accuracy of the unsupervised clustering algorithm and demonstrated its potential to identify rare and scarcely described cell subsets. Our observations show that data-driven analyses of cytometry data significantly enrich the amount and quality of knowledge gained, representing an important step in refining the characterization of immune responses.

Gating Harmonization Guidelines for Intracellular Cytokine Staining Validated in Second International Multiconsortia Proficiency Panel Conducted by Cancer Immunotherapy Consortium (CIC/CRI)

Results from the first gating proficiency panel of intracellular cytokine staining (ICS) highlighted the value of using a consensus gating approach to reduce the variability across laboratories in reported %CD8⁺ or %CD4⁺ cytokine-positive cells. Based on the data analysis from the first proficiency panel, harmonization guidelines for a consensus gating protocol were proposed. To validate the recommendations from the first panel and to examine factors that were not included in the first panel, a second ICS gating proficiency panel was organized. All participants analyzed the same set of Flow Cytometry Standard (FCS) files using their own gating protocol. An optional learning module was provided to demonstrate how to apply the previously established gating recommendations and harmonization guidelines to actual ICS data files. Eighty-three participants took part in this proficiency panel. The results from this proficiency panel confirmed the harmonization guidelines from the first panel. These recommendations addressed the (1) placement of the cytokine-positive gate, (2) identification of CD4⁺ CD8⁺ double-positive T cells, (3) placement of lymphocyte gate, (4) inclusion of dim cells, (5) gate uniformity, and (6) proper adjustment of the biexponential scaling. In addition, based on the results of this proficiency gating panel, two new recommendations were added to expand the harmonization guidelines: (1) inclusion of dump channel marker to gate all live and dump negative cells and (2) backgating to confirm the correct placement of gates across all populations. © 2020 International Society for Advancement of Cytometry.

Generation of TCR-engineered reference cell samples to control T-cell assay performance

In vitro cellular assays analyzing antigen-specific T cells are characterized by their high complexity and require controlled conditions to lower experimental variations. Without standard cellular reagents, it is difficult to compare results over time and across institutions. To overcome this problem, a simple and robust technology was developed to generate TCR-engineered reference samples (TERS) containing defined numbers of antigen-specific T cells. Utilization of TERS enables performance control of three main T-cell assays: MHC-peptide multimer staining, IFN-γ ELISpot and cytokine flow cytometry. TERS continuously deliver stable results and can be stored for longer periods of time. Here, an optimized manufacturing protocol, based on the electroporation of stable T-cell receptor in vitro-transcribed mRNA, is provided for versatile in-house production of TERS. Included are a guideline to optimize the electroporation settings on locally available electroporation devices and a step-by-step protocol for the production process.

Adhering to adhesion: assessing integrin conformation to monitor T cells

Monitoring T cells is of major importance for the development of immunotherapies. Recent sophisticated assays can address particular aspects of the anti-tumor T-cell repertoire or support very large-scale immune screening for biomarker discovery. Robust methods for the routine assessment of the quantity and quality of antigen-specific T cells remain, however, essential. This review discusses selected methods that are commonly used for T-cell monitoring and summarizes the advantages and limitations of these assays. We also present a new functional assay, which specifically detects activated β2 integrins within a very short time following CD8+ T-cell stimulation. Because of its unique and favorable characteristics, this assay could be useful for implementation into our T-cell monitoring toolbox.

Improvement of in vitro potency assays by a resting step for clinical-grade chimeric antigen receptor engineered T cells

BACKGROUND

Chimeric antigen receptor engineered T (CAR-T) cell therapy is a promising approach currently revolutionizing the field of cancer immunotherapy. However, data concerning clinical-grade CAR-T cell stability and functionality after months of cryopreservation have not been released by companies so far. To investigate the effect of cryopreservation on CAR-T cells and to further optimize the potency assays, we performed this study.

METHODS

A third generation of CD19 CAR-T cells was manufactured according to Good Manufacturing Practice (GMP) requirements, which is applied to patients in an ongoing clinical phase 1 study. Quality control tests for sterility, endotoxin and mycoplasma were performed for each batch. Stability in terms of viability, recovery, transduction efficiency and functional capacity was determined using microscopy, multiparametric flow cytometry as well as chromium-51 release tests.

RESULTS

Up to 90days of cryopreservation had no influence on viability, recovery and transduction efficiency of CAR-T cells. However, higher cell concentration for cryopreservation could alter the cell viability and recovery but not the transduction efficiency. Moreover, directly after thawing, both the quantity and quality of the functionality of CAR-T cells were transiently hampered by the negative effects of cryopreservation. Notably, the impaired functionality could be fully restored and even strengthened after an overnight resting process.

DISCUSSION

Cryopreservation is a challenge for the functional activity of CAR-T cells. However, CAR-T cells regain their potency by overnight incubation at 37°C, which mimics the clinical application setting. Therefore, an overnight resting step should be included in in vitro potency assays.

Actively personalized vaccination trial for newly diagnosed glioblastoma

Patients with glioblastoma currently do not sufficiently benefit from recent breakthroughs in cancer treatment that use checkpoint inhibitors1,2. For treatments using checkpoint inhibitors to be successful, a high mutational load and responses to neoepitopes are thought to be essential3. There is limited intratumoural infiltration of immune cells4 in glioblastoma and these tumours contain only 30-50 non-synonymous mutations5. Exploitation of the full repertoire of tumour antigens-that is, both unmutated antigens and neoepitopes-may offer more effective immunotherapies, especially for tumours with a low mutational load. Here, in the phase I trial GAPVAC-101 of the Glioma Actively Personalized Vaccine Consortium (GAPVAC), we integrated highly individualized vaccinations with both types of tumour antigens into standard care to optimally exploit the limited target space for patients with newly diagnosed glioblastoma. Fifteen patients with glioblastomas positive for human leukocyte antigen (HLA)-A*02:01 or HLA-A*24:02 were treated with a vaccine (APVAC1) derived from a premanufactured library of unmutated antigens followed by treatment with APVAC2, which preferentially targeted neoepitopes. Personalization was based on mutations and analyses of the transcriptomes and immunopeptidomes of the individual tumours. The GAPVAC approach was feasible and vaccines that had poly-ICLC (polyriboinosinic-polyribocytidylic acid-poly-L-lysine carboxymethylcellulose) and granulocyte-macrophage colony-stimulating factor as adjuvants displayed favourable safety and strong immunogenicity. Unmutated APVAC1 antigens elicited sustained responses of central memory CD8+ T cells. APVAC2 induced predominantly CD4+ T cell responses of T helper 1 type against predicted neoepitopes.

Modulation of B Cells and Homing Marker on NK Cells Through Extracorporeal Photopheresis in Patients With Steroid-Refractory/Resistant Graft-Vs.-Host Disease Without Hampering Anti-viral/Anti-leukemic Effects

Graft-vs.-host disease (GvHD), a severe complication of allogeneic hematopoietic stem cell transplantation, significantly affects the post-transplant morbidity and mortality. Systemic steroids remain the gold standard for the initial management of GvHD. However, up to 60% of patients will not sufficiently respond to steroids. Extracorporeal photopheresis (ECP), a cell-based immunotherapy, has shown good clinical results in such steroid-refractory/resistant GvHD patients. Given its immunomodulatory, but not global immunosuppressive and steroid-sparing capacity, ECP constitutes an attractive option. In the case of GvHD, the balance of immune cells is destroyed: effector cells are not any longer efficiently controlled by regulatory cells. ECP therapy may restore this balance. However, the precise mechanism and the impact of ECP on anti-viral/anti-leukemic function remain unclear. In this study, 839 ECP treatments were performed on patients with acute GvHD (aGvHD) and chronic GvHD (cGvHD). A comprehensive analysis of effector and regulatory cells in patients under ECP therapy included multi-parametric flow cytometry and tetramer staining, Luminex^TM-based cytokine, interferon-γ enzyme-linked immunospot, and chromium-51 release assays. Gene profiling of myeloid-derived suppressor cells (MDSCs) was performed by microarray analysis. Immunologically, modulations of effector and regulatory cells as well as proinflammatory cytokines were observed under ECP treatment: (1) GvHD-relevant cell subsets like CD62L⁺ NK cells and newly defined CD19^hiCD20^hi B cells were modulated, but (2) quantity and quality of anti-viral/anti-leukemic effector cells were preserved. (3) The development of MDSCs was promoted and switched from an inactivated subset (CD33^-CD11b⁺) to an activated subset (CD33⁺CD11b⁺). (4) The frequency of Foxp3⁺CD4⁺ regulatory T cells (Tregs) and CD24⁺CD38^hi regulatory B cells was considerably increased in aGvHD patients, and Foxp3⁺CD8⁺ Tregs in cGvHD patients. (5) Proinflammatory cytokines like IL-1β, IL-6, IL-8, and TNF-α were significantly reduced. In summary, ECP constitutes an effective immunomodulatory therapy for patients with steroid-refractory/resistant GvHD without impairment of anti-viral/leukemia effects.

Activated integrins identify functional antigen-specific CD8+ T cells within minutes after antigen stimulation

Immediate β2-integrin activation upon T cell receptor stimulation is critical for effective interaction between T cells and their targets and may therefore be used for the rapid identification and isolation of functional T cells. We present a simple and sensitive flow cytometry-based assay to assess antigen-specific T cells using fluorescent intercellular adhesion molecule (ICAM)-1 multimers that specifically bind to activated β2-integrins. The method is compatible with surface and intracellular staining; it is applicable for monitoring of a broad range of virus-, tumor-, and vaccine-specific CD8+ T cells, and for isolating viable antigen-reacting cells. ICAM-1 binding correlates with peptide-MHC multimer binding but, notably, it identifies the fraction of antigen-specific CD8+ T cells with immediate and high functional capability (i.e., expressing high levels of cytotoxic markers and cytokines). Compared with the currently available methods, staining of activated β2-integrins presents the unique advantage of requiring activation times of only several minutes, therefore delivering functional information nearly reflecting the in vivo situation. Hence, the ICAM-1 assay is most suitable for rapid and precise monitoring of functional antigen-specific T cell responses, including for patient samples in a variety of clinical settings, as well as for the isolation of functional T cells for adoptive cell-transfer immunotherapies.

Development of an RNA-based kit for easy generation of TCR-engineered lymphocytes to control T-cell assay performance

Cell-based assays to monitor antigen-specific T-cell responses are characterized by their high complexity and should be conducted under controlled conditions to lower multiple possible sources of assay variation. However, the lack of standard reagents makes it difficult to directly compare results generated in one lab over time and across institutions. Therefore TCR-engineered reference samples (TERS) that contain a defined number of antigen-specific T cells and continuously deliver stable results are urgently needed. We successfully established a simple and robust TERS technology that constitutes a useful tool to overcome this issue for commonly used T-cell immuno-assays. To enable users to generate large-scale TERS, on-site using the most commonly used electroporation (EP) devices, an RNA-based kit approach, providing stable TCR mRNA and an optimized manufacturing protocol were established. In preparation for the release of this immuno-control kit, we established optimal EP conditions on six devices and initiated an extended RNA stability study. Furthermore, we coordinated on-site production of TERS with 4 participants. Finally, a proficiency panel was organized to test the unsupervised production of TERS at different laboratories using the kit approach. The results obtained show the feasibility and robustness of the kit approach for versatile in-house production of cellular control samples.

Validation of Immunomonitoring Methods for Application in Clinical Studies: The HLA-Peptide Multimer Staining Assay

BACKGROUND

Validated assays are essential to generate data with defined specificity, consistency, and reliability. Although the process of validation is required for applying immunoassays in the context of clinical studies, reports on systematic validation of in vitro T cell assays are scarce so far. We recently validated our HLA-peptide multimer staining assay in a systematic manner so as to qualify the method for monitoring antigen-specific T cell responses after immunotherapy.

METHODS

Parameters of the assay, specificity, precision, linearity, sensitivity, and robustness were assessed systematically. Experiments were designed to address specifically each parameter and are detailed.

RESULTS

Nonspecific multimer staining was below the acceptance limit of 0.02% multimer(+) CD8(+) cells. The assay showed acceptable precision in all dimensions it was repeated (CV < 10%) and also demonstrated a linear detection (R2  > 0.99) of antigen specific cells.

CONCLUSIONS

We succeeded in validating the HLA-multimer staining assay in a systematic manner. Additionally, we propose a technical framework and recommendations that can be applied for validating other T cell assessment methods. © 2016 International Clinical Cytometry Society.

Assay optimisation and technology transfer for multi-site immuno-monitoring in vaccine trials

Cellular immunological assays are important tools for the monitoring of responses to T-cell-inducing vaccine candidates. As these bioassays are often technically complex and require considerable experience, careful technology transfer between laboratories is critical if high quality, reproducible data that allows comparison between sites, is to be generated. The aim of this study, funded by the European Union Framework Program 7-funded TRANSVAC project, was to optimise Standard Operating Procedures and the technology transfer process to maximise the reproducibility of three bioassays for interferon-gamma responses: enzyme-linked immunosorbent assay (ELISA), ex-vivo enzyme-linked immunospot and intracellular cytokine staining. We found that the initial variability in results generated across three different laboratories reduced following a combination of Standard Operating Procedure harmonisation and the undertaking of side-by-side training sessions in which assay operators performed each assay in the presence of an assay ‘lead’ operator. Mean inter-site coefficients of variance reduced following this training session when compared with the pre-training values, most notably for the ELISA assay. There was a trend for increased inter-site variability at lower response magnitudes for the ELISA and intracellular cytokine staining assays. In conclusion, we recommend that on-site operator training is an essential component of the assay technology transfer process and combined with harmonised Standard Operating Procedures will improve the quality, reproducibility and comparability of data produced across different laboratories. These data may be helpful in ongoing discussions of the potential risk/benefit of centralised immunological assay strategies for large clinical trials versus decentralised units.

Automated Analysis of Flow Cytometry Data to Reduce Inter-Lab Variation in the Detection of Major Histocompatibility Complex Multimer-Binding T Cells

Manual analysis of flow cytometry data and subjective gate-border decisions taken by individuals continue to be a source of variation in the assessment of antigen-specific T cells when comparing data across laboratories, and also over time in individual labs. Therefore, strategies to provide automated analysis of major histocompatibility complex (MHC) multimer-binding T cells represent an attractive solution to decrease subjectivity and technical variation. The challenge of using an automated analysis approach is that MHC multimer-binding T cell populations are often rare and therefore difficult to detect. We used a highly heterogeneous dataset from a recent MHC multimer proficiency panel to assess if MHC multimer-binding CD8+ T cells could be analyzed with computational solutions currently available, and if such analyses would reduce the technical variation across different laboratories. We used three different methods, FLOw Clustering without K (FLOCK), Scalable Weighted Iterative Flow-clustering Technique (SWIFT), and ReFlow to analyze flow cytometry data files from 28 laboratories. Each laboratory screened for antigen-responsive T cell populations with frequency ranging from 0.01 to 1.5% of lymphocytes within samples from two donors. Experience from this analysis shows that all three programs can be used for the identification of high to intermediate frequency of MHC multimer-binding T cell populations, with results very similar to that of manual gating. For the less frequent populations (<0.1% of live, single lymphocytes), SWIFT outperformed the other tools. As used in this study, none of the algorithms offered a completely automated pipeline for identification of MHC multimer populations, as varying degrees of human interventions were needed to complete the analysis. In this study, we demonstrate the feasibility of using automated analysis pipelines for assessing and identifying even rare populations of antigen-responsive T cells and discuss the main properties, differences, and advantages of the different methods tested.

Validation of biomarkers to predict response to immunotherapy in cancer: Volume I - pre-analytical and analytical validation

Immunotherapies have emerged as one of the most promising approaches to treat patients with cancer. Recently, there have been many clinical successes using checkpoint receptor blockade, including T cell inhibitory receptors such as cytotoxic T-lymphocyte-associated antigen 4 (CTLA-4) and programmed cell death-1 (PD-1). Despite demonstrated successes in a variety of malignancies, responses only typically occur in a minority of patients in any given histology. Additionally, treatment is associated with inflammatory toxicity and high cost. Therefore, determining which patients would derive clinical benefit from immunotherapy is a compelling clinical question.

Although numerous candidate biomarkers have been described, there are currently three FDA-approved assays based on PD-1 ligand expression (PD-L1) that have been clinically validated to identify patients who are more likely to benefit from a single-agent anti-PD-1/PD-L1 therapy. Because of the complexity of the immune response and tumor biology, it is unlikely that a single biomarker will be sufficient to predict clinical outcomes in response to immune-targeted therapy. Rather, the integration of multiple tumor and immune response parameters, such as protein expression, genomics, and transcriptomics, may be necessary for accurate prediction of clinical benefit. Before a candidate biomarker and/or new technology can be used in a clinical setting, several steps are necessary to demonstrate its clinical validity. Although regulatory guidelines provide general roadmaps for the validation process, their applicability to biomarkers in the cancer immunotherapy field is somewhat limited. Thus, Working Group 1 (WG1) of the Society for Immunotherapy of Cancer (SITC) Immune Biomarkers Task Force convened to address this need. In this two volume series, we discuss pre-analytical and analytical (Volume I) as well as clinical and regulatory (Volume II) aspects of the validation process as applied to predictive biomarkers for cancer immunotherapy. To illustrate the requirements for validation, we discuss examples of biomarker assays that have shown preliminary evidence of an association with clinical benefit from immunotherapeutic interventions. The scope includes only those assays and technologies that have established a certain level of validation for clinical use (fit-for-purpose). Recommendations to meet challenges and strategies to guide the choice of analytical and clinical validation design for specific assays are also provided.

Transfer from research/academia to clinical/regulated

We focus here on how the interface in academia has adapted in their approach to assessing the PDs of biological agents to better understand mechanisms at an early stage. This understanding enables drugs to be modified early and to be reassessed before progressing to late stage trials. We discuss how these efforts are now being bolstered by a network of consortia involving industry, academia and regulatory bodies, to bring together resources, knowledge and a harmonization in bioanalytical techniques. We highlight how the regulatory guidance still lags behind the rapid advancement in biologicals and associated analytical techniques, especially in immunotherapies and immunological bioassays. Despite this, new collaborative groups are working together to deliver robust and accurate results essential for identifying the most promising drugs to progress from early phase academic research to late phase industry based trials. We show how the relationship between academia and not-for-profit organizations with large pharma and emerging biotech companies has shifted toward a more collaborative effort in bringing new therapies to the forefront.

Immunogenicity of GX301 cancer vaccine: Four (telomerase peptides) are better than one

Peptide_540–548, peptide_611–626, peptide_672–686 and peptide_766–780, which are derived from human telomerase, constitute the immunogenic component of the GX301 cancer vaccine. The relative immunogenicity of these peptides is unknown, thus it is unsure whether their combined use offers real advantages over single peptide stimulation. Hence, this study compared the number of specific immune responses and responders to each peptide, as well as to their mixture (meaning the co-presence of the 4 peptides in the same culture well), achieved after ex vivo stimulation of PBMC from 21, HLA-A2+ (n.11) or HLA-A2- (n.10), healthy donors. The study was performed on freshly collected PBMC (T0) and on PBMC stimulated for 10 d with single peptides or their mixture (T1). Peptide-specific immune responses were analyzed by Elispot and cytokine intracellular staining by flow cytometry. The results showed that each peptide induced specific immune responses in some subjects, with different panels of responders among the peptides. Moreover, the numbers of responses and responders to the single peptides or their mixture were comparable. Importantly, the overall number of responders to the 4 peptides was higher than to each single peptide, or to their mixture, both at T0 and T1. These data demonstrate the immunogenicity of each of the 4 GX301 telomerase peptides. Moreover, they show the advantage of multi-peptide over single peptide stimulation, providing a clear support to their combined administration in vaccination protocols. However, the data pose a warning against peptide administration as a mixture due to possible interference phenomena during antigen presentation processes.

Toward harmonized phenotyping of human myeloid-derived suppressor cells by flow cytometry: results from an interim study

There is an increasing interest for monitoring circulating myeloid-derived suppressor cells (MDSCs) in cancer patients, but there are also divergences in their phenotypic definition. To overcome this obstacle, the Cancer Immunoguiding Program under the umbrella of the Association of Cancer Immunotherapy is coordinating a proficiency panel program that aims at harmonizing MDSC phenotyping. After a consultation period, a two-stage approach was designed to harmonize MDSC phenotype. In the first step, an international consortium of 23 laboratories immunophenotyped 10 putative MDSC subsets on pretested, peripheral blood mononuclear cells of healthy donors to assess the level of concordance and define robust marker combinations for the identification of circulating MDSCs. At this stage, no mandatory requirements to standardize reagents or protocols were introduced. Data analysis revealed a small intra-laboratory, but very high inter-laboratory variance for all MDSC subsets, especially for the granulocytic subsets. In particular, the use of a dead-cell marker altered significantly the reported percentage of granulocytic MDSCs, confirming that these cells are especially sensitive to cryopreservation and/or thawing. Importantly, the gating strategy was heterogeneous and associated with high inter-center variance. Overall, our results document the high variability in MDSC phenotyping in the multicenter setting if no harmonization/standardization measures are applied. Although the observed variability depended on a number of identified parameters, the main parameter associated with variation was the gating strategy. Based on these findings, we propose further efforts to harmonize marker combinations and gating parameters to identify strategies for a robust enumeration of MDSC subsets.

BayesFlow: latent modeling of flow cytometry cell populations

Background

Flow cytometry is a widespread single-cell measurement technology with a multitude of clinical and research applications. Interpretation of flow cytometry data is hard; the instrumentation is delicate and can not render absolute measurements, hence samples can only be interpreted in relation to each other while at the same time comparisons are confounded by inter-sample variation. Despite this, most automated flow cytometry data analysis methods either treat samples individually or ignore the variation by for example pooling the data. A key requirement for models that include multiple samples is the ability to visualize and assess inferred variation, since what could be technical variation in one setting would be different phenotypes in another.

Results

We introduce BayesFlow, a pipeline for latent modeling of flow cytometry cell populations built upon a Bayesian hierarchical model. The model systematizes variation in location as well as shape. Expert knowledge can be incorporated through informative priors and the results can be supervised through compact and comprehensive visualizations.

BayesFlow is applied to two synthetic and two real flow cytometry data sets. For the first real data set, taken from the FlowCAP I challenge, BayesFlow does not only give a gating which would place it among the top performers in FlowCAP I for this dataset, it also gives a more consistent treatment of different samples than either manual gating or other automated gating methods. The second real data set contains replicated flow cytometry measurements of samples from healthy individuals. BayesFlow gives here cell populations with clear expression patterns and small technical intra-donor variation as compared to biological inter-donor variation.

Conclusions

Modeling latent relations between samples through BayesFlow enables a systematic analysis of inter-sample variation. As opposed to other joint gating methods, effort is put at ensuring that the obtained partition of the data corresponds to actual cell populations, and the result is therefore directly biologically interpretable. BayesFlow is freely available at GitHub.

Electronic supplementary material

The online version of this article (doi:10.1186/s12859-015-0862-z) contains supplementary material, which is available to authorized users.

Monitoring regulatory T cells in clinical samples: consensus on an essential marker set and gating strategy for regulatory T cell analysis by flow cytometry

Regulatory T cell (Treg)-mediated immunosuppression is considered a major obstacle for successful cancer immunotherapy. The association between clinical outcome and Tregs is being studied extensively in clinical trials, but unfortunately, no consensus has been reached about (a) the markers and (b) the gating strategy required to define human Tregs in this context, making it difficult to draw final conclusions. Therefore, we have organized an international workshop on the detection and functional testing of Tregs with leading experts in the field, and 40 participants discussing different analyses and the importance of different markers and context in which Tregs were analyzed. This resulted in a rationally composed ranking list of "Treg markers". Subsequently, the proposed Treg markers were tested to get insight into the overlap/differences between the most frequently used Treg definitions and their utility for Treg detection in various human tissues. Here, we conclude that the CD3, CD4, CD25, CD127, and FoxP3 markers are the minimally required markers to define human Treg cells. Staining for Ki67 and CD45RA showed to provide additional information on the activation status of Tregs. The use of markers was validated in a series of PBMC from healthy donors and cancer patients, as well as in tumor-draining lymph nodes and freshly isolated tumors. In conclusion, we propose an essential marker set comprising antibodies to CD3, CD4, CD25, CD127, Foxp3, Ki67, and CD45RA and a corresponding robust gating strategy for the context-dependent analysis of Tregs by flow cytometry.

Guidelines for the automated evaluation of Elispot assays

The presented protocol for Elispot plate evaluation summarizes how to implement the recommendations developed following the establishment of a large-scale international Elispot plate-reading panel and subsequent multistep consensus-finding process. The panel involved >100 scientists from various immunological backgrounds. The protocol includes the description and justification of steps for setting reading parameters to obtain accurate, reliable and precise automated analysis results of Elispot plates. Further, necessary adjustments for out-of-specification situations are described and examples are provided. The plate analysis, including parameter adjustments, auditing of results and necessary annotations, should be achievable within a time range of 10-30 min per plate. Adoption of these guidelines should enable a further reduction in assay variability and an increase in the reliability and comparability of results obtained by Elispot. These guidelines conclude the ongoing harmonization efforts for the enzymatic Elispot assay.

Managing Multi-center Flow Cytometry Data for Immune Monitoring

With the recent results of promising cancer vaccines and immunotherapy1–5, immune monitoring has become increasingly relevant for measuring treatment-induced effects on T cells, and an essential tool for shedding light on the mechanisms responsible for a successful treatment. Flow cytometry is the canonical multi-parameter assay for the fine characterization of single cells in solution, and is ubiquitously used in pre-clinical tumor immunology and in cancer immunotherapy trials. Current state-of-the-art polychromatic flow cytometry involves multi-step, multi-reagent assays followed by sample acquisition on sophisticated instruments capable of capturing up to 20 parameters per cell at a rate of tens of thousands of cells per second. Given the complexity of flow cytometry assays, reproducibility is a major concern, especially for multi-center studies. A promising approach for improving reproducibility is the use of automated analysis borrowing from statistics, machine learning and information visualization21–23, as these methods directly address the subjectivity, operator-dependence, labor-intensive and low fidelity of manual analysis. However, it is quite time-consuming to investigate and test new automated analysis techniques on large data sets without some centralized information management system. For large-scale automated analysis to be practical, the presence of consistent and high-quality data linked to the raw FCS files is indispensable. In particular, the use of machine-readable standard vocabularies to characterize channel metadata is essential when constructing analytic pipelines to avoid errors in processing, analysis and interpretation of results. For automation, this high-quality metadata needs to be programmatically accessible, implying the need for a consistent Application Programming Interface (API). In this manuscript, we propose that upfront time spent normalizing flow cytometry data to conform to carefully designed data models enables automated analysis, potentially saving time in the long run. The ReFlow informatics framework was developed to address these data management challenges.

Data analysis as a source of variability of the HLA-peptide multimer assay: from manual gating to automated recognition of cell clusters

Multiparameter flow cytometry is an indispensable method for assessing antigen-specific T cells in basic research and cancer immunotherapy. Proficiency panels have shown that cell sample processing, test protocols and data analysis may all contribute to the variability of the results obtained by laboratories performing ex vivo T cell immune monitoring. In particular, analysis currently relies on a manual, step-by-step strategy employing serial gating decisions based on visual inspection of one- or two-dimensional plots. It is therefore operator dependent and subjective. In the context of continuing efforts to support inter-laboratory T cell assay harmonization, the CIMT Immunoguiding Program organized its third proficiency panel dedicated to the detection of antigen-specific CD8(+) T cells by HLA-peptide multimer staining. We first assessed the contribution of manual data analysis to the variability of reported T cell frequencies within a group of laboratories staining and analyzing the same cell samples with their own reagents and protocols. The results show that data analysis is a source of variation in the multimer assay outcome. To evaluate whether an automated analysis approach can reduce variability of proficiency panel data, we used a hierarchical statistical mixture model to identify cell clusters. Challenges for automated analysis were the need to process non-standardized data sets from multiple centers, and the fact that the antigen-specific cell frequencies were very low in most samples. We show that this automated method can circumvent difficulties inherent to manual gating strategies and is broadly applicable for experiments performed with heterogeneous protocols and reagents.

Challenges in the development of a survivin vaccine (SurVaxM) for malignant glioma

There is growing interest in immunotherapy for malignant gliomas. This interest stems from a number of immunological observations, together with the failure of conventional therapeutic agents to produce broad and clinically meaningful improvements in survival and quality of life. The challenges faced in translating laboratory-based immunological observations to Phase I and II clinical trials for immunotherapy of gliomas are substantial. Nevertheless, as our understanding of the effects of active specific vaccination in glioma patients grows, results support optimism that such methods may eventually prove useful as an adjunctive treatment for these cancers. This paper highlights a number of barriers encountered in the translational development of a survivin-targeted peptide vaccine (SurVaxM) for patients with malignant gliomas.

Latent infection with cytomegalovirus is associated with poor memory CD4 responses to influenza A core proteins in the elderly

Influenza remains a major pathogen in older people. Infection with CMV and the accumulation of late-differentiated T cells associated with it have been implicated in poor Ab responsiveness to influenza vaccination in the elderly, most of whom are CMV positive. However, whether CMV infection also affects memory T cell responses to influenza remains unknown. To investigate this, we assessed T cell responses to influenza A matrix protein and nucleoprotein ex vivo in 166 Dutch individuals (mean age 62.2 y, range 42-82) and validated the results in a second cohort from North America (mean age 73.1 y, range 65-81, n = 28). We found that less than half of the CMV-infected older subjects mounted a CD4 T cell response to influenza Ags, whereas ∼80% of uninfected elderly did so. A similar proportion of younger subjects possessed influenza A virus-responsive CD4 T cells, and, interestingly, this was the case whether they were CMV-infected. Thus, the effect of CMV was only seen in the older donors, who may have been exposed to the virus for decades. The percentage of donors with CD8 responses to influenza A virus was lower than those with CD4; this was not influenced by whether the subjects were CMV seropositive or seronegative. CMV-seropositive responders had significantly higher frequencies of late-differentiated CD4 T-cells (CD45RA(+/-)CCR7(-)CD27(-)CD28(-)) compared with CMV-infected nonresponders. These data add to the accumulating evidence that infection with CMV has profound but heterogeneous effects on responses to the products of other viruses and have implications for the design of influenza vaccines, especially in the elderly.

Immune monitoring in cancer vaccine clinical trials: critical issues of functional flow cytometry-based assays

The development of immune monitoring assays is essential to determine the immune responses against tumor-specific antigens (TSAs) and tumor-associated antigens (TAAs) and their possible correlation with clinical outcome in cancer patients receiving immunotherapies. Despite the wide range of techniques used, to date these assays have not shown consistent results among clinical trials and failed to define surrogate markers of clinical efficacy to antitumor vaccines. Multiparameter flow cytometry- (FCM-) based assays combining different phenotypic and functional markers have been developed in the past decade for informative and longitudinal analysis of polyfunctional T-cells. These technologies were designed to address the complexity and functional heterogeneity of cancer biology and cellular immunity and to define biomarkers predicting clinical response to anticancer treatment. So far, there is still a lack of standardization of some of these immunological tests. The aim of this review is to overview the latest technologies for immune monitoring and to highlight critical steps involved in some of the FCM-based cellular immune assays. In particular, our laboratory is focused on melanoma vaccine research and thus our main goal was the validation of a functional multiparameter test (FMT) combining different functional and lineage markers to be applied in clinical trials involving patients with melanoma.

Immunological Monitoring to Rationally Guide AAV Gene Therapy

Recent successes with adeno-associated virus (AAV)-based gene therapies fuel the hope for new treatments for hereditary diseases. Pre-existing as well as therapy-induced immune responses against both AAV and the encoded transgenes have been described and may impact on safety and efficacy of gene therapy approaches. Consequently, monitoring of vector- and transgene-specific immunity is mandated and may rationally guide clinical development. Next to the humoral immune response, the cellular response is central in our understanding of the host reaction in gene therapy. But in contrast to the monitoring of antibodies, which has matured over many decades, sensitive and robust monitoring of T cells is a relatively new development. To make cellular immune assessments fit for purpose, investigators need to know, control and report the critical assay variables that influence the results. In addition, the quality of immune assays needs to be continuously adjusted to allow for exploratory hypothesis generation in early stages and confirmatory hypothesis validation in later stages of clinical development. The concept of immune assay harmonization which includes use of field-wide benchmarks, harmonization guidelines, and external quality control can support the context-specific evolution of immune assays. Multi-center studies pose particular challenges to sample logistics and quality control of sample specimens. Cooperative groups need to define if immune assessments should be performed in one central facility, in peripheral labs or including a combination of both. Finally, engineered reference samples that contain a defined number of antigen-specific T cells may become broadly applicable tools to control assay performance over time or across institutions.

A harmonized approach to intracellular cytokine staining gating: Results from an international multiconsortia proficiency panel conducted by the Cancer Immunotherapy Consortium (CIC/CRI)

Previous results from two proficiency panels of intracellular cytokine staining (ICS) from the Cancer Immunotherapy Consortium and panels from the National Institute of Allergy and Infectious Disease and the Association for Cancer Immunotherapy highlight the variability across laboratories in reported % CD8+ or % CD4+ cytokine-positive cells. One of the main causes of interassay variability in flow cytometry-based assays is due to differences in gating strategies between laboratories, which may prohibit the generation of robust results within single centers and across institutions. To study how gating strategies affect the variation in reported results, a gating panel was organized where all participants analyzed the same set of Flow Cytometry Standard (FCS) files from a four-color ICS assay using their own gating protocol (Phase I) and a gating protocol drafted by consensus from the organizers of the panel (Phase II). Focusing on analysis removed donor, assay, and instrument variation, enabling us to quantify the variability caused by gating alone. One hundred ten participating laboratories applied 110 different gating approaches. This led to high variability in the reported percentage of cytokine-positive cells and consequently in response detection in Phase I. However, variability was dramatically reduced when all laboratories used the same gating strategy (Phase II). Proximity of the cytokine gate to the negative population most impacted true-positive and false-positive response detection. Recommendations are provided for the (1) placement of the cytokine-positive gate, (2) identification of CD4+ CD8+ double-positive T cells, (3) placement of lymphocyte gate, (4) inclusion of dim cells, (5) gate uniformity, and 6) proper adjustment of the biexponential scaling.

The development of standard samples with a defined number of antigen-specific T cells to harmonize T cell assays: a proof-of-principle study

The validation of assays that quantify antigen-specific T cell responses is critically dependent on cell samples that contain clearly defined measurable numbers of antigen-specific T cells. An important requirement is that such cell samples are handled and analyzed in a comparable fashion to peripheral blood mononuclear cells (PBMC). We performed a proof-of-principle study to show that retrovirally TCR-transduced T cells spiked at defined numbers in autologous PBMC can be used as standard samples for HLA/peptide multimer staining. NY-ESO-1157-165-specific, TCR-transduced CD8+ T cell batches were successfully generated from PBMC of several HLA-A*0201 healthy donors, purified by magnetic cell sorting on the basis of HLA tetramer (TM) staining and expanded with specific antigen in vitro. When subsequently spiked into autologous PBMC, the detection of these CD3+CD8+TM+ T cells was highly accurate with a mean accuracy of 91.6 %. The standard cells can be preserved for a substantial period of time in liquid nitrogen. Furthermore, TM staining of fresh and cryopreserved standard samples diluted at decreasing concentrations into autologous cryopreserved unspiked PBMC revealed that the spiked CD3+CD8+TM+ T cells could be accurately detected at all dilutions in a linear fashion with a goodness-of-fit of over 0.99 at a frequency of at least 0.02 % among the CD3+CD8+ T cell population. Notably, the CD3+CD8+TM+ cells of the standard samples were located exactly within the gates used to analyze patient samples and displayed a similar scatter pattern. The performance of the cryopreserved standard samples in the hands of 5 external investigators was good with an inter-laboratory variation of 32.9 % and the doubtless identification of one outlier.

Targeted therapy in renal cell carcinoma: moving from molecular agents to specific immunotherapy

Non-specific immunotherapy has been for a long time a standard treatment option for patients with metastatic renal cell carcinoma but was redeemed by specific targeted molecular therapies, namely the VEGF and mTOR inhibitors. After moving treatment for mRCC to specific molecular agents with a well-defined mode of action, immunotherapy still needs this further development to increase its accuracy. Nowadays, an evolution from a rather non-specific cytokine treatment to sophisticated targeted approaches in specific immunotherapy led to a re-launch of immunotherapy in clinical studies. Recent steps in the development of immunotherapy strategies are discussed in this review with a special focus on peptide vaccination which aims at a tumor targeting by specific T lymphocytes. In addition, different combinatory strategies with immunomodulating agents like cyclophosphamide or sunitinib are outlined, and the effects of immune checkpoint modulators as anti-CTLA-4 or PD-1 antibodies are discussed.