Adapting crowdsourced clinical cancer curation in CIViC to the ClinGen minimum variant level data community-driven standards

Assessments of Somatic Variant Classification Using the Association for Molecular Pathology/American Society of Clinical Oncology/College of American Pathologists Guidelines: A Report from the Association for Molecular Pathology

To assess the clinical implementation of the 2017 Standards and Guidelines for the Interpretation and Reporting of Sequence Variants in Cancer: A Joint Consensus Recommendation of the Association for Molecular Pathology, American Society of Clinical Oncology, and College of American Pathologists, identify content that may result in classification inconsistencies, and evaluate implementation barriers, an Association for Molecular Pathology Working Group conducted variant interpretation challenges and a guideline implementation survey. A total of 134 participants participated in the variant interpretation challenges, consisting of 11 variants in four cancer cases. Results demonstrate 86% (range, 54% to 94%) of the respondents correctly classified clinically significant variants, variants of uncertain significance, and benign/likely benign variants; however, only 59% (range, 39% to 84%) of responses agreed with the working group's consensus intended responses regarding both tiers and categories of clinical significance. In the implementation survey, 71% (157/220) of respondents have implemented the 2017 guidelines for variant classification and reporting either with or without modifications. Collectively, this study demonstrates that, although they may not yet be optimized, the 2017 guideline recommendations are being adopted for standardized somatic variant classification. The working group identified significant areas for future guideline improvement, including the need for a more granular and comprehensive classification system and education resources to meet the growing needs of both laboratory professionals and medical oncologists.

Developing a disease-specific annotation protocol for VHL gene curation using Hypothes.is

Von Hippel-Lindau (VHL) disease is a rare, autosomal dominant disorder that predisposes individuals to developing tumors in many organs. There is significant phenotypic variability and genetic variants encountered within this syndrome, posing a considerable challenge to patient care. The lack of VHL variant data sharing paired with the absence of aggregated genotype-phenotype information results in an arduous process, when characterizing genetic variants and predicting patient prognosis. To address these gaps in knowledge, the Clinical Genome Resource (ClinGen) VHL Variant Curation Expert Panel (VCEP) has been resolving a list of variants of uncertain significance within the VHL gene. Through community curation, we crowdsourced the laborious task of variant annotation by modifying the ClinGen Community Curation (C3)-developed Baseline Annotation protocol and annotating all published VHL cases with the reported genotype-phenotype information in Hypothes.is, an open-access web annotation tool. This process, incorporated into the ClinGen VCEP's workflow, will aid in their curation efforts. To facilitate the curation at all levels of genetics expertise, our team developed a 4-day biocuration training protocol and resource guide. To date, 91.3% of annotations have been completed by undergraduate and high-school students without formal academic genetics specialization. Here, we present our VHL-specific annotation protocol utilizing Hypothes.is, which offers a standardized method to present case-resolution data, and our biocuration training protocol, which can be adapted for other rare disease platforms. By facilitating training for community curation of VHL disease, we increased student engagement with clinical genetics while enhancing knowledge translation in the field of hereditary cancer. Database URL: https://hypothes.is/groups/dKymJJpZ/vhl-hypothesis-annotation.

Using Long-Term Follow-Up Data to Classify Genetic Variants in Newborn Screened Conditions

With the rapid increase in publicly available sequencing data, healthcare professionals are tasked with understanding how genetic variation informs diagnosis and affects patient health outcomes. Understanding the impact of a genetic variant in disease could be used to predict susceptibility/protection and to help build a personalized medicine profile. In the United States, over 3.8 million newborns are screened for several rare genetic diseases each year, and the follow-up testing of screen-positive newborns often involves sequencing and the identification of variants. This presents the opportunity to use longitudinal health information from these newborns to inform the impact of variants identified in the course of diagnosis. To test this, we performed secondary analysis of a 10-year natural history study of individuals diagnosed with metabolic disorders included in newborn screening (NBS). We found 564 genetic variants with accompanying phenotypic data and identified that 161 of the 564 variants (29%) were not included in ClinVar. We were able to classify 139 of the 161 variants (86%) as pathogenic or likely pathogenic. This work demonstrates that secondary analysis of longitudinal data collected as part of NBS finds unreported genetic variants and the accompanying clinical information can inform the relationship between genotype and phenotype.

A community approach to the cancer-variant-interpretation bottleneck

As guidelines, therapies, and literature on cancer variants expand, the lack of consensus variant interpretations impedes clinical applications. CIViC is a public domain, crowd-sourced, and adaptable knowledgebase of evidence for the Clinical Interpretation of Variants in Cancer, designed to reduce barriers to knowledge sharing and alleviate the variant interpretation bottleneck.

The International Collaboration for Cancer Classification and Research

Gaps in the translation of research findings to clinical management have been recognized for decades. They exist for the diagnosis as well as the management of cancer. The international standards for cancer diagnosis are contained within the World Health Organization (WHO) Classification of Tumours, published by the International Agency for Research on Cancer (IARC) and known worldwide as the WHO Blue Books. In addition to their relevance to individual patients, these volumes provide a valuable contribution to cancer research and surveillance, fulfilling an important role in scientific evidence synthesis and international standard setting. However, the multidimensional nature of cancer classification, the way in which the WHO Classification of Tumours is constructed, and the scientific information overload in the field pose important challenges for the translation of research findings to tumour classification and hence cancer diagnosis. To help address these challenges, we have established the International Collaboration for Cancer Classification and Research (IC3 R) to provide a forum for the coordination of efforts in evidence generation, standard setting and best practice recommendations in the field of tumour classification. The first IC3 R meeting, held in Lyon, France, in February 2019, gathered representatives of major institutions involved in tumour classification and related fields to identify and discuss translational challenges in data comparability, standard setting, quality management, evidence evaluation and copyright, as well as to develop a collaborative plan for addressing these challenges.

CIViCpy: A Python Software Development and Analysis Toolkit for the CIViC Knowledgebase

PURPOSE

Precision oncology depends on the matching of tumor variants to relevant knowledge describing the clinical significance of those variants. We recently developed the Clinical Interpretations for Variants in Cancer (CIViC; civicdb.org) crowd-sourced, expert-moderated, and open-access knowledgebase. CIViC provides a structured framework for evaluating genomic variants of various types (eg, fusions, single-nucleotide variants) for their therapeutic, prognostic, predisposing, diagnostic, or functional utility. CIViC has a documented application programming interface for accessing CIViC records: assertions, evidence, variants, and genes. Third-party tools that analyze or access the contents of this knowledgebase programmatically must leverage this application programming interface, often reimplementing redundant functionality in the pursuit of common analysis tasks that are beyond the scope of the CIViC Web application.

METHODS

To address this limitation, we developed CIViCpy (civicpy.org), a software development kit for extracting and analyzing the contents of the CIViC knowledgebase. CIViCpy enables users to query CIViC content as dynamic objects in Python. We assess the viability of CIViCpy as a tool for advancing individualized patient care by using it to systematically match CIViC evidence to observed variants in patient cancer samples.

RESULTS

We used CIViCpy to evaluate variants from 59,437 sequenced tumors of the American Association for Cancer Research Project GENIE data set. We demonstrate that CIViCpy enables annotation of > 1,200 variants per second, resulting in precise variant matches to CIViC level A (professional guideline) or B (clinical trial) evidence for 38.6% of tumors.

CONCLUSION

The clinical interpretation of genomic variants in cancers requires high-throughput tools for interoperability and analysis of variant interpretation knowledge. These needs are met by CIViCpy, a software development kit for downstream applications and rapid analysis. CIViCpy is fully documented, open-source, and available free online.

Standard operating procedure for curation and clinical interpretation of variants in cancer

Manually curated variant knowledgebases and their associated knowledge models are serving an increasingly important role in distributing and interpreting variants in cancer. These knowledgebases vary in their level of public accessibility, and the complexity of the models used to capture clinical knowledge. CIViC (Clinical Interpretation of Variants in Cancer - www.civicdb.org) is a fully open, free-to-use cancer variant interpretation knowledgebase that incorporates highly detailed curation of evidence obtained from peer-reviewed publications and meeting abstracts, and currently holds over 6300 Evidence Items for over 2300 variants derived from over 400 genes. CIViC has seen increased adoption by, and also undertaken collaboration with, a wide range of users and organizations involved in research. To enhance CIViC’s clinical value, regular submission to the ClinVar database and pursuit of other regulatory approvals is necessary. For this reason, a formal peer reviewed curation guideline and discussion of the underlying principles of curation is needed. We present here the CIViC knowledge model, standard operating procedures (SOP) for variant curation, and detailed examples to support community-driven curation of cancer variants.

A case for expert curation: an overview of cancer curation in the Clinical Genome Resource (ClinGen)

We describe the Clinical Genome Resource (ClinGen) cancer-related curation activities and the importance of curation to the evolving state of variant interpretation in a clinical context for both pediatric and adult cancer patients. We highlight specific examples from the CDH1 and PTEN Variant Curation Expert Panels (VCEPs) of the FDA-recognized process by which ClinGen VCEPs specify the American College of Medical Genetics and Genomics/Association of Molecular Pathology evidence code to develop variant classifications. We also review gene curations performed within the Hereditary Cancer Clinical Domain. We describe the parallel efforts for curation of somatic cancer variants from the Somatic Cancer Working Group. The ClinGen Germline/Somatic Committee is working to improve incorporation of both hereditary and somatic variant data to aid clinical interpretation. These ClinGen efforts rely on broad data sharing and detailed phenotypic and molecular information from published case studies to provide expert-curated variant interpretation to the cancer community.

Knowledge base toward understanding actionable alterations and realizing precision oncology

In Japan, the National Cancer Center and university hospitals have initiated next-generation sequencing-based in vitro diagnostic testing for cancer patients as a method of clinical sequencing. Based on the molecular alterations detected, physicians can provide approved targeted therapy and access to investigational drugs for cancer patients. However, interpretation of the clinical significance of genomic alterations remains the most severe bottleneck of precision medicine in cancer. Although many research institutes in the United States are developing knowledge bases for interpretation of the tumor alterations and clinical decisions, these knowledge bases are unsuited as sources of reference in Japan due to differences in the information on approved drugs and implementation of clinical trials. In this review, we introduce knowledge bases for clinical decision-making based on genomic events in cancer, and discuss the resources of additional information necessary for implementing precision medicine in Japan.

Adapting crowdsourced clinical cancer curation in CIViC to the ClinGen minimum variant level data community-driven standards

Harmonization of cancer variant representation, efficient communication, and free distribution of clinical variant-associated knowledge are central problems that arise with increased usage of clinical next-generation sequencing. The Clinical Genome Resource (ClinGen) Somatic Working Group (WG) developed a minimal variant level data (MVLD) representation of cancer variants, and has an ongoing collaboration with Clinical Interpretations of Variants in Cancer (CIViC), an open-source platform supporting crowdsourced and expert-moderated cancer variant curation. Harmonization between MVLD and CIViC variant formats was assessed by formal field-by-field analysis. Adjustments to the CIViC format were made to harmonize with MVLD and support ClinGen Somatic WG curation activities, including four new features in CIViC: (1) introduction of an assertions feature for clinical variant assessment following the Association of Molecular Pathologists (AMP) guidelines, (2) group-level curation tracking for organizations, enabling member transparency, and curation effort summaries, (3) introduction of ClinGen Allele Registry IDs to CIViC, and (4) mapping of CIViC assertions into ClinVar submission with automated submissions. A generalizable workflow utilizing MVLD and new CIViC features is outlined for use by ClinGen Somatic WG task teams for curation and submission to ClinVar, and provides a model for promoting harmonization of cancer variant representation and efficient distribution of this information.