2
|
Foox J, Tighe SW, Nicolet CM, Zook JM, Byrska-Bishop M, Clarke WE, Khayat MM, Mahmoud M, Laaguiby PK, Herbert ZT, Warner D, Grills GS, Jen J, Levy S, Xiang J, Alonso A, Zhao X, Zhang W, Teng F, Zhao Y, Lu H, Schroth GP, Narzisi G, Farmerie W, Sedlazeck FJ, Baldwin DA, Mason CE. Performance assessment of DNA sequencing platforms in the ABRF Next-Generation Sequencing Study. Nat Biotechnol 2021; 39:1129-1140. [PMID: 34504351 PMCID: PMC8985210 DOI: 10.1038/s41587-021-01049-5] [Citation(s) in RCA: 47] [Impact Index Per Article: 15.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Accepted: 08/05/2021] [Indexed: 02/08/2023]
Abstract
Assessing the reproducibility, accuracy and utility of massively parallel DNA sequencing platforms remains an ongoing challenge. Here the Association of Biomolecular Resource Facilities (ABRF) Next-Generation Sequencing Study benchmarks the performance of a set of sequencing instruments (HiSeq/NovaSeq/paired-end 2 × 250-bp chemistry, Ion S5/Proton, PacBio circular consensus sequencing (CCS), Oxford Nanopore Technologies PromethION/MinION, BGISEQ-500/MGISEQ-2000 and GS111) on human and bacterial reference DNA samples. Among short-read instruments, HiSeq 4000 and X10 provided the most consistent, highest genome coverage, while BGI/MGISEQ provided the lowest sequencing error rates. The long-read instrument PacBio CCS had the highest reference-based mapping rate and lowest non-mapping rate. The two long-read platforms PacBio CCS and PromethION/MinION showed the best sequence mapping in repeat-rich areas and across homopolymers. NovaSeq 6000 using 2 × 250-bp read chemistry was the most robust instrument for capturing known insertion/deletion events. This study serves as a benchmark for current genomics technologies, as well as a resource to inform experimental design and next-generation sequencing variant calling.
Collapse
Affiliation(s)
- Jonathan Foox
- Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA.,The HRH Prince Alwaleed Bin Talal Bin Abdulaziz Alsaud Institute for Computational Biomedicine, Weill Cornell Medicine, New York, NY, USA
| | - Scott W. Tighe
- University of Vermont Cancer Center, Vermont Integrative Genomics Resource, University of Vermont, Burlington, VT, USA
| | - Charles M. Nicolet
- Keck School of Medicine, University of Southern California, Los Angeles, CA, USA
| | - Justin M. Zook
- Biosystems and Biomaterials Division, National Institute of Standards and Technology, Gaithersburg, MD, USA
| | | | | | - Michael M. Khayat
- Human Genome Sequencing Center, Baylor College of Medicine, Houston, TX, USA.,Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, TX, USA
| | - Medhat Mahmoud
- Human Genome Sequencing Center, Baylor College of Medicine, Houston, TX, USA.,Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, TX, USA
| | - Phoebe K. Laaguiby
- University of Vermont Cancer Center, Vermont Integrative Genomics Resource, University of Vermont, Burlington, VT, USA
| | - Zachary T. Herbert
- Molecular Biology Core Facilities, Dana-Farber Cancer Institute, Boston, MA, USA
| | - Derek Warner
- DNA Sequencing Core, University of Utah, Salt Lake City, UT, USA
| | - George S. Grills
- Sylvester Comprehensive Cancer Center, University of Miami, Miami, FL, USA
| | - Jin Jen
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN, USA
| | - Shawn Levy
- HudsonAlpha Institute for Biotechnology, Huntsville, AL, USA
| | - Jenny Xiang
- Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA
| | - Alicia Alonso
- Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA
| | - Xia Zhao
- BGI-Shenzhen, Shenzhen, China.,MGI, BGI-Shenzhen, Shenzhen, China
| | | | | | - Yonggang Zhao
- BGI-Shenzhen, Shenzhen, China.,Department of Biotechnology and Biomedicine, Technical University of Denmark, Lyngby, Denmark
| | - Haorong Lu
- BGI-Shenzhen, Shenzhen, China.,Guangdong Provincial Key Laboratory of Genome Read and Write, Shenzhen, China
| | | | | | - William Farmerie
- Interdisciplinary Center for Biotechnology Research, University of Florida, Gainesville, FL, USA
| | - Fritz J. Sedlazeck
- Human Genome Sequencing Center, Baylor College of Medicine, Houston, TX, USA.,Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, TX, USA.,Correspondence and requests for materials should be addressed to Fritz J. Sedlazeck, Don A. Baldwin or Christopher E. Mason. ; ;
| | - Don A. Baldwin
- Department of Pathology, Fox Chase Cancer Center, Philadelphia, PA, USA.,Correspondence and requests for materials should be addressed to Fritz J. Sedlazeck, Don A. Baldwin or Christopher E. Mason. ; ;
| | - Christopher E. Mason
- Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA.,The HRH Prince Alwaleed Bin Talal Bin Abdulaziz Alsaud Institute for Computational Biomedicine, Weill Cornell Medicine, New York, NY, USA.,The Feil Family Brain and Mind Research Institute, New York, NY, USA.,The WorldQuant Initiative for Quantitative Prediction, Weill Cornell Medicine, New York, NY, USA.,Correspondence and requests for materials should be addressed to Fritz J. Sedlazeck, Don A. Baldwin or Christopher E. Mason. ; ;
| |
Collapse
|
3
|
Sipos O, Tovey H, Quist J, Haider S, Nowinski S, Gazinska P, Kernaghan S, Toms C, Maguire S, Orr N, Linn SC, Owen J, Gillett C, Pinder SE, Bliss JM, Tutt A, Cheang MCU, Grigoriadis A. Assessment of structural chromosomal instability phenotypes as biomarkers of carboplatin response in triple negative breast cancer: the TNT trial. Ann Oncol 2021; 32:58-65. [PMID: 33098992 PMCID: PMC7784666 DOI: 10.1016/j.annonc.2020.10.475] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2020] [Revised: 08/05/2020] [Accepted: 10/13/2020] [Indexed: 12/27/2022] Open
Abstract
BACKGROUND In the TNT trial of triple negative breast cancer (NCT00532727), germline BRCA1/2 mutations were present in 28% of carboplatin responders. We assessed quantitative measures of structural chromosomal instability (CIN) to identify a wider patient subgroup within TNT with preferential benefit from carboplatin over docetaxel. PATIENTS AND METHODS Copy number aberrations (CNAs) were established from 135 formalin-fixed paraffin-embedded primary carcinomas using Illumina OmniExpress SNP-arrays. Seven published [allelic imbalanced CNA (AiCNA); allelic balanced CNA (AbCNA); copy number neutral loss of heterozygosity (CnLOH); number of telomeric allelic imbalances (NtAI); BRCA1-like status; percentage of genome altered (PGA); homologous recombination deficiency (HRD) scores] and two novel [Shannon diversity index (SI); high-level amplifications (HLAMP)] CIN-measurements were derived. HLAMP was defined based on the presence of at least one of the top 5% amplified cytobands located on 1q, 8q and 10p. Continuous CIN-measurements were divided into tertiles. All nine CIN-measurements were used to analyse objective response rate (ORR) and progression-free survival (PFS). RESULTS Patients with tumours without HLAMP had a numerically higher ORR and significantly longer PFS in the carboplatin (C) than in the docetaxel (D) arm [56% (C) versus 29% (D), PHLAMP,quiet = 0.085; PFS 6.1 months (C) versus 4.1 months (D), Pinteraction/HLAMP = 0.047]. In the carboplatin arm, patients with tumours showing intermediate telomeric NtAI and AiCNA had higher ORR [54% (C) versus 20% (D), PNtAI,intermediate = 0.03; 62% (C) versus 33% (D), PAiCNA,intermediate = 0.076]. Patients with high AiCNA and PGA had shorter PFS in the carboplatin arm [3.4 months (high) versus 5.7 months (low/intermediate); and 3.8 months (high) versus 5.6 months (low/intermediate), respectively; Pinteraction/AiCNA = 0.027, Padj.interaction/AiCNA = 0.125 and Pinteraction/PGA = 0.053, Padj.interaction/PGA = 0.176], whilst no difference was observed in the docetaxel arm. CONCLUSIONS Patients with tumours lacking HLAMP and demonstrating intermediate CIN-measurements formed a subgroup benefitting from carboplatin relative to docetaxel treatment within the TNT trial. This suggests a complex and paradoxical relationship between the extent of genomic instability in primary tumours and treatment response in the metastatic setting.
Collapse
Affiliation(s)
- O Sipos
- Breast Cancer Now Toby Robins Research Centre, The Institute of Cancer Research, London, UK
| | - H Tovey
- Clinical Trials and Statistics Unit, The Institute of Cancer Research, London, UK
| | - J Quist
- Breast Cancer Now Unit, King's College London Faculty of Life Sciences and Medicine, London, UK; School of Cancer and Pharmaceutical Sciences, King's College London Faculty of Life Sciences and Medicine, London, UK
| | - S Haider
- Breast Cancer Now Toby Robins Research Centre, The Institute of Cancer Research, London, UK
| | - S Nowinski
- School of Cancer and Pharmaceutical Sciences, King's College London Faculty of Life Sciences and Medicine, London, UK
| | - P Gazinska
- Breast Cancer Now Toby Robins Research Centre, The Institute of Cancer Research, London, UK
| | - S Kernaghan
- Clinical Trials and Statistics Unit, The Institute of Cancer Research, London, UK
| | - C Toms
- Clinical Trials and Statistics Unit, The Institute of Cancer Research, London, UK
| | - S Maguire
- Patrick G Johnston Centre for Cancer Research, Queen's University Belfast, Belfast, UK
| | - N Orr
- Patrick G Johnston Centre for Cancer Research, Queen's University Belfast, Belfast, UK
| | - S C Linn
- Division of Molecular Pathology, Netherlands Cancer Institute, Amsterdam, Netherlands
| | - J Owen
- King's Health Partners Cancer Biobank, London, UK
| | - C Gillett
- King's Health Partners Cancer Biobank, London, UK
| | - S E Pinder
- School of Cancer and Pharmaceutical Sciences, King's College London Faculty of Life Sciences and Medicine, London, UK
| | - J M Bliss
- Clinical Trials and Statistics Unit, The Institute of Cancer Research, London, UK
| | - A Tutt
- Breast Cancer Now Toby Robins Research Centre, The Institute of Cancer Research, London, UK; Breast Cancer Now Unit, King's College London Faculty of Life Sciences and Medicine, London, UK; School of Cancer and Pharmaceutical Sciences, King's College London Faculty of Life Sciences and Medicine, London, UK
| | - M C U Cheang
- Clinical Trials and Statistics Unit, The Institute of Cancer Research, London, UK
| | - A Grigoriadis
- Breast Cancer Now Unit, King's College London Faculty of Life Sciences and Medicine, London, UK; School of Cancer and Pharmaceutical Sciences, King's College London Faculty of Life Sciences and Medicine, London, UK.
| |
Collapse
|
4
|
Mahamdallie S, Ruark E, Holt E, Poyastro-Pearson E, Renwick A, Strydom A, Seal S, Rahman N. The ICR639 CPG NGS validation series: A resource to assess analytical sensitivity of cancer predisposition gene testing. Wellcome Open Res 2018; 3:68. [PMID: 30175241 PMCID: PMC6081973 DOI: 10.12688/wellcomeopenres.14594.1] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/06/2018] [Indexed: 11/20/2022] Open
Abstract
The analytical sensitivity of a next generation sequencing (NGS) test reflects the ability of the test to detect real sequence variation. The evaluation of analytical sensitivity relies on the availability of gold-standard, validated, benchmarking datasets. For NGS analysis the availability of suitable datasets has been limited. Most laboratories undertake small scale evaluations using in-house data, and/or rely on in silico generated datasets to evaluate the performance of NGS variant detection pipelines. Cancer predisposition genes (CPGs), such as BRCA1 and BRCA2, are amongst the most widely tested genes in clinical practice today. Hundreds of providers across the world are now offering CPG testing using NGS methods. Validating and comparing the analytical sensitivity of CPG tests has proved difficult, due to the absence of comprehensive, orthogonally validated, benchmarking datasets of CPG pathogenic variants. To address this we present the ICR639 CPG NGS validation series. This dataset comprises data from 639 individuals. Each individual has sequencing data generated using the TruSight Cancer Panel (TSCP), a targeted NGS assay for the analysis of CPGs, together with orthogonally generated data showing the presence of at least one CPG pathogenic variant per individual. The set consists of 645 pathogenic variants in total. There is strong representation of the most challenging types of variants to detect, with 339 indels, including 16 complex indels and 24 with length greater than five base pairs and 74 exon copy number variations (CNVs) including 23 single exon CNVs. The series includes pathogenic variants in 31 CPGs, including 502 pathogenic variants in BRCA1 or BRCA2, making this an important comprehensive validation dataset for providers of BRCA1 and BRCA2 NGS testing. We have deposited the TSCP FASTQ files of the ICR639 series in the European Genome-phenome Archive (EGA) under accession number EGAD00001004134.
Collapse
Affiliation(s)
- Shazia Mahamdallie
- Division of Genetics & Epidemiology, The Institute of Cancer Research, London, SM2 5NG, UK.,TGLclinical, The Institute of Cancer Research, London, SM2 5NG, UK
| | - Elise Ruark
- Division of Genetics & Epidemiology, The Institute of Cancer Research, London, SM2 5NG, UK.,TGLclinical, The Institute of Cancer Research, London, SM2 5NG, UK
| | - Esty Holt
- Division of Genetics & Epidemiology, The Institute of Cancer Research, London, SM2 5NG, UK
| | - Emma Poyastro-Pearson
- Division of Genetics & Epidemiology, The Institute of Cancer Research, London, SM2 5NG, UK.,TGLclinical, The Institute of Cancer Research, London, SM2 5NG, UK
| | - Anthony Renwick
- Division of Genetics & Epidemiology, The Institute of Cancer Research, London, SM2 5NG, UK
| | - Ann Strydom
- Division of Genetics & Epidemiology, The Institute of Cancer Research, London, SM2 5NG, UK.,TGLclinical, The Institute of Cancer Research, London, SM2 5NG, UK
| | - Sheila Seal
- Division of Genetics & Epidemiology, The Institute of Cancer Research, London, SM2 5NG, UK.,TGLclinical, The Institute of Cancer Research, London, SM2 5NG, UK
| | - Nazneen Rahman
- Division of Genetics & Epidemiology, The Institute of Cancer Research, London, SM2 5NG, UK.,TGLclinical, The Institute of Cancer Research, London, SM2 5NG, UK.,Cancer Genetics Unit, Royal Marsden NHS Foundation Trust, London, SM2 5PT, UK
| |
Collapse
|