1
|
Errington TM, Denis A, Perfito N, Iorns E, Nosek BA. Challenges for assessing replicability in preclinical cancer biology. eLife 2021. [DOI: 10.10.7554/elife.67995] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
We conducted the Reproducibility Project: Cancer Biology to investigate the replicability of preclinical research in cancer biology. The initial aim of the project was to repeat 193 experiments from 53 high-impact papers, using an approach in which the experimental protocols and plans for data analysis had to be peer reviewed and accepted for publication before experimental work could begin. However, the various barriers and challenges we encountered while designing and conducting the experiments meant that we were only able to repeat 50 experiments from 23 papers. Here we report these barriers and challenges. First, many original papers failed to report key descriptive and inferential statistics: the data needed to compute effect sizes and conduct power analyses was publicly accessible for just 4 of 193 experiments. Moreover, despite contacting the authors of the original papers, we were unable to obtain these data for 68% of the experiments. Second, none of the 193 experiments were described in sufficient detail in the original paper to enable us to design protocols to repeat the experiments, so we had to seek clarifications from the original authors. While authors were extremely or very helpful for 41% of experiments, they were minimally helpful for 9% of experiments, and not at all helpful (or did not respond to us) for 32% of experiments. Third, once experimental work started, 67% of the peer-reviewed protocols required modifications to complete the research and just 41% of those modifications could be implemented. Cumulatively, these three factors limited the number of experiments that could be repeated. This experience draws attention to a basic and fundamental concern about replication – it is hard to assess whether reported findings are credible.
Collapse
|
2
|
Errington TM, Denis A, Perfito N, Iorns E, Nosek BA. Challenges for assessing replicability in preclinical cancer biology. eLife 2021; 10:e67995. [PMID: 34874008 PMCID: PMC8651289 DOI: 10.7554/elife.67995] [Citation(s) in RCA: 102] [Impact Index Per Article: 25.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Accepted: 07/20/2021] [Indexed: 02/07/2023] Open
Abstract
We conducted the Reproducibility Project: Cancer Biology to investigate the replicability of preclinical research in cancer biology. The initial aim of the project was to repeat 193 experiments from 53 high-impact papers, using an approach in which the experimental protocols and plans for data analysis had to be peer reviewed and accepted for publication before experimental work could begin. However, the various barriers and challenges we encountered while designing and conducting the experiments meant that we were only able to repeat 50 experiments from 23 papers. Here we report these barriers and challenges. First, many original papers failed to report key descriptive and inferential statistics: the data needed to compute effect sizes and conduct power analyses was publicly accessible for just 4 of 193 experiments. Moreover, despite contacting the authors of the original papers, we were unable to obtain these data for 68% of the experiments. Second, none of the 193 experiments were described in sufficient detail in the original paper to enable us to design protocols to repeat the experiments, so we had to seek clarifications from the original authors. While authors were extremely or very helpful for 41% of experiments, they were minimally helpful for 9% of experiments, and not at all helpful (or did not respond to us) for 32% of experiments. Third, once experimental work started, 67% of the peer-reviewed protocols required modifications to complete the research and just 41% of those modifications could be implemented. Cumulatively, these three factors limited the number of experiments that could be repeated. This experience draws attention to a basic and fundamental concern about replication - it is hard to assess whether reported findings are credible.
Collapse
Affiliation(s)
| | | | | | | | - Brian A Nosek
- Center for Open ScienceCharlottesvilleUnited States
- University of VirginiaCharlottesvilleUnited States
| |
Collapse
|
3
|
Teodorescu E, Echim M. Open-Source Software Analysis Tool to Investigate Space Plasma Turbulence and Nonlinear DYNamics (ODYN). EARTH AND SPACE SCIENCE (HOBOKEN, N.J.) 2020; 7:e2019EA001004. [PMID: 32715025 PMCID: PMC7375156 DOI: 10.1029/2019ea001004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/19/2019] [Revised: 03/06/2020] [Accepted: 03/09/2020] [Indexed: 06/11/2023]
Abstract
We have designed and built a versatile modularized software library-ODYN-that wraps a comprehensive set of advanced data analysis methods meant to facilitate the study of turbulence, nonlinear dynamics, and complexity in space plasmas. The Python programming language is used for the algorithmic implementation of models and methods devised to understand fundamental phenomena of space plasma physics like elements of spectral analysis, probability distribution functions and their moments, multifractal analysis, or information theory. ODYN is an open-source software analysis tool and freely available to any user interested in turbulence and nonlinear dynamics analysis and provides a tool to perform automatic analysis on large collections of space measurements, in situ or simulations, a feature that distinguishes ODYN from other similar software. A user-friendly configurator is provided, which allows customization of key parameters of the analysis methods, most useful for nonprogrammers.
Collapse
Affiliation(s)
| | - M.M. Echim
- Institute of Space Science (ISS)MăgureleRomania
- The Royal Belgian Institute for Space Aeronomy (BIRA‐IASB)BrusselsBelgium
| |
Collapse
|
4
|
Lim Y, Shin H, Choi Y, Lee D. Evolutionary processes of melanomas from giant congenital melanocytic nevi. Pigment Cell Melanoma Res 2019; 33:318-325. [DOI: 10.1111/pcmr.12829] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Revised: 09/24/2019] [Accepted: 10/01/2019] [Indexed: 12/16/2022]
Affiliation(s)
- Youngkyoung Lim
- Department of Dermatology Samsung Medical Center Sungkyunkwan University School of Medicine Seoul Korea
| | - Hyun‐Tae Shin
- Veterans Medical Research Institute Veterans Health Service Medical Center Seoul Korea
| | - YoungHwan Choi
- Department of Dermatology Samsung Medical Center Sungkyunkwan University School of Medicine Seoul Korea
| | - Dong‐Youn Lee
- Department of Dermatology Samsung Medical Center Sungkyunkwan University School of Medicine Seoul Korea
| |
Collapse
|
5
|
Abstract
The transcription factor c-Myc amplifies the transcription of many growth-related genes in cancer cells, but its role as an oncogene is not fully understood.
Collapse
Affiliation(s)
- Dirk Eick
- Department of Molecular Epigenetics, Helmholtz Center Munich, Munich, Germany.,Center for Integrated Protein Science Munich (CIPSM), Munich, Germany
| |
Collapse
|
6
|
Lewis LM, Edwards MC, Meyers ZR, Talbot CC, Hao H, Blum D. Replication Study: Transcriptional amplification in tumor cells with elevated c-Myc. eLife 2018; 7:30274. [PMID: 29313490 PMCID: PMC5760205 DOI: 10.7554/elife.30274] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2017] [Accepted: 11/16/2017] [Indexed: 12/17/2022] Open
Abstract
As part of the Reproducibility Project: Cancer Biology, we published a Registered Report (Blum et al., 2015), that described how we intended to replicate selected experiments from the paper 'Transcriptional amplification in tumor cells with elevated c-Myc' (Lin et al., 2012). Here we report the results. We found overexpression of c-Myc increased total levels of RNA in P493-6 Burkitt's lymphoma cells; however, while the effect was in the same direction as the original study (Figure 3E; Lin et al., 2012), statistical significance and the size of the effect varied between the original study and the two different lots of serum tested in this replication. Digital gene expression analysis for a set of genes was also performed on P493-6 cells before and after c-Myc overexpression. Transcripts from genes that were active before c-Myc induction increased in expression following c-Myc overexpression, similar to the original study (Figure 3F; Lin et al., 2012). Transcripts from genes that were silent before c-Myc induction also increased in expression following c-Myc overexpression, while the original study concluded elevated c-Myc had no effect on silent genes (Figure 3F; Lin et al., 2012). Treating the data as paired, we found a statistically significant increase in gene expression for both active and silent genes upon c-Myc induction, with the change in gene expression greater for active genes compared to silent genes. Finally, we report meta-analyses for each result.
Collapse
Affiliation(s)
- L Michelle Lewis
- University of Georgia, Bioexpression and Fermentation Facility, Georgia, United States
| | - Meredith C Edwards
- University of Georgia, Bioexpression and Fermentation Facility, Georgia, United States
| | - Zachary R Meyers
- University of Georgia, Bioexpression and Fermentation Facility, Georgia, United States
| | - C Conover Talbot
- Johns Hopkins University, Deep Sequencing and Microarray Core Facility, Maryland, United States
| | - Haiping Hao
- Johns Hopkins University, Deep Sequencing and Microarray Core Facility, Maryland, United States
| | - David Blum
- University of Georgia, Bioexpression and Fermentation Facility, Georgia, United States
| | | |
Collapse
|
7
|
Zou J, Zhang W, Li XL. Effects of SOST Gene Silencing on Proliferation, Apoptosis, Invasion, and Migration of Human Osteosarcoma Cells Through the Wnt/β-Catenin Signaling Pathway. Calcif Tissue Int 2017; 100:551-564. [PMID: 28246931 DOI: 10.1007/s00223-016-0231-6] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/12/2016] [Accepted: 12/26/2016] [Indexed: 01/15/2023]
Abstract
Our study explored the effects of SOST gene silencing on the proliferation, apoptosis, invasion, and migration of human osteosarcoma cells through Wnt/β-catenin signaling pathway. Fresh tissues were obtained from 108 patients with osteosarcoma and 46 patients with osteochondroma. Human osteosarcoma cells (MG-63, U2-OS, HOS, and Saos-2) and normal osteoblast (hFoB1.19) were selected and cultured. Osteosarcoma cells were grouped randomly into the blank group, the scrambled control group, and the SOST-siRNA group. Cell proliferation was determined by MTT assay. Cell cycle and apoptosis were tested by flow cytometry. Transwell and scratch test were performed to determine cell invasion and migration. The qRT-PCR and Western blotting were used to detect mRNA and protein expression level of sclerostin, Wnt1, β-catenin, C-Myc, Cyclin D1, and MMP-7. The activity of caspase-3 was assessed by immunocytochemistry. Alkaline phosphatase (ALP) activity was measured using P-nitrophenylphosphate as a substrate. Low SOST mRNA and sclerostin protein expression levels were observed in osteosarcoma tissues and cells. Compared with the blank and scrambled control groups, sclerostin expression, apoptotic cells, ALP activity, and caspase-3 activity were down-regulated, while the proliferation, invasion, and migration abilities of osteosarcoma cells were evidently enhanced in the SOST-siRNA group. After SOST gene silencing, the mRNA and protein expression levels of Wnt1, β-catenin, C-Myc, Cyclin D1, and MMP-7 in osteosarcoma cells and β-catenin protein expression levels in the nucleus and cytoplasm were significantly elevated. SOST gene silencing promotes the proliferation, invasion, and migration, and inhibits apoptosis of osteosarcoma cells by activating Wnt/β-catenin signaling pathway.
Collapse
Affiliation(s)
- Jian Zou
- Department of Orthopedics, Shanghai Jiaotong University Affiliated Sixth People's Hospital, No. 600, Yishan Road, Xuhui District, Shanghai, 200233, People's Republic of China
| | - Wei Zhang
- Department of Orthopedics, Shanghai Jiaotong University Affiliated Sixth People's Hospital, No. 600, Yishan Road, Xuhui District, Shanghai, 200233, People's Republic of China.
| | - Xiao-Lin Li
- Department of Orthopedics, Shanghai Jiaotong University Affiliated Sixth People's Hospital, No. 600, Yishan Road, Xuhui District, Shanghai, 200233, People's Republic of China.
| |
Collapse
|
8
|
Lin X, Sun R, Zhao X, Zhu D, Zhao X, Gu Q, Dong X, Zhang D, Zhang Y, Li Y, Sun B. C-myc overexpression drives melanoma metastasis by promoting vasculogenic mimicry via c-myc/snail/Bax signaling. J Mol Med (Berl) 2016; 95:53-67. [PMID: 27543492 DOI: 10.1007/s00109-016-1452-x] [Citation(s) in RCA: 69] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2016] [Revised: 07/14/2016] [Accepted: 07/27/2016] [Indexed: 02/07/2023]
Abstract
c-Myc is a well-characterized proto-oncogene that induces cellular transformation and modulates programmed cell death. While recent studies have demonstrated high expression of c-Myc protein in advanced and metastatic melanoma, the clinical and biological implications remain to be fully elucidated. In this study, we investigated the effect of c-Myc overexpression in melanoma tumorigenesis. Clinicopathological analysis demonstrated that c-Myc expression positively correlated with the formation of vasculogenic mimicry (VM) and linearly patterned programmed cell necrosis (LPPCN). Clinically, high c-Myc expression was significantly associated with distant metastasis and poor prognosis, while biologically, c-Myc overexpression led to significant increases in cell motility, invasiveness and metastasis. Moreover, c-Myc induced the formation of VM and promoted the expression of epithelial-mesenchymal transition (EMT)-associated protein Snail both in vivo and in vitro. High expression of c-Myc increased Bax expression in hypoxic conditions and induced cell apoptosis. Taken together, we conclude that c-Myc overexpression promotes the formation of VM by EMT and LPPCN in melanoma. Our improved understanding of the clinical and biological effects of c-Myc overexpression in melanoma highlights the incomplete understanding of this oncogene, and indicates that c-Myc is a potential therapeutic target of this disease. KEY MESSAGE High c-Myc expression is associated with tumor metastasis and poor prognosis in human melanoma. c-Myc upregulates Snail expression to promote EMT via the TGF-β/Snail/Ecadherin signal pathway. c-Myc leads to cell death by upregulating Bax expression causing a lower Bcl2/Bax ratio under severe hypoxic conditions. c-Myc promotes vasculogenic mimicry and linearly patterned programmed cell necrosis.
Collapse
Affiliation(s)
- Xian Lin
- Department of Pathology, Tianjin Medical University, Tianjin, 300070, China
| | - Ran Sun
- Department of Surgery, Tianjin Hospital of ITCWM Nankai Hospital, Tianjin, 300100, China
| | - Xiulan Zhao
- Department of Pathology, Tianjin Medical University, Tianjin, 300070, China
- Department of Pathology, General Hospital of Tianjin Medical University, Tianjin, 300052, China
| | - Dongwang Zhu
- Department of Surgery, Stomatological Hospital of Tianjin Medical University, Tianjin, 300070, China
| | - Xueming Zhao
- Department of Pathology, Tianjin Medical University, Tianjin, 300070, China
| | - Qiang Gu
- Department of Pathology, Tianjin Medical University, Tianjin, 300070, China
- Department of Pathology, General Hospital of Tianjin Medical University, Tianjin, 300052, China
| | - Xueyi Dong
- Department of Pathology, Tianjin Medical University, Tianjin, 300070, China
| | - Danfang Zhang
- Department of Pathology, Tianjin Medical University, Tianjin, 300070, China
| | - Yanhui Zhang
- Department of Pathology, Cancer Hospital of Tianjin Medical University, Tianjin, 300060, China
| | - Yanlei Li
- Department of Pathology, Tianjin Medical University, Tianjin, 300070, China
| | - Baocun Sun
- Department of Pathology, Tianjin Medical University, Tianjin, 300070, China.
- Department of Pathology, Cancer Hospital of Tianjin Medical University, Tianjin, 300060, China.
- Department of Pathology, General Hospital of Tianjin Medical University, Tianjin, 300052, China.
| |
Collapse
|