1
|
Abstract
How often a researcher is cited usually plays a decisive role in that person's career advancement, because academic institutions often use citation metrics, either explicitly or implicitly, to estimate research impact and productivity. Research has shown, however, that citation patterns and practices are affected by various biases, including the prestige of the authors being cited and their gender, race, and nationality, whether self-attested or perceived. Some commentators have proposed that researchers can address biases related to social identity or position by including a Citation Diversity Statement in a manuscript submitted for publication. A Citation Diversity Statement is a paragraph placed before the reference section of a manuscript in which the authors address the diversity and equitability of their references in terms of gender, race, ethnicity, or other factors and affirm a commitment to promoting equity and diversity in sources and references. The present commentary considers arguments in favor of Citation Diversity Statements, and some practical and ethical issues that these statements raise.
Collapse
Affiliation(s)
- Keisha S Ray
- McGovern Center For Humanities & Ethics, University of Texas Health Science Center at Houston, Houston, Texas, USA
| | - Perry Zurn
- Department of Philosophy and Religion, American University, Washington, Washington DC, USA
| | - Jordan D Dworkin
- Department of Psychiatry, Columbia University Medical Center, New York, New York, USA
| | - Dani S Bassett
- Departments of Bioengineering, Electrical & Systems Engineering, Physics and Astronomy, Neurology, and Psychiatry, University of Pennsylvania; and the Santa Fe Institute, Philadelphia, Philadelphia, USA
| | - David B Resnik
- National Institutes of Health, National Institute of Environmental Health Sciences, New York, New York, USA
| |
Collapse
|
2
|
Schneider JW, Allum N, Andersen JP, Petersen MB, Madsen EB, Mejlgaard N, Zachariae R. Is something rotten in the state of Denmark? Cross-national evidence for widespread involvement but not systematic use of questionable research practices across all fields of research. PLoS One 2024; 19:e0304342. [PMID: 39133711 PMCID: PMC11318862 DOI: 10.1371/journal.pone.0304342] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Accepted: 05/10/2024] [Indexed: 08/15/2024] Open
Abstract
Questionable research practices (QRP) are believed to be widespread, but empirical assessments are generally restricted to a few types of practices. Furthermore, conceptual confusion is rife with use and prevalence of QRPs often being confused as the same quantity. We present the hitherto most comprehensive study examining QRPs across scholarly fields and knowledge production modes. We survey perception, use, prevalence and predictors of QRPs among 3,402 researchers in Denmark and 1,307 in the UK, USA, Croatia and Austria. Results reveal remarkably similar response patterns among Danish and international respondents (τ = 0.85). Self-reported use indicates whether respondents have used a QRP in recent publications. 9 out of 10 respondents admitted using at least one QRP. Median use is three out of nine QRP items. Self-reported prevalence reflects the frequency of use. On average, prevalence rates were roughly three times lower compared to self-reported use. Findings indicated that the perceived social acceptability of QRPs influenced self-report patterns. Results suggest that most researchers use different types of QRPs within a restricted time period. The prevalence estimates, however, do not suggest outright systematic use of specific QRPs. Perceived pressure was the strongest systemic predictor for prevalence. Conversely, more local attention to research cultures and academic age was negatively related to prevalence. Finally, the personality traits conscientiousness and, to a lesser degree, agreeableness were also inversely associated with self-reported prevalence. Findings suggest that explanations for engagement with QRPs are not only attributable to systemic factors, as hitherto suggested, but a complicated mixture of experience, systemic and individual factors, and motivated reasoning.
Collapse
Affiliation(s)
- Jesper W. Schneider
- Danish Centre for Studies in Research and Research Policy, Aarhus University, Aarhus, Denmark
| | - Nick Allum
- Department of Sociology, University of Essex, Essex, United Kingdom
| | - Jens Peter Andersen
- Danish Centre for Studies in Research and Research Policy, Aarhus University, Aarhus, Denmark
| | | | - Emil B. Madsen
- Danish Centre for Studies in Research and Research Policy, Aarhus University, Aarhus, Denmark
| | - Niels Mejlgaard
- Danish Centre for Studies in Research and Research Policy, Aarhus University, Aarhus, Denmark
| | - Robert Zachariae
- Unit for Psychooncology and Health Psychology (EPoS), Department of Oncology, Aarhus University Hospital, Aarhus, Denmark
- Department Psychology and Behavioral Science, Aarhus University, Aarhus, Denmark
| |
Collapse
|
3
|
Abdelkreem E, Ibrahim ME, Elateek S, Abdelgawad F, Silverman HJ. Perceptions of the Research Integrity Climate in Egyptian Universities: A Survey Among Academic Researchers. J Empir Res Hum Res Ethics 2024:15562646241273097. [PMID: 39119646 DOI: 10.1177/15562646241273097] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/10/2024]
Abstract
Problem: Investigations regarding perceptions of the institutional research integrity climate in the Arab Middle East remain underexplored. Subjects: We surveyed faculty from three Egyptian universities. Method: We utilized the Survey of Organizational Research Climate (SOuRCe) tool, which incorporates seven subscales that measure different aspects of the research integrity climate. Responses were obtained from a 5-point Likert scale. Findings: Of the 228 participants, the subscales 'Regulatory Quality' and '[Lack of] Integrity Inhibitors' received the highest mean scores, whereas the lowest scores pertained to 'Departmental Expectations,' 'Integrity Socialization,' and 'Responsible Conduct of Research´ indicating areas in need of improvement. Conclusions: Academic leaders should set fairer expectations for research and funding for their researchers, ensure junior researchers are socialized into research integrity practices, and promote effective RCR training and availability of RCR policies. We identify specific targeted interventions to enhance the research integrity climate within these institutions.
Collapse
Affiliation(s)
- Elsayed Abdelkreem
- Department of Pediatrics, Faculty of Medicine, Sohag University, Sohag, Egypt
| | - Maha Emad Ibrahim
- Department of Physical Medicine, Rheumatology and Rehabilitation, Faculty of Medicine, Suez Canal University, Ismailia, Egypt
| | - Sawsan Elateek
- Department of Genetics, Faculty of Agriculture, Ain Shams University, Cairo, Egypt
| | - Fatma Abdelgawad
- Department of Pediatric Dentistry and Dental Public Health, Faculty of Dentistry, Cairo University, Cairo, Egypt
| | - Henry J Silverman
- Department of Medicine, University of Maryland School of Medicine, Baltimore, Maryland, USA
| |
Collapse
|
4
|
Nortes I. Academic integrity among nursing students: A survey of knowledge and behavior. Nurs Ethics 2024; 31:553-571. [PMID: 37804005 PMCID: PMC11308353 DOI: 10.1177/09697330231200568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/08/2023]
Abstract
BACKGROUND Minimal research has been done to determine how well European nursing students understand the core principles of academic integrity and how often they deviate from good academic practice. AIM The aim of this study was to find out what educational needs nursing students have in terms of academic integrity. RESEARCH DESIGN A quantitative cross-sectional study in the form of a survey of nursing students was conducted via questionnaire in the fall of 2020. PARTICIPANTS The sample was composed of 79 students in the BScN and MScN programs at Zürich University of Applied Sciences. ETHICAL CONSIDERATIONS An application for a non-competence clearance was approved by the Ethics Committee in Zurich (BASEC No. Req-2020-00868). The survey was anonymous, and informed consent was obtained prior to participation. RESULTS The participants had a high level of confidence in their own knowledge but were in many cases unable to correctly identify clear-cut examples of misconduct and to differentiate them from questionable practices. About 13% of the participants admitted that during their university education they had copied shorter passages from other sources into their own text without marking them as quotes. CONCLUSIONS The study documents extensive knowledge gaps among nursing students regarding both academic misconduct and questionable practices and indicates a need for improved academic integrity training.
Collapse
Affiliation(s)
- Isabelle Nortes
- Department for Internal Medicine, University Hospital of Zurich, Zurich, Switzerland
| |
Collapse
|
5
|
Ursić L, Bralić N, Žuljević MF, Puljak L, Buljan I. Exploring the understanding of reproducibility among stakeholders within academia and their expectations for a web-based education tool: A qualitative study. Account Res 2024:1-30. [PMID: 38704659 DOI: 10.1080/08989621.2024.2345723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 04/09/2024] [Indexed: 05/06/2024]
Abstract
Although reproducibility is central to the scientific method, its understanding within the research community remains insufficient. We aimed to explore the perceptions of research reproducibility among stakeholders within academia, learn about possible barriers and facilitators to reproducibility-related practices, and gather their suggestions for the Croatian Reproducibility Network website. We conducted four focus groups with researchers, teachers, editors, research managers, and policymakers from Croatia (n = 23). The participants observed a lack of consensus on the core definitions of reproducibility, both generally and between disciplines. They noted that incentivization and recognition of reproducibility-related practices from publishers and institutions, alongside comprehensive education adapted to the researchers' career stage, could help with implementing reproducibility. Education was considered essential to these efforts, as it could help create a research culture based on good reproducibility-related practices and behavior rather than one driven by mandates or career advancement. This was particularly found to be relevant for growing reproducibility efforts globally. Regarding the Croatian Reproducibility Network website, the participants suggested we adapt the content to users from different disciplines or career stages and offer guidance and tools for reproducibility through which we should present core reproducibility concepts. Our findings could inform other initiatives focused on improving research reproducibility.
Collapse
Affiliation(s)
- Luka Ursić
- Department of Research in Biomedicine and Health, University of Split School of Medicine, Split, Croatia
- Center for Evidence-Based Medicine, University of Split School of Medicine, Split, Croatia
- Croatian Reproducibility and Integrity Network, Croatia
| | - Nensi Bralić
- Department of Research in Biomedicine and Health, University of Split School of Medicine, Split, Croatia
- Center for Evidence-Based Medicine, University of Split School of Medicine, Split, Croatia
- Croatian Reproducibility and Integrity Network, Croatia
| | - Marija Franka Žuljević
- Center for Evidence-Based Medicine, University of Split School of Medicine, Split, Croatia
- Croatian Reproducibility and Integrity Network, Croatia
- Department of Medical Humanities, University of Split School of Medicine, Split, Croatia
| | - Livia Puljak
- Croatian Reproducibility and Integrity Network, Croatia
- Center for Evidence-Based Medicine and Healthcare, Catholic University of Croatia, Zagreb, Croatia
| | - Ivan Buljan
- Croatian Reproducibility and Integrity Network, Croatia
- Department of Psychology, Faculty of Humanities and Social Sciences in Split, University of Split, Split, Croatia
| |
Collapse
|
6
|
Reyes Elizondo A, Kaltenbrunner W. Navigating the Science System: Research Integrity and Academic Survival Strategies. SCIENCE AND ENGINEERING ETHICS 2024; 30:12. [PMID: 38568341 PMCID: PMC10991043 DOI: 10.1007/s11948-024-00467-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Accepted: 11/30/2023] [Indexed: 04/05/2024]
Abstract
Research Integrity (RI) is high on the agenda of both institutions and science policy. The European Union as well as national ministries of science have launched ambitious initiatives to combat misconduct and breaches of research integrity. Often, such initiatives entail attempts to regulate scientific behavior through guidelines that institutions and academic communities can use to more easily identify and deal with cases of misconduct. Rather than framing misconduct as a result of an information deficit, we instead conceptualize Questionable Research Practices (QRPs) as attempts by researchers to reconcile epistemic and social forms of uncertainty in knowledge production. Drawing on previous literature, we define epistemic uncertainty as the inherent intellectual unpredictability of scientific inquiry, while social uncertainty arises from the human-made conditions for scientific work. Our core argument-developed on the basis of 30 focus group interviews with researchers across different fields and European countries-is that breaches of research integrity can be understood as attempts to loosen overly tight coupling between the two forms of uncertainty. Our analytical approach is not meant to relativize or excuse misconduct, but rather to offer a more fine-grained perspective on what exactly it is that researchers want to accomplish by engaging in it. Based on the analysis, we conclude by proposing some concrete ways in which institutions and academic communities could try to reconcile epistemic and social uncertainties on a more collective level, thereby reducing incentives for researchers to engage in misconduct.
Collapse
Affiliation(s)
- Andrea Reyes Elizondo
- Centre for Science and Technology Studies, Leiden University, Leiden, The Netherlands.
| | | |
Collapse
|
7
|
Meirmans S. How Competition for Funding Impacts Scientific Practice: Building Pre-fab Houses but no Cathedrals. SCIENCE AND ENGINEERING ETHICS 2024; 30:6. [PMID: 38349578 PMCID: PMC10864468 DOI: 10.1007/s11948-024-00465-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Accepted: 11/30/2023] [Indexed: 02/15/2024]
Abstract
In the research integrity literature, funding plays two different roles: it is thought to elevate questionable research practices (QRPs) due to perverse incentives, and it is a potential actor to incentivize research integrity standards. Recent studies, asking funders, have emphasized the importance of the latter. However, the perspective of active researchers on the impact of competitive research funding on science has not been explored yet. Here, I address this issue by conducting a series of group sessions with researchers in two different countries with different degrees of competition for funding, from three scientific fields (medical sciences, natural sciences, humanities), and in two different career stages (permanent versus temporary employment). Researchers across all groups experienced that competition for funding shapes science, with many unintended negative consequences. Intriguingly, these consequences had little to do with the type of QRPs typically being presented in the research integrity literature. Instead, the researchers pointed out that funding could result in predictable, fashionable, short-sighted, and overpromising science. This was seen as highly problematic: scientists experienced that the 'projectification' of science makes it more and more difficult to do any science of real importance: plunging into the unknown or addressing big issues that need a long-term horizon to mature. They also problematized unintended negative effects from collaboration and strategizing. I suggest it may be time to move away from a focus on QRPs in connection with funding, and rather address the real problems. Such a shift may then call for entirely different types of policy actions.
Collapse
Affiliation(s)
- Stephanie Meirmans
- Department of Ethics, Law and Humanities, Amsterdam UMC, Academic Medical Center, University of Amsterdam, Meibergdreef 9, Amsterdam, 1105 AZ, Netherlands.
| |
Collapse
|
8
|
Roje R, Reyes Elizondo A, Kaltenbrunner W, Buljan I, Marušić A. Factors influencing the promotion and implementation of research integrity in research performing and research funding organizations: A scoping review. Account Res 2023; 30:633-671. [PMID: 35531936 DOI: 10.1080/08989621.2022.2073819] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
Promoting and implementing research integrity is considered the joint responsibility and effort of multiple stakeholders in the research community. We conducted a scoping review and analyzed 236 research articles and gray literature publications from biomedical sciences, social sciences, natural sciences (including engineering), and humanities that dealt with the factors that may positively or negatively impact the promotion and implementation of research integrity. Critical appraisal of evidence was performed for studies describing interventions aimed at research integrity promotion in order to provide insight into the effectiveness of these interventions. The results of this scoping review provide a comprehensive taxonomy of factors with positive or negative impact and their relatedness to individual researchers, research performing and funding organizations, and the system of science. Moreover, the results show that efforts for fostering and promoting research integrity should be implemented at all three levels (researcher, institution, system) simultaneously to deliver greater adherence and implementation of research integrity practices. Although various educational interventions aiming at research integrity promotion exist, we were not able to conclude on the effectiveness of explored interventions due to the methodological quality issues in the studies.
Collapse
Affiliation(s)
- Rea Roje
- Department of Research in Biomedicine in Health, University of Split School of Medicine, Split, Croatia
| | - Andrea Reyes Elizondo
- Centre for Science and Technology Studies (CWTS), Leiden University, Leiden, The Netherlands
| | - Wolfgang Kaltenbrunner
- Centre for Science and Technology Studies (CWTS), Leiden University, Leiden, The Netherlands
| | - Ivan Buljan
- Department of Research in Biomedicine in Health, University of Split School of Medicine, Split, Croatia
| | - Ana Marušić
- Department of Research in Biomedicine in Health, University of Split School of Medicine, Split, Croatia
| |
Collapse
|
9
|
Haven T, Bouter L, Mennen L, Tijdink J. Superb supervision: A pilot study on training supervisors to convey responsible research practices onto their PhD candidates. Account Res 2023; 30:574-591. [PMID: 35475492 DOI: 10.1080/08989621.2022.2071153] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
One way to strengthen research integrity, is through supervision. According to previous research, a supervisor should be well-versed in responsible research practices (RRPs) and possess the necessary interpersonal skills to convey RRPs. We developed a 3-day pilot training for PhD supervisors that combined RRPs and interpersonal skills. Our aim was to assess: perceptions regarding supervision skills (before and after the pilot) and participants' views on combining RRPs and interpersonal skills. Before and after the pilot, we sent the Research Supervision Quality Evaluation survey to the participating PhD supervisors and their PhD candidates. The pilot was concluded with a focus group where participants deliberated over the combination of training in interpersonal skills and RRPs and whether such training should become compulsory. Both supervisors and PhD candidates were more positive about the supervisor's interpersonal skills and the ability to foster RRPs after the training. Participants were enthusiastic about the training's dual focus but believed that making the training compulsory would be undesirable. The results highlight the potential of RRPs training for supervisors. However, caution is warranted, as the results regard a small sample of volunteering supervisors, underscoring the need for larger programs to foster responsible supervision that are rigorously evaluated.
Collapse
Affiliation(s)
- Tamarinde Haven
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin, Berlin, Germany
| | - Lex Bouter
- Department of Philosophy, Faculty of Humanities, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
- Department of Epidemiology and Data Science, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Louise Mennen
- Mennen Training & Consultancy, Haarlem, The Netherlands
| | - Joeri Tijdink
- Department of Philosophy, Faculty of Humanities, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
- Department of Ethics, Law and Humanities, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| |
Collapse
|
10
|
Conix S, De Peuter S, Block AD, Vaesen K. Questionable research practices in competitive grant funding: A survey. PLoS One 2023; 18:e0293310. [PMID: 37917785 PMCID: PMC10621923 DOI: 10.1371/journal.pone.0293310] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Accepted: 10/08/2023] [Indexed: 11/04/2023] Open
Abstract
There has been a surge of interest in research integrity over the last decade, with a wide range of studies investigating the prevalence of questionable research practices (QRPs). However, nearly all these studies focus on research design, data collection and analysis, and hardly any empirical research has been done on the occurrence of QRPs in the context of research funding. To fill this gap, we conducted a cross-sectional pre-registered survey of applicants, reviewers and panel members from the Research Foundation-Flanders (FWO), one of the main funding agencies in Belgium. We developed a bespoke survey and further refined it through feedback from experienced researchers and a pilot study. We asked how often respondents had engaged in a series of QRPs over the last ten years. A total of 1748 emails were sent, inviting recipients to participate in the survey, complemented by featuring the survey in the FWO newsletter. This resulted in 704 complete responses. Our results indicate that such QRPs are remarkably prevalent. Of the 496 participants who answered both the applicant and reviewer track, more than 60% responded that they engaged regularly in at least one of such practices, and around 40% indicated that they engaged at least occasionally in half of the QRPs queried. Only 12% reported not to have engaged in any of the QRPs. Contrary to our hypotheses, male respondents did not self-report to engage in the QRPs more often than female respondents, nor was there an association between the prevalence of QRPs and self-reported success rate in grant funding. Furthermore, half of the respondents indicated that they doubted the reliability of the grant peer review process more often than not. These results suggest that preventive action is needed, and provide new reasons to reconsider the practice of allocating research money through grant peer review.
Collapse
Affiliation(s)
- Stijn Conix
- Center for the Philosophy of Science and Society, UCLouvain, Louvain-la-Neuve, Belgium
- Centre for Logic and Philosophy of Science, KU Leuven, Leuven, Belgium
| | - Steven De Peuter
- Methods, Individual and Cultural Differences, Affect and Social Behavior (MICAS), KU Leuven, Leuven, Belgium
| | - Andreas De Block
- Centre for Logic and Philosophy of Science, KU Leuven, Leuven, Belgium
| | - Krist Vaesen
- Philosophy & Ethics, Eindhoven University of Technology, Eindhoven, Netherlands
| |
Collapse
|
11
|
Malički M, Aalbersberg IJJ, Bouter L, Mulligan A, ter Riet G. Transparency in conducting and reporting research: A survey of authors, reviewers, and editors across scholarly disciplines. PLoS One 2023; 18:e0270054. [PMID: 36888682 PMCID: PMC9994678 DOI: 10.1371/journal.pone.0270054] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Accepted: 06/03/2022] [Indexed: 03/09/2023] Open
Abstract
Calls have been made for improving transparency in conducting and reporting research, improving work climates, and preventing detrimental research practices. To assess attitudes and practices regarding these topics, we sent a survey to authors, reviewers, and editors. We received 3,659 (4.9%) responses out of 74,749 delivered emails. We found no significant differences between authors', reviewers', and editors' attitudes towards transparency in conducting and reporting research, or towards their perceptions of work climates. Undeserved authorship was perceived by all groups as the most prevalent detrimental research practice, while fabrication, falsification, plagiarism, and not citing prior relevant research, were seen as more prevalent by editors than authors or reviewers. Overall, 20% of respondents admitted sacrificing the quality of their publications for quantity, and 14% reported that funders interfered in their study design or reporting. While survey respondents came from 126 different countries, due to the survey's overall low response rate our results might not necessarily be generalizable. Nevertheless, results indicate that greater involvement of all stakeholders is needed to align actual practices with current recommendations.
Collapse
Affiliation(s)
- Mario Malički
- Urban Vitality Centre of Expertise, Amsterdam University of Applied Sciences, Amsterdam, The Netherlands
| | | | - Lex Bouter
- Faculty of Humanities, Department of Philosophy, Vrije Universiteit, Amsterdam, The Netherlands
- Department of Epidemiology and Data Science, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | | | - Gerben ter Riet
- Urban Vitality Centre of Expertise, Amsterdam University of Applied Sciences, Amsterdam, The Netherlands
- Department of Cardiology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| |
Collapse
|
12
|
Bouter L. Research misconduct and questionable research practices form a continuum. Account Res 2023:1-5. [PMID: 36866641 DOI: 10.1080/08989621.2023.2185141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2022] [Accepted: 02/23/2023] [Indexed: 03/04/2023]
Abstract
Research data mismanagement (RDMM) is a serious threat to accountability, reproducibility, and re-use of data. In a recent article in this journal, it was argued that RDMM can take two forms: intentional research misconduct or unintentional questionable research practice (QRP). I disagree because the scale for severity of consequences of research misbehavior is not bimodal. Furthermore, intentionality is difficult to prove beyond doubt and is only one of many criteria that should be taken into account when deciding on the severity of a breach of research integrity and whether a sanction is justified. Making a distinction between RDMM that is research misconduct and RDMM which not puts too much emphasis on intentionality and sanctioning. The focus should rather be on improving data management practices by preventive actions, in which research institutions should take a leading role.
Collapse
Affiliation(s)
- Lex Bouter
- Department of Epidemiology and Data Science, Amsterdam University Medical Centers, Amsterdam, The Netherlands
- Department of Philosophy, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
13
|
Deniau N. Perceptions on the role of research integrity officers in French medical schools. Account Res 2023:1-21. [PMID: 36717111 DOI: 10.1080/08989621.2023.2173070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Accepted: 01/23/2023] [Indexed: 02/01/2023]
Abstract
Researchers, organizations, and governments are trying to foster research integrity. In France, the law recently permitted the appointment of research integrity officers (RIOs) in each university, to promote research integrity and handle misconducts. Since we assumed that having adequate bodies to deal with research integrity could foster research integrity, we wanted to understand how this might work more concretely. We interviewed 11 newly appointed RIOs in medical schools about how they perceive their role and cope with their responsibilities. We analyzed data following the Paillé and Muchielli's thematic analysis approach. The RIOs report a strong and interesting appropriation of concepts of research integrity, which allows them to warrant their role. Although they report that they did not seek their appointment, they show a real desire to cope with their responsibilities. They are willing to build a role which is currently poorly defined. They assert their legitimacy through their position and experience. They identify themselves with a preventive and corrective role, in an altruistic way. They emphasize their independent and collective role, congruent with other actors. The RIOs intend to be enablers of a responsible conduct of research. These results are encouraging about the potential impact of RIOs to foster research integrity.
Collapse
Affiliation(s)
- Nicolas Deniau
- Université de Versailles Saint-Quentin-en-Yvelines, UFR Simone Veil, Montigny-le-Bretonneux, France
| |
Collapse
|
14
|
Olsson TM, Sundell K. Publication bias, time-lag bias, and place-of-publication bias in social intervention research: An exploratory study of 527 Swedish articles published between 1990-2019. PLoS One 2023; 18:e0281110. [PMID: 36745625 PMCID: PMC9901762 DOI: 10.1371/journal.pone.0281110] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Accepted: 01/17/2023] [Indexed: 02/07/2023] Open
Abstract
Publication and related biases constitute serious threats to the validity of research synthesis. If research syntheses are based on a biased selection of the available research, there is an increased risk of producing misleading results. The purpose fo this study is to explore the extent of positive outcome bias, time-lag bias, and place-of-publication bias in published research on the effects of psychological, social, and behavioral interventions. The results are based on 527 Swedish outcome trials published in peer-reviewed journals between 1990 and 2019. We found no difference in the number of studies reporting significant compared to non-significant findings or in the number of studies reporting strong effect sizes in the published literature. We found no evidence of time-lag bias or place-of-publication bias in our results. The average reported effect size remained constant over time as did the proportion of studies reporting significant effects.
Collapse
Affiliation(s)
- Tina M. Olsson
- School of Health and Welfare, Jönköping University, Jönköping, Sweden,Department of Social Work, Gothenburg University, Gothenburg, Sweden,* E-mail:
| | - Knut Sundell
- University of Gävle, Department of Social Work and Criminology, Gävle, Sweden
| |
Collapse
|
15
|
Abdi S, Nemery B, Dierickx K. What criteria are used in the investigation of alleged cases of research misconduct? Account Res 2023; 30:109-131. [PMID: 34455868 DOI: 10.1080/08989621.2021.1973894] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Abstract
Research misconduct is a global concern. Considerable research has been devoted to guidance documents, but little attention has been paid to the empirical investigation of how (alleged) cases of research misconduct are addressed in real-life and which criteria are used to qualify a case as misconduct. Therefore, we performed a content analysis of 169 closed misconduct reports between 2007 and 2017 from Denmark, the Netherlands and Belgium, representing three different types of governance of research misconduct. This study showed that when considering a case of (alleged) misconduct investigating committees assess 1) the objective evidence of research misconduct, 2) the subjective intent of the person subject to investigations, and 3) case specific circumstances. We found that research misconduct was established in 15% (9/61) of cases in Denmark; 16% (13/82) in the Netherlands and 38% (10/26) in Belgium. 57% (35/61) of cases in Denmark, 49% (40/82) in the Netherlands, and 12% (3/26) in Belgium were deemed outside of the scope of the investigating committee. Our analysis improves the understanding of how investigations of (alleged) misconduct are handled by the investigating committees in Europe.
Collapse
Affiliation(s)
- Shila Abdi
- Department of Public Health and Primary Care, University of Leuven, Leuven, Belgium
| | - Benoit Nemery
- Department of Public Health and Primary Care, University of Leuven, Leuven, Belgium
| | - Kris Dierickx
- Department of Public Health and Primary Care, University of Leuven, Leuven, Belgium
| |
Collapse
|
16
|
Damen JA, Heus P, Lamberink HJ, Tijdink JK, Bouter L, Glasziou P, Moher D, Otte WM, Vinkers CH, Hooft L. Indicators of questionable research practices were identified in 163,129 randomized controlled trials. J Clin Epidemiol 2023; 154:23-32. [PMID: 36470577 DOI: 10.1016/j.jclinepi.2022.11.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Revised: 11/17/2022] [Accepted: 11/29/2022] [Indexed: 12/03/2022]
Abstract
OBJECTIVES To explore indicators of the following questionable research practices (QRPs) in randomized controlled trials (RCTs): (1) risk of bias in four domains (random sequence generation, allocation concealment, blinding of participants and personnel, and blinding of outcome assessment); (2) modifications in primary outcomes that were registered in trial registration records (proxy for selective reporting bias); (3) ratio of the achieved to planned sample sizes; and (4) statistical discrepancy. STUDY DESIGN AND SETTING Full texts of all human RCTs published in PubMed in 1996-2017 were automatically identified and information was collected automatically. Potential indicators of QRPs included author-specific, publication-specific, and journal-specific characteristics. Beta, logistic, and linear regression models were used to identify associations between these potential indicators and QRPs. RESULTS We included 163,129 RCT publications. The median probability of bias assessed using Robot Reviewer software ranged between 43% and 63% for the four risk of bias domains. A more recent publication year, trial registration, mentioning of CONsolidated Standards Of Reporting Trials-checklist, and a higher journal impact factor were consistently associated with a lower risk of QRPs. CONCLUSION This comprehensive analysis provides an insight into indicators of QRPs. Researchers should be aware that certain characteristics of the author team and publication are associated with a higher risk of QRPs.
Collapse
Affiliation(s)
- Johanna A Damen
- Cochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands.
| | - Pauline Heus
- Cochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Herm J Lamberink
- Department of Child Neurology, UMC Utrecht Brain Center, University Medical Center Utrecht and Utrecht University, Utrecht, The Netherlands; Department of Neurology, Haaglanden Medical Center, Den Haag, The Netherlands
| | - Joeri K Tijdink
- Department of Ethics, Law and Humanities, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands; Department of Philosophy, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Lex Bouter
- Department of Epidemiology and Data Science, Amsterdam UMC, Amsterdam, The Netherlands; Department of Philosophy, Vrije Universiteit, Amsterdam, The Netherlands
| | - Paul Glasziou
- Institute for Evidence-Based Healthcare, Bond University, Gold Coast, Australia
| | - David Moher
- Centre for Journalology, Clinical Epidemiology Program, The Ottawa Hospital Research Institute, Ottawa, Canada; School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
| | - Willem M Otte
- Department of Child Neurology, UMC Utrecht Brain Center, University Medical Center Utrecht and Utrecht University, Utrecht, The Netherlands; Biomedical MR Imaging and Spectroscopy group, Center for Image Sciences, University Medical Center Utrecht and Utrecht University, Utrecht, The Netherlands
| | - Christiaan H Vinkers
- Department of Psychiatry and Anatomy & Neurosciences, Amsterdam University Medical Center Location Vrije Universiteit Amsterdam, 1081 HV Amsterdam, The Netherlands; Amsterdam Public Health, Mental Health Program and Amsterdam Neuroscience, Mood, Anxiety, Psychosis, Sleep & Stress Program, Amsterdam, The Netherlands; Amsterdam Public Health (Mental Health Program) Research Institute, 1081 HV Amsterdam, The Netherlands; GGZ inGeest Mental Health Care, 1081 HJ Amsterdam, The Netherlands
| | - Lotty Hooft
- Cochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
17
|
van Hoof M, Evans N, Inguaggiato G, Marušić A, Gordijn B, Dierickx K, van Zeggeren D, Dunnik H, Gesinn A, Bouter L, Widdershoven G. The Embassy of Good Science - a community driven initiative to promote ethics and integrity in research. OPEN RESEARCH EUROPE 2023; 2:27. [PMID: 37767226 PMCID: PMC10521075 DOI: 10.12688/openreseurope.14422.2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 01/05/2023] [Indexed: 09/29/2023]
Abstract
The Embassy of Good Science ( https://www.embassy.science) aims to improve research integrity and research ethics by offering an online, open, 'go-to' platform, which brings together information on research integrity and research ethics and makes that information accessible, understandable, and appealing. It effectively organizes and describes research integrity and research ethics guidelines, educational materials, cases, and scenarios. The Embassy is wiki-based, allowing users to add -- when logged in with their ORCID researcher id -- new information, and update and refine existing information. The platform also makes the research integrity and research ethics community visible and more accessible in pages dedicated to relevant initiatives, news and events. Therefore, the Embassy enables researchers to find useful guidance, rules and tools to conduct research responsibly. The platform empowers researchers through increased knowledge and awareness, and through the support of the research integrity and research ethics community. In this article we will discuss the background of this new platform, the way in which it is organized, and how users can contribute.
Collapse
Affiliation(s)
- Marc van Hoof
- Department of Ethics, Law and Humanities, Amsterdam UMC, Vrije Universiteit, Amsterdam, Noord-Holland, 1081 HV, The Netherlands
| | - Natalie Evans
- Department of Ethics, Law and Humanities, Amsterdam UMC, Vrije Universiteit, Amsterdam, Noord-Holland, 1081 HV, The Netherlands
| | - Giulia Inguaggiato
- Department of Ethics, Law and Humanities, Amsterdam UMC, Vrije Universiteit, Amsterdam, Noord-Holland, 1081 HV, The Netherlands
| | - Ana Marušić
- Department of Research in Biomedicine and Health, University of Split School of Medicine, Split, Split-Dalmatia, HR-21000, Croatia
| | - Bert Gordijn
- Institute of Ethics, Dublin City University, Dublin, Leinster, 9, Ireland
| | - Kris Dierickx
- Interfaculty Center for Biomedical Ethics and Law, KU Leuven, Leuven, 3000, Belgium
| | | | - Harald Dunnik
- Momkai BV, Amsterdam, Noord-Holland, 1013 NJ, The Netherlands
| | | | - Lex Bouter
- Department of Philosophy, Amsterdam UMC, Vrije Universiteit, Amsterdam, Noord-Holland, 1081 HV, The Netherlands
| | - Guy Widdershoven
- Department of Ethics, Law and Humanities, Amsterdam UMC, Vrije Universiteit, Amsterdam, Noord-Holland, 1081 HV, The Netherlands
| | - EnTIRE and VIRT2UE consortia
- Department of Ethics, Law and Humanities, Amsterdam UMC, Vrije Universiteit, Amsterdam, Noord-Holland, 1081 HV, The Netherlands
- Department of Research in Biomedicine and Health, University of Split School of Medicine, Split, Split-Dalmatia, HR-21000, Croatia
- Institute of Ethics, Dublin City University, Dublin, Leinster, 9, Ireland
- Interfaculty Center for Biomedical Ethics and Law, KU Leuven, Leuven, 3000, Belgium
- Momkai BV, Amsterdam, Noord-Holland, 1013 NJ, The Netherlands
- Gesinn.it, Schwarzenfeld, 92521, Germany
- Department of Philosophy, Amsterdam UMC, Vrije Universiteit, Amsterdam, Noord-Holland, 1081 HV, The Netherlands
| |
Collapse
|
18
|
Robinson-Garcia N, Costas R, Nane GF, van Leeuwen TN. Valuation regimes in academia: Researchers’ attitudes towards their diversity of activities and academic performance. RESEARCH EVALUATION 2023. [DOI: 10.1093/reseval/rvac049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Abstract
Abstract
Evaluation systems have been long criticized for abusing and misusing bibliometric indicators. This has created a culture by which academics are constantly exposing their daily work to the standards they are expected to perform. In this study, we investigate whether researchers’ own values and expectations are in line with the expectations of the evaluation system. We conduct a multiple case study of five departments in two Dutch universities to examine how they balance between their own valuation regimes and the evaluation schemes. For this, we combine curriculum analysis with a series of semi-structured interviews. We propose a model to study the diversity of academic activities and apply it to the multiple case study to understand how such diversity is shaped by discipline and career stage. We conclude that the observed misalignment is not only resulting from an abuse of metrics but also by a lack of tools to evaluate performance in a contextualized and adaptable way.
Collapse
Affiliation(s)
- Nicolas Robinson-Garcia
- EC3 Research Group, Departamento de Información y Comunicación, Colegio Máximo de Cartuja s/n, 18071, Universidad de Granada, Granada , Spain
- Delft Institute of Applied Mathematics, TU Delft, Building 36 Mekelweg 4 2628 CD Delft , Netherlands
| | - Rodrigo Costas
- Centre for Science and Technology Sutides (CWTS), Leiden University, Willem Einthoven Building Kolffpad 1 2333 BN Leiden , The Netherlands
- Centre for Research on Evaluation, Science and Technology (CREST), Faculty of Arts and Social Sciences, Stellenbosch University, Krotoa Building Building, 52 Ryneveld Street, Stellenbosch, 7600 , South Africa
| | - Gabriela F Nane
- Delft Institute of Applied Mathematics, TU Delft, Building 36 Mekelweg 4 2628 CD Delft , Netherlands
| | - Thed N van Leeuwen
- Centre for Science and Technology Sutides (CWTS), Leiden University, Willem Einthoven Building Kolffpad 1 2333 BN Leiden , The Netherlands
| |
Collapse
|
19
|
Slobodin O. Beyond the language barrier: A systematic review of selective mutism in culturally and linguistically diverse children. Transcult Psychiatry 2023; 60:313-331. [PMID: 36628442 DOI: 10.1177/13634615221146435] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Abstract
Selective mutism is a childhood psychiatric disorder that has been associated with adverse psychological, social and educational outcomes. Although evidence suggests that culturally and linguistically diverse children might be overrepresented among children with selective mutism, a direct examination of how migration or minority status are associated with the development and persistence of the disorder is still scarce. Guided by eco-cultural perspectives of development, the current review aims to provide an overview of selective mutism in culturally and linguistically diverse children. A systematic literature review of selective mutism studies that included a group of culturally and linguistically diverse children yielded eight studies that met our inclusion criteria. Although these studies support the view that bilingualism and minority status might be associated with selective mutism, the role of sociocultural factors in the development and persistence of the disorder remained mostly unexamined. The review concludes with a discussion of potential directions for future research, including examination of the cultural and psychological meanings of silence and talk, socialization goals, gender inequality, and parental acculturation strategies.
Collapse
Affiliation(s)
- Ortal Slobodin
- 26732Department of Education, Ben-Gurion University, Beer-Sheva, Israel
| |
Collapse
|
20
|
Pizzolato D, Dierickx K. Research Integrity Supervision Practices and Institutional Support: A Qualitative Study. JOURNAL OF ACADEMIC ETHICS 2022; 21:1-22. [PMID: 36573209 PMCID: PMC9772598 DOI: 10.1007/s10805-022-09468-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 12/14/2022] [Accepted: 12/16/2022] [Indexed: 12/24/2022]
Abstract
Scientific malpractice is not just due to researchers having bad intentions, but also due to a lack of education concerning research integrity practices. Besides the importance of institutionalised trainings on research integrity, research supervisors play an important role in translating what doctoral students learn during research integrity formal sessions. Supervision practices and role modelling influence directly and indirectly supervisees' attitudes and behaviour toward responsible research. Research supervisors can not be left alone in this effort. Research institutions are responsible for supporting supervisors in being more aware of their RI function, and in supporting responsible supervision practices to have a positive cascading effect on supervisees' research practices. We interviewed 22 European research supervisors to investigate how they perceive their role as research integrity trainers and their real-life supervision practices. Moreover, we investigated their points of view concerning the role of research institutions in supporting supervision practices. Although there are different commonalities in supervisors' perception of their research integrity-related role, differences are emphasised depending on the supervisors' characteristics such as academic domain, seniority, working country and gender. In addition, supervisors' way of mentoring depend also on supervisees' learning curve. Overall, all supervisors agreed on institutions playing an important role in support their supervision effort and practices. This study aims to be a starting point for better understanding research integrity supervision practices and the role of institutions in supporting them. Moreover, it puts the basis to further investigate differences in supervision practices depending on supervisors' characteristics. Supplementary Information The online version contains supplementary material available at 10.1007/s10805-022-09468-y.
Collapse
Affiliation(s)
- Daniel Pizzolato
- Department of Public Health and Primary Care, Centre for Biomedical Ethics and Law, KU Leuven, B-3000 Leuven, Belgium
| | - Kris Dierickx
- Department of Public Health and Primary Care, Centre for Biomedical Ethics and Law, KU Leuven, B-3000 Leuven, Belgium
| |
Collapse
|
21
|
Meta-research evaluating redundancy and use of systematic reviews when planning new studies in health research: a scoping review. Syst Rev 2022; 11:241. [PMID: 36380367 PMCID: PMC9667610 DOI: 10.1186/s13643-022-02096-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Accepted: 10/01/2022] [Indexed: 11/16/2022] Open
Abstract
BACKGROUND Several studies have documented the production of wasteful research, defined as research of no scientific importance and/or not meeting societal needs. We argue that this redundancy in research may to a large degree be due to the lack of a systematic evaluation of the best available evidence and/or of studies assessing societal needs. OBJECTIVES The aim of this scoping review is to (A) identify meta-research studies evaluating if redundancy is present within biomedical research, and if so, assessing the prevalence of such redundancy, and (B) to identify meta-research studies evaluating if researchers had been trying to minimise or avoid redundancy. ELIGIBILITY CRITERIA Meta-research studies (empirical studies) were eligible if they evaluated whether redundancy was present and to what degree; whether health researchers referred to all earlier similar studies when justifying and designing a new study and/or when placing new results in the context of earlier similar trials; and whether health researchers systematically and transparently considered end users' perspectives when justifying and designing a new study. SOURCES OF EVIDENCE The initial overall search was conducted in MEDLINE, Embase via Ovid, CINAHL, Web of Science, Social Sciences Citation Index, Arts & Humanities Citation Index, and the Cochrane Methodology Register from inception to June 2015. A 2nd search included MEDLINE and Embase via Ovid and covered January 2015 to 26 May 2021. No publication date or language restrictions were applied. CHARTING METHODS Charting methods included description of the included studies, bibliometric mapping, and presentation of possible research gaps in the identified meta-research. RESULTS We identified 69 meta-research studies. Thirty-four (49%) of these evaluated the prevalence of redundancy and 42 (61%) studies evaluated the prevalence of a systematic and transparent use of earlier similar studies when justifying and designing new studies, and/or when placing new results in context, with seven (10%) studies addressing both aspects. Only one (1%) study assessed if the perspectives of end users had been used to inform the justification and design of a new study. Among the included meta-research studies evaluating whether redundancy was present, only two of nine health domains (medical areas) and only two of 10 research topics (different methodological types) were represented. Similarly, among the included meta-research studies evaluating whether researchers had been trying to minimise or avoid redundancy, only one of nine health domains and only one of 10 research topics were represented. CONCLUSIONS THAT RELATE TO THE REVIEW QUESTIONS AND OBJECTIVES Even with 69 included meta-research studies, there was a lack of information for most health domains and research topics. However, as most included studies were evaluating across different domains, there is a clear indication of a high prevalence of redundancy and a low prevalence of trying to minimise or avoid redundancy. In addition, only one meta-research study evaluated whether the perspectives of end users were used to inform the justification and design of a new study. SYSTEMATIC REVIEW REGISTRATION Protocol registered at Open Science Framework: https://osf.io/3rdua/ (15 June 2021).
Collapse
|
22
|
Leaving academia: PhD attrition and unhealthy research environments. PLoS One 2022; 17:e0274976. [PMID: 36197884 PMCID: PMC9534392 DOI: 10.1371/journal.pone.0274976] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Accepted: 09/07/2022] [Indexed: 11/07/2022] Open
Abstract
This study investigates PhD candidates’ (N = 391) perceptions about their research environment at a Dutch university in terms of the research climate, (un)ethical supervisory practices, and questionable research practices. We assessed whether their perceptions are related to career considerations. We gathered quantitative self-report estimations of the perceptions of PhD candidates using an online survey tool and then conducted descriptive and within-subject correlation analysis of the results. While most PhD candidates experience fair evaluation processes, openness, integrity, trust, and freedom in their research climate, many report lack of time and support, insufficient supervision, and witness questionable research practices. Results based on Spearman correlations indicate that those who experience a less healthy research environment (including experiences with unethical supervision, questionable practices, and barriers to responsible research), more often consider leaving academia and their current PhD position.
Collapse
|
23
|
Núñez-Núñez M, Andrews JC, Fawzy M, Bueno-Cavanillas A, Khan KS. Research integrity in clinical trials: innocent errors and spin versus scientific misconduct. Curr Opin Obstet Gynecol 2022; 34:332-339. [PMID: 35895940 DOI: 10.1097/gco.0000000000000807] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
PURPOSE OF REVIEW High-quality research underpins the best healthcare practice. This article focuses on analyzing the current literature to promote research integrity across clinical trials. RECENT FINDINGS Recent admissions of questionable practices by researchers have undermined practitioner and public confidence. There is limited evidence specifically for ethical and professional standards in clinical trials to guide researchers and institutions to embed integrity into research practice. SUMMARY Unintentional errors and spin in research are not uncommon as training in design and conduct of clinical trials is not part of health education for medical and allied health professions. There is unfamiliarity with procedures, such as prospective registration, a priori documentation of statistical analysis plans, openness in data sharing, and so forth. This, combined with the academic culture of secrecy, has led to an environment where scientific suspicion, instead of trust, is the norm. Existing science integrity documents are devoid of specific recommendations about how to translate any guidance into clinical trial practice. There is a need for constructive, supportive and multidisciplinary approaches based on open dialogue and continuous training, targeting the research environment. Research integrity now needs to take centre stage to re-instill confidence in randomized trial evidence to inform clinical practice.
Collapse
Affiliation(s)
- María Núñez-Núñez
- Clínico San Cecilio Clinical University Hospital, Granada, Spain
- Consortium for Biomedical Research in Epidemiology and Public Health (CIBERESP), Madrid, Spain
- Department of Preventive Medicine and Public Health, Faculty of Medicine, University of Granada, Spain
- Biosanitary Research Institute of Granada (Ibs.Granada), Granada, Spain
| | | | - Mohamed Fawzy
- IbnSina (Sohag), Banon (Assiut), Qena (Qena), Amshag (Sohag) IVF Facilities, Egypt
| | - Aurora Bueno-Cavanillas
- Consortium for Biomedical Research in Epidemiology and Public Health (CIBERESP), Madrid, Spain
- Department of Preventive Medicine and Public Health, Faculty of Medicine, University of Granada, Spain
- Biosanitary Research Institute of Granada (Ibs.Granada), Granada, Spain
| | - Khalid Saeed Khan
- Consortium for Biomedical Research in Epidemiology and Public Health (CIBERESP), Madrid, Spain
- Department of Preventive Medicine and Public Health, Faculty of Medicine, University of Granada, Spain
| |
Collapse
|
24
|
Soehartono AM, Yu LG, Khor KA. Essential signals in publication trends and collaboration patterns in global Research Integrity and Research Ethics (RIRE). Scientometrics 2022; 127:7487-7497. [PMID: 35755633 PMCID: PMC9206420 DOI: 10.1007/s11192-022-04400-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2021] [Accepted: 05/03/2022] [Indexed: 11/28/2022]
Abstract
Amid an increasingly demanding research environment, there has been a growing interest in studies concerning Research Integrity and Research Ethics (RIRE). Between 1990 and 2020, over 9700 publications were published to address problematic research conduct such as falsification, plagiarism, and related protocols and standards. In this work, country-level trends and collaborative structures are examined with respect to economic group. Our results showed that RIRE publications are predominantly led by the West, with North America and Western Europe contributing the most. While there is interest within growing economies such as China, the pace is not comparable to its overall publications. However, international collaborations on RIRE grew to account for nearly 30% of all publications on the subject in 2020. Although there is a stronger preference for high income countries to collaborate with other high income countries, we observe a rise in partnerships between high-/middle-income and middle-/lower-income co-authorship pairs in the last decade. These trends point to a maturing global community with distributed knowledge transfer, towards more unified international standards for research ethics and integrity. Supplementary Information The online version contains supplementary material available at 10.1007/s11192-022-04400-y.
Collapse
Affiliation(s)
- A. M. Soehartono
- Talent Recruitment and Career Support (TRACS) Office and Bibliometrics Analysis, Nanyang Technological University, 76 Nanyang Drive, Singapore, 637331 Singapore
| | - L. G. Yu
- Talent Recruitment and Career Support (TRACS) Office and Bibliometrics Analysis, Nanyang Technological University, 76 Nanyang Drive, Singapore, 637331 Singapore
| | - K. A. Khor
- Talent Recruitment and Career Support (TRACS) Office and Bibliometrics Analysis, Nanyang Technological University, 76 Nanyang Drive, Singapore, 637331 Singapore
| |
Collapse
|
25
|
de Ridder J. How to trust a scientist. STUDIES IN HISTORY AND PHILOSOPHY OF SCIENCE 2022; 93:11-20. [PMID: 35247820 DOI: 10.1016/j.shpsa.2022.02.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/06/2021] [Revised: 02/07/2022] [Accepted: 02/10/2022] [Indexed: 06/14/2023]
Abstract
Epistemic trust among scientists is inevitable. There are two questions about this: (1) What is the content of this trust, what do scientists trust each other for? (2) Is such trust epistemically justified? I argue that if we assume a traditional answer to (1), namely that scientists trust each other to be reliable informants, then the answer to question (2) is negative, certainly for the biomedical and social sciences. This motivates a different construal of trust among scientists and therefore a different answer to (1): scientists trust each other to only testify to claims that are backed by evidence gathered in accordance with prevailing methodological standards. On this answer, trust among scientists is epistemically justified.
Collapse
Affiliation(s)
- Jeroen de Ridder
- Department of Philosophy, Vrije Universiteit Amsterdam, the Netherlands.
| |
Collapse
|
26
|
Kalandadze T, Hart SA. Open developmental science: An overview and annotated reading list. INFANT AND CHILD DEVELOPMENT 2022. [DOI: 10.1002/icd.2334] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Affiliation(s)
- Tamara Kalandadze
- Department of Education ICT and Learning, Østfold University College Halden Norway
| | - Sara A. Hart
- Department of Psychology Florida State University Tallahassee Florida USA
- Florida Center for Reading Research Florida State University Tallahassee Florida USA
| |
Collapse
|
27
|
Cristofaro M, Giardino PL, Misra S, Pham QT, Hiep Phan H. Behavior or culture? Investigating the use of cryptocurrencies for electronic commerce across the USA and China. MANAGEMENT RESEARCH REVIEW 2022. [DOI: 10.1108/mrr-06-2021-0493] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
Purpose
This paper claims to identify the behavioral and cultural features that push to use, or not, cryptocurrencies for electronic commerce. Indeed, despite the use of cryptocurrencies for electronic commerce spreading worldwide at a fast and growing pace, there are supporters and detractors among their users. The analysis of what distinguish these two groups of users is fundamental for understanding their different intention to use cryptocurrencies for electronic commerce.
Design/methodology/approach
A survey has been administered to 2,532 cryptocurrencies’ users across the USA and China, collecting data on their behavioral predispositions and cultural features. Results were then analyzed through structured equation modeling.
Findings
Results showed that while attitude, subjective norms, perceived behavioral control and herding behavior have a positive impact on the intention to use cryptocurrencies for electronic commerce, financial literacy has no influence. Cultural dimensions amplified or reduced the discovered relationships and caused different effects: positive for the USA and negative for China when considering illegal attitude and perceived risk.
Originality/value
Theory of planned behavior, financial behavior and cultural factors can, all together, represent a useful framework for envisioning the behavior of users in adopting cryptocurrencies for electronic commerce purposes through a test of all its elements. To the best of the authors’ knowledge, this is the first study considering behavior and cultural variables on the intention to use cryptocurrencies for electronic commerce as well as being the largest carried out, in terms of sample, on the cryptocurrency topic.
Collapse
|
28
|
Gopalakrishna G, Wicherts JM, Vink G, Stoop I, van den Akker OR, ter Riet G, Bouter LM. Prevalence of responsible research practices among academics in The Netherlands. F1000Res 2022; 11:471. [PMID: 36128558 PMCID: PMC9478502 DOI: 10.12688/f1000research.110664.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 04/20/2022] [Indexed: 09/05/2024] Open
Abstract
Background: Traditionally, research integrity studies have focused on research misbehaviors and their explanations. Over time, attention has shifted towards preventing questionable research practices and promoting responsible ones. However, data on the prevalence of responsible research practices, especially open methods, open codes and open data and their underlying associative factors, remains scarce. Methods: We conducted a web-based anonymized questionnaire, targeting all academic researchers working at or affiliated to a university or university medical center in The Netherlands, to investigate the prevalence and potential explanatory factors of 11 responsible research practices. Results: A total of 6,813 academics completed the survey, the results of which show that prevalence of responsible practices differs substantially across disciplines and ranks, with 99 percent avoiding plagiarism in their work but less than 50 percent pre-registering a research protocol. Arts and humanities scholars as well as PhD candidates and junior researchers engaged less often in responsible research practices. Publication pressure negatively affected responsible practices, while mentoring, scientific norms subscription and funding pressure stimulated them. Conclusions: Understanding the prevalence of responsible research practices across disciplines and ranks, as well as their associated explanatory factors, can help to systematically address disciplinary- and academic rank-specific obstacles, and thereby facilitate responsible conduct of research.
Collapse
Affiliation(s)
- Gowri Gopalakrishna
- Department of Epidemiology and Data Science, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Jelte M. Wicherts
- Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands
| | - Gerko Vink
- Department of Methodology and Statistics, Utrecht University, Utrecht, The Netherlands
| | - Ineke Stoop
- The Netherlands Institute for Social Research, Den Haag, The Netherlands
| | - Olmo R. van den Akker
- Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands
| | - Gerben ter Riet
- Center of Expertise Urban Vitality, Faculty of Health, Amsterdam University of Applied Science, Amsterdam, The Netherlands
| | - Lex M. Bouter
- Department of Epidemiology and Data Science, Amsterdam University Medical Centers, Amsterdam, The Netherlands
- Department of Philosophy, Faculty of Humanities, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
29
|
Gopalakrishna G, Wicherts JM, Vink G, Stoop I, van den Akker OR, ter Riet G, Bouter LM. Prevalence of responsible research practices among academics in The Netherlands. F1000Res 2022; 11:471. [PMID: 36128558 PMCID: PMC9478502 DOI: 10.12688/f1000research.110664.2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 07/28/2022] [Indexed: 11/20/2022] Open
Abstract
Background: Traditionally, research integrity studies have focused on research misbehaviors and their explanations. Over time, attention has shifted towards preventing questionable research practices and promoting responsible ones. However, data on the prevalence of responsible research practices, especially open methods, open codes and open data and their underlying associative factors, remains scarce. Methods: We conducted a web-based anonymized questionnaire, targeting all academic researchers working at or affiliated to a university or university medical center in The Netherlands, to investigate the prevalence and potential explanatory factors of 11 responsible research practices. Results: A total of 6,813 academics completed the survey, the results of which show that prevalence of responsible practices differs substantially across disciplines and ranks, with 99 percent avoiding plagiarism in their work but less than 50 percent pre-registering a research protocol. Arts and humanities scholars as well as PhD candidates and junior researchers engaged less often in responsible research practices. Publication pressure negatively affected responsible practices, while mentoring, scientific norms subscription and funding pressure stimulated them. Conclusions: Understanding the prevalence of responsible research practices across disciplines and ranks, as well as their associated explanatory factors, can help to systematically address disciplinary- and academic rank-specific obstacles, and thereby facilitate responsible conduct of research.
Collapse
Affiliation(s)
- Gowri Gopalakrishna
- Department of Epidemiology and Data Science, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Jelte M. Wicherts
- Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands
| | - Gerko Vink
- Department of Methodology and Statistics, Utrecht University, Utrecht, The Netherlands
| | - Ineke Stoop
- The Netherlands Institute for Social Research, Den Haag, The Netherlands
| | - Olmo R. van den Akker
- Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands
| | - Gerben ter Riet
- Center of Expertise Urban Vitality, Faculty of Health, Amsterdam University of Applied Science, Amsterdam, The Netherlands
| | - Lex M. Bouter
- Department of Epidemiology and Data Science, Amsterdam University Medical Centers, Amsterdam, The Netherlands
- Department of Philosophy, Faculty of Humanities, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
30
|
Gopalakrishna G, ter Riet G, Vink G, Stoop I, Wicherts JM, Bouter LM. Prevalence of questionable research practices, research misconduct and their potential explanatory factors: A survey among academic researchers in The Netherlands. PLoS One 2022; 17:e0263023. [PMID: 35171921 PMCID: PMC8849616 DOI: 10.1371/journal.pone.0263023] [Citation(s) in RCA: 59] [Impact Index Per Article: 29.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2021] [Accepted: 01/10/2022] [Indexed: 11/19/2022] Open
Abstract
Prevalence of research misconduct, questionable research practices (QRPs) and their associations with a range of explanatory factors has not been studied sufficiently among academic researchers. The National Survey on Research Integrity targeted all disciplinary fields and academic ranks in the Netherlands. It included questions about engagement in fabrication, falsification and 11 QRPs over the previous three years, and 12 explanatory factor scales. We ensured strict identity protection and used the randomized response method for questions on research misconduct. 6,813 respondents completed the survey. Prevalence of fabrication was 4.3% (95% CI: 2.9, 5.7) and of falsification 4.2% (95% CI: 2.8, 5.6). Prevalence of QRPs ranged from 0.6% (95% CI: 0.5, 0.9) to 17.5% (95% CI: 16.4, 18.7) with 51.3% (95% CI: 50.1, 52.5) of respondents engaging frequently in at least one QRP. Being a PhD candidate or junior researcher increased the odds of frequently engaging in at least one QRP, as did being male. Scientific norm subscription (odds ratio (OR) 0.79; 95% CI: 0.63, 1.00) and perceived likelihood of detection by reviewers (OR 0.62, 95% CI: 0.44, 0.88) were associated with engaging in less research misconduct. Publication pressure was associated with more often engaging in one or more QRPs frequently (OR 1.22, 95% CI: 1.14, 1.30). We found higher prevalence of misconduct than earlier surveys. Our results suggest that greater emphasis on scientific norm subscription, strengthening reviewers in their role as gatekeepers of research quality and curbing the "publish or perish" incentive system promotes research integrity.
Collapse
Affiliation(s)
- Gowri Gopalakrishna
- Department of Epidemiology and Data Science, Amsterdam University Medical Centers, Amsterdam, The Netherlands
- * E-mail:
| | - Gerben ter Riet
- Faculty of Health, Center of Expertise Urban Vitality Amsterdam University of Applied Science, Amsterdam, The Netherlands
| | - Gerko Vink
- Department of Methodology & Statistics, Utrecht University, Utrecht, The Netherlands
| | - Ineke Stoop
- The Netherlands Institute for Social Research, Den Haag, The Netherlands
| | - Jelte M. Wicherts
- Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands
| | - Lex M. Bouter
- Department of Epidemiology and Data Science, Amsterdam University Medical Centers, Amsterdam, The Netherlands
- Department of Philosophy, Faculty of Humanities, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
31
|
Parlangeli O, Palmitesta P, Bracci M, Marchigiani E, Di Pomponio I, Guidi S. University Teachers During the First Lockdown Due to SARS-CoV-2 in Italy: Stress, Issues and Perceptions of Misconduct. SCIENCE AND ENGINEERING ETHICS 2022; 28:9. [PMID: 35166946 PMCID: PMC8847283 DOI: 10.1007/s11948-022-00362-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/03/2021] [Accepted: 01/13/2022] [Indexed: 06/14/2023]
Abstract
With the spread of the pandemic and the introduction of measures aimed at its containment, it is necessary to understand in specific national contexts how home quarantine has affected the psychophysical well-being of academics, and their ability to maintain integrity. To this end we constructed an online questionnaire to investigate the levels of stress, well-being, and work-life balance in relationship with living and working conditions. Moreover, the questionnaire was designed to obtain information about the perceived occurrence, increase or decrease of misconduct in research (e.g., research misconduct by colleagues) and professional relationships (e.g., misbehaviors between colleagues, from students and toward students). The questionnaire was administered online by contacting faculty at three universities in Tuscany, Italy, asking them to relate their experience during the first lockdown (March-May 2020). Faculty members were invited to complete the questionnaire by their institutional e-mail account. The final sample consisted of 581 respondents. The results showed that inadequacies of the equipment, and particularly poor internet connection, were significantly correlated with main issues reported, such as relationships with students and research activities. Female teachers primarily suffered from stressful conditions, lacked well-being, and experienced work-life imbalance. Stress levels were related to perceptions of the frequency of misconduct and of an increase in their frequency during the period of home quarantine. Female professors, when compared to their male counterparts, perceived misconduct from students as increased and more frequent in the period of quarantine. Results point to a gender issue that is likely to arise from conditions of domestic activities imbalance and that increases stress and misconduct perception.
Collapse
Affiliation(s)
- Oronzo Parlangeli
- Department of Social, Political and Cognitive Sciences, University of Siena, Via Roma 56, 53100, Siena, Italy.
| | - Paola Palmitesta
- Department of Social, Political and Cognitive Sciences, University of Siena, Via Roma 56, 53100, Siena, Italy
| | - Margherita Bracci
- Department of Social, Political and Cognitive Sciences, University of Siena, Via Roma 56, 53100, Siena, Italy
| | - Enrica Marchigiani
- Department of Social, Political and Cognitive Sciences, University of Siena, Via Roma 56, 53100, Siena, Italy
| | - Ileana Di Pomponio
- Department of Social, Political and Cognitive Sciences, University of Siena, Via Roma 56, 53100, Siena, Italy
| | - Stefano Guidi
- Department of Social, Political and Cognitive Sciences, University of Siena, Via Roma 56, 53100, Siena, Italy.
| |
Collapse
|
32
|
Gøtzsche PC. Citation bias: questionable research practice or scientific misconduct? J R Soc Med 2022; 115:31-35. [PMID: 35105192 DOI: 10.1177/01410768221075881] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023] Open
|
33
|
Kaiser M, Drivdal L, Hjellbrekke J, Ingierd H, Rekdal OB. Questionable Research Practices and Misconduct Among Norwegian Researchers. SCIENCE AND ENGINEERING ETHICS 2021; 28:2. [PMID: 34932191 PMCID: PMC8692305 DOI: 10.1007/s11948-021-00351-4] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/30/2020] [Accepted: 11/10/2021] [Indexed: 06/14/2023]
Abstract
This article presents results from the national survey conducted in 2018 for the project Research Integrity in Norway (RINO). A total of 31,206 questionnaires were sent out to Norwegian researchers by e-mail, and 7291 responses were obtained. In this paper, we analyse the survey data to determine attitudes towards and the prevalence of fabrication, falsification and plagiarism (FFP) and contrast this with attitudes towards and the prevalence of the more questionable research practices (QRPs) surveyed. Our results show a relatively low percentage of self-reported FFPs (0.2-0.3%), while the number of researchers who report having committed one of the QRPs during the last three years reached a troublesome 40%. The article also presents a ranking of the perceived severity of FFP and QRPs among Norwegian researchers. Overall, there is a widespread normative consensus, where FFP is considered more troublesome than QRPs.
Collapse
Affiliation(s)
- Matthias Kaiser
- Center for the Study of the Sciences and Humanities, University of Bergen, Bergen, Norway
| | - Laura Drivdal
- Center for the Study of the Sciences and Humanities, University of Bergen, Bergen, Norway
| | | | - Helene Ingierd
- The National Committees for Research Ethics in Norway, Oslo, Norway
| | - Ole Bjørn Rekdal
- Department of Welfare and Participation, Western Norway University of Applied Sciences, Bergen, Norway
| |
Collapse
|
34
|
Abstract
Reflexive metrics is a branch of science studies that explores how the demand for accountability and performance measurement in science has shaped the research culture in recent decades. Hypercompetition and publication pressure are part of this neoliberal culture. How do scientists respond to these pressures? Studies on research integrity and organisational culture suggest that people who feel treated unfairly by their institution are more likely to engage in deviant behaviour, such as scientific misconduct. By building up on reflexive metrics, combined with studies on the influence of organisational culture on research integrity, this study reflects on the research behaviour of astronomers with the following questions: (1) To what extent is research (mis-)behaviour reflexive, i.e., dependent on perceptions of publication pressure and distributive and organisational justice? (2) What impact does scientific misconduct have on research quality? In order to perform this reflection, we conducted a comprehensive survey of academic and non-academic astronomers worldwide and received 3509 responses. We found that publication pressure explains 10% of the variance in occurrence of misconduct and between 7% and 13% of the variance of the perception of distributive and organisational justice as well as overcommitment to work. Our results on the perceived impact of scientific misconduct on research quality show that the epistemic harm of questionable research practices should not be underestimated. This suggests there is a need for a policy change. In particular, lesser attention to metrics (such as publication rate) in the allocation of grants, telescope time and institutional rewards would foster better scientific conduct and, hence, research quality.
Collapse
|
35
|
Abstract
A large part of governmental research funding is currently distributed through the peer review of project proposals. In this paper, we argue that such funding systems incentivize and even force researchers to violate five moral values, each of which is central to commonly used scientific codes of conduct. Our argument complements existing epistemic arguments against peer-review project funding systems and, accordingly, strengthens the mounting calls for reform of these systems.
Collapse
Affiliation(s)
- Stijn Conix
- Centre for Logic and Philosophy of Science, KU Leuven, Leuven, Vlaams Brabant, 3000, Belgium
| | - Andreas De Block
- Centre for Logic and Philosophy of Science, KU Leuven, Leuven, Vlaams Brabant, 3000, Belgium
| | - Krist Vaesen
- Philosophy & Ethics, Eindhoven University of Technology, Eindhoven, The Netherlands
| |
Collapse
|
36
|
Abstract
A large part of governmental research funding is currently distributed through the peer review of project proposals. In this paper, we argue that such funding systems incentivize and even force researchers to violate five moral values, each of which is central to commonly used scientific codes of conduct. Our argument complements existing epistemic arguments against peer-review project funding systems and, accordingly, strengthens the mounting calls for reform of these systems.
Collapse
Affiliation(s)
- Stijn Conix
- Centre for Logic and Philosophy of Science, KU Leuven, Leuven, Vlaams Brabant, 3000, Belgium
| | - Andreas De Block
- Centre for Logic and Philosophy of Science, KU Leuven, Leuven, Vlaams Brabant, 3000, Belgium
| | - Krist Vaesen
- Philosophy & Ethics, Eindhoven University of Technology, Eindhoven, The Netherlands
| |
Collapse
|
37
|
The frequency of plagiarism identified by text-matching software in scientific articles: a systematic review and meta-analysis. Scientometrics 2021. [DOI: 10.1007/s11192-021-04140-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
38
|
Roje R, Tomić V, Buljan I, Marušić A. Development and implementation of research integrity guidance documents: Explorative interviews with research integrity experts. Account Res 2021:1-38. [PMID: 34612089 DOI: 10.1080/08989621.2021.1989676] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
Research integrity (RI) guidance documents often lack sufficient details on handling specific RI issues causing the lack of harmonized approaches to RI and opening the way to research misconduct and other detrimental research practices. Standard operating procedures (SOPs) are developed and implemented by organizations for ensuring the uniformity and quality of performed actions. This study aimed to explore stakeholders' opinions on SOPs for RI, factors influencing the implementation of RI guidance documents and practices, and ideas for improvements in the RI field. We conducted semi-structured interviews with stakeholders from different groups. Data were analyzed using the reflexive thematic analysis approach, and three themes were developed. The first theme addressed participants' knowledge and perceptions on SOPs for RI and their impact on RI promotion and implementation. The second theme described different factors that have a positive or negative impact on the implementation of RI and RI guidance documents and practices, while the third theme addressed needed changes and ideas for improvements in the RI field. Participants considered SOPs valuable for RI promotion. SOPs should be developed based on and consistent with more general and aspirational guidance and through the dialogue with researchers and other stakeholders, to ensure their relevancy.
Collapse
Affiliation(s)
- Rea Roje
- Department of Research in Biomedicine and Health, University of Split School of Medicine, Split, Croatia
| | - Vicko Tomić
- Department of Research in Biomedicine and Health, University of Split School of Medicine, Split, Croatia.,ST-OPEN, University of Split, Split, Croatia
| | - Ivan Buljan
- Department of Research in Biomedicine and Health, University of Split School of Medicine, Split, Croatia
| | - Ana Marušić
- Department of Research in Biomedicine and Health, University of Split School of Medicine, Split, Croatia
| |
Collapse
|
39
|
Ljubenković AM, Borovečki A, Ćurković M, Hofmann B, Holm S. Survey on the Research Misconduct and Questionable Research Practices of Medical Students, PhD Students, and Supervisors at the Zagreb School of Medicine in Croatia. J Empir Res Hum Res Ethics 2021; 16:435-449. [PMID: 34310249 DOI: 10.1177/15562646211033727] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
This cross-sectional study evaluates the knowledge, attitudes, experiences, and behavior of final year medical students, PhD students, and supervisors at the School of Medicine of the University of Zagreb in relation to research misconduct, questionable research practices, and the research environment. The overall response rate was 36.4% (68%-100% for the paper survey and 8%-15% for the online surveys). The analysis reveals statistically significant differences in attitude scores between PhD students and supervisors, the latter having attitudes more in concordance with accepted norms. The results overall show a nonnegligible incidence of self-reported misconduct and questionable research practices, as well as some problematic attitudes towards misconduct and questionable research practices. The incidence of problematic authorship practices was particularly high. The research environment was evaluated as being mostly supportive of research integrity.
Collapse
Affiliation(s)
| | - Ana Borovečki
- Andrija Stampar School of Public Health, School of Medicine, 37632University of Zagreb, Zagreb, Croatia
| | | | - Bjørn Hofmann
- Department of the Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway.,Centre for Medical Ethics, University of Oslo, Oslo, Norway
| | - Søren Holm
- Centre for Medical Ethics, University of Oslo, Oslo, Norway.,Centre for Social Ethics and Policy, University of Manchester, Manchester, UK
| |
Collapse
|
40
|
Labib K, Roje R, Bouter L, Widdershoven G, Evans N, Marušić A, Mokkink L, Tijdink J. Important Topics for Fostering Research Integrity by Research Performing and Research Funding Organizations: A Delphi Consensus Study. SCIENCE AND ENGINEERING ETHICS 2021; 27:47. [PMID: 34244889 PMCID: PMC8270794 DOI: 10.1007/s11948-021-00322-9] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Accepted: 06/14/2021] [Indexed: 06/13/2023]
Abstract
To foster research integrity (RI), it is necessary to address the institutional and system-of-science factors that influence researchers' behavior. Consequently, research performing and research funding organizations (RPOs and RFOs) could develop comprehensive RI policies outlining the concrete steps they will take to foster RI. So far, there is no consensus on which topics are important to address in RI policies. Therefore, we conducted a three round Delphi survey study to explore which RI topics to address in institutional RI policies by seeking consensus from research policy experts and institutional leaders. A total of 68 RPO and 52 RFO experts, representing different disciplines, countries and genders, completed one, two or all rounds of the study. There was consensus among the experts on the importance of 12 RI topics for RPOs and 11 for RFOs. The topics that ranked highest for RPOs concerned education and training, supervision and mentoring, dealing with RI breaches, and supporting a responsible research process (e.g. through quality assurance). The highest ranked RFO topics concerned dealing with breaches of RI, conflicts of interest, and setting expectations on RPOs (e.g. about educating researchers about RI). Together with the research policy experts and institutional leaders, we developed a comprehensive overview of topics important for inclusion in the RI policies of RPOs and RFOs. The topics reflect preference for a preventative approach to RI, coupled with procedures for dealing with RI breaches. RPOs and RFOs should address each of these topics in order to support researchers in conducting responsible research.
Collapse
Affiliation(s)
- Krishma Labib
- Department of Ethics, Law and Humanities, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health Institute, De Boelelaan 1117, 1081HV, Amsterdam, The Netherlands.
| | - Rea Roje
- School of Medicine, University of Split, Šoltanska ul. 2, 21000, Split, Croatia
| | - Lex Bouter
- Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health Institute, De Boelelaan 1117, 1081HV, Amsterdam, The Netherlands
- Department of Philosophy, Vrije Universiteit Amsterdam, De Boelelaan 1105, 1081 HV, Amsterdam, The Netherlands
| | - Guy Widdershoven
- Department of Ethics, Law and Humanities, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health Institute, De Boelelaan 1117, 1081HV, Amsterdam, The Netherlands
| | - Natalie Evans
- Department of Ethics, Law and Humanities, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health Institute, De Boelelaan 1117, 1081HV, Amsterdam, The Netherlands
| | - Ana Marušić
- School of Medicine, University of Split, Šoltanska ul. 2, 21000, Split, Croatia
| | - Lidwine Mokkink
- Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health Institute, De Boelelaan 1117, 1081HV, Amsterdam, The Netherlands
| | - Joeri Tijdink
- Department of Ethics, Law and Humanities, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health Institute, De Boelelaan 1117, 1081HV, Amsterdam, The Netherlands
- Department of Philosophy, Vrije Universiteit Amsterdam, De Boelelaan 1105, 1081 HV, Amsterdam, The Netherlands
| |
Collapse
|
41
|
Ravn T, Sørensen MP. Exploring the Gray Area: Similarities and Differences in Questionable Research Practices (QRPs) Across Main Areas of Research. SCIENCE AND ENGINEERING ETHICS 2021; 27:40. [PMID: 34136962 DOI: 10.1007/s11948-021-00310-z] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/09/2020] [Accepted: 05/03/2021] [Indexed: 06/12/2023]
Abstract
This paper explores the gray area of questionable research practices (QRPs) between responsible conduct of research and severe research misconduct in the form of fabrication, falsification, and plagiarism (Steneck in SEE 12(1): 53-57, 2006). Up until now, we have had very little knowledge of disciplinary similarities and differences in QRPs. The paper is the first systematic account of variances and similarities. It reports on the findings of a comprehensive study comprising 22 focus groups on practices and perceptions of QRPs across main areas of research. The paper supports the relevance of the idea of epistemic cultures (Knorr Cetina in: Epistemic cultures: how the sciences make knowledge, Harvard University Press, Cambridge, 1999), also when it comes to QRPs. It shows which QRPs researchers from different areas of research (humanities, social sciences, medical sciences, natural sciences, and technical sciences) report as the most severe and prevalent within their fields. Furthermore, it shows where in the research process these self-reported QRPs can be found. This is done by using a five-phase analytical model of the research process (idea generation, research design, data collection, data analysis, scientific publication and reporting). The paper shows that QRPs are closely connected to the distinct research practices within the different areas of research. Many QRPs can therefore only be found within one area of research, and QRPs that cut across main areas often cover relatively different practices. In a few cases, QRPs in one area are considered good research practice in another.
Collapse
Affiliation(s)
- Tine Ravn
- Department of Political Science, The Danish Centre for Studies in Research and Research Policy, Aarhus University, Bartholins Allé 7, 8000, Aarhus C, Denmark.
| | - Mads P Sørensen
- Department of Political Science, The Danish Centre for Studies in Research and Research Policy, Aarhus University, Bartholins Allé 7, 8000, Aarhus C, Denmark
| |
Collapse
|
42
|
Tijdink JK, Horbach SPJM, Nuijten MB, O'Neill G. Towards a Research Agenda for Promoting Responsible Research Practices. J Empir Res Hum Res Ethics 2021; 16:450-460. [PMID: 34037490 PMCID: PMC8458678 DOI: 10.1177/15562646211018916] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
This opinion piece aims to inform future research funding programs on responsible research practices (RRP) based on three specific objectives: (1) to give a sketch of the current international discussion on responsible research practices (RRPs); (2) to give an overview of current initiatives and already obtained results regarding RRP; and (3) to give an overview of potential future needs for research on RRP. In this opinion piece, we have used seven iterative methodological steps (including literature review, ranking, and sorting exercises) to create the proposed research agenda. We identified six main themes that we believe need attention in future research: (1) responsible evaluation of research and researchers, (2) the influence of open science and transparency on RRP, (3) research on responsible mentoring, supervision, and role modeling, (4) the effect of education and training on RRP, (5) checking for reproducibility, and (6) responsible and fair peer review. These themes have in common that they address aspects of research that are mostly on the level of the scientific system, more than on the level of the individual researcher. Some current initiatives are already gathering substantial empirical evidence to start filling these gaps. We believe that with sufficient support from all relevant stakeholders, more progress can be made.
Collapse
Affiliation(s)
- Joeri K Tijdink
- Department of Ethics, Law and Humanities, 1209Amsterdam UMC, Amsterdam, the Netherlands.,Department of Philosophy, 404761Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| | - Serge P J M Horbach
- Danish Centre for Studies in Research and Research Policy, Aarhus University, Aarhus, Denmark.,Center for Science and Technology Studies, 168095Leiden University, Leiden, the Netherlands
| | - Michèle B Nuijten
- Department of Methodology and Statistics, Tilburg School of Social and Behavioural Sciences, 120694Tilburg University, Tilburg, the Netherlands
| | - Gareth O'Neill
- Technopolis Group, Brussels, Belgium.,Leiden University Centre for Linguistics, Leiden University, Leiden, the Netherlands
| |
Collapse
|
43
|
Haven T, Tijdink J, Martinson B, Bouter L, Oort F. Explaining variance in perceived research misbehavior: results from a survey among academic researchers in Amsterdam. Res Integr Peer Rev 2021; 6:7. [PMID: 33941288 PMCID: PMC8094603 DOI: 10.1186/s41073-021-00110-w] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2020] [Accepted: 04/11/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Concerns about research misbehavior in academic science have sparked interest in the factors that may explain research misbehavior. Often three clusters of factors are distinguished: individual factors, climate factors and publication factors. Our research question was: to what extent can individual, climate and publication factors explain the variance in frequently perceived research misbehaviors? METHODS From May 2017 until July 2017, we conducted a survey study among academic researchers in Amsterdam. The survey included three measurement instruments that we previously reported individual results of and here we integrate these findings. RESULTS One thousand two hundred ninety-eight researchers completed the survey (response rate: 17%). Results showed that individual, climate and publication factors combined explained 34% of variance in perceived frequency of research misbehavior. Individual factors explained 7%, climate factors explained 22% and publication factors 16%. CONCLUSIONS Our results suggest that the perceptions of the research climate play a substantial role in explaining variance in research misbehavior. This suggests that efforts to improve departmental norms might have a salutary effect on behavior.
Collapse
Affiliation(s)
- Tamarinde Haven
- Department of Philosophy, Vrije Universiteit, Amsterdam, De Boelelaan 1105, 1081 HV, Amsterdam, The Netherlands.
| | - Joeri Tijdink
- Department of Philosophy, Vrije Universiteit, Amsterdam, De Boelelaan 1105, 1081 HV, Amsterdam, The Netherlands.,Department of Ethics, Law and Humanities, Amsterdam UMC, Vrije Universiteit Amsterdam, De Boelelaan 1117, Amsterdam, Netherlands
| | - Brian Martinson
- Department of Research, HealthPartners Institute, 8170 33rd Ave. S., Bloomington, MN, 55425, USA.,Center for Care Delivery and Outcomes Research, Minneapolis Veterans Affairs Health Care System, One Veterans Drive, Minneapolis, MN, 55417, USA.,Department of Medicine, University of Minnesota, 420 Delaware St SE, Minneapolis, MN, 55455, USA
| | - Lex Bouter
- Department of Philosophy, Vrije Universiteit, Amsterdam, De Boelelaan 1105, 1081 HV, Amsterdam, The Netherlands.,Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, De Boelelaan 1117, Amsterdam, The Netherlands
| | - Frans Oort
- Research Institute of Child Development and Education, University of Amsterdam, Nieuwe Achtergracht 127, 1018 WS, Amsterdam, The Netherlands
| |
Collapse
|
44
|
Armond ACV, Gordijn B, Lewis J, Hosseini M, Bodnár JK, Holm S, Kakuk P. A scoping review of the literature featuring research ethics and research integrity cases. BMC Med Ethics 2021; 22:50. [PMID: 33931043 PMCID: PMC8086087 DOI: 10.1186/s12910-021-00620-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2020] [Accepted: 04/21/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND The areas of Research Ethics (RE) and Research Integrity (RI) are rapidly evolving. Cases of research misconduct, other transgressions related to RE and RI, and forms of ethically questionable behaviors have been frequently published. The objective of this scoping review was to collect RE and RI cases, analyze their main characteristics, and discuss how these cases are represented in the scientific literature. METHODS The search included cases involving a violation of, or misbehavior, poor judgment, or detrimental research practice in relation to a normative framework. A search was conducted in PubMed, Web of Science, SCOPUS, JSTOR, Ovid, and Science Direct in March 2018, without language or date restriction. Data relating to the articles and the cases were extracted from case descriptions. RESULTS A total of 14,719 records were identified, and 388 items were included in the qualitative synthesis. The papers contained 500 case descriptions. After applying the eligibility criteria, 238 cases were included in the analysis. In the case analysis, fabrication and falsification were the most frequently tagged violations (44.9%). The non-adherence to pertinent laws and regulations, such as lack of informed consent and REC approval, was the second most frequently tagged violation (15.7%), followed by patient safety issues (11.1%) and plagiarism (6.9%). 80.8% of cases were from the Medical and Health Sciences, 11.5% from the Natural Sciences, 4.3% from Social Sciences, 2.1% from Engineering and Technology, and 1.3% from Humanities. Paper retraction was the most prevalent sanction (45.4%), followed by exclusion from funding applications (35.5%). CONCLUSIONS Case descriptions found in academic journals are dominated by discussions regarding prominent cases and are mainly published in the news section of journals. Our results show that there is an overrepresentation of biomedical research cases over other scientific fields compared to its proportion in scientific publications. The cases mostly involve fabrication, falsification, and patient safety issues. This finding could have a significant impact on the academic representation of misbehaviors. The predominance of fabrication and falsification cases might diverge the attention of the academic community from relevant but less visible violations, and from recently emerging forms of misbehaviors.
Collapse
Affiliation(s)
- Anna Catharina Vieira Armond
- Department of Behavioural Sciences, Faculty of Medicine, University of Debrecen, Móricz Zsigmond krt. 22. III. Apartman Diákszálló, Debrecen, 4032, Hungary.
| | - Bert Gordijn
- Institute of Ethics, School of Theology, Philosophy and Music, Dublin City University, Dublin, Ireland
| | - Jonathan Lewis
- Institute of Ethics, School of Theology, Philosophy and Music, Dublin City University, Dublin, Ireland
| | - Mohammad Hosseini
- Institute of Ethics, School of Theology, Philosophy and Music, Dublin City University, Dublin, Ireland
| | - János Kristóf Bodnár
- Department of Behavioural Sciences, Faculty of Medicine, University of Debrecen, Móricz Zsigmond krt. 22. III. Apartman Diákszálló, Debrecen, 4032, Hungary
| | - Soren Holm
- Centre for Social Ethics and Policy, School of Law, University of Manchester, Manchester, UK.,Center for Medical Ethics, HELSAM, Faculty of Medicine, University of Oslo, Oslo, Norway
| | - Péter Kakuk
- Center for Ethics and Law in Biomedicine, Central European University, Budapest, Hungary
| |
Collapse
|
45
|
Laas K, Taylor S, Miller CZ, Brey EM, Hildt E. Views on ethical issues in research labs: A university-wide survey. Account Res 2021; 29:178-201. [PMID: 33780303 DOI: 10.1080/08989621.2021.1910503] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
In this article, we summarize the key findings of an exploratory study in which students and faculty completed a survey that sought to identify the most important ethical issues in STEM fields, how often these issues are discussed in research groups, and how often these ethical issues come up in the daily practice of research. Participants answered a series of open-ended and Likert-scale questions to provide a detailed look at the current ethical landscape at a private research university in the Midwest. The survey also looked at potential differences between faculty and undergraduate and graduate students' perceptions in answering these questions. The results indicate that while all community members tended to view issues that can be classified as research misconduct as the most important activities to avoid in STEM-related research, the level of discussion and actual witnessing of these practices was relatively low. The study points to a consensus among students and faculty about the important ethical issues in STEM and the need for more discussion and attention to be paid to communication, collaboration, and interpersonal relationships in the research environment.
Collapse
Affiliation(s)
- Kelly Laas
- Center for the Study of Ethics in the Professions, Illinois Institute of Technology, Chicago IL, USA
| | - Stephanie Taylor
- Center for the Study of Ethics in the Professions, Illinois Institute of Technology, Chicago IL, USA
| | | | - Eric M Brey
- Department of Biomedical Engineering, University of Texas, San Antonio TX, USA
| | - Elisabeth Hildt
- Center for the Study of Ethics in the Professions, Illinois Institute of Technology, Chicago IL, USA
| |
Collapse
|
46
|
Sperling D. "Like a Sheriff in a Small Town": Status, Roles, and Challenges of Ethics Committees in Academic Colleges of Education. J Empir Res Hum Res Ethics 2021; 16:290-303. [PMID: 33784840 DOI: 10.1177/15562646211005253] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In recent years, Research Ethics Committees in academic colleges of education have constituted to review research proposals in the field of education. Yet, little is known about their work, composition, challenges, and relationships with external partners. This study explores the views and attitudes of 13 members and chairpersons of Research Ethics Committees in colleges of education in Israel, and two policy makers at the Ministry of Education about their roles, responsibilities, challenges, and limitations. Findings revealed an instrumental attitude towards the ethics committee. Committees are perceived as supportive rather than enforcing. Interviews shed light on the complex relationships between committee members, college lecturers/researchers, ethics regulators, and academic management. Moreover, the findings emphasized the lack of formal training and broad discussion on ethics. The study calls for strengthening committees' raison d'être and the internalization of ethics among committee members, researchers, and lecturers in the field of education.
Collapse
Affiliation(s)
- Daniel Sperling
- Department of Nursing, 26748University of Haifa, Haifa, Israel
| |
Collapse
|
47
|
Aubert Bonn N, Pinxten W. Rethinking success, integrity, and culture in research (part 2) - a multi-actor qualitative study on problems of science. Res Integr Peer Rev 2021; 6:3. [PMID: 33441167 PMCID: PMC7807493 DOI: 10.1186/s41073-020-00105-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2020] [Accepted: 11/19/2020] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Research misconduct and questionable research practices have been the subject of increasing attention in the past few years. But despite the rich body of research available, few empirical works also include the perspectives of non-researcher stakeholders. METHODS We conducted semi-structured interviews and focus groups with policy makers, funders, institution leaders, editors or publishers, research integrity office members, research integrity community members, laboratory technicians, researchers, research students, and former-researchers who changed career to inquire on the topics of success, integrity, and responsibilities in science. We used the Flemish biomedical landscape as a baseline to be able to grasp the views of interacting and complementary actors in a system setting. RESULTS Given the breadth of our results, we divided our findings in a two-paper series with the current paper focusing on the problems that affect the integrity and research culture. We first found that different actors have different perspectives on the problems that affect the integrity and culture of research. Problems were either linked to personalities and attitudes, or to the climates in which researchers operate. Elements that were described as essential for success (in the associate paper) were often thought to accentuate the problems of research climates by disrupting research culture and research integrity. Even though all participants agreed that current research climates need to be addressed, participants generally did not feel responsible nor capable of initiating change. Instead, respondents revealed a circle of blame and mistrust between actor groups. CONCLUSIONS Our findings resonate with recent debates, and extrapolate a few action points which might help advance the discussion. First, the research integrity debate must revisit and tackle the way in which researchers are assessed. Second, approaches to promote better science need to address the impact that research climates have on research integrity and research culture rather than to capitalize on individual researchers' compliance. Finally, inter-actor dialogues and shared decision making must be given priority to ensure that the perspectives of the full research system are captured. Understanding the relations and interdependency between these perspectives is key to be able to address the problems of science. STUDY REGISTRATION https://osf.io/33v3m.
Collapse
Affiliation(s)
- Noémie Aubert Bonn
- Research Group of Healthcare and Ethics, Faculty of Medicine and Life Sciences, Hasselt University, Martelarenlaan 42, 3500, Hasselt, Belgium.
| | - Wim Pinxten
- Research Group of Healthcare and Ethics, Faculty of Medicine and Life Sciences, Hasselt University, Martelarenlaan 42, 3500, Hasselt, Belgium
| |
Collapse
|
48
|
Systemic Explanations of Scientific Misconduct: Provoked by Spectacular Cases of Norm Violation? JOURNAL OF ACADEMIC ETHICS 2021. [DOI: 10.1007/s10805-020-09389-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
AbstractIn the past two decades, individual explanations of scientific misconduct (‘bad apples’) have increasingly given way to systemic explanations (‘bad systems’). Where did this interest in systemic factors (publication pressure, competition for research funding) come from? Given that research ethicists often present their interventions as responses to scientific misconduct, this article tests the hypothesis that these systemic explanations were triggered by high-visibility cases of scientific norm violation. It does so by examining why Dutch scientists in 2011 explained Diederik Stapel’s grand-scale data fabrication largely in systemic terms, whereas only fifteen years earlier, in the René Diekstra affair (1996), such explanations had been close to absent. Drawing on a wealth of historical sources, the article suggests that cases like Stapel’s as such do not explain why early 21st-century commentators exchanged individual explanations for systemic ones. Only against the background of an existing discourse of criticism of the science system, developed in the 1990s and 2000s in response to rapidly increasing competition for research funding, could the Stapel affair achieve notoriety as an example of how systemic factors provoke bad conduct.
Collapse
|
49
|
Paruzel-Czachura M, Baran L, Spendel Z. Publish or be ethical? Publishing pressure and scientific misconduct in research. RESEARCH ETHICS 2020. [DOI: 10.1177/1747016120980562] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
The paper reports two studies exploring the relationship between scholars’ self-reported publication pressure and their self-reported scientific misconduct in research. In Study 1 the participants ( N = 423) were scholars representing various disciplines from one big university in Poland. In Study 2 the participants ( N = 31) were exclusively members of the management, such as dean, director, etc. from the same university. In Study 1 the most common reported form of scientific misconduct was honorary authorship. The majority of researchers (71%) reported that they had not violated ethical standards in the past; 3% admitted to scientific misconduct; 51% reported being were aware of colleagues’ scientific misconduct. A small positive correlation between perceived publication pressure and intention to engage in scientific misconduct in the future was found. In Study 2 more than half of the management (52%) reported being aware of researchers’ dishonest practices, the most frequent one of these being honorary authorship. As many as 71% of the participants report observing publication pressure in their subordinates. The primary conclusions are: (1) most scholars are convinced of their morality and predict that they will behave morally in the future; (2) scientific misconduct, particularly minor offenses such as honorary authorship, is frequently observed both by researchers (particularly in their colleagues) and by their managers; (3) researchers experiencing publication pressure report a willingness to engage in scientific misconduct in the future.
Collapse
Affiliation(s)
| | - Lidia Baran
- Institue of Psychology, University of Silesia in Katowice, Poland
| | - Zbigniew Spendel
- Institue of Psychology, University of Silesia in Katowice, Poland
| |
Collapse
|
50
|
Urlings MJE, Duyx B, Swaen GMH, Bouter LM, Zeegers MP. Citation bias and other determinants of citation in biomedical research: findings from six citation networks. J Clin Epidemiol 2020; 132:71-78. [PMID: 33278612 DOI: 10.1016/j.jclinepi.2020.11.019] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Revised: 10/05/2020] [Accepted: 11/02/2020] [Indexed: 01/11/2023]
Abstract
OBJECTIVES When the probability of being cited depends on the outcome of that study, this is called citation bias. The aim of this study is to assess the determinants of citation and how these compare across six different biomedical research fields. STUDY DESIGN AND SETTING Citation network analyses were performed for six biomedical research questions. After identifying all relevant publications, all potential citations were mapped together with the actually performed citations in each network. As determinants of citation we assessed the following: study outcome, study design, sample size, journal impact factor, gender, affiliation, authority and continent of the corresponding author, funding source, title of the publication, number of references, and self-citation. Random effect logistic regression analysis was used to assess these factors. RESULTS Four out of six networks showed evidence for citation bias. Self-citation, authority of the author, and journal impact factor were also positively associated with the probability of citation in all networks. CONCLUSION The probability of being cited seems associated with positive study outcomes, the authority of its authors, and the journal in which that article is published. In addition, each network showed specific characteristics that impact the citation dynamics and that need to be considered when performing and interpreting citation analyses.
Collapse
Affiliation(s)
- Miriam J E Urlings
- Department of Genetics and Cell Biology, Nutrition and Translational Research in Metabolism (School NUTRIM), Maastricht University, Maastricht, The Netherlands.
| | - Bram Duyx
- Department of Genetics and Cell Biology, Nutrition and Translational Research in Metabolism (School NUTRIM), Maastricht University, Maastricht, The Netherlands
| | - Gerard M H Swaen
- Department of Genetics and Cell Biology, Nutrition and Translational Research in Metabolism (School NUTRIM), Maastricht University, Maastricht, The Netherlands
| | - Lex M Bouter
- Department of Epidemiology and Data Science, Amsterdam University Medical Centers, Amsterdam, The Netherlands; Department of Philosophy, Faculty of Humanities, Vrije Universiteit, Amsterdam, The Netherlands
| | - Maurice P Zeegers
- Department of Genetics and Cell Biology, Nutrition and Translational Research in Metabolism (School NUTRIM), Maastricht University, Maastricht, The Netherlands; Department of Genetics and Cell Biology, Care and Public Health Research Institute (School CAPHRI), Maastricht University, Maastricht, The Netherlands
| |
Collapse
|