The effects of citation-based research evaluation schemes on self-citation behavior

A global exploratory comparison of country self-citations 1996-2019

Self-citations are a key topic in evaluative bibliometrics because they can artificially inflate citation-related performance indicators. Recently, self-citations defined at the largest scale, i.e., country self-citations, have started to attract the attention of researchers and policymakers. According to a recent research, in fact, the anomalous trends in the country self-citation rates of some countries, such as Italy, have been induced by the distorting effect of citation metrics-centered science policies. In the present study, we investigate the trends of country self-citations in 50 countries over the world in the period 1996-2019 using Scopus data. Results show that for most countries country self-citations have decreased over time. 12 countries (Colombia, Egypt, Indonesia, Iran, Italy, Malaysia, Pakistan, Romania, Russian Federation, Saudi Arabia, Thailand, and Ukraine), however, exhibit different behavior, with anomalous trends of self-citations. We argue that these anomalies should be attributed to the aggressive science policies adopted by these countries in recent years, which are all characterized by direct or indirect incentives for citations. Our analysis confirms that when bibliometric indicators are integrated into systems of incentives, they are capable of affecting rapidly and visibly the citation behavior of entire countries.

In health research publications, the number of authors is strongly associated with collective self-citations but less so with citations by others

OBJECTIVE

. This study investigated the associations between the number of authors and collective self-citations versus citations by others.

STUDY DESIGN AND SETTING

. We analyzed 88,594 health science articles published in 2015 and citations they received until 2020. The main variables were the number of authors, the number of citations by co-authors (collective self-citations), and the number of citations by others.

RESULTS

. The number of authors correlated more strongly with the number of citations by co-authors than with citations by others (Spearman r 0.31 vs. 0.23; mutually adjusted r 0.26 vs. 0.12). The percentage of self-citations among all citations was 10.6% for single-authored articles, and increased gradually with the number of authors to 34.8% for ≥ 50 authors. Collective self-citations increased the proportion of articles reaching or exceeding 30 total citations by 0.7% for single-authored articles, but by 11.6% for articles written by ≥ 50 authors.

CONCLUSIONS

. If citations by others reflect scientific utility, then another mechanism must explain the excess of collective self-citations observed for multi-authored articles. The results support the hypothesis that the authors' own motivations explain this excess. The evaluation of scientific utility should also be based on citations by others, excluding collective self-citations.

Citation behavior, audience awareness, and identity construction in Arabic and EFL research

Citations are an integral component of writer-reader dialogic interaction in academic discourse. One under-researched question concerns the role of audience as a contextual factor that impacts writers' citation choices and the nature of the identity and disciplinary knowledge that they construct. The present study adopts a discourse analytic, case-study research design. First, it aims to investigate the citation behavior in five Arabic education research articles. Second, it examines whether the writers of these papers would modify their intertextual style to enact different identity and disciplinary community when writing in English as a foreign language (EFL). Findings revealed a unique character for the Arabic-based citation behavior that contrasted, sometimes, markedly with conventional academic norms, indicating the pivotal role that culture plays in shaping rhetorical preferences. Arabic-based tendencies involved predominance of integral citations, use of combined citations and non-citations, and reliance on what is herein termed intertextual saturation and diffused intertextuality as rhetorical strategies to contract dialogic space and persuade audience. The findings also showed marginal modification of intertextual style in the EFL texts. This suggests lack of significant orientation toward target audiences' characteristics that would have resulted from enculturation into disciplinary community. The findings imply the need to introduce novice writers to the concept of audience if they are to produce academic discourse that is interpersonally optimal from the perspective of the international discourse community.

Implications of Publication Requirements for the Research Output of Ukrainian Academics in Scopus in 1999–2019

Purpose

This article explores the implications of publication requirements for the research output of Ukrainian academics in Scopus in 1999–2019. As such it contributes to the existing body of knowledge on quantitative and qualitative effects of research evaluation policies.

Design/methodology/approach

Three metrics were chosen to analyse the implications of publication requirements for the quality of research output: publications in predatory journals, publications in local journals and publications per SNIP quartile from the disciplinary perspective.

Findings

Study results highlight, that, firstly, publications of Ukrainian authors in predatory journals rose to 1% in 2019. Secondly, the share of publications in local journals reached the peak of 47.3% in 2015. In 2019 it fell to 31.8%. Thirdly, though the total number of publications has risen dramatically since 2011, but the share of Q3+Q4 has exceeded the share of Q1+Q2. To summarise, the study findings highligh, that research evaluation policies are required to contain not only quantitative but also qualitative criteria.

Research limitation

The study does not explore in detail the effects of a particular type of publication requirements.

Practical implications

The findings of the study have practical implications for policymakers and university managers aimed to develop research evaluation policies.

Originality/value

This paper gains insights into the effects of publication requirements on the research output of Ukrainian academics in Scopus.