Evaluated works

Research Articles

  • Article

    Minhyuk Park, Haotian Yi, Tandy Warnow, George Chacko

    Preprint of a manuscript developed by Park, M; Yi, H; Warnow, T; and Chacko, G concerning very large scale simulations of the growth of citation networks using an agent based modeling approach. A document containing supplemental material accompanies the manuscript. The manuscript contains a link to a public Github repository where the code generated for this project is available. Data generated during this project is being made available via the Illinois Data Bank under repository IDB-9265079.

    March 26, 2026

  • Article

    Alex O. Holcombe et al.

    Contributorship refers to indicating who did what in a project, going beyond a simple list of authors. In scholarly journal articles about a project, the Contributor Roles Taxonomy (CRediT) has become a popular way to provide individual contribution information, often with accompanying machine-readable metadata. While CRediT is used by hundreds of scientific journals, the official version of CRediT exists only in English. To support scientific publishers and researchers writing in other languages, we have created translations of the fourteen CRediT roles and their descriptions into thirty-six languages. To ensure high quality, at least one speaker fluent in the target language drafted the translation, with additional involvement of a second fluent person. Because hundreds of scientific journals publish non-English work, the use of our translations could improve the recognition of the associated researchers’ contributions. We have contacted relevant publishers and academic organizations to make them more aware of CRediT, of our translations, and of contributorship generally. To conclude, we discuss the potential for CRediT and other ontologies to be applied more broadly, for example to facilitate greater recognition of people who are not co-authors but are named in Acknowledgments sections.

    March 24, 2026

  • Article

    Carter W. Bloch, Rikke E. Povlsen, Mette Falkenberg, Irene Ramos-Vielba, Duncan A. Thomas,b, Andreas K. Stage

    Drawing on two in-depth cases of research projects that have received societally targeted funding and appear to have involved highly intensive academic/non-academic engagements, this study examines processes leading from research funding towards societal outcomes. We trace causal linkages from the specific research funding to the societally relevant outcomes of the research they fund. Using process-tracing, we aim to explore how societally targeted funding and its specific characteristics can be linked to societal outcomes, with particular focus on collaboration/productive interactions. Through interviews and document analysis, we trace how the funding shaped the research projects and how research was conducted, and subsequently how the project design promoted the development of societally relevant research results.

    March 23, 2026

  • Article

    Dmitry Kochetkov

    The integration of generative artificial intelligence (GenAI) and large language models (LLMs) into scientific research and higher education presents a paradigm shift, offering revolutionizing opportunities while simultaneously raising profound ethical, legal, and regulatory questions. This study examines the complex intersection of AI and science, with a specific focus on the challenges posed to copyright law and the principles of open science. The author argues that current regulatory frameworks in key jurisdictions like the United States, China, the European Union, and the United Kingdom, while aiming to foster innovation, contain significant gaps, particularly concerning the use of copyrighted works and open science outputs for AI training. Widely adopted licensing mechanisms, such as Creative Commons, fail to adequately address the nuances of AI training, and the pervasive lack of attribution within AI systems fundamentally challenges established notions of originality. While current doctrine treats AI training as potentially fair use, this paper argues such mechanisms are inadequate and that copyright holders should retain explicit opt-out rights regardless of fair use doctrine. Instead, the author advocates for upholding authors' rights to refuse the use of their works for AI training and proposes that universities assume a leading role in shaping responsible AI governance. The conclusion is that a harmonized international legislative effort is urgently needed to ensure transparency, protect intellectual property, and prevent the emergence of an oligopolistic market structure that could prioritize commercial profit over scientific integrity and equitable knowledge production. This is a substantially expanded and revised version of a work originally presented at the 20th International Conference on Scientometrics & Informetrics (Kochetkov, 2025).

    March 12, 2026

  • Article

    Cristina I. Font-Julián, Enrique Orduna-Malea, Carlos Lopezosa, Isidro Aguillo

    Search engines play a crucial role in discovering and disseminating academic work, making academic search engine optimisation (A-SEO) vital for enhancing research visibility. Consequently, the collection of robust A-SEO data is essential. This study compares four leading SEO tools—Ahrefs, Semrush, Serpstat, and Ubersuggest—to evaluate their performance in measuring the organic traffic of gold open access academic publishers, using MDPI and Frontiers as case studies. The findings reveal significant discrepancies in the web traffic metrics reported by each platform, likely attributable to their diverse and often opaque traffic estimation methodologies. These differences may lead to divergent interpretations, thereby limiting the replicability and reproducibility of studies, and hindering the development of standardised web traffic indicators. This study highlights the need for greater methodological rigour and standardisation in academic SEO research, offering both theoretical insights and practical guidance to improve the online visibility of research within a platform-driven scholarly ecosystem.

    March 11, 2026

  • Article

    Narmin Rzayeva, Stephen Pinfield, Ludo Waltman

    Preprinting has become an increasingly important component of the scholarly communication system, facilitating rapid open dissemination of scientific knowledge. This study investigates the adoption of preprinting over time, focusing on how it varies across scientific disciplines and geographical regions. We analyzed bibliometric data on 4M preprints and 105M peer-reviewed outputs in the period 1991-2023. Peer-reviewed outputs were linked to preprints using data from Dimensions, OpenAlex, and Crossref, resulting in 2.2M peer-reviewed outputs linked to a preprint. Our findings indicate a strong growth in preprinting, with a nearly threefold increase in the number of preprints published between 2017 and 2022. The adoption of preprinting is highest in the physical and mathematical sciences, particularly among researchers in the Americas and Europe. In recent years, preprinting has also increased notably in the information and computing sciences and the life and medical sciences, driven primarily by researchers in North America and Western and Northern Europe. Preprinting remains relatively uncommon in the humanities and the social and behavioral sciences. Asia demonstrates low preprint adoption, with Eastern Asia showing a modest increase in recent years. Preprint adoption in specific disciplines varies significantly across regions, showing that preprint adoption is shaped by the interplay between disciplines and regions.

    March 9, 2026

  • Article

    Adrian Barnett, Nicole White, Taya Collyer

    Currently, much medical research is wasted due to inappropriate study design or analysis. Qualified statisticians are essential for ensuring ideal study design and analysis, and the ethical review process is an ideal stage for their input. We estimated the percentage of Australian ethics committees with access to a qualified statistician. Sixty percent of committees reported access to a qualified statistician, either as a full committee member or as a non-member who could be consulted when needed; however, when accounting for statistical qualifications this dropped to 35%. Many committees rely on “highly numerate” researchers in place of qualified statisticians, as they viewed research experience and advanced statistical training as equivalent. Many committees felt that improving study designs was not part of their remit. Some committee chairs viewed formal statistical input as essential; however, there was also a common belief that statistical review was only applicable to some study designs and that “simple” studies did not need review. There was a surprising variance in practice and attitudes towards the involvement of statisticians on research ethics committees. The high number of research studies that receive approval without statistical review risks approving studies that could cause harm due to flawed evidence.

    March 4, 2026

  • Article

    Tom Hardwicke

    Bartoš et al. propose a new article format — Synchronous Robustness Reports (SRRs) — in which journals invite researchers to conduct alternative analyses of recently accepted studies. The goal is to assess the robustness of the original results by exploring how they vary across different analysis choices. However, the proposal does not distinguish between SRRs planned before versus after analysts have seen the data. This distinction is crucial because data-dependent analyses introduce a risk of bias from selective reporting. In this commentary, I argue that without safeguards, SRRs could inadvertently create more confusion than clarity about robustness.

    March 4, 2026

  • Article

    Steffen Lemke, Isabella Peters

    Bronze OA is an under-researched facet of open access (OA) surrounded by many uncertainties regarding its causes and their individual significance. This study aims to reduce these uncertainties by providing an overview over the state of Bronze OA within Web of Science, and by investigating relationships between research fields, publishers, and their rates of Bronze OA. We analyze 3,943,511 Bronze OA publications registered in Web of Science since 2000, applying statistical analyses and heat maps. Our results show high occurrences of Bronze OA in biologic and medical fields, while arts & humanities, engineering sciences, physics, and chemistry comprise the lower end of the spectrum. Regarding publishers, large university presses and the BMJ Group stand out as heavy users of Bronze OA. Continuations of this study will semi-manually investigate article pages of Bronze OA publications to provide empirical evidence for the significance of different speculated reasons for the Bronze OA label.

    February 25, 2026

  • Article

    Hélène Draux, Briony Fane, Daniel W. Hook, Juergen Wastl, Philip Lewis, Molly Morgan Jones, Pablo Roblero, James R. Wilsdon

    The UK has a long-established reputation for excellence in research across a broad range of fields, but in recent years, there has been greater emphasis on STEM investment and greater recognition of the UK's success in STEM. This paper examines the relative strengths of SHAPE disciplines and demonstrates that the UK's SHAPE research portfolio outperforms the UK's STEM research, for each international benchmark considered in this work. It is argued that SHAPE research is becoming increasingly important as a partner to STEM as the widespread use of technology creates societal challenges. It is also argued that the strength of UK SHAPE is the basis of a strategic advantage for UK research.

    February 24, 2026