Published at MetaROR
November 25, 2024
Table of contents
The rise and fall of the initial era
1 Digital Science
Originally published on May 8, 2024 at:
Editors
Ludo Waltman
Ludo Waltman
Editorial assessment
by Ludo Waltman
This article presents a large-scale data-driven analysis of the use of initials versus full first names in the author lists of scientific publications, focusing on changes over time in the use of initials. The article has been reviewed by three reviewers. The originality of the research and the large-scale data analysis are considered strengths of the article. A weakness is the clarity, readability, and focus of certain parts of the article, in particular the introduction and background sections. In addition, the reviewers point out that the discussion section can be improved and deepened. The reviewers also suggest opportunities for strengthening or extending the article. This includes adding case studies, extending the comparative analysis, and providing more in-depth analyses of changes over time in policies, technologies, and data sources. Finally, while reviewer 3 is critical about the gender analysis, reviewer 2 considers this analysis to be a strength of the article.
Peer review 1
The presented preprint is a well-researched study on a relevant topic that could be of interest to a broad audience. The study’s strengths include a well-structured and clearly presented methodology. The code and data used in the research are openly available on Figshare, in line with best practices for transparency. Furthermore, the findings are presented in a clear and organized manner, with visualization that aid understanding.
At the same time, I would like to draw your attention to a few points that could potentially improve the work.
- I think it would be beneficial to expand the annotation to approximately 250 words.
- The introduction starts with a very broad context, but the connection between this context and the object of the research is not immediately clear. There are few references in this section, making it difficult to determine whether the authors are citing others or their own findings.
- The transition to the main topic of the study is not well-defined, and there is no description of the gap in the literature regarding the object of study. Additionally, “bibliometric archaeology” appears at the end of the introduction but is only mentioned again later in the discussion, which may cause confusion for the reader.
- It would be helpful to clearly state the purpose and objectives of the study both in the Introduction and in the abstract as well.
- Besides, it is important to elaborate on the contribution of this study in the introduction section.
- The same applies to the background – a very broad context, but the connection with the object of the research is not entirely clear.
- Page 4 – as far as I understand, these are conclusions from a literature review, while point 3 (Reflective Richness of Data) does not follow from the previous analysis.
- The overall impression of the introduction and background is that it is an interesting text, but it is not well related to the objectives of the study. I would recommend shortening these sections by making the introduction and literature review more pragmatic and structured. At the same time, this text could be published as a standalone contribution.
- As I mentioned above, the methodology refers to the strengths of the study. However, in this section, it would be helpful to introduce and justify the structure of presenting the results.
- In the methodology section, the authors could also provide a footnote with a link to the code and dataset (currently, it is only given at the end).
- With regard to the discussion, I would like to encourage the authors to place their results more clearly in the academic context. Ideally, references from the introduction and/or literature review would reappear in this section to help clarify the research contribution.
- Although Discussion C is an interesting read, it seems more related to the introduction than the results. Again, the text itself is rather interesting, but it would benefit from a more thorough justification.
Remarks on the images:
- At least the data source for the images should be specified in the background, because it is not obvious to the reader before describing the methodology.
- The color distinction between China and Russia in Figure 8 is not very clear.
- The gray lines in Figures 9-11 make the figures difficult to read. Additionally, the meaning of these lines is not clearly indicated in the legends of Figures 10 and 11. These issues should be addressed.
All comments and suggestions are intended to improve the article. Overall, I have a very positive impression of the work.
Sincere,
Dmitry Kochetkov
Peer review 2
Overview
This manuscript provides an in-depth examination of the use of initials versus full names in academic publications over time, identifying what the authors term the “Initial Era” (1945-1980) as a period during which initials were predominantly used. The authors contextualize this within broader technological, cultural, and societal changes, leveraging a large dataset from the Dimensions database. This study contributes to the understanding of how bibliographic metadata reflects shifts in research culture.
Strengths
+ Novel concept and historical depth
The paper introduces a unique angle on the evolution of scholarly communication by focusing on the use of initials in author names. The concept of the “Initial Era” is original and well- defined, adding a historical dimension to the study of metadata that is often overlooked. The manuscript provides a compelling narrative that connects technological changes with shifts in academic culture.
+ Comprehensive dataset
The use of the Dimensions database, which includes over 144 million publications, lends significant weight to the findings. The authors effectively utilize this resource to provide both anecdotal and statistical analyses, giving the paper a broad scope. The differentiation between the anecdotal and statistical epochs helps clarify the limitations of the dataset and strengthens the authors’ conclusions.
+ Cross-disciplinary relevance
The study’s insights into the sociology of research, particularly the implications of name usage for gender and cultural representation, are highly relevant across multiple disciplines. The paper touches on issues of diversity, bias, and the visibility of researchers from different backgrounds, making it an important contribution to ongoing discussions about equity in academia.
+ Technological impact
The authors successfully connect the decline of the “Initial Era” to the rise of digital publishing technologies, such as Crossref, PubMed, and ORCID. This link between technological infrastructure and shifts in scholarly norms is a critical insight, showing how the adoption of new tools has real-world implications for academic practices.
Weaknesses
– Lack of clarity and readability
While the manuscript is rich in data and analysis, it can be dense and challenging to follow for readers not familiar with the technical details of bibliometric studies. The text occasionally delves into highly specific discussions that may be difficult for a broader audience to grasp while other concepts are introduced in cursory. Consider condensing the introduction section, removing unrelated historical accounts, and leading the audience to the key objectives of this research much earlier.
– Missing empirical case studies
The manuscript remains largely theoretical, relying heavily on data analysis without providing concrete case studies or empirical examples of how the “Initial Era” affected individual disciplines or researchers. A more detailed exploration of specific instances where the use of initials had significant consequences would make the findings more tangible. Incorporating case studies or anecdotes from the history of science that illustrate the real-world impacts of the trends identified in the data would enrich the paper. These examples could help ground the analysis in practical outcomes and demonstrate the relevance of the “Initial Era” to contemporary debates.
– Half-baked comparative analysis
Although the paper presents interesting data about different countries and disciplines, the comparative analysis between these groups could be further developed. For example, the reasons behind the differences in initial use between countries with different writing systems or academic cultures are not fully explored. A more in-depth comparative analysis that explains the cultural, linguistic, or institutional factors driving the observed differences in initial use would add nuance to the findings. This could involve a more detailed discussion of how non-Roman writing systems influence name formatting or how specific national academic policies shape author metadata.
– Limited discussion of alternative explanations
While the authors link the decline of the “Initial Era” to technological advancements, other potential explanations, such as changing editorial policies (“technological harmonisation”), shifts in academic prestige, or the influence of global collaboration, are not fully explored. The paper could benefit from a broader discussion of these factors. Expanding the discussion to include alternative explanations for the decline of initial use, and how these might interact with technological changes, would provide a more comprehensive view. Engaging with literature on academic publishing practices, editorial decisions, and global research trends could help contextualize the findings within a wider framework.
Conclusion
This manuscript offers a novel and insightful analysis of the evolution of name usage in academic publications, providing valuable contributions to the fields of bibliometrics, science studies, and research culture. With improvements in clarity, comparative analysis, and the incorporation of case studies, this paper has the potential to make a significant impact on our understanding of how metadata reflects broader societal and technological changes in academia. The authors are encouraged to refine their discussion and expand on the implications of their findings to make the manuscript more accessible and applicable to a wider audience.
Peer review 3
Anonymous reviewer
I started reading this paper with great interest, which flagged over time. As someone with extensive experience both publishing peer-reviewed research articles and working with publication data (Web of Science, Scopus, PubMed, PubMedCentral) I understand there are vagaries in the data because of how and when it was collected, and when certain policies and processes were implemented. For example, as an author starting in the late 1980s, we were instructed by the journal “guide to authors” to use only initials. My early papers were all only using initials. This changed in the mid-late 1990s. Another example, when working with NIH publications data, one knows dates like 1946 (how far back MedLine data go), 1996 (when PubMed was launched), and 2000 (when PubMedCentral was launched) and 2008 (when NIH Open Access policy enacted). There are also intermediate dates for changes in curation policy…. that underlie a transition from initials to full name in the biomedical literature.
I realize that the study covers all research disciplines, but still I am surprised that the authors of this paper don’t start with an examination of the policies underlying publications data, and only get to this at the end of a fairly torturous study.
As a reader, this reviewer felt pulled all over the place in this article and increasingly frustrated that this is a paper that explores the Dimensions database vagaries only and not really the core overall challenges of bibliometric data, irrespective of data source. Dimensions ingests data from multiple sources — so any analysis of its contents needs to examine those sources first.
A few specific comments:
-
The “history of science” portion of the paper focuses on English learned societies in the 17th century. There were many other learned societies across Europe, and also “papers” (books, treatises) from long before the 17th century in Middle-eastern and Asian countries (e.g, see history of mathematics, engineering, governance and policy, etc.). These other histories were not acknowledged by the authors. Research didn’t just spring full-formed out of Zeus’ head.
-
It is unclear throughout if the authors are referring to science, research, which disciplines are or are not included. The first chart on discipinary coverage is Fig 13 and goes back to 1940ish. Also, which languages are included in the analysis? For example, Figure 2 says “academic output” but from which academies? What countries? What languages? Disciplines? Also, in Figure 2, this reviewer would have like to see discussion about the variability in the noisiness of the data over time.
-
The inclusion of gender in the paper misses the mark for this reviewer. When dealing with initials, how can one identify gender? And when working in times/societies where women had to hide their identity to be published…. how can a name-based analysis of gender be applied? If this paper remains a study of the “initial era”, this reviewer recommends removing the gender analysis.
-
Reference needed for “It is just as important to see ourselves reflected in the outputs of the research careers…” (section B).
-
Reference needed for “This period marked the emergence of “Big Science” (Section B). How do we know this is Big Science? What is the relationship with the nature of science careers? Here it would be useful perhaps to mention that postdocs were virtually unheard of before Sputnik.
-
Fig 3. This would be more effective as a % total papers than absolute #.
-
Gradual Evolution of the Scholarly Record. This reviewer would like to see proportion of papers without authors. A lot of history of science research is available for this period, and a few references here would be welcome, as well as a by-country analysis (or acknowledgement that the data are largely from Europe and/or English-speaking countries).
-
Accelerated Changes in Recent Times. Again, this reviewer would like to see reference to scholarship on the history of science. One of the things happening in the post WW2 timeframe is the increase in government spending (in the US particularly) on R&D and academic research. So, is the academy changing or is it responding to “market forces”.
-
Reflective richness of data. “Evolution of the research community” is not described in the text, not is collaborative networks.
-
In the following paragraph, one could argue that evaluation was a driver of change, not a response to it. This reviewer would like to see references here.
-
II. Methodology. (i) 2nd sentence missing “to” “… and full form to refer to an author name…”. (ii) 2nd para the authors talk about epochs, but the data could be (are) discontinuous because of (a) curation policy, (b) curation technology, (c) data sources (e.g., Medline rolled out in the 1960s and back-populated to 1946). (iii) 4th para referes to Figs 3 and 4 showing a marked change between 1940 and 1950, but Fig 3 goes back only to 1960, and Fig 4 is so compressed it is hard to see anything in that time range. (iv) Para 7. “the active publishing community is a reasonable proxy for the global research population”. We need a reference here and more analysis. Is this Europe? English language? Which disciplines? All academia? Dimensions data? (v) Para 12 “In exploring the issue of gender…” see comments above. Gender is an important consideration but is out of scope, in this reviewer’s opinion, for this paper focused on use of initials vs. full name.
-
Listing 1. Is there a resolvable URL/DOI for this query?
-
Figs 9-11, 14, 15. This reviewer would like to see a more fulsome examination / discussion of data discontinuities. Particularly around ~1985-2000.
Discussion
-
The country-level discussion suggests the data (publications included) are only those that have been translated into English. Please clarify. Also, please add references in this section. There are a lot of bold statements, such as “A characteristic of these countries was the establishment of strong national academies.” Is this different from other places in the world? How? In the para before this statement, there is a phrase “picking out Slavonic stages” that is not clear to this reviewer.
-
The authors seem to get ahead of themselves talking about “formal” and “informal” in relation to whether initials or full names are used. And then discuss the “Power Distance” and end up arguing that it isn’t formal/informal … but rather publisher policies and curation practices driving the initial era and its end.
-
And then the authors come full circle on research articles being a technology, akin to a contract. Which is neat and useful. But all the intermediate data analysis is focused on the Dimensions data base and this reviewer would argue should be a part of the database documentation rather than a scholarly article.
-
This reviewer would prefer this paper be focused much more tightly on how publishing technology can and has driven the sociology of science. Dig more into the E. Journal Analysis and F. Technological analysis. Stick with what you have deep data for, and provide us readers with a practical and useful paper that maybe, just maybe, publishers will read and be incentivized to up their game with respect to adoption of “new” technologies like ORCID, DOIs for data, etc. Because these papers are not just expositions on a disciplinary discourse, they are also a window into how science (research) works and is done.
Author response
Dear Editor,
Thank you for the editorial assessment of our manuscript “The Rise and Fall of the Initial Era,” and for arranging three substantive peer reviews. We are grateful to all three reviewers for their careful engagement with the paper. We submit a revised manuscript and detailed responses to each reviewer alongside this letter.
We have given particular attention to the three weaknesses identified in your editorial assessment: the clarity, readability, and focus of the introduction and background sections; the depth of the discussion; and the treatment of changes over time in policies, technologies, and data sources. Where reviewer comments point to issues of substance — including all three of these areas — we have engaged in detail and revised the manuscript accordingly. Where comments concern the paper’s underlying scope, framing, or argumentative structure, we have explained our reasoning for retaining the chosen approach while addressing the substantive concerns within it.
The principal revisions are the following.
Introduction and background (clarity, readability, focus). We have restructured the abstract to make the paper’s purpose, contribution, and findings explicit, while keeping its length essentially unchanged. We have added a new closing paragraph to the introduction that articulates a threefold contribution: identification of the Initial Era, multi-layered analysis of its rise and fall, and use of the era as a case study in bibliometric archaeology. The latter concept — which Reviewer 1 rightly noted appeared in the introduction and discussion without connection — has been promoted to a framing thread that runs from the abstract through to the discussion. We have reordered the three “key insights” in Section I.B so that they frame the analysis to come rather than appearing to be drawn from the preceding historical material, addressing Reviewer 1’s specific concern that the third insight did not follow from what preceded it. We have also added a paragraph in Section I.A acknowledging the Eurocentric framing of the historical material and explaining why the seventeenth-century European tradition is the appropriate frame for this paper given its unit of study.
Discussion section (depth and academic context). We have added a new subsection (IV.C, “Alternative drivers and their interaction with technology”) that treats editorial policy, academic prestige economics, and globalisation as candidate explanations alongside the technological account, and have revised the opening of IV.B so that the three factors we ultimately propose are presented as the most plausible synthesis among multiple candidates rather than as the unique explanation. Reviewer 2’s comment on alternative explanations was particularly valuable in shaping this revision.
Policies, technologies, and data sources over time. Reviewer 3’s central substantive concern — that the paper treats Dimensions as a transparent window onto the scholarly record rather than as a layered artefact — was well-taken and is reinforced by the editorial assessment. We have added a new methodology subsection (II.A, “The layered provenance of bibliographic data”) that traces the policy and technology timeline of the major data sources Dimensions ingests, including the dates that create coverage and metadata discontinuities. The new subsection explicitly signposts Section III.F (Technological Analysis) as the place where the paper engages with these effects analytically, and the discussion subsection IV.D (formerly IV.C, on bibliometric archaeology) returns to the methodological implications.
Gender analysis. We note that the reviewers disagreed on this section, with Reviewer 2 considering it a strength and Reviewer 3 recommending its removal. With the editorial assessment leaving the question open, and given that we believe Reviewer 3’s critique points to a real weakness in our framing rather than to an irreducible flaw in the analysis, we have substantially strengthened the framing and methodological caveats of Section III.G rather than removing it. The section is now explicitly framed as an analysis of gender visibility in the scholarly metadata rather than of gender participation in research, and we have articulated the natural-experiment logic of the 2002 PubMed metadata transition more carefully. We have named the Lockhart et al. critique of name-to-gender attribution methods explicitly and acknowledged its implications for our work.
New references. We have added four references to address specific gaps identified by the reviewers: Weinberg (1961) and de Solla Price (1963) for the “Big Science” claim; Stephan (2012) for the post-war restructuring of research careers, including the post-Sputnik R&D context; and Hofstra et al. (2020) for the diversity-and-research-output claim. A footnote refers readers to the Wilsdon Review of metric-driven evaluation in the new alternative-drivers subsection.
Items we have considered and declined. For transparency, we note the reviewer suggestions we have considered carefully and ultimately declined, with reasons given in the individual responses: removal of the gender analysis (Reviewer 3); presentation of Figure 3 as a percentage rather than absolute counts (Reviewer 3); revision of the colour palette in Figure 8 (Reviewer 1, on accessibility grounds); addition of further case studies beyond the three journal-level cases already in Section III.E (Reviewer 2); and restructuring the paper to begin from the policy and curation history of bibliographic data (Reviewer 3). We have also retained the abstract at approximately its original length while restructuring it for clarity, rather than expanding it to 250 words as Reviewer 1 suggested.
The net length increase from these revisions is approximately 800 words. We have tried to ensure that the additions strengthen the paper’s central argument rather than diluting it.
We are grateful for the rigour of the review process and for the constructive nature of all three reviews.
With best regards,
Simon J Porter and Daniel W Hook
Response to Reviewer 1 (Dmitry Kochetkov)
We thank Dr Kochetkov for a careful, constructive review and for the positive overall assessment. We have addressed each of his points below. References to numbered changes (e.g. “Change 7”) refer to the consolidated change list at the end of this document.
R1.1 — Expand the abstract to approximately 250 words. We have restructured the abstract to make purpose, contribution, and findings explicit, but have kept the length essentially unchanged. We agree with the reviewer that the original abstract did not convey the paper’s contribution clearly, but we judge that the issue was structural rather than one of length, and that a 250-word abstract risks duplicating the introduction. The revised abstract now states explicitly what the paper does, what data it uses, what is argued, and what is implied [Change 1].
R1.2 — The introduction starts with very broad context whose connection to the research object is not immediately clear; few references make it difficult to determine whether the authors are citing others or their own findings. We have added a closing paragraph to the introduction that states the paper’s purpose, objectives, and threefold contribution explicitly [Change 2]. We have also added references in two places where the reviewer (and Reviewer 3) noted that claims were unsupported: for “Big Science” we now cite Weinberg (1961) and de Solla Price (1963), and for the post-war restructuring of research careers we cite Stephan (2012) [Change 4]. For the diversity-and-research-output claim we now cite Hofstra et al. (2020) [Change 5].
R1.3 — The transition to the main topic is not well-defined, and “bibliometric archaeology” appears once in the introduction and once in the discussion without connection. We have promoted bibliometric archaeology to a more prominent framing concept. It now appears in the abstract, is named explicitly as the third element of the paper’s contribution in the new closing paragraph of the introduction, is referenced in the new methodology subsection on the layered provenance of bibliographic data, and is returned to in the Discussion. We hope the reader now experiences this as a coherent framing thread rather than two isolated mentions [Changes 1, 2, 7].
R1.4 — State the purpose and objectives clearly in both the abstract and the introduction. Addressed in Changes 1 and 2.
R1.5 — Elaborate on the contribution of the study in the introduction. The new closing paragraph of the introduction articulates a threefold contribution: identification of the Initial Era, multi-layered analysis of its rise and fall, and use of the era as a case study in bibliometric archaeology [Change 2].
R1.6 — The same applies to the background section: broad context, weak connection. We have made two changes here. First, we have reordered the three “key insights” (Gradual Evolution, Accelerated Changes, Reflective Richness) so that they now precede rather than follow the discussion of Figs 2 and 3, framing the analysis to come rather than emerging from the historical material — this directly addresses the reviewer’s specific concern that the third insight does not follow from the preceding analysis [Change 6]. Second, we have added linking sentences and references throughout the background to connect the historical material to the research object more tightly [Changes 4, 5].
R1.7 — Page 4: the conclusions from a literature review do not all follow from previous analysis; specifically, “Reflective Richness of Data” does not. This is the same concern as R1.6 and is fully addressed by the reordering in Change 6. The three insights now frame the data presentation rather than being presented as conclusions from it.
R1.8 — Shorten the introduction and literature review; the introduction text could be a standalone contribution. We have undertaken targeted tightening of the introduction (the reordering in Change 6 and the explicit-purpose paragraph in Change 2) but have retained the substantive content. The literary parallels (Austen, Conan Doyle) and the contextual material on pseudonymity and identity that the reviewer flags as potentially extraneous serve, in our view, to motivate the central argument that name-form conventions reflect deeper questions about visibility and identity in scholarly communication — a theme the paper develops empirically. We are persuaded by the reviewer (and by the editorial assessment) that the introduction needed structural improvement; we are less persuaded that significant content cuts would strengthen the paper’s argument.
R1.9 — In the methodology, justify the structure of presenting the results. The new closing paragraph of the introduction now signposts the analytical structure (paper-level, author-level, country, discipline, journal, technology, gender), which we hope gives the reader the orientation requested [Change 2].
R1.10 — Provide a footnote with a link to the code and dataset early in the methodology. The data and code are referenced in the existing Data Availability statement, which contains a Figshare DOI providing access to all data, all code, and a complete reproduction package. We have not duplicated this in the methodology section as it would risk redundancy, but we are happy to add a forward-pointer if the editor prefers.
R1.11 — In the discussion, place results more clearly in the academic context, ideally with references from the introduction reappearing. We have substantially revised the discussion. A new subsection (IV.C, “Alternative drivers and their interaction with technology”) engages with editorial policy, prestige economics, and globalisation as alternative or complementary explanations to the technological account, with references to existing and newly-introduced literature [Change 12]. We have also restructured the opening of IV.B to acknowledge that the technological account is one perspective among several [Change 11], and have revised the gender material in IV.B to align with the strengthened framing of Section III.G [Change 13c].
R1.12 — Discussion C is interesting but seems more related to the introduction than the results; it would benefit from a more thorough justification. The new bibliometric-archaeology framing thread (R1.3 above) means that the Discussion section on the future of bibliometric archaeology — now IV.D following the insertion of IV.C — connects directly back to a concept introduced in the abstract, the introduction, and the methodology. We hope this answers the reviewer’s concern that the section was inadequately connected to the rest of the paper.
Image remarks 1 — The data source for the images should be specified in the background. The new methodology subsection on the layered provenance of bibliographic data (II.A) makes the Dimensions basis of all figures explicit early in the paper [Change 7]. We have not added the data source to each figure caption, since this would create substantial visual clutter and the source is now stated very prominently both in the background discussion and the methodology.
Image remarks 2 — The colour distinction between China and Russia in Figure 8 is not very clear. We have considered this carefully. The current colour palette has been chosen to maintain accessibility for partially-sighted readers, and we have found it difficult to improve the China/Russia distinction without compromising accessibility for other categories. We have therefore retained the current palette, but note that the reviewer’s concern is registered and we will look at this again in case we submit to a journal and need to make changes at a proof stage and a better solution presents itself.
Image remarks 3 — Grey lines in Figs 9–11 make figures difficult to read; their meaning is not indicated in the legends of Figs 10 and 11. We have updated the captions of Figs 10 and 11 to match Fig 9 in stating explicitly that the grey dotted lines represent all countries that consistently participate in more than 500 papers per year, plotted for context [Change 10].
We thank the reviewer again for the constructive engagement.
Response to Reviewer 2 (Erjia Yan)
We thank Professor Yan for a thorough and constructive review and for the positive assessment of the paper’s strengths, including the gender analysis (which we note has been the subject of disagreement between reviewers and which we discuss further below). We address each weakness in turn.
R2.1 — Lack of clarity and readability; condense the introduction, remove unrelated historical accounts, and lead the audience to key objectives earlier. We have made two structural improvements to the introduction. First, we have added a new closing paragraph that articulates the paper’s threefold contribution explicitly, so that the reader reaches a clear statement of purpose before the methodology section [Change 2]. Second, we have reordered the three “key insights” so that they frame the analysis to come rather than appearing to be drawn from the preceding historical discussion [Change 6]. We have also added a paragraph in Section I.A acknowledging the Eurocentric framing of the historical material and explaining why the seventeenth-century European tradition is the appropriate frame for this paper given its subject [Change 3]; this also helps clarify what the paper is and is not about.
We have not undertaken substantial cuts to the historical material. The literary parallels and contextual discussion of pseudonymity, while not strictly necessary to the data analysis, serve to motivate the broader argument that author-name conventions are an instrument of visibility and identity in the scholarly record. We accept the reviewer’s point about clarity — and the editorial assessment’s reinforcement of it — but in our view the issue is structural rather than one of excess content, and we have addressed it through reorganisation rather than deletion.
R2.2 — Missing empirical case studies; incorporate concrete examples or case studies from the history of science. The paper already contains case studies of three named journals — Journal of Biological Chemistry, Tetrahedron, and The BMJ — in Section III.E, where we trace the policy and platform events that drove their distinct trajectories through the Initial Era and beyond. These are concrete cases that ground the macro-pattern, and the post-1995 Journal of Biological Chemistry transition coinciding with the Highwire launch is a particularly clean instance of the technology-driven mechanism we propose. We hope that on a second reading the reviewer will recognise these as the case-study material the review calls for.
We have considered adding additional case studies — for example a named individual researcher whose contributions were obscured by initial-form publication — but have decided against doing so. The paper is already substantial in length, and the editorial assessment specifically flags clarity and focus as concerns; further extension would work against that goal. We have, however, made the connection between Section III.E and the broader argument more explicit by referencing the journal-level cases in the new alternative-drivers subsection [Change 12].
R2.3 — Half-baked comparative analysis; the reasons behind differences between countries with different writing systems or academic cultures are not fully explored. We have added a paragraph acknowledging the Eurocentric framing of the historical material, which goes some way toward addressing the writing-systems point — making explicit that what we study is the modern globalised journal article as a particular technology, with the conventions it inherited from a particular tradition [Change 3].
The deeper comparative analysis the reviewer suggests — disentangling cultural, linguistic, institutional, and policy effects on a country-by-country basis — would constitute a substantial separate study. The current paper is limited to the observation that these effects are visible in the data and that they appear, on the evidence of Fig. 12 and Section III.C, to be only weakly correlated with measures of cultural formality such as Hofstede’s Power Distance. We have taken the more cautious view that a deeper comparative analysis is beyond the scope of the present paper, and have made this explicit in the existing discussion. We are grateful to the reviewer for identifying this as a productive direction for further work.
R2.4 — Limited discussion of alternative explanations beyond technology — editorial policies, academic prestige, global collaboration are not fully explored. This is, we believe, the reviewer’s most substantive point and we have engaged with it directly. We have added a new subsection IV.C (“Alternative drivers and their interaction with technology”) that treats editorial policy and house style, academic prestige economics, and globalisation as candidate explanations alongside the technological account [Change 12]. We have also revised the opening of IV.B so that the three factors we ultimately propose (technological harmonisation, globalisation, trust) are presented as the most plausible synthesis among multiple candidates rather than as the unique explanation [Change 11]. The new IV.C material engages with the Pardo-Guerra evaluation literature already cited [22] and refers, in a footnote, to the Wilsdon Review’s critique of metric-driven evaluation.
We thank the reviewer for the encouraging conclusion and hope that the revised discussion now provides the comprehensive view requested.
Response to Reviewer 3
We thank the reviewer for a detailed and challenging review. The reviewer’s critique has prompted substantial revisions to the paper, particularly around the policy and curation history of bibliographic data, the framing of the historical material, and the methodological caveats around the gender analysis. We address each comment below.
On the overall framing. The reviewer argues that the paper should have begun with an examination of the policies underlying publications data, rather than reaching this material at the end of “a fairly torturous study.” We accept the substantive point that policy and curation history deserve more prominence, and we have responded by adding a new methodology subsection (II.A) on the layered provenance of bibliographic data, which traces the policy and technology timeline of the major data sources Dimensions ingests — including the dates the reviewer specifically cites (1946 MedLine retrospective coverage, 1996 PubMed launch, 2000 PubMedCentral, 2002 PubMed redesign) [Change 7]. The new subsection explicitly acknowledges that some of the discontinuities in our data are features of the recording systems rather than of scholarly practice itself, and it signposts Section III.F as the place where the paper engages with this distinction analytically.
We have not, however, restructured the paper so that this material is its starting point. Our reasoning is that the paper has two contributions — identifying the Initial Era as a phenomenon, and showing how it is illuminated by reading bibliographic data as a layered artefact — and beginning with the second risks losing the first. We hope the reviewer will accept that the new II.A places the policy/curation context where it belongs methodologically, and that Section III.F now has the prominence it deserves through the explicit signposting in the methodology and the new discussion subsection IV.C.
Specific comments:
R3.1 — The history-of-science portion focuses on English learned societies in the seventeenth century and ignores other scholarly traditions. This is a fair criticism and we have addressed it directly. A new paragraph in Section I.A acknowledges that scholarly traditions of substantial sophistication existed long before, and in parallel with, seventeenth-century European learned societies — in mathematics, astronomy, medicine, and other areas across the Islamic world, China, India, and elsewhere — and explains that our focus on the Philosophical Transactions and its successors reflects not a claim about the origins of scholarship but a narrower observation about the modern journal article as a specific technology with particular conventions [Change 3]. We are grateful to the reviewer for highlighting an oversight that the paper now corrects.
R3.2 — Unclear which disciplines, languages, and academies are covered; Fig 2 says “academic output” but from where? The new methodology subsection II.A discusses the data sources directly [Change 7], and we have added a sentence to the existing epoch discussion that draws attention to the standard-deviation envelope in Fig 2 as a visual indicator of the small n in the early period [Change 8]. The figure now serves as its own data-availability commentary. The paper’s scope is determined by Dimensions’ coverage and is necessarily skewed toward English-language, Western-curated sources for the earlier periods; the paper makes this explicit in the methodology section.
R3.3 — The inclusion of gender misses the mark; with initials, how can one identify gender? Recommend removing. We have engaged with this point at length. We note that Reviewer 2 considers the gender analysis to be a strength of the paper, and that the editorial assessment leaves the question open. With that in mind — and given that we believe the reviewer’s critique points to a real weakness in our framing rather than to an irreducible flaw in the analysis — we have substantially strengthened the framing and methodological caveats of the gender section rather than removing it.
The reviewer’s central concern is correct: gender cannot be inferred from initials. But this is precisely the finding the analysis is designed to illuminate, not a fatal objection to it. The gender analysis is not a measurement of gender participation in research; it is a measurement of gender visibility in the scholarly metadata. The pre-2002 initial-form convention rendered a very large fraction of authors gender-indeterminate by name; the 2002 PubMed metadata change made gender suddenly inferrable for a much larger share of the population. The relative jump sizes for female-coded and male-coded names following this metadata change cannot be a participation effect — participation does not change discontinuously in a single year — and the disproportionate steepness of the female-coded rise is therefore most plausibly read as a visibility effect: the initial-form convention was hiding women, in the metadata, more than it was hiding men. This is a structural argument at the population level and makes no claims about individual researchers.
We have rewritten the opening of Section III.G to make this framing explicit and to acknowledge the Lockhart et al. critique of name-to-gender attribution methods [Change 13a]. We have rewritten the closing paragraph of the section to articulate the natural-experiment logic of the 2002 transition explicitly [Change 13b]. We have also revised the corresponding sentence in Section IV.B to make the claim more careful — “render systematically less visible in the scholarly metadata” rather than “hide and marginalise” [Change 13c]. We hope the reviewer will agree that, with these revisions, the analysis now defends itself against the methodological objection raised.
R3.4 — Reference needed for “It is just as important to see ourselves reflected in the outputs of the research careers…” Added [Change 5]; we now cite Hofstra et al. (2020) on the diversity-innovation relationship.
R3.5 — Reference needed for “Big Science”; mention that postdocs were virtually unheard of before Sputnik. Added [Change 4]; we now cite Weinberg (1961) for the term itself, de Solla Price (1963) for the bibliometric framing, and Stephan (2012) for the postdoctoral and R&D-spending context the reviewer specifically mentions.
R3.6 — Fig 3 would be more effective as a percentage of total papers than absolute numbers. We have considered this and have decided to retain the absolute-count presentation. Our reasoning is that Fig 3’s purpose is to convey the emergence of large-collaboration science as a new phenomenon in the late 1970s — papers with 500 or 1000 co-authors — and the absolute-count presentation conveys this directly: such papers did not exist before. A percentage presentation would render these papers as small fractions of the (much larger) total publication output, obscuring the rise rather than highlighting it. We acknowledge that the reviewer’s preferred presentation would be informative for a different question and would make a useful supplementary analysis, but we believe the question Fig 3 is designed to answer is best served by the current presentation.
R3.7 — “Gradual Evolution of the Scholarly Record”: would like to see proportion of papers without authors, history-of-science references, by-country analysis or acknowledgement of geographic skew. The new Section I.A paragraph acknowledges the geographic skew of the historical material directly [Change 3]. The new methodology subsection II.A discusses the data-coverage limitations of the early period explicitly [Change 7]. A full analysis of papers without identified authors would constitute a separate paper and is beyond the scope of the present study; we note in passing that the early Philosophical Transactions figures we already report (171 of 357 articles in 1665–1669 with identifiable authors) implicitly provide the by-journal version of this for the seventeenth century.
R3.8 — “Accelerated Changes in Recent Times”: reference to scholarship on the history of science; post-WW2 increase in government R&D spending. Addressed by the new Stephan (2012) reference [Change 4], which covers the post-Sputnik R&D context the reviewer suggests, and by the new alternative-drivers subsection IV.C, which engages with the Pardo-Guerra (2022) evaluation literature [Change 12].
R3.9 — “Reflective Richness of Data”: evolution of research community and collaborative networks not described. This concern is partially addressed by the reordering of the three insights [Change 6] — they now frame what is to come, rather than appearing to summarise what has been shown. The “richness of data” point is then exemplified by the analyses that follow.
R3.10 — “Evaluation as a driver” needs references. Pardo-Guerra (2022) is already cited as reference [22]; the new subsection IV.C draws on this more explicitly [Change 12], and a footnote points to the Wilsdon Review of metric-driven evaluation.
R3.11 — Methodology specific points. (i) Missing “to” — fixed [Change 9]. (ii) Discontinuities from curation policy/technology/sources — addressed by new subsection II.A [Change 7]. (iii) Fig 3 dates — Fig 3 is restricted to 1960 onwards by deliberate choice (papers with 100+ authors do not exist before this); the marked change between 1940 and 1950 is most clearly seen in Fig 4, and we have added the variance observation noted in [Change 8] to clarify Fig 2 in the same period. (iv) “Active publishing community as proxy” — we have not added a specific reference here as the claim is qualified in the text and the limitations are explicitly acknowledged. (v) Gender out of scope — addressed at length in our response to R3.3.
R3.12 — Listing 1: is there a resolvable URL/DOI for this query? The Listing 1 query, along with all derived analyses, is available in the Figshare repository referenced in the Data Availability statement. We have not added a separate DOI for the listing alone, since it is a component of the larger reproduction package.
R3.13 — Figs 9–11, 14, 15: more fulsome examination of data discontinuities, particularly around 1985–2000. The new subsection II.A engages with the systemic discontinuities directly [Change 7]; Section III.F continues to treat the 2002 PubMed transition explicitly. The 1985–2000 period is one of multiple overlapping changes (the introduction of online publishing, journal-level policy revisions, the launch of PubMed and Crossref) and we address it through the journal-level cases in Section III.E and the technological analysis in Section III.F. A more detailed disentangling of these effects across multiple disciplines and countries is, again, a productive direction for separate work.
Discussion comments — country-level data appear to be only English; references missing; “strong national academies” undefended; “picking out Slavonic stages” unclear; the paper appears to come full circle on research articles as technology. The “Slavonic stages” wording was a stylistic choice we no longer endorse — we have changed it to “Slavonic-language countries” [Change 15]. We acknowledge that the national-academies discussion is somewhat speculative, and we have re-read the paragraph to ensure it now reads clearly as a conjecture rather than as an established claim; the paragraph already opens with the statement that “isolating the effect of national academies in research culture agenda-setting is beyond the scope of the current work.” On the question of formality versus publisher policy and curation: the reviewer’s reading is correct that the paper argues, on the evidence, that publisher policies and curation practices were more important drivers than cultural formality at the country level. This is, in our view, a finding rather than a contradiction. The paper’s central claim is that the scholarly article is a technology shaped by multiple interacting forces; we identify those forces empirically and conclude that — for the Initial Era specifically — the technological and policy layer was the most consequential.
We thank the reviewer again for the rigour of the engagement, which has materially improved the paper.
Consolidated List of Changes to the Manuscript
All changes below are referenced by number in the responses to individual reviewers. The net length increase is approximately 800 words. New bibliography entries appear at the end.
Change 1 — Abstract restructured
Section: Abstract. Addresses: R1.1, R1.4, R1.5; editorial assessment (clarity/focus). Effect: Restructured to make purpose, contribution, and findings explicit. Length essentially unchanged.
Change 2 — New closing paragraph in introduction
Section: Introduction (after the “The paper is organised” paragraph). Addresses: R1.4, R1.5, R1.6; editorial assessment. Effect: New paragraph stating threefold contribution: identification of the Initial Era; multi-layered analysis; bibliometric archaeology framing.
Change 3 — Eurocentrism acknowledgement
Section: I.A. Addresses: R3.1; editorial assessment. Effect: New paragraph acknowledging that scholarly traditions existed before and in parallel with seventeenth-century European learned societies, and explaining why the journal article as a specific technology is nonetheless the appropriate frame for this paper.
Change 4 — “Big Science” references added
Section: I.B (the “emergence of ‘Big Science’” paragraph). Addresses: R1.2, R3.5, R3.8. Effect: Added Weinberg (1961) for the coinage of “Big Science”, de Solla Price (1963) for the bibliometric framing, and Stephan (2012) for the post-Sputnik R&D and postdoc context.
Change 5 — Diversity reference added
Section: I.B (the “see ourselves reflected” sentence). Addresses: R3.4. Effect: Added Hofstra et al. (2020) on the diversity–innovation relationship.
Change 6 — Three insights reordered
Section: I.B. Addresses: R1.6, R1.7, R3.9. Effect: The numbered list of three insights (Gradual Evolution, Accelerated Changes, Reflective Richness) has been moved to before the discussion of Figs 2 and 3, with the lead-in changed from “From the overarching observations and detailed examples discussed, three key insights emerge…” to “Three insights frame the analysis that follows…”. The insights now frame the analysis rather than appearing to be drawn from preceding material.
Change 7 — New methodology subsection II.A
Section: Methodology (new subsection “The layered provenance of bibliographic data” inserted at start of Section II). Addresses: R3 (overall framing), R3.7, R3.11, R3.13; editorial assessment. Effect: New subsection traces the policy/technology timeline of major data sources Dimensions ingests (MedLine 1946 retrospective and 1960s rollout, PubMed 1996, PubMedCentral 2000, PubMed 2002 redesign, Crossref DOI infrastructure, JATS XML). Acknowledges that some discontinuities are features of recording systems rather than of scholarly practice. Signposts Section III.F as the analytical engagement with this distinction. New label sec:provenance added.
Change 8 — Fig 2 variance observation
Section: Methodology (existing epoch discussion paragraph). Addresses: R3.2, R3.11. Effect: Added a sentence drawing attention to the width of the standard-deviation envelope in Fig 2 as a visual indicator of small n in the anecdotal epoch, reinforcing the argument for the 1945 cutoff.
Change 9 — Missing “to” corrected
Section: Methodology, second sentence. Addresses: R3.11(i). Effect: “full form to refer an author name” corrected to “full form to refer to an author name”.
Change 10 — Captions of Figs 10 and 11 clarified
Section: Results, geographic analysis figures. Addresses: R1 image remarks 3. Effect: Captions of Figs 10 and 11 now state explicitly that the grey dotted lines represent all countries that consistently participate in more than 500 papers per year, plotted for context, matching Fig 9’s caption.
Change 11 — Opening of IV.B restructured
Section: Discussion, IV.B (“The fall of the Initial Era”). Addresses: R2.4, R1.11. Effect: Opening sentence — “The fall of the Initial Era is fairly clear cut from a technological perspective” — replaced with text that explicitly acknowledges multiple plausible accounts and presents the technological account as one perspective. The three factors that follow are now framed as the most plausible synthesis among candidates rather than the unique explanation.
Change 12 — New discussion subsection IV.C
Section: Discussion (new subsection “Alternative drivers and their interaction with technology” inserted between the previous IV.B and the existing IV.C, which becomes IV.D). Addresses: R2.4, R1.11; editorial assessment (deepen discussion). Effect: New subsection treating editorial policy/house style, academic prestige economics, and globalisation as alternative or complementary explanations to the technological account. Includes a footnote referencing Wilsdon et al., The Metric Tide (HEFCE, 2015). Cross-references the existing journal cases in III.E (new label sec:journal) and the Technological Analysis section (new label sec:tech).
Change 13 — Gender section reframing
Section: III.G (Gender Analysis) and IV.B. Addresses: R3.3. Effect: Three sub-changes:
13a: new framing paragraph at the start of III.G distinguishing visibility from participation, acknowledging Lockhart et al. (2023) critique of name-to-gender attribution and stating clearly that the analysis makes no claims about specific researchers.
13b: closing paragraph of III.G replaced with a natural-experiment framing of the 2002 PubMed transition, arguing that the steeper proportional rise of female-coded names cannot be a participation effect (which would require a discontinuous demographic shift in a single year) and is therefore most plausibly a visibility effect.
13c: corresponding sentence in IV.B revised from “hide and marginalise the contribution of women to research” to “render the contribution of women to research systematically less visible in the scholarly metadata”, aligning with the strengthened framing in III.G.
Change 14 — New bibliography entries
Section: Bibliography (Initials.bib). Addresses: Changes 4 and 5. Effect: Four new entries appended:
- weinberg_impact_1961 — A. M. Weinberg, “Impact of Large-Scale Science on the United States,” Science 134(3473), 161–164 (1961). DOI: 10.1126/science.134.3473.161
- desolla_little_1963 — D. J. de Solla Price, Little Science, Big Science. Columbia University Press, New York (1963). DOI: 10.7312/pric91844
- stephan_economics_2012 — P. Stephan, How Economics Shapes Science. Harvard University Press, Cambridge, MA (2012). DOI: 10.4159/harvard.9780674062757
- hofstra_diversity_2020 — B. Hofstra, V. V. Kulkarni, S. Munoz-Najar Galvez, B. He, D. Jurafsky, and D. A. McFarland, “The Diversity–Innovation Paradox in Science,” Proceedings of the National Academy of Sciences 117(17), 9284–9291 (2020). DOI: 10.1073/pnas.1915378117
Change 15 — “Slavonic stages” wording corrected
Section: Geographical analysis (introduction to Fig 11). Addresses: R3 (Discussion comments). Effect: “picking out Slavonic stages” corrected to “picking out Slavonic-language countries”.
Items considered and declined
Removal of the gender analysis (R3): addressed by strengthening the framing and methodological caveats (Change 13) rather than removal, given Reviewer 2’s contrary view and the editorial assessment leaving the question open.
Fig 3 as percentage rather than absolute counts (R3.6): declined; absolute counts better convey the emergence of large-collaboration science as a new phenomenon. Acknowledged as a useful supplementary analysis.
Fig 8 colour palette revision (R1 image remarks 2): declined on accessibility grounds; current palette has been chosen for partially-sighted readers.
Additional case studies (R2.2): declined; existing journal cases in Section III.E provide the case-study material, and the editorial assessment’s emphasis on clarity and focus weighs against further extension.
Restructure paper to start from policy/curation history (R3): declined; addressed instead through new subsection II.A (Change 7), which places the policy context where it belongs methodologically while preserving the paper’s argumentative structure.
Abstract expansion to ~250 words (R1.1): declined; the issue identified is structural and addressed by restructuring (Change 1) rather than by adding length.




















