Preprints Can Be Good for Your Research Career, but Community Involvement Is Needed to Evaluate Them

Highlights

• A preprint is a research manuscript that is made freely available online by its authors before the manuscript has been peer reviewed.
• Unlike traditional journal articles, preprints can be posted quickly and are free to post and read.
• Preprinting can have career benefits for researchers because journal articles that first appear as preprints may be cited more often than articles that are not distributed as preprints. Citation counts are a factor in hiring, promotion, and tenure decisions.
• Because preprints are not peer reviewed when they are posted, how preprints should be evaluated remains unclear.
• At Research Square, we encourage authors to leave constructive comments on their colleagues' preprints to help address this evaluation issue. Constructive comments follow normal guidelines for good peer reviews.

Summary

In preprinting, researchers make their manuscripts freely available online before those manuscripts have been peer reviewed. Preprints are free to upload and read, and they can be made available as soon as manuscripts are complete. Preprinting avoids the high costs and lengthy publication times associated with journals. However, the benefits of preprinting remain unclear to many researchers.

In this article, we show that preprinting can increase the impact and decrease the time to publication of preprinted manuscripts that are eventually submitted to journals. Because impact (as measured by citation counts) is a factor in hiring, promotion, and tenure decisions, preprinting may help researchers to advance in their careers.

Moreover, submitting manuscripts to a preprint platform that provides digital object identifiers (DOIs) helps protect the ideas in those manuscripts from being stolen. Preprinting is becoming increasingly accepted among funding agencies and journal publishers.

However, how the research presented in preprints should be evaluated remains an open question. Journal publication and citation counts likely provide some basis for evaluating preprints, but these mechanisms only become meaningful some time after preprints are posted.

Some preprint platforms also allow for public comments or provide other mechanisms to enable the research community to rapidly evaluate the content of individual preprints. At Research Square, we encourage researchers to use these mechanisms to help the authors of preprints improve their manuscripts and ensure the quality of the research literature.

What are preprints?

Preprinting is a new element of the research landscape that turns normal research publishing on its head.

Presently, many manuscripts are submitted directly to journals and become available only after peer reviewers. Editors conclude that the manuscripts are ready for publication.

In preprinting, manuscripts that have not been peer reviewed are made freely available online. These preprints can then be submitted to a journal for formal peer review or evaluated by the research community in real time through the platforms that host the preprints. Thus, while traditional journals evaluate manuscripts before publishing them, research is evaluated after it is posted in preprinting.

Preprints are free

Preprints are free to both read and publish, unlike articles in traditional journals. Many journals are available only through research libraries because subscriptions to those journals are too expensive for individuals to purchase on their own. Thus, many research articles are not available to the general public, even though much research is carried out using money from public funding agencies.

Articles in open access journals are free to download. However, the article publishing charges for many open access journals are high enough that some researchers, particularly those in developing countries, cannot pay them. Thus, preprints remove the costs of reading and publishing research articles imposed by traditional journals.

Preprint servers are faster than publishing in a journal

The rapid sharing enabled by preprinting also distinguishes preprints from traditional journal publishing. Publishing in a journal is often a slow process. In one recent survey, the average time required to publish a journal article was over a year [1]. There are many reasons that journal articles may take a long time to be published. Key among them are:

• The continuing increase in the number of articles that are published each year [2]
• The challenge in finding peer reviewers caused by this increase in published articles
• The need to reformat and resubmit rejected manuscripts [1, 3]

With preprinting, this lengthy wait is bypassed.

Preprinting is becoming more popular

Given that preprints provide a free, rapid means of disseminating new research, it's not surprising that the number of preprints posted each year is increasing rapidly. As of late 2018, over 2,000 preprints were being posted each month to major biology-oriented preprint platforms. Over 24,000 preprints appeared on those platforms in 2018 [4]. These numbers represent a 20-fold increase over the corresponding values for a decade earlier [4]. While preprints represent a small fraction of total research output, the rate of growth in preprint publishing is much more rapid than that of traditional journal articles [2, 4].

How can preprinting benefit researchers?

The career benefits of preprinting for individual researchers may be substantial. At least two recent studies have shown that journal articles made available as preprints before being published in a journal are cited more frequently than those that are not [5, 6]. Given that citation counts affect hiring, promotion and tenure decisions, preprinting should arguably be considered by all researchers, especially early-career researchers.

Preprints are quicker to get published

Moreover, preprinted manuscripts submitted to a journal may be published faster than those that do not appear as preprints. At one megajournal, preprinted manuscripts are published an average of 19 days sooner than manuscripts that have not been preprinted [7].

Many researchers remain cautious of preprinting because they fear that their work will be stolen (“scooped”). One key feature of preprint platforms helps mitigate this concern.

When a preprint is published, a digital object identifier (DOI) is issued. This DOI enables citation of the preprint and includes when it was made available online. Thus, preprinting provides an immutable time stamp for research contributions that can be used to establish who had an idea first. In cases in which preprinted manuscripts are copied and published in journals, the DOIs can be provided to the journals' editors as evidence of research misconduct. Reputable journals will then retract the plagiarized articles.

Journal publishers are lightening up to preprints

Moreover, journal publishers and funding agencies are becoming increasingly accepting of preprints. One community-updated list shows 35 publishers whose editorial policies specifically permit the publication of preprints, including SpringerNature, Elsevier, IEEE, and Cambridge University Press [8].

While some journals still do not publish manuscripts that have appeared online as preprints, these policies are likely to shift as preprints become a routine part of research publishing. Some funding agencies now permit the citation of preprints in grant applications (e.g., the Wellcome Trust [9], the US National Institutes of Health [10], and the European Research Council [11]).

How can preprints be assessed?

Assessment and quality control remain key issues in preprinting. Unlike journal articles, which are peer reviewed before they are published, preprints are generally not examined by independent researchers before they are made available. Thus, it may not be clear which preprints in a given field represent well-done research.

Two features of normal research practice may help provide this quality control:

• First, many preprinted manuscripts are subsequently submitted to journals, where they are evaluated through the normal peer review process. Those manuscripts that are then published presumably represent well-done research.
• Second, as noted above, preprints with DOIs can be cited just like peer-reviewed journal articles. The number of citations that a preprint receives should approximate the value of the research that preprint describes.

However, both traditional mechanisms for evaluating preprints are relatively slow. There is an active discussion as to how preprints can be evaluated in real time. Some preprint platforms enable members of the research community to comment on preprints, although the value of such comments is debated [12]. It has also been suggested that a form of self-organizing peer review could be instituted directly on preprint platforms by providing appropriate incentives to participating researchers [13].

At Research Square, we encourage members of the research community to leave constructive comments on their colleagues' preprints. If constructive commenting becomes a widespread practice, it may help to improve the overall quality of preprints and the research literature as a whole. Constructive comments follow the same guidelines as good peer reviews; for suggestions, see [14, 15].

Conclusion

In conclusion, preprints provide important benefits relative to the traditional, journal-based model of research publishing in that they permit rapid communication of new results and are free to upload and read. Preprinting can benefit individual researchers through increasing citation counts and decreasing the time to publication for manuscripts that are eventually published as journal articles.

Preprints are also becoming increasingly accepted by both funding agencies and journal publishers. How preprints should be evaluated remains an open question, but both traditional and novel evaluation methods may help solve this problem.

At Research Square, we encourage researchers to comment on their colleagues' preprints because constructive comments may help improve both preprints and published articles.

Before submitting your research as a preprint, utilize our academic English Editing services for your manuscript.

Acknowledgements

Thank you to Jodi Harrell & Kristen Kato who contributed to the final version of this article.

A note to readers: AJE is a division of Research Square Company. Our colleagues built and operate the Research Square preprint platform. For more author resources on preprints we encourage you to browse the content on the Research Square Blog.

References

1. Grigston, J.; Mudrak, B. 2016. The State of Authorship: Maximizing Impact with the Time and Money You Spend. White paper, AJE. https://www.aje.com/arc/state-of-authorship-report/

2. Mudrak, B. 2016. AJE Scholarly Publishing Report 2016. AJE. https://www.aje.com/arc/scholarly-publishing-trends-2016/

3. Wong, T. E.; Srikrishnan, V.; Hadka, D.; Keller, K. 2017. A multi-objective decision-making approach to the journal submission problem. PLOS One. https://doi.org/10.1371/journal.pone.0178874, https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0178874

4. Anaya, J. 2018. Monthly Statistics for December 2018. PrePubMed. http://www.prepubmed.org/monthly_stats/

5. Feldman, S.; Lo, K.; Ammar, W. 2018. Citation Count Analysis for Papers with Preprints. arXiv:1805.05238. https://arxiv.org/abs/1805.05238

6. Fraser, N.; Momeni, F.; Mayr, P.; Peters, I. 2018. The effect of bioRxiv preprints on citations and altmetrics. bioRxiv. doi: https://doi.org/10.1101/673665, https://www.biorxiv.org/content/10.1101/673665v1

7. Public Library of Science. 2019. Trends in Preprints. The Official PLOS Blog. https://blogs.plos.org/plos/2019/10/trends-in-preprints/

8. Wikipedia. Accessed 24 Jan 2020. List of academic journals by preprint policy. https://en.wikipedia.org/wiki/List_of_academic_journals_by_preprint_policy

9. Wellcome Trust. 2017. We now accept preprints in grant applications. https://wellcome.ac.uk/news/we-now-accept-preprints-grant-applications

10. Kaiser, J. 2017. NIH enables investigators to include draft preprints in grant proposals. Science. doi:10.1126/science.aal0961, https://www.sciencemag.org/news/2017/03/nih-enables-investigators-include-draft-preprints-grant-proposals

11. Matthews, D. 2018. New boost for preprints after acceptance by ERC. Times Higher Education. https://www.timeshighereducation.com/news/new-boost-preprints-after-acceptance-erc

12. Polka, J. 2017. Preprint comments: boon or 'bog?' The American Society for Cell Biology. https://www.ascb.org/science-policy/preprint-comments-boon-bog/

13. LingFeng, W. 2019. Self-organising peer review for preprints – A future paradigm for scholarly publishing. The London School of Economics and Political Science Impact Blog. https://blogs.lse.ac.uk/impactofsocialsciences/2019/04/17/self-organising-peer-review-for-preprints-a-future-paradigm-for-scholarly-publishing/

14. Stiller-Reeve, M. 2018. How to write a thorough peer review. Nature. doi:10.1038/d41586-018-06991-0, https://www.nature.com/articles/d41586-018-06991-0

15. Applegate, P. J. How to write a good peer review. Recorded talk, American Journal Experts. Slides, https://www.aje.com/dist/docs/How-to-Write-a-Good-Peer-Review-Research-Square-AJE.pdf; recording, https://www.aje.com/arc/webinar-quality-in-peer-review/

Date of Publication: 3-31-2020