Personalised vs. Non-Personalised Peer Review Requests

Preliminary Data for Calculating Effects on Response Rate, Quality and Completion

doi: 10.17646/KOME.of.27

Abstract

Peer review is and will remain the cornerstone of research publishing, but finding the right candidate to write an evaluation report for submitted manuscripts can be a challenge for academic publishers. Reaching out to peer reviewers always leaves a written trail (both for reasons of editorial accountability and quality control) and generally starts with an email inquiry from the editors. The content and style of these emails can influence how the recipient responds to the request, and analysing them could offer publishers valuable insights on how to design such initial contacts for optimal efficacy. This article is aimed at presenting a database and preliminary results for such analysis, consisting of 854 anonymised peer review requests sent out through traditional email, academia.edu and
researchgate.net private messages between 2018 and 2022. It was found that personalised peer review requests had a higher response rate and higher ratio of submitted reports than non-personalised ones, and personalisation has the best results with peers of low academic seniority. Requests sent through academic social media had a response rate comparable to personalised email messages but received significantly fewer refusals and resulted in more completed evaluation reports, especially when female academics were targeted.

Keywords:

editorial process peer review response rate email personalisation quality control

How to Cite

Tóth, J. J. (2025). Personalised vs. Non-Personalised Peer Review Requests: Preliminary Data for Calculating Effects on Response Rate, Quality and Completion. KOME, 13(1), 167–181. https://doi.org/10.17646/KOME.of.27

References

Bucklin, R. E. & Sismeiro, C. (2003). A Model of Web Site Browsing Behavior Estimated on Clickstream Data. Journal of Marketing Research, 40(3), 249–267. Online: https://doi.org/10.1509/jmkr.40.3.249.19241

Data & Marketing Association (2018). Marketer Email Tracker 2018. Online: https://dma.org.uk/uploads/misc/5a7c1de1ca4d7-marketer-email-tracking-report-2018_v2-final_5a7c1de1ca425.pdf

Data & Marketing Association (2020). Marketer Email Tracker 2020. Online: https://dma.org.uk/uploads/misc/marketer-email-tracker-2020.pdf

Evergage (2020). 2020 Trends in Personalization. Online: https://www.salesforce.com/content/dam/web/en_us/www/documents/reports/researchscape-evergage-2020-trends-in-personalization-report.pdf

Gagné, M. & Deci, E. L. (2005). Self-Determination Theory and Work Motivation. Journal of Organizational Behavior, 26(4), 331–362. Online: https://doi.org/10.1002/job.322

Goic, M. & Rojas, A. & Saavedra, I. (2021). The Effectiveness of Triggered Email Marketing in Addressing Browse Abandonments. Journal of Interactive Marketing, 55, 118–145. Online: https://doi.org/10.1016/j.intmar.2021.02.002

Huang, J. & Zhou, L. (2018). Timing of Web Personalization in Mobile Shopping: A Perspective from Uses and Gratifications Theory. Computers in Human Behavior, 88, 103–113. Online: https://doi.org/10.1016/j.chb.2018.06.035

Kósa, I., Bálint, B., Ambrus, Z., Sólyom, A. & Zsigmond, C. D. (2020). Headlines Readers’ Avoidance Attitude Towards Visual Material? Effects of the Camcorder Symbol on Selective Exposure to Headlines. KOME − An International Journal of Pure Communication Inquiry, 8(2), 61–87. Online: https://doi.org/10.17646/KOME.75672.48

Munz, K. P., Jung, M. H. & Alter, A. L. (2020). Name Similarity Encourages Generosity: A Field Experiment in Email Personalization. Marketing Science, 39(6), 1071–1091. Online: https://doi.org/10.1287/mksc.2019.1220

Porter, S. R. & Whitcomb, M. E. (2005). Email Subject Lines and Their Effect on Web Survey Viewing and Response. Social Science Computer Review, 23(3), 380–387. Online: https://doi.org/10.1177/0894439305275912

Rhee, C. E. & Choi, J. (2020). Effects of Personalization and Social Role in Voice Shopping: An Experimental Study on Product Recommendation by a Conversational Voice Agent. Computers in Human Behavior, 109. Online: https://doi.org/10.1016/j.chb.2020.106359

Romero, T. J. D. (2024). Prolegomena for any Future Narrative Literaturemetrics. KOME – An International Journal of Pure Communication Inquiry, 12(2), 3–27. Online: https://doi.org/10.17646/KOME.of.19

Sahni, N. S., Wheeler, S. C. & Chintagunta, P. (2018). Personalization in Email Marketing: The Role of Noninformative Advertising Content. Marketing Science, 37(2), 236–258. Online: https://doi.org/10.1287/mksc.2017.1066

Salonen, V. & Karjaluoto, H. (2016). Web Personalization: The State of the Art and Future Avenues for Research and Practice. Telematics and Informatics, 33(4), 1088–1104. Online: https://doi.org/10.1016/j.tele.2016.03.004

Squazzoni, F., Brezis, E. & Marušić, A. (2017). Scientometrics of Peer Review. Scientometrics, 113(1), 501–502. Online: https://doi.org/10.1007/s11192-017-2518-4

Telang, R., Boatwright, P. & Mukhopadhyay, T. (2004). A Mixture Model for Internet Search-Engine Visits. Journal of Marketing Research, 41(2), 206–214.

Trouteaud, A. R. (2004). How You Ask Counts: A Test of Internet-Related Components of Response Rates to a Web-Based Survey. Social Science Computer Review, 22(3), 385–392. Online: https://doi.org/10.1177/0894439304265650

Wilson, L. (2019). Data-Driven Marketing Content. Emerald Publishing Limited.

Zaharie, M. & Osoian, C. (2016). Peer Review Motivation Frames: A Qualitative Approach. European Management Journal, 34(1), 69–79. Online: https://doi.org/10.1016/j.emj.2015.12.004

Zaharie, M. A. & Seeber, M. (2018). Are Non-Monetary Rewards Effective in Attracting Peer Reviewers? A Natural Experiment. Scientometrics, 117, 1587–1609. Online: https://doi.org/10.1007/s11192-018-2912-6

Zhang X., Kumar V. & Cosguner K. (2017). Dynamically Managing a Profitable Email Marketing Program. Journal of Marketing Research, 54(6), 851–866. Online: https://doi.org/10.1509/jmr.16.0210