This week has been the 5th annual Peer Review Week. The subject of peer review is discussed all year round, but it's been fascinating to observe the focussed discussion this week on the theme that gets to the heart of the issue: Quality. Peer Review has long been a cornerstone of academic publishing and a signifier of quality, but evidence of bias towards positive findings and spotlights on flaws, in general, have come to light over the years.
The increased workload on academics, pressures on early career researchers to publish or perish and a lack of recognition for reviewers has also resulted in questions about the sustainability of peer review. Technology inevitably is involved in generating possible solutions to these challenges, but at what cost to quality?
This post will summarise some of the contributions to these topics that have been made this week.
Types of Peer Review. http://reviewers.plos.org/open-peer-review/ |
Declaring conflict of interest in peer review. @Editage https://twitter.com/Editage |
To celebrate this year's #PeerRevWk19 theme 'Quality in peer review' we are asking our #literatiaward winning reviewers to share their thoughts with us. First up we have @AWHarzing. What do you think makes a quality peer review and why? #peerreview #academictwitter pic.twitter.com/QxzZvS3DFG— Emerald Publishing (@EmeraldGlobal) September 16, 2019
Words to the wise!
Lots of researchers have been sharing their experiences of peer-reviewing and why they do it. Often the message has been to be constructive and supportive in equal measure. Dr. Manu Saunders from the University of New England wrote a particularly poignant post, "Why I don't want to be paid for peer review".
Dr. Heather Staines from MIT Knowledge Futures Group builds upon the subject of Open Peer Review and offers a great insight into emerging experiments and approaches. Read her post, "Making Open Peer Review More Open and Transparent".
Sense About Science worked with Elsevier on a survey 10 years on from their first major survey of researchers. Their report, "Quality, trust and peer review: researchers' perspectives 10 years on" offers an interesting overview of how scholarly communications has changed dramatically in 10 years, the rise of predatory publishers and variety of research outputs being available (preprints, data, code, etc) are making a significant impact. Despite these changes they found that researchers confidence in peer review has increased. Challenges posed to the industry by researchers in the survey include:
- Ensuring researchers receive clear guidance on how to conduct peer review
- Ensuring researchers get meaningful recognition for reviewing, which relates to the pressing need to overhaul research assessment and evaluation.
- A need to leverage technologies to manage the ever-increasing volume of research articles and improve the speed of review.
- Should peer review be extended beyond the research article, which would pose a significant resource challenge?
Sense About Science and Elsevier report published during Peer Review Week 2019 |
Finally, courses on peer review!
It seems the first point mentioned in the survey challenges above has been addressed by publishers already. Many of whom took Peer Review Week as an opportunity to promote their free courses on conducting peer review. Some highlights of courses include:
- Focus on Peer Review online - Nature Publishing Group
- The Publons Academy - Clarivate Analytics, producers of Web of Science.
- Certified Peer Review Course - Elsevier