in , ,

Could Open Peer Review Advance Quality Science?

National Academy of Sciences DC NAS: Photo 154240992 © William Perry |

[Orginally published in 2017 as A Positive Step for Science]

When I submit a paper to a scientific journal, it is reviewed by experts in the field before it is published.

The experts might say that the paper should be published as it is. They might say that the paper should be published, but certain changes should be made to either make it more consistent with what we know or to provide better context for understanding the results that are being presented. The reviewers might say that the article shouldn’t be published, because it contains poor science or because the results aren’t important.

Advertisement Below:

This is the process of peer review.

I have been on both sides. I have submitted papers for publication that went through peer review, and I have been a peer reviewer for scientific journals in my area of expertise. Although neither process is particularly enjoyable, I think it is a very important part of science. Indeed, even though it is not required, I have all of my science texts reviewed by at least two experts before they are sent to the publisher. These experts often catch errors that I have made, and they also add valuable comments that allow me to improve the way I discuss certain topics. My textbooks are significantly better because they are peer-reviewed.

Of course, there is also a problem with peer review. It can lead to the suppression of scientific results for unscientific reasons. I have experienced this personally. I recall one paper that my collaborators and I submitted to a nuclear physics journal. It was rejected by the peer reviewers, and the journal said that it would not be published. We looked at the reports of the peer reviewers and showed the editor that the reviewers’ objections were without merit. The journal agreed to send it to two more peer reviewers, who both accepted it with only minor corrections.

We later learned that the two peer reviewers who rejected the paper were from research teams who had published papers that our results contradicted. They rejected the paper not because it was poor, but because they didn’t want their results challenged. Fortunately, it was easy for us to show that their rejections didn’t make sense, because their review reports clearly demonstrated the weakness of their case. They apparently thought that since these reports are confidential (shared only with the editor and the team trying to publish the paper), they could use technical jargon to convince the editor that they were right, and no one would be the wiser.

That’s the dark side of peer review. Fortunately, there is a new trend in scientific publication, and if it catches on, it will greatly diminish this dark side. It’s called open peer review.

The Royal Society (the oldest independent scientific academy in the world) has been doing this since 2014. If the authors and reviewers agree, the journal Royal Society Open Science will publish a scientific paper along with the relevant parts of the peer reviewers’ comments. That way, all readers will see not only what the authors think, but also what the peer reviewers think. This seems to be catching on, because the Royal Society says that more than half of the papers published in Royal Society Open Science have open peer review.

The numbers vary with discipline, however. About 85% of their physics papers were published with open peer review, while slightly less than 50% of their genetics papers were published that way. Other journals like the British Medical Journal and PloS ONE have been experimenting with open peer review as well.

Advertisement Below:

I do hope this becomes more and more popular. Peer review is an important part of science, but as we know, it is becoming more and more popular to weaponize science for political and social causes. Confidential peer review makes this weaponization of science easier, while open peer review makes it harder. In addition, I like the idea of reading a scientific paper and then reading what some experts in the field think of it.

Now before I finish, I want to make it clear that peer review is not a perfect system, and open peer review will only help it to a certain extent. There are still times where even open peer review will lead to the suppression of good science. When a paper challenges the “scientific consensus,” for example, it might still be blocked, regardless of its merits. Nevertheless, open peer review seems better than the system that currently exists, and I think that, on balance, it is a positive step for science.

Dr. Jay Wile

Written by Jay Wile

As a scientist, it is hard for me to fathom anyone who has scientific training and does not believe in God. Indeed, it was science that brought me not only to a belief in God, but also to faith in Christianity. I have an earned Ph.D. from the University of Rochester in nuclear chemistry and a B.S. in chemistry from the same institution.

Advertisement Below:


Leave a Reply

Your email address will not be published. Required fields are marked *


Advertisement Below:
Advertisement Below:
Evolution 101 YouTube still

Evolution is Survival of the Luckiest and More

Whale species size

Thinking Beyond the “Species”