Transparent anonymous peer review policy

[ Last modification 31.1.2019. Please send comments to Arkadiy Skopenkov, s*open*o@mccme.ru, where *=k. ]

The reviews are publicly available together with specific versions of papers to which the reviews are written (on arxiv or elsewhere). The reviews are anonymous unless the reviewer wants to sign his/her review.

Examples of transparent peer review

  • Electronic Proceedings of the Neural Information Processing Systems Conference
  • International Conference on Learning Representations, see Reviewing Process.
  • Open review platform used by some conferences (=journals) on computer science.
  • Collaborative Peer Review.
  • Moscow Mathematical Conference of High School Students (the page where reports are published, mostly in Russian: рецензирование работ на Московской математической конференции школьников).

    Relevant examples

  • Review the peer review process.
  • ЗАПРЕТ НА СЪЁМКУ В МАГАЗИНАХ - КОММЕНТАРИИ ЮРИСТА (in Russian).

    Discussion

  • We must demand evidence of peer review.
  • Make reviews public, says peer review expert.
  • Can I publish the reviews I receive? Can I publish the reviews I write?
    Researchers have a duty to expedite the scientific process. A publicly-funded scientific process should be transparent. Authors, reviewers and editors should all be accountable for their actions. There are now more formal options for sharing your reviews; for example via Publons. [ChrisSampson87]
    ... I totally support the sharing of provided peer reviews after publication. I believe transparency can only add to speed and quality of scientific research, and most of the major flaws in peer review rely on the fact that it is kept secret behind curtains by most of the community. Likewise I am in favor of signing my reviews -- this is not always easy, and often leads to a backlash, which is halfway gone towards sharing it later. When one signs a review and plans on sharing it later, immediately a greater sense of responsibility is created. There are websites allowing for this practice which implies that any member journals include editors who are OK with the practice, and authors submitting papers to those journals should be aware of the possibility of greater exposure after their publication. Minor personal conflicts and egoistic feelings aside, I strongly believe bringing in more light to peer reviews, even of rejected papers, would do far greater good than damage to the working conditions of scientists everywhere. [Scientist]
  • This is an interesting idea. Personally I would not mind publicizing my reviews anonymously. My recent impression about the peer reviews of my own papers is that not everything is OK in the commonly used scheme. In most cases the reviews I receive (both positive and negative) show that the reviewer did not read the paper. In some cases the reviews even refer to the content of the paper incorrectly. As you might guess, all such review took months or even years to be written, possibly to indicate that the formalities are properly met. [A reply from a colleague.]