Peer Review and Reputation Systems: A Discussion
Can we trust traditional peer review? If it’s broken, how might we fix it?
These questions are put to a panel of experts in this Journal of Participatory Medicine podcast. The spirited discussion accompanies 2 articles on the subject in JPM’s inaugural issue: “In Search of an Optimal Peer Review System”, by former British Medical Journal Richard Smith, and “Reputation Systems: A New Vision for Publishing and Peer Review” by Medscape founder Peter Frishauf.
In addition to Smith and Frishauf, participating in the podcast are peer review researcher Liz Wager, health policy researcher Alex Jadad, and computer scientist Thomas (Bo) Adler. More complete bios may be found by clicking on the participants’ names at the top of this page. Click here to see a list of recommended resources compiled by the participants.
While there are many views on getting to a better form of peer review, the panelists agreed on a number of criteria that ideal peer review should include. Bo Adler and Frishauf led a discussion on specific improvements that might come about through an Internet-based reputation system that is now being beta tested in Wikipedia.
Chapter 1: Defining the Problems and Issues with Peer Review Today [download]
Chapter 2: Light Versus Heavy Peer Review [download]
Chapter 3: Transparency in Peer Review [download]
Chapter 4: Wikipedia-Style Peer Review…and Rating/Reputation Systems [download]
Chapter 5: Crowdsourcing Research/Peer Review [download]
Chapter 6: Building a Community [download]
One Response to “Peer Review and Reputation Systems: A Discussion”