We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

econ

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Economics > General Economics

Title: Auctions and Peer Prediction for Academic Peer Review

Abstract: Peer reviewed publications are considered the gold standard in certifying and disseminating ideas that a research community considers valuable. However, we identify two major drawbacks of the current system: (1) the overwhelming demand for reviewers due to a large volume of submissions, and (2) the lack of incentives for reviewers to participate and expend the necessary effort to provide high-quality reviews. In this work, we adopt a mechanism-design approach to propose improvements to the peer review process, tying together the paper submission and review processes and simultaneously incentivizing high-quality submissions and reviews. In the submission stage, authors participate in a VCG auction for review slots by submitting their papers along with a bid that represents their expected value for having their paper reviewed. For the reviewing stage, we propose a novel peer prediction mechanism (H-DIPP) building on recent work in the information elicitation literature, which incentivizes participating reviewers to provide honest and effortful reviews. The revenue raised in the submission stage auction is used to pay reviewers based on the quality of their reviews in the reviewing stage.
Subjects: General Economics (econ.GN); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG)
Cite as: arXiv:2109.00923 [econ.GN]
  (or arXiv:2109.00923v2 [econ.GN] for this version)

Submission history

From: Siddarth Srinivasan [view email]
[v1] Fri, 27 Aug 2021 23:47:15 GMT (474kb,D)
[v2] Wed, 10 May 2023 22:28:12 GMT (528kb,D)

Link back to: arXiv, form interface, contact.