Challenges, experiments, and computational solutions in peer review Page 1 76
COMMUNICATIONS OF THE ACM | JUNE 2022 | VOL. 65 | NO. 6 review articles IMA GER YB Y …

In peer mechanisms, the competitors for a prize also determine who wins. Each competitor
may be asked to rank, grade, or nominate peers for the prize. Since the prize can be …

We consider three important challenges in conference peer review:(i) reviewers maliciously
attempting to get assigned to certain papers to provide positive reviews, possibly as part of …

Algorithms and machine learning models, including the decisions made by these models,
are becoming ubiquitous in our daily life, including hiring. We make no value judgment …

Modern machine learning and computer science conferences are experiencing a surge in
the number of submissions that challenges the quality of peer review as the number of …

Strategic behavior is a fundamental problem in a variety of real-world applications that
require some form of peer assessment, such as peer grading of homeworks, grant proposal …

I consider the setting where reviewers offer very noisy scores for a number of items for the
selection of high-quality ones (eg, peer review of large conference proceedings) whereas …

It is common to see a handful of reviewers reject a highly novel paper, because they view,
say, extensive experiments as far more important than novelty, whereas the community as a …

We consider peer review in a conference setting where there is typically an overlap between
the set of reviewers and the set of authors. This overlap can incentivize strategic reviews to …

In the committee voting setting, a subset of k alternatives is selected based on the
preferences of voters. In this paper, our goal is to efficiently compute ex-ante fair probability …