Eliciting informative text evaluations with large language models
Peer prediction mechanisms motivate high-quality feedback with provable guarantees.
However, current methods only apply to rather simple reports, like multiple-choice or scalar …
However, current methods only apply to rather simple reports, like multiple-choice or scalar …
AgentReview: Exploring Peer Review Dynamics with LLM Agents
Peer review is fundamental to the integrity and advancement of scientific publication.
Traditional methods of peer review analyses often rely on exploration and statistics of …
Traditional methods of peer review analyses often rely on exploration and statistics of …
The Surprising Effectiveness of SP Voting with Partial Preferences
We consider the problem of recovering the ground truth ordering (ranking, top-$ k $, or
others) over a large number of alternatives. The wisdom of crowd is a heuristic approach …
others) over a large number of alternatives. The wisdom of crowd is a heuristic approach …
Surprisingly Popular Voting for Concentric Rank-Order Models
An important problem on social information sites is the recovery of ground truth from
individual reports when the experts are in the minority. The wisdom of the crowd, ie the …
individual reports when the experts are in the minority. The wisdom of the crowd, ie the …