Challenges, experiments, and computational solutions in peer review
NB Shah - Communications of the ACM, 2022 - dl.acm.org
Challenges, experiments, and computational solutions in peer review Page 1 76
COMMUNICATIONS OF THE ACM | JUNE 2022 | VOL. 65 | NO. 6 review articles IMA GER YB Y …
COMMUNICATIONS OF THE ACM | JUNE 2022 | VOL. 65 | NO. 6 review articles IMA GER YB Y …
Counterfactual evaluation of peer-review assignment policies
Peer review assignment algorithms aim to match research papers to suitable expert
reviewers, working to maximize the quality of the resulting reviews. A key challenge in …
reviewers, working to maximize the quality of the resulting reviews. A key challenge in …
A one-size-fits-all approach to improving randomness in paper assignment
The assignment of papers to reviewers is a crucial part of the peer review processes of large
publication venues, where organizers (eg, conference program chairs) rely on algorithms to …
publication venues, where organizers (eg, conference program chairs) rely on algorithms to …
A randomized controlled trial on anonymizing reviewers to each other in peer review discussions
Many peer-review processes involve reviewers submitting their independent reviews,
followed by a discussion between the reviewers of each paper. A common question among …
followed by a discussion between the reviewers of each paper. A common question among …
Peer review and scientific publication at a crossroads: call for research for the 10th international congress on peer review and scientific publication
JPA Ioannidis, M Berkwits, A Flanagin, T Bloom - JAMA, 2023 - jamanetwork.com
The way science is assessed, published, and disseminated has markedly changed since
1986, when the launch of a new Congress focused on the science of peer review was first …
1986, when the launch of a new Congress focused on the science of peer review was first …
Peer review and scientific publication at a crossroads
JPA Ioannidis, M Berkwits, A Flanagin, T Bloom - bmj, 2023 - bmj.com
The way science is assessed, published, and disseminated has markedly changed since
1986, when the launch of a new congress focused on the science of peer review was first …
1986, when the launch of a new congress focused on the science of peer review was first …
Loss functions, axioms, and peer review
It is common to see a handful of reviewers reject a highly novel paper, because they view,
say, extensive experiments as far more important than novelty, whereas the community as a …
say, extensive experiments as far more important than novelty, whereas the community as a …
How do authors' perceptions of their papers compare with co-authors' perceptions and peer-review decisions?
How do author perceptions match up to the outcomes of the peer-review process and
perceptions of others? In a top-tier computer science conference (NeurIPS 2021) with more …
perceptions of others? In a top-tier computer science conference (NeurIPS 2021) with more …
To ArXiv or not to ArXiv: A study quantifying pros and cons of posting preprints online
Double-blind conferences have engaged in debates over whether to allow authors to post
their papers online on arXiv or elsewhere during the review process. Independently, some …
their papers online on arXiv or elsewhere during the review process. Independently, some …
Cite-seeing and reviewing: A study on citation bias in peer review
Citations play an important role in researchers' careers as a key factor in evaluation of
scientific impact. Many anecdotes advice authors to exploit this fact and cite prospective …
scientific impact. Many anecdotes advice authors to exploit this fact and cite prospective …