Challenges, experiments, and computational solutions in peer review Page 1 76
COMMUNICATIONS OF THE ACM | JUNE 2022 | VOL. 65 | NO. 6 review articles IMA GER YB Y …

The rapid development of science and technology has been accompanied by an
exponential growth in peer-reviewed scientific publications. At the same time, the review of …

Given the rapid ascent of large language models (LLMs), we study the question:(How) can
large language models help in reviewing of scientific papers or proposals? We first conduct …

Opinions in the scientific domain can be divergent, leading to controversy or consensus
among reviewers. However, current opinion summarization datasets mostly focus on product …

We survey human evaluation in papers presenting work on creative natural language
generation that have been published in INLG 2020 and ICCC 2020. The most typical human …

Peer review is a key component of the publishing process in most fields of science.
Increasing submission rates put a strain on reviewing quality and efficiency, motivating the …

This work is motivated by two key trends. On one hand, large language models (LLMs) have
shown remarkable versatility in various generative tasks such as writing, drawing, and …

Recent advances in Large Language Models (LLMs) show the potential to significantly
augment or even replace complex human writing activities. However, for complex tasks …

Emerging events, such as the COVID pandemic and the Ukraine Crisis, require a time-
sensitive comprehensive understanding of the situation to allow for appropriate decision …

With the rapid development of deep learning, training Big Models (BMs) for multiple
downstream tasks becomes a popular paradigm. Researchers have achieved various …