Language models: past, present, and future

H Li - Communications of the ACM, 2022 - dl.acm.org
Language models: past, present, and future Page 1 56 COMMUNICATIONS OF THE ACM |
JULY 2022 | VOL. 65 | NO. 7 contributed articles NATURAL LANGUAGE PROCESSING (NLP) …

State-of-the-art generalisation research in NLP: a taxonomy and review

D Hupkes, M Giulianelli, V Dankers, M Artetxe… - arXiv preprint arXiv …, 2022 - arxiv.org
The ability to generalise well is one of the primary desiderata of natural language
processing (NLP). Yet, what'good generalisation'entails and how it should be evaluated is …

[PDF][PDF] DisCoTex at EVALITA 2023: overview of the assessing discourse coherence in Italian texts task

D Brunato, D Colla, F Dell'Orletta, I Dini… - CEUR WORKSHOP …, 2023 - iris.unito.it
Abstract The Assessing DIScourse COherence in Italian TEXts (DisCoTEX) task is the first
shared task focused on modelling discourse coherence for Italian real-word texts, which has …

Snac: Coherence error detection for narrative summarization

T Goyal, JJ Li, G Durrett - arXiv preprint arXiv:2205.09641, 2022 - arxiv.org
Progress in summarizing long texts is inhibited by the lack of appropriate evaluation
frameworks. When a long summary must be produced to appropriately cover the facets of …

Rethinking self-supervision objectives for generalizable coherence modeling

P Jwalapuram, S Joty, X Lin - arXiv preprint arXiv:2110.07198, 2021 - arxiv.org
Given the claims of improved text generation quality across various pre-trained neural
models, we consider the coherence evaluation of machine generated text to be one of the …

Detecting documents with inconsistent context

D Jung, M Kim, YS Cho - IEEE Access, 2022 - ieeexplore.ieee.org
Extremely large volumes of documents are available from online news platforms and social
media. While the quantity of these documents have grown exponentially, the majority lack …

A Multi-Task Dataset for Assessing Discourse Coherence in Chinese Essays: Structure, Theme, and Logic Analysis

H Wu, X Shen, M Lan, S Mao, X Bai… - Proceedings of the 2023 …, 2023 - aclanthology.org
This paper introduces the Chinese Essay Discourse Coherence Corpus (CEDCC), a multi-
task dataset for assessing discourse coherence. Existing research tends to focus on isolated …

[PDF][PDF] Coherence Evaluation in Italian Language Models

M Sartor, F Dell'Orletta, G Venturi - … of the Eighth Workshop on Natural …, 2024 - ceur-ws.org
Coherence assessment is central to many NLP tasks, but its evaluation is complex and often
done indirectly. In the LLM era, it is even more crucial to understand how, and how well …

CoUDA: Coherence Evaluation via Unified Data Augmentation

D Zhu, W Wu, Y Song, F Zhu, Z Cao, S Li - arXiv preprint arXiv:2404.00681, 2024 - arxiv.org
Coherence evaluation aims to assess the organization and structure of a discourse, which
remains challenging even in the era of large language models. Due to the scarcity of …

Ffcd: A fast-and-frugal coherence detection method

S Duari, V Bhatnagar - IEEE Access, 2021 - ieeexplore.ieee.org
In the era of heavy emphasis on deep neural architectures with well-proven and impressive
competencies albeit with massive carbon footprints, we present a simple and inexpensive …