Discoscore: Evaluating text generation with bert and discourse coherence

W Zhao, M Strube, S Eger - arXiv preprint arXiv:2201.11176, 2022 - arxiv.org
Recently, there has been a growing interest in designing text generation systems from a
discourse coherence perspective, eg, modeling the interdependence between sentences …

Evaluation metrics on text summarization: comprehensive survey

E Davoodijam, M Alambardar Meybodi - Knowledge and Information …, 2024 - Springer
Automatic text summarization is the process of shortening a large document into a summary
text that preserves the main concepts and key points of the original document. Due to the …

Modeling structural similarities between documents for coherence assessment with graph convolutional networks

W Liu, X Fu, M Strube - arXiv preprint arXiv:2306.06472, 2023 - arxiv.org
Coherence is an important aspect of text quality, and various approaches have been applied
to coherence modeling. However, existing methods solely focus on a single document's …

How to find strong summary coherence measures? a toolbox and a comparative study for summary coherence measure evaluation

J Steen, K Markert - arXiv preprint arXiv:2209.06517, 2022 - arxiv.org
Automatically evaluating the coherence of summaries is of great significance both to enable
cost-efficient summarizer evaluation and as a tool for improving coherence by selecting high …

BBScore: A Brownian Bridge Based Metric for Assessing Text Coherence

Z Sheng, T Zhang, C Jiang, D Kang - Proceedings of the AAAI …, 2024 - ojs.aaai.org
Measuring the coherence of text is a vital aspect of evaluating the quality of written content.
Recent advancements in neural coherence modeling have demonstrated their efficacy in …

[PDF][PDF] IUSSNets at DisCoTeX: A fine-tuned approach to coherence.

E Zanoli, M Barbini, C Chesi - EVALITA, 2023 - ceur-ws.org
We present our submission to the DisCoTex shared task of the EVALITA 2023 evaluation
campaign, which focuses on modeling discourse coherence for Italian texts. We highlight the …

CoUDA: Coherence Evaluation via Unified Data Augmentation

D Zhu, W Wu, Y Song, F Zhu, Z Cao, S Li - arXiv preprint arXiv:2404.00681, 2024 - arxiv.org
Coherence evaluation aims to assess the organization and structure of a discourse, which
remains challenging even in the era of large language models. Due to the scarcity of …

Sentence Ordering with a Coherence Verifier

S Jia, W Song, J Gong, S Wang… - Findings of the Association …, 2023 - aclanthology.org
This paper presents a novel sentence ordering method by plugging a coherence verifier
(CoVer) into pair-wise ranking-based and sequence generation-based methods. It does not …

Cognitive structures of content for controlled summarization

R Cardenas Acosta - 2024 - era.ed.ac.uk
In the current information age, where over 1 Petabyte of data is created every day on the
web, demand continues to rise for effective technological tools to aid end-users in …