News summarization and evaluation in the era of gpt-3

T Goyal, JJ Li, G Durrett - arXiv preprint arXiv:2209.12356, 2022 - arxiv.org
The recent success of zero-and few-shot prompting with models like GPT-3 has led to a
paradigm shift in NLP research. In this paper, we study its impact on text summarization …

Unlimiformer: Long-range transformers with unlimited length input

A Bertsch, U Alon, G Neubig… - Advances in Neural …, 2024 - proceedings.neurips.cc
Since the proposal of transformers, these models have been limited to bounded input
lengths, because of their need to attend to every token in the input. In this work, we propose …

Evaluating large language models on medical evidence summarization

L Tang, Z Sun, B Idnay, JG Nestor, A Soroush… - NPJ digital …, 2023 - nature.com
Recent advances in large language models (LLMs) have demonstrated remarkable
successes in zero-and few-shot performance on various downstream tasks, paving the way …

A survey on long text modeling with transformers

Z Dong, T Tang, L Li, WX Zhao - arXiv preprint arXiv:2302.14502, 2023 - arxiv.org
Modeling long texts has been an essential technique in the field of natural language
processing (NLP). With the ever-growing number of long documents, it is important to …

Taxonomy of abstractive dialogue summarization: scenarios, approaches, and future directions

Q Jia, Y Liu, S Ren, KQ Zhu - ACM Computing Surveys, 2023 - dl.acm.org
Abstractive dialogue summarization generates a concise and fluent summary covering the
salient information in a dialogue among two or more interlocutors. It has attracted significant …

Applicability of large language models and generative models for legal case judgement summarization

A Deroy, K Ghosh, S Ghosh - Artificial Intelligence and Law, 2024 - Springer
Automatic summarization of legal case judgements, which are known to be long and
complex, has traditionally been tried via extractive summarization models. In recent years …

DYLE: Dynamic latent extraction for abstractive long-input summarization

Z Mao, CH Wu, A Ni, Y Zhang, R Zhang, T Yu… - arXiv preprint arXiv …, 2021 - arxiv.org
Transformer-based models have achieved state-of-the-art performance on short-input
summarization. However, they still struggle with summarizing longer text. In this paper, we …

Bamboo: A comprehensive benchmark for evaluating long text modeling capacities of large language models

Z Dong, T Tang, J Li, WX Zhao, JR Wen - arXiv preprint arXiv:2309.13345, 2023 - arxiv.org
Large language models (LLMs) have achieved dramatic proficiency over NLP tasks with
normal length. Recently, multiple studies have committed to extending the context length …

Abstractive meeting summarization: A survey

V Rennard, G Shang, J Hunter… - Transactions of the …, 2023 - direct.mit.edu
A system that could reliably identify and sum up the most important points of a conversation
would be valuable in a wide variety of real-world contexts, from business meetings to …

MeetingBank: A benchmark dataset for meeting summarization

Y Hu, T Ganter, H Deilamsalehy, F Dernoncourt… - arXiv preprint arXiv …, 2023 - arxiv.org
As the number of recorded meetings increases, it becomes increasingly important to utilize
summarization technology to create useful summaries of these recordings. However, there is …