Measurement of text similarity: a survey

J Wang, Y Dong - Information, 2020 - mdpi.com
Text similarity measurement is the basis of natural language processing tasks, which play an
important role in information retrieval, automatic question answering, machine translation …

LongT5: Efficient text-to-text transformer for long sequences

M Guo, J Ainslie, D Uthus, S Ontanon, J Ni… - arXiv preprint arXiv …, 2021 - arxiv.org
Recent work has shown that either (1) increasing the input length or (2) increasing model
size can improve the performance of Transformer-based neural models. In this paper, we …

[图书][B] Pretrained transformers for text ranking: Bert and beyond

J Lin, R Nogueira, A Yates - 2022 - books.google.com
The goal of text ranking is to generate an ordered list of texts retrieved from a corpus in
response to a query. Although the most common formulation of text ranking is search …

Specter: Document-level representation learning using citation-informed transformers

A Cohan, S Feldman, I Beltagy, D Downey… - arXiv preprint arXiv …, 2020 - arxiv.org
Representation learning is a critical ingredient for natural language processing systems.
Recent Transformer language models like BERT learn powerful textual representations, but …

Sentence mover's similarity: Automatic evaluation for multi-sentence texts

E Clark, A Celikyilmaz, NA Smith - … of the 57th Annual Meeting of …, 2019 - aclanthology.org
For evaluating machine-generated texts, automatic methods hold the promise of avoiding
collection of human judgments, which can be expensive and time-consuming. The most …

5335 days of Implementation Science: using natural language processing to examine publication trends and topics

JP Scaccia, VC Scott - Implementation Science, 2021 - Springer
Introduction Moving evidence-based practices into the hands of practitioners requires the
synthesis and translation of research literature. However, the growing pace of scientific …

Reinforcement learning based text style transfer without parallel training corpus

H Gong, S Bhat, L Wu, JJ Xiong, W Hwu - arXiv preprint arXiv:1903.10671, 2019 - arxiv.org
Text style transfer rephrases a text from a source style (eg, informal) to a target style (eg,
formal) while keeping its original meaning. Despite the success existing works have …

Beyond word embeddings: A survey

F Incitti, F Urli, L Snidaro - Information Fusion, 2023 - Elsevier
The goal of this paper is to provide an overview of the methods that allow text
representations with a focus on embeddings for text of different lengths, specifically on works …

Hierarchical optimal transport for document representation

M Yurochkin, S Claici, E Chien… - Advances in neural …, 2019 - proceedings.neurips.cc
The ability to measure similarity between documents enables intelligent summarization and
analysis of large corpora. Past distances between documents suffer from either an inability …

Cultural cartography with word embeddings

DS Stoltz, MA Taylor - Poetics, 2021 - Elsevier
Using the frequency of keywords is a classic approach in the formal analysis of text, but has
the drawback of glossing over the relationality of word meanings. Word embedding models …