Learning to tokenize for generative retrieval

W Sun, L Yan, Z Chen, S Wang, H Zhu… - Advances in …, 2024 - proceedings.neurips.cc
As a new paradigm in information retrieval, generative retrieval directly generates a ranked
list of document identifiers (docids) for a given query using generative language models …

From matching to generation: A survey on generative information retrieval

X Li, J Jin, Y Zhou, Y Zhang, P Zhang, Y Zhu… - arXiv preprint arXiv …, 2024 - arxiv.org
Information Retrieval (IR) systems are crucial tools for users to access information, widely
applied in scenarios like search engines, question answering, and recommendation …

How does generative retrieval scale to millions of passages?

R Pradeep, K Hui, J Gupta, AD Lelkes… - arXiv preprint arXiv …, 2023 - arxiv.org
Popularized by the Differentiable Search Index, the emerging paradigm of generative
retrieval re-frames the classic information retrieval problem into a sequence-to-sequence …

Continual learning for generative retrieval over dynamic corpora

J Chen, R Zhang, J Guo, M de Rijke, W Chen… - Proceedings of the …, 2023 - dl.acm.org
Generative retrieval (GR) directly predicts the identifiers of relevant documents (ie, docids)
based on a parametric model. It has achieved solid performance on many ad-hoc retrieval …

Generative sequential recommendation with gptrec

AV Petrov, C Macdonald - arXiv preprint arXiv:2306.11114, 2023 - arxiv.org
Sequential recommendation is an important recommendation task that aims to predict the
next item in a sequence. Recently, adaptations of language models, particularly Transformer …

Incdsi: incrementally updatable document retrieval

V Kishore, C Wan, J Lovelace, Y Artzi… - International …, 2023 - proceedings.mlr.press
Abstract Differentiable Search Index is a recently proposed paradigm for document retrieval,
that encodes information about a corpus of documents within the parameters of a neural …

Toward general-purpose robots via foundation models: A survey and meta-analysis

Y Hu, Q Xie, V Jain, J Francis, J Patrikar… - arXiv preprint arXiv …, 2023 - arxiv.org
Building general-purpose robots that can operate seamlessly, in any environment, with any
object, and utilizing various skills to complete diverse tasks has been a long-standing goal in …

Unigen: A unified generative framework for retrieval and question answering with large language models

X Li, Y Zhou, Z Dou - Proceedings of the AAAI Conference on Artificial …, 2024 - ojs.aaai.org
Generative information retrieval, encompassing two major tasks of Generative Document
Retrieval (GDR) and Grounded Answer Generation (GAR), has gained significant attention …

NOVO: learnable and interpretable document identifiers for model-based IR

Z Wang, Y Zhou, Y Tu, Z Dou - Proceedings of the 32nd ACM …, 2023 - dl.acm.org
Model-based Information Retrieval (Model-based IR) has gained attention due to
advancements in generative language models. Unlike traditional dense retrieval methods …

Recent advances in generative information retrieval

Y Tang, R Zhang, J Guo, M de Rijke - … in Information Retrieval in the Asia …, 2023 - dl.acm.org
Generative retrieval (GR) has become a highly active area of information retrieval (IR) that
has witnessed significant growth recently. Compared to the traditional “index-retrieve-then …