A metaverse: Taxonomy, components, applications, and open challenges

SM Park, YG Kim - IEEE access, 2022 - ieeexplore.ieee.org
Unlike previous studies on the Metaverse based on Second Life, the current Metaverse is
based on the social value of Generation Z that online and offline selves are not different …

Improving the domain adaptation of retrieval augmented generation (RAG) models for open domain question answering

S Siriwardhana, R Weerasekera, E Wen… - Transactions of the …, 2023 - direct.mit.edu
Abstract Retrieval Augment Generation (RAG) is a recent advancement in Open-Domain
Question Answering (ODQA). RAG has only been trained and explored with a Wikipedia …

PAQ: 65 million probably-asked questions and what you can do with them

P Lewis, Y Wu, L Liu, P Minervini, H Küttler… - Transactions of the …, 2021 - direct.mit.edu
Abstract Open-domain Question Answering models that directly leverage question-answer
(QA) pairs, such as closed-book QA (CBQA) models and QA-pair retrievers, show promise in …

Evaluating open-domain question answering in the era of large language models

E Kamalloo, N Dziri, CLA Clarke, D Rafiei - arXiv preprint arXiv …, 2023 - arxiv.org
Lexical matching remains the de facto evaluation method for open-domain question
answering (QA). Unfortunately, lexical matching fails completely when a plausible candidate …

Question and answer test-train overlap in open-domain question answering datasets

P Lewis, P Stenetorp, S Riedel - arXiv preprint arXiv:2008.02637, 2020 - arxiv.org
Ideally Open-Domain Question Answering models should exhibit a number of
competencies, ranging from simply memorizing questions seen at training time, to …

Multilingual autoregressive entity linking

N De Cao, L Wu, K Popat, M Artetxe, N Goyal… - Transactions of the …, 2022 - direct.mit.edu
We present mGENRE, a sequence-to-sequence system for the Multilingual Entity Linking
(MEL) problem—the task of resolving language-specific mentions to a multilingual …

Utility is in the eye of the user: A critique of NLP leaderboards

K Ethayarajh, D Jurafsky - arXiv preprint arXiv:2009.13888, 2020 - arxiv.org
Benchmarks such as GLUE have helped drive advances in NLP by incentivizing the creation
of more accurate models. While this leaderboard paradigm has been remarkably successful …

Generation-augmented retrieval for open-domain question answering

Y Mao, P He, X Liu, Y Shen, J Gao, J Han… - arXiv preprint arXiv …, 2020 - arxiv.org
We propose Generation-Augmented Retrieval (GAR) for answering open-domain questions,
which augments a query through text generation of heuristically discovered relevant …

Efficient nearest neighbor language models

J He, G Neubig, T Berg-Kirkpatrick - arXiv preprint arXiv:2109.04212, 2021 - arxiv.org
Non-parametric neural language models (NLMs) learn predictive distributions of text utilizing
an external datastore, which allows them to learn through explicitly memorizing the training …

Beyond efficiency: A systematic survey of resource-efficient large language models

G Bai, Z Chai, C Ling, S Wang, J Lu, N Zhang… - arXiv preprint arXiv …, 2024 - arxiv.org
The burgeoning field of Large Language Models (LLMs), exemplified by sophisticated
models like OpenAI's ChatGPT, represents a significant advancement in artificial …