mgpt: Few-shot learners go multilingual

O Shliazhko, A Fenogenova, M Tikhonova… - arXiv preprint arXiv …, 2022 - arxiv.org
Recent studies report that autoregressive language models can successfully solve many
NLP tasks via zero-and few-shot learning paradigms, which opens up new possibilities for …

Artificial text detection via examining the topology of attention maps

L Kushnareva, D Cherniavskii, V Mikhailov… - arXiv preprint arXiv …, 2021 - arxiv.org
The impressive capabilities of recent generative models to create texts that are challenging
to distinguish from the human-written ones can be misused for generating fake news …

The next chapter: A study of large language models in storytelling

Z Xie, T Cohn, JH Lau - arXiv preprint arXiv:2301.09790, 2023 - arxiv.org
To enhance the quality of generated stories, recent story generation models have been
investigating the utilization of higher-level attributes like plots or commonsense knowledge …

A family of pretrained transformer language models for Russian

D Zmitrovich, A Abramov, A Kalmykov… - arXiv preprint arXiv …, 2023 - arxiv.org
Nowadays, Transformer language models (LMs) represent a fundamental component of the
NLP research methodologies and applications. However, the development of such models …

Selective-lama: Selective prediction for confidence-aware evaluation of language models

H Yoshikawa, N Okazaki - Findings of the Association for …, 2023 - aclanthology.org
Recent studies have suggested that neural language models learn and store a large amount
of facts and commonsense knowledge from training data. The ability of language models to …

Monolingual and cross-lingual acceptability judgments with the Italian CoLA corpus

D Trotta, R Guarasci, E Leonardelli… - arXiv preprint arXiv …, 2021 - arxiv.org
The development of automated approaches to linguistic acceptability has been greatly
fostered by the availability of the English CoLA corpus, which has also been included in the …

[图书][B] Deep learning and linguistic representation

S Lappin - 2021 - taylorfrancis.com
The application of deep learning methods to problems in natural language processing has
generated significant progress across a wide range of natural language processing tasks …

RuCoLA: Russian corpus of linguistic acceptability

V Mikhailov, T Shamardina, M Ryabinin… - arXiv preprint arXiv …, 2022 - arxiv.org
Linguistic acceptability (LA) attracts the attention of the research community due to its many
uses, such as testing the grammatical knowledge of language models and filtering …

[HTML][HTML] Testing the limits of natural language models for predicting human language judgements

T Golan, M Siegelman, N Kriegeskorte… - Nature Machine …, 2023 - nature.com
Neural network language models appear to be increasingly aligned with how humans
process and generate language, but identifying their weaknesses through adversarial …

[HTML][HTML] Too true to be good? The non-uniformity of extraction from adjunct clauses in english

AM Nyvad, C Müller, KR Christensen - Languages, 2022 - mdpi.com
Adjunct clauses are traditionally assumed to be strong islands for extraction across
languages. However, the universal island status of adjunct clauses has been challenged by …