Automatic genre identification (AGI) is a text classification task focused on genres, ie, text
categories defined by the author's purpose, common function of the text, and the text's …

Foundation model development attracts a rapidly expanding body of contributors, scientists,
and applications. To help shape responsible development practices, we introduce the …

Large language models (LLMs) are routinely pre-trained on billions of tokens, only to start
the process over again once new data becomes available. A much more efficient solution is …

This article explores deep learning models for the automatic identification of registers-text
varieties such as news reports and discussion forums-in web-based datasets across 16 …

This paper presents a collection of highly comparable web corpora of Slovenian, Croatian,
Bosnian, Montenegrin, Serbian, Macedonian, and Bulgarian, covering thereby the whole …

We present the HPLT (High Performance Language Technologies) language resources, a
new massive multilingual dataset including both monolingual and bilingual corpora …

Web-scale corpora present valuable research opportunities but often lack detailed
metadata, making them challenging to use in linguistics and social sciences. This study …

In corpus linguistics, registers–language varieties suited to different contexts–have
traditionally been defined by their situations of use, yet recent studies reveal significant …

Machine learning (ML) models achieve remarkable performance on tasks they are trained
for. However, they often are sensitive to shifts in the data distribution, which may lead to …

This article introduces a resource-efficient method for developing question-answer (QA)
datasets by extracting QA pairs from web-scale data using machine learning (ML). Our …