We present BARTpho with two versions, BARTpho-syllable and BARTpho-word, which are
the first public large-scale monolingual sequence-to-sequence models pre-trained for …

Sentiment Analysis (SA) is one of the most active research areas in the Natural Language
Processing (NLP) field due to its potential for business and society. With the development of …

This paper presents ViDeBERTa, a new pre-trained monolingual language model for
Vietnamese, with three versions-ViDeBERTa_xsmall, ViDeBERTa_base, and …

English and Chinese, known as resource-rich languages, have witnessed the strong
development of transformer-based language models for natural language processing tasks …

Machine reading comprehension has been an interesting and challenging task in recent
years, with the purpose of extracting useful information from texts. To attain the computer …

Pre-trained language models have become crucial to achieving competitive results across
many Natural Language Processing (NLP) problems. For monolingual pre-trained models in …

Social media processing is a fundamental task in natural language processing with
numerous applications. As Vietnamese social media and information science have grown …

Hate speech detection on social media networks is the classification task that automatically
detects harmful comments from users and prevents the appearance of those toxic comments …

Despite the rise of recent performant methods in Automatic Speech Recognition (ASR), such
methods do not ensure proper casing and punctuation for their outputs. This problem has a …

This paper introduces a semantics-aware approach to natural language inference which
allows neural network models to perform better on natural language inference benchmarks …