End-to-end transformer-based models in textual-based NLP

A Rahali, MA Akhloufi - AI, 2023 - mdpi.com
Transformer architectures are highly expressive because they use self-attention
mechanisms to encode long-range dependencies in the input sequences. In this paper, we …

Deep transformer language models for Arabic text summarization: a comparison study

H Chouikhi, M Alsuhaibani - Applied Sciences, 2022 - mdpi.com
Large text documents are sometimes challenging to understand and time-consuming to
extract vital information from. These issues are addressed by automatic text summarizing …

Do you ever get off track in a conversation? the conversational system's anatomy and evaluation metrics

S Yadav, A Kaushik - Knowledge, 2022 - mdpi.com
Conversational systems are now applicable to almost every business domain. Evaluation is
an important step in the creation of dialog systems so that they may be readily tested and …

Characterisation of COVID-19-related tweets in the Croatian language: framework based on the Cro-CoV-cseBERT model

K Babić, M Petrović, S Beliga, S Martinčić-Ipšić… - Applied Sciences, 2021 - mdpi.com
This study aims to provide insights into the COVID-19-related communication on Twitter in
the Republic of Croatia. For that purpose, we developed an NL-based framework that …

Ai-generated text detector for arabic language using encoder-based transformer architecture

H Alshammari, A El-Sayed, K Elleithy - Big Data and Cognitive Computing, 2024 - mdpi.com
The effectiveness of existing AI detectors is notably hampered when processing Arabic texts.
This study introduces a novel AI text classifier designed specifically for Arabic, tackling the …

Towards transfer learning techniques—bert, distilbert, bertimbau, and distilbertimbau for automatic text classification from different languages: A case study

R Silva Barbon, AT Akabane - Sensors, 2022 - mdpi.com
The Internet of Things is a paradigm that interconnects several smart devices through the
internet to provide ubiquitous services to users. This paradigm and Web 2.0 platforms …

[HTML][HTML] Toward Robust Arabic AI-Generated Text Detection: Tackling Diacritics Challenges

H Alshammari, K Elleithy - Information, 2024 - mdpi.com
Current AI detection systems often struggle to distinguish between Arabic human-written text
(HWT) and AI-generated text (AIGT) due to the small marks present above and below the …

Reusing monolingual pre-trained models by cross-connecting seq2seq models for machine translation

J Oh, YS Choi - Applied Sciences, 2021 - mdpi.com
This work uses sequence-to-sequence (seq2seq) models pre-trained on monolingual
corpora for machine translation. We pre-train two seq2seq models with monolingual corpora …

[HTML][HTML] Assessing Fine-Tuned NER Models with Limited Data in French: Automating Detection of New Technologies, Technological Domains, and Startup Names in …

C MacLean, D Cavallucci - Machine Learning and Knowledge Extraction, 2024 - mdpi.com
Achieving carbon neutrality by 2050 requires unprecedented technological, economic, and
sociological changes. With time as a scarce resource, it is crucial to base decisions on …

A deeper look at sheet music composer classification using self-supervised pretraining

D Yang, K Ji, TJ Tsai - Applied Sciences, 2021 - mdpi.com
This article studies a composer style classification task based on raw sheet music images.
While previous works on composer recognition have relied exclusively on supervised …