End-to-end transformer-based models in textual-based NLP
A Rahali, MA Akhloufi - AI, 2023 - mdpi.com
Transformer architectures are highly expressive because they use self-attention
mechanisms to encode long-range dependencies in the input sequences. In this paper, we …
mechanisms to encode long-range dependencies in the input sequences. In this paper, we …
Deep transformer language models for Arabic text summarization: a comparison study
H Chouikhi, M Alsuhaibani - Applied Sciences, 2022 - mdpi.com
Large text documents are sometimes challenging to understand and time-consuming to
extract vital information from. These issues are addressed by automatic text summarizing …
extract vital information from. These issues are addressed by automatic text summarizing …
Do you ever get off track in a conversation? the conversational system's anatomy and evaluation metrics
Conversational systems are now applicable to almost every business domain. Evaluation is
an important step in the creation of dialog systems so that they may be readily tested and …
an important step in the creation of dialog systems so that they may be readily tested and …
Characterisation of COVID-19-related tweets in the Croatian language: framework based on the Cro-CoV-cseBERT model
This study aims to provide insights into the COVID-19-related communication on Twitter in
the Republic of Croatia. For that purpose, we developed an NL-based framework that …
the Republic of Croatia. For that purpose, we developed an NL-based framework that …
Ai-generated text detector for arabic language using encoder-based transformer architecture
The effectiveness of existing AI detectors is notably hampered when processing Arabic texts.
This study introduces a novel AI text classifier designed specifically for Arabic, tackling the …
This study introduces a novel AI text classifier designed specifically for Arabic, tackling the …
Towards transfer learning techniques—bert, distilbert, bertimbau, and distilbertimbau for automatic text classification from different languages: A case study
R Silva Barbon, AT Akabane - Sensors, 2022 - mdpi.com
The Internet of Things is a paradigm that interconnects several smart devices through the
internet to provide ubiquitous services to users. This paradigm and Web 2.0 platforms …
internet to provide ubiquitous services to users. This paradigm and Web 2.0 platforms …
[HTML][HTML] Toward Robust Arabic AI-Generated Text Detection: Tackling Diacritics Challenges
H Alshammari, K Elleithy - Information, 2024 - mdpi.com
Current AI detection systems often struggle to distinguish between Arabic human-written text
(HWT) and AI-generated text (AIGT) due to the small marks present above and below the …
(HWT) and AI-generated text (AIGT) due to the small marks present above and below the …
Reusing monolingual pre-trained models by cross-connecting seq2seq models for machine translation
J Oh, YS Choi - Applied Sciences, 2021 - mdpi.com
This work uses sequence-to-sequence (seq2seq) models pre-trained on monolingual
corpora for machine translation. We pre-train two seq2seq models with monolingual corpora …
corpora for machine translation. We pre-train two seq2seq models with monolingual corpora …
[HTML][HTML] Assessing Fine-Tuned NER Models with Limited Data in French: Automating Detection of New Technologies, Technological Domains, and Startup Names in …
C MacLean, D Cavallucci - Machine Learning and Knowledge Extraction, 2024 - mdpi.com
Achieving carbon neutrality by 2050 requires unprecedented technological, economic, and
sociological changes. With time as a scarce resource, it is crucial to base decisions on …
sociological changes. With time as a scarce resource, it is crucial to base decisions on …
A deeper look at sheet music composer classification using self-supervised pretraining
D Yang, K Ji, TJ Tsai - Applied Sciences, 2021 - mdpi.com
This article studies a composer style classification task based on raw sheet music images.
While previous works on composer recognition have relied exclusively on supervised …
While previous works on composer recognition have relied exclusively on supervised …