Attention in natural language processing

A Galassi, M Lippi, P Torroni - IEEE transactions on neural …, 2020 - ieeexplore.ieee.org
Attention is an increasingly popular mechanism used in a wide range of neural
architectures. The mechanism itself has been realized in a variety of formats. However …

Evolution of semantic similarity—a survey

D Chandrasekaran, V Mago - ACM Computing Surveys (CSUR), 2021 - dl.acm.org
Estimating the semantic similarity between text data is one of the challenging and open
research problems in the field of Natural Language Processing (NLP). The versatility of …

N-gram in swin transformers for efficient lightweight image super-resolution

H Choi, J Lee, J Yang - … of the IEEE/CVF conference on …, 2023 - openaccess.thecvf.com
While some studies have proven that Swin Transformer (Swin) with window self-attention
(WSA) is suitable for single image super-resolution (SR), the plain WSA ignores the broad …

Attention-based sentiment analysis using convolutional and recurrent neural network

M Usama, B Ahmad, E Song, MS Hossain… - Future Generation …, 2020 - Elsevier
Convolution and recurrent neural network have obtained remarkable performance in natural
language processing (NLP). Moreover, from the attention mechanism perspective …

Generative steganography based on long readable text generation

Y Cao, Z Zhou, C Chakraborty, M Wang… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Text steganography has received a lot of attention in the application of covert
communication. How to ensure desirable capacity and imperceptibility has become a key …

Exploring syntactic and semantic features for authorship attribution

H Wu, Z Zhang, Q Wu - Applied Soft Computing, 2021 - Elsevier
Authorship attribution is to extract features to identify authors of anonymous documents.
Many previous works on authorship attribution focus on statistical style features (eg …

A siamese neural network for learning semantically-informed sentence embeddings

N Bölücü, B Can, H Artuner - Expert Systems with Applications, 2023 - Elsevier
Semantic representation is a way of expressing the meaning of a text that can be processed
by a machine to serve a particular natural language processing (NLP) task that usually …

Extending persian sentiment lexicon with idiomatic expressions for sentiment analysis

K Dashtipour, M Gogate, A Gelbukh… - Social Network Analysis …, 2022 - Springer
Nowadays, it is important for buyers to know other customer opinions to make informed
decisions on buying a product or service. In addition, companies and organizations can …

STAD-GCN: Spatial–Temporal Attention-based Dynamic Graph Convolutional Network for retail market price prediction

S Kim, E Park - Expert Systems with Applications, 2024 - Elsevier
As technology advances, competition among market players intensifies, highlighting the
importance of comprehending both one's own and competitors' pricing strategies. Traditional …

BiGRU attention capsule neural network for persian text classification

A Kenarang, M Farahani, M Manthouri - Journal of Ambient Intelligence …, 2022 - Springer
Text classification is a significant part of the business world. In the news classification world,
detection of the subject is an important issue that can lead to the recognition of news trends …