Attention mechanisms in computer vision: A survey

MH Guo, TX Xu, JJ Liu, ZN Liu, PT Jiang, TJ Mu… - Computational visual …, 2022 - Springer
Humans can naturally and effectively find salient regions in complex scenes. Motivated by
this observation, attention mechanisms were introduced into computer vision with the aim of …

A review on the attention mechanism of deep learning

Z Niu, G Zhong, H Yu - Neurocomputing, 2021 - Elsevier
Attention has arguably become one of the most important concepts in the deep learning
field. It is inspired by the biological systems of humans that tend to focus on the distinctive …

[HTML][HTML] Deep learning attention mechanism in medical image analysis: Basics and beyonds

X Li, M Li, P Yan, G Li, Y Jiang, H Luo… - International Journal of …, 2023 - sciltp.com
With the improvement of hardware computing power and the development of deep learning
algorithms, a revolution of" artificial intelligence (AI)+ medical image" is taking place …

Distract your attention: Multi-head cross attention network for facial expression recognition

Z Wen, W Lin, T Wang, G Xu - Biomimetics, 2023 - mdpi.com
This paper presents a novel facial expression recognition network, called Distract your
Attention Network (DAN). Our method is based on two key observations in biological visual …

A survey on video-based human action recognition: recent updates, datasets, challenges, and applications

P Pareek, A Thakkar - Artificial Intelligence Review, 2021 - Springer
Abstract Human Action Recognition (HAR) involves human activity monitoring task in
different areas of medical, education, entertainment, visual surveillance, video retrieval, as …

EEG-based emotion recognition via channel-wise attention and self attention

W Tao, C Li, R Song, J Cheng, Y Liu… - IEEE Transactions …, 2020 - ieeexplore.ieee.org
Emotion recognition based on electroencephalography (EEG) is a significant task in the
brain-computer interface field. Recently, many deep learning-based emotion recognition …

Attention on attention for image captioning

L Huang, W Wang, J Chen… - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
Attention mechanisms are widely used in current encoder/decoder frameworks of image
captioning, where a weighted average on encoded vectors is generated at each time step to …

Cbam: Convolutional block attention module

S Woo, J Park, JY Lee… - Proceedings of the …, 2018 - openaccess.thecvf.com
Abstract We propose Convolutional Block Attention Module (CBAM), a simple and effective
attention module that can be integrated with any feed-forward convolutional neural …

Attention, please! A survey of neural attention models in deep learning

A de Santana Correia, EL Colombini - Artificial Intelligence Review, 2022 - Springer
In humans, Attention is a core property of all perceptual and cognitive operations. Given our
limited ability to process competing sources, attention mechanisms select, modulate, and …

Bam: Bottleneck attention module

J Park, S Woo, JY Lee, IS Kweon - arXiv preprint arXiv:1807.06514, 2018 - arxiv.org
Recent advances in deep neural networks have been developed via architecture search for
stronger representational power. In this work, we focus on the effect of attention in general …