Attention mechanisms in computer vision: A survey

MH Guo, TX Xu, JJ Liu, ZN Liu, PT Jiang, TJ Mu… - Computational visual …, 2022 - Springer
Humans can naturally and effectively find salient regions in complex scenes. Motivated by
this observation, attention mechanisms were introduced into computer vision with the aim of …

Understanding more about human and machine attention in deep neural networks

Q Lai, S Khan, Y Nie, H Sun, J Shen… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Human visual system can selectively attend to parts of a scene for quick perception, a
biological mechanism known as Human attention. Inspired by this, recent deep learning …

Visual attention methods in deep learning: An in-depth survey

M Hassanin, S Anwar, I Radwan, FS Khan, A Mian - Information Fusion, 2024 - Elsevier
Inspired by the human cognitive system, attention is a mechanism that imitates the human
cognitive awareness about specific information, amplifying critical details to focus more on …

Bi-directional object-context prioritization learning for saliency ranking

X Tian, K Xu, X Yang, L Du, B Yin… - Proceedings of the …, 2022 - openaccess.thecvf.com
The saliency ranking task is recently proposed to study the visual behavior that humans
would typically shift their attention over different objects of a scene based on their degrees of …

Deep visual attention prediction

W Wang, J Shen - IEEE Transactions on Image Processing, 2017 - ieeexplore.ieee.org
In this paper, we aim to predict human eye fixation with view-free scenes based on an end-to-
end deep learning architecture. Although convolutional neural networks (CNNs) have made …

DeepGaze II: Reading fixations from deep features trained on object recognition

M Kümmerer, TSA Wallis, M Bethge - arXiv preprint arXiv:1610.01563, 2016 - arxiv.org
Here we present DeepGaze II, a model that predicts where people look in images. The
model uses the features from the VGG-19 deep neural network trained to identify objects in …

Attention mechanism in neural networks: where it comes and where it goes

D Soydaner - Neural Computing and Applications, 2022 - Springer
A long time ago in the machine learning literature, the idea of incorporating a mechanism
inspired by the human visual system into neural networks was introduced. This idea is …

Res2net: A new multi-scale backbone architecture

SH Gao, MM Cheng, K Zhao, XY Zhang… - IEEE transactions on …, 2019 - ieeexplore.ieee.org
Representing features at multiple scales is of great importance for numerous vision tasks.
Recent advances in backbone convolutional neural networks (CNNs) continually …

An empirical study of spatial attention mechanisms in deep networks

X Zhu, D Cheng, Z Zhang, S Lin… - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
Attention mechanisms have become a popular component in deep neural networks, yet
there has been little examination of how different influencing factors and methods for …

Recurrent mixture density network for spatiotemporal visual attention

L Bazzani, H Larochelle, L Torresani - arXiv preprint arXiv:1603.08199, 2016 - arxiv.org
In many computer vision tasks, the relevant information to solve the problem at hand is
mixed to irrelevant, distracting information. This has motivated researchers to design …