Attention mechanism in intelligent fault diagnosis of machinery: A review of technique and application

H Lv, J Chen, T Pan, T Zhang, Y Feng, S Liu - Measurement, 2022 - Elsevier
Attention Mechanism has become very popular in the field of mechanical fault diagnosis in
recent years and has become an important technique for scholars to study and apply. The …

SegFormer: Simple and efficient design for semantic segmentation with transformers

E Xie, W Wang, Z Yu, A Anandkumar… - Advances in neural …, 2021 - proceedings.neurips.cc
We present SegFormer, a simple, efficient yet powerful semantic segmentation framework
which unifies Transformers with lightweight multilayer perceptron (MLP) decoders …

Dynamic neural networks: A survey

Y Han, G Huang, S Song, L Yang… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Dynamic neural network is an emerging research topic in deep learning. Compared to static
models which have fixed computational graphs and parameters at the inference stage …

EPSANet: An efficient pyramid squeeze attention block on convolutional neural network

H Zhang, K Zu, J Lu, Y Zou… - Proceedings of the asian …, 2022 - openaccess.thecvf.com
Recently, it has been demonstrated that the performance of a deep convolutional neural
network can be effectively improved by embedding an attention module into it. In this work, a …

Polarized self-attention: Towards high-quality pixel-wise regression

H Liu, F Liu, X Fan, D Huang - arXiv preprint arXiv:2107.00782, 2021 - arxiv.org
Pixel-wise regression is probably the most common problem in fine-grained computer vision
tasks, such as estimating keypoint heatmaps and segmentation masks. These regression …

Spectral–spatial transformer network for hyperspectral image classification: A factorized architecture search framework

Z Zhong, Y Li, L Ma, J Li… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Neural networks have dominated the research of hyperspectral image classification,
attributing to the feature learning capacity of convolution operations. However, the fixed …

A comprehensive review of modern object segmentation approaches

Y Wang, U Ahsan, H Li, M Hagen - Foundations and Trends® …, 2022 - nowpublishers.com
Image segmentation is the task of associating pixels in an image with their respective object
class labels. It has a wide range of applications in many industries including healthcare …

AAU-net: an adaptive attention U-net for breast lesions segmentation in ultrasound images

G Chen, L Li, Y Dai, J Zhang… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Various deep learning methods have been proposed to segment breast lesions from
ultrasound images. However, similar intensity distributions, variable tumor morphologies …

GoogLeNet based on residual network and attention mechanism identification of rice leaf diseases

L Yang, X Yu, S Zhang, H Long, H Zhang, S Xu… - … and Electronics in …, 2023 - Elsevier
Rice leaf diseases are a major cause of declining rice production and quality. The early
identification and control of rice leaf diseases is critical for maintaining rice quality and …

卷积神经网络中的注意力机制综述.

张宸嘉, 朱磊, 俞璐 - Journal of Computer Engineering & …, 2021 - search.ebscohost.com
注意力机制因其优秀的效果与即插即用的便利性, 在深度学习任务中得到了越来越广泛的应用.
主要着眼于卷积神经网络, 对卷积网络注意力机制发展过程中的各种主流方法进行介绍 …