TransCS: A transformer-based hybrid architecture for image compressed sensing

M Shen, H Gan, C Ning, Y Hua… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
M Shen, H Gan, C Ning, Y Hua, T Zhang
IEEE Transactions on Image Processing, 2022ieeexplore.ieee.org
Well-known compressed sensing (CS) is widely used in image acquisition and
reconstruction. However, accurately reconstructing images from measurements at low
sampling rates remains a considerable challenge. In this paper, we propose a novel
Transformer-based hybrid architecture (dubbed TransCS) to achieve high-quality image CS.
In the sampling module, TransCS adopts a trainable sensing matrix strategy that gains better
image reconstruction by learning the structural information from the training images. In the …
Well-known compressed sensing (CS) is widely used in image acquisition and reconstruction. However, accurately reconstructing images from measurements at low sampling rates remains a considerable challenge. In this paper, we propose a novel Transformer-based hybrid architecture (dubbed TransCS) to achieve high-quality image CS. In the sampling module, TransCS adopts a trainable sensing matrix strategy that gains better image reconstruction by learning the structural information from the training images. In the reconstruction module, inspired by the powerful long-distance dependence modelling capacity of the Transformer, a customized iterative shrinkage-thresholding algorithm (ISTA)-based Transformer backbone that iteratively works with gradient descent and soft threshold operation is designed to model the global dependency among image subblocks. Moreover, the auxiliary convolutional neural network (CNN) is introduced to capture the local features of images. Therefore, the proposed hybrid architecture that integrates the customized ISTA-based Transformer backbone with CNN can gain high-performance reconstruction for image compressed sensing. The experimental results demonstrate that our proposed TransCS obtains superior reconstruction quality and noise robustness on several public benchmark datasets compared with other state-of-the-art methods. Our code is available on TransCS.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果