[HTML][HTML] Deep learning in electron microscopy
JM Ede - Machine Learning: Science and Technology, 2021 - iopscience.iop.org
Deep learning is transforming most areas of science and technology, including electron
microscopy. This review paper offers a practical perspective aimed at developers with …
microscopy. This review paper offers a practical perspective aimed at developers with …
Optimization for deep learning: An overview
RY Sun - Journal of the Operations Research Society of China, 2020 - Springer
Optimization is a critical component in deep learning. We think optimization for neural
networks is an interesting topic for theoretical research due to various reasons. First, its …
networks is an interesting topic for theoretical research due to various reasons. First, its …
Mvitv2: Improved multiscale vision transformers for classification and detection
In this paper, we study Multiscale Vision Transformers (MViTv2) as a unified architecture for
image and video classification, as well as object detection. We present an improved version …
image and video classification, as well as object detection. We present an improved version …
Segmenter: Transformer for semantic segmentation
Image segmentation is often ambiguous at the level of individual image patches and
requires contextual information to reach label consensus. In this paper we introduce …
requires contextual information to reach label consensus. In this paper we introduce …
Multiscale vision transformers
Abstract We present Multiscale Vision Transformers (MViT) for video and image recognition,
by connecting the seminal idea of multiscale feature hierarchies with transformer models …
by connecting the seminal idea of multiscale feature hierarchies with transformer models …
Transreid: Transformer-based object re-identification
Extracting robust feature representation is one of the key challenges in object re-
identification (ReID). Although convolution neural network (CNN)-based methods have …
identification (ReID). Although convolution neural network (CNN)-based methods have …
Training data-efficient image transformers & distillation through attention
Recently, neural networks purely based on attention were shown to address image
understanding tasks such as image classification. These high-performing vision …
understanding tasks such as image classification. These high-performing vision …
On lazy training in differentiable programming
In a series of recent theoretical works, it was shown that strongly over-parameterized neural
networks trained with gradient-based methods could converge exponentially fast to zero …
networks trained with gradient-based methods could converge exponentially fast to zero …
Semask: Semantically masked transformers for semantic segmentation
Finetuning a pretrained backbone in the encoder part of an image transformer network has
been the traditional approach for the semantic segmentation task. However, such an …
been the traditional approach for the semantic segmentation task. However, such an …
Salvaging federated learning by local adaptation
Federated learning (FL) is a heavily promoted approach for training ML models on sensitive
data, eg, text typed by users on their smartphones. FL is expressly designed for training on …
data, eg, text typed by users on their smartphones. FL is expressly designed for training on …