Pitfalls of in-domain uncertainty estimation and ensembling in deep learning

A Ashukha, A Lyzhov, D Molchanov… - arXiv preprint arXiv …, 2020 - arxiv.org
Uncertainty estimation and ensembling methods go hand-in-hand. Uncertainty estimation is
one of the main benchmarks for assessment of ensembling performance. At the same time …

Bayesian hierarchical graph neural networks with uncertainty feedback for trustworthy fault diagnosis of industrial processes

D Chen, Z Xie, R Liu, W Yu, Q Hu, X Li… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Deep learning (DL) methods have been widely applied to intelligent fault diagnosis of
industrial processes and achieved state-of-the-art performance. However, fault diagnosis …

Cooperative Active Learning-Based Dual Control for Exploration and Exploitation in Autonomous Search

Z Li, WH Chen, J Yang, C Liu - IEEE Transactions on Neural …, 2024 - ieeexplore.ieee.org
In this article, a multi-estimator based computationally efficient algorithm is developed for
autonomous search in an unknown environment with an unknown source. Different from the …

Bayes-MIL: A New Probabilistic Perspective on Attention-based Multiple Instance Learning for Whole Slide Images

C Yufei, Z Liu, X Liu, X Liu, C Wang… - The Eleventh …, 2022 - openreview.net
Multiple instance learning (MIL) is a popular weakly-supervised learning model on the
whole slide image (WSI) for AI-assisted pathology diagnosis. The recent advance in …

Bayesian deep learning and uncertainty in computer vision

BT Phan - 2019 - uwspace.uwaterloo.ca
Visual data contains rich information about the operating environment of an intelligent
robotic system. Extracting this information allows intelligent systems to reason and decide …

Dual Control of Exploration and Exploitation for Auto-Optimization Control With Active Learning

Z Li, WH Chen, J Yang, Y Yan - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
The quest for optimal operation in environments with unknowns and uncertainties is highly
desirable but critically challenging across numerous fields. This paper develops a dual …

Variational nested dropout

Y Cui, Y Mao, Z Liu, Q Li, AB Chan, X Liu… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Nested dropout is a variant of dropout operation that is able to order network parameters or
features based on the pre-defined importance during training. It has been explored for: I …

Pareto optimization for active learning under out-of-distribution data scenarios

X Zhan, Z Dai, Q Wang, Q Li, H Xiong, D Dou… - arXiv preprint arXiv …, 2022 - arxiv.org
Pool-based Active Learning (AL) has achieved great success in minimizing labeling cost by
sequentially selecting informative unlabeled samples from a large unlabeled data pool and …

Functional ensemble distillation

C Penso, I Achituve, E Fetaya - Advances in Neural …, 2022 - proceedings.neurips.cc
Bayesian models have many desirable properties, most notable is their ability to generalize
from limited data and to properly estimate the uncertainty in their predictions. However …

The Pitfalls and Promise of Conformal Inference Under Adversarial Attacks

Z Liu, Y Cui, Y Yan, Y Xu, X Ji, X Liu… - arXiv preprint arXiv …, 2024 - arxiv.org
In safety-critical applications such as medical imaging and autonomous driving, where
decisions have profound implications for patient health and road safety, it is imperative to …