Position paper: Bayesian deep learning in the age of large-scale ai

T Papamarkou, M Skoularidou, K Palla… - arXiv preprint arXiv …, 2024 - arxiv.org
In the current landscape of deep learning research, there is a predominant emphasis on
achieving high predictive accuracy in supervised tasks involving large image and language …

A Bayesian Interpretation of Adaptive Low-Rank Adaptation

H Chen, PN Garner - arXiv preprint arXiv:2409.10673, 2024 - arxiv.org
Motivated by the sensitivity-based importance score of the adaptive low-rank adaptation
(AdaLoRA), we utilize more theoretically supported metrics, including the signal-to-noise …

Partially Stochastic Infinitely Deep Bayesian Neural Networks

SC Ordoñez, M Meunier, F Piatti, Y Shi - Forty-first International Conference … - openreview.net
In this paper, we present Partially Stochastic Infinitely Deep Bayesian Neural Networks, a
novel family of architectures that integrates partial stochasticity into the framework of …