Task-agnostic continual learning using online variational bayes with fixed-point updates

C Zeno, I Golan, E Hoffer, D Soudry - Neural Computation, 2021 - direct.mit.edu
Catastrophic forgetting is the notorious vulnerability of neural networks to the changes in the
data distribution during learning. This phenomenon has long been considered a major …

Partitioned variational inference: A unified framework encompassing federated and continual learning

TD Bui, CV Nguyen, S Swaroop, RE Turner - arXiv preprint arXiv …, 2018 - arxiv.org
Variational inference (VI) has become the method of choice for fitting many modern
probabilistic models. However, practitioners are faced with a fragmented literature that offers …

Partitioned variational inference: A framework for probabilistic federated learning

M Ashman, TD Bui, CV Nguyen, S Markou… - arXiv preprint arXiv …, 2022 - arxiv.org
The proliferation of computing devices has brought about an opportunity to deploy machine
learning models on new problem domains using previously inaccessible data. Traditional …

Excess risk bounds for the bayes risk using variational inference in latent gaussian models

R Sheth, R Khardon - Advances in neural information …, 2017 - proceedings.neurips.cc
Bayesian models are established as one of the main successful paradigms for complex
problems in machine learning. To handle intractable inference, research in this area has …

Monte carlo structured svi for two-level non-conjugate models

R Sheth, R Khardon - arXiv preprint arXiv:1612.03957, 2016 - arxiv.org
The stochastic variational inference (SVI) paradigm, which combines variational inference,
natural gradients, and stochastic updates, was recently proposed for large-scale data …

Variational wishart approximation for graphical model selection: Monoscale and multiscale models

H Yu, L Xin, J Dauwels - IEEE Transactions on Signal …, 2019 - ieeexplore.ieee.org
Graphical models are powerful tools to describe high-dimensional data; they provide a
compact graphical representation of the interactions between different variables and such …

Algorithms and Theory for Variational Inference in Two-Level Non-conjugate Models

R Sheth - 2019 - search.proquest.com
Work over the last two decades has resulted in the development of powerful models in
probabilistic machine learning with a variety of applications: recommender systems …