Gcr: Gradient coreset based replay buffer selection for continual learning

R Tiwari, K Killamsetty, R Iyer… - Proceedings of the …, 2022 - openaccess.thecvf.com
Continual learning (CL) aims to develop techniques by which a single model adapts to an
increasing number of tasks encountered sequentially, thereby potentially leveraging …

Can Public Large Language Models Help Private Cross-device Federated Learning?

B Wang, YJ Zhang, Y Cao, B Li, HB McMahan… - arXiv preprint arXiv …, 2023 - arxiv.org
We study (differentially) private federated learning (FL) of language models. The language
models in cross-device FL are relatively small, which can be trained with meaningful formal …

Emerging Directions in Bayesian Computation

S Winter, T Campbell, L Lin, S Srivastava… - Statistical …, 2024 - projecteuclid.org
Bayesian models are powerful tools for studying complex data, allowing the analyst to
encode rich hierarchical dependencies and leverage prior information. Most importantly …

Coreset Markov chain Monte Carlo

N Chen, T Campbell - International Conference on Artificial …, 2024 - proceedings.mlr.press
A Bayesian coreset is a small, weighted subset of data that replaces the full dataset during
inference in order to reduce computational cost. However, state of the art methods for tuning …

Bayesian inference via sparse Hamiltonian flows

N Chen, Z Xu, T Campbell - Advances in Neural …, 2022 - proceedings.neurips.cc
A Bayesian coreset is a small, weighted subset of data that replaces the full dataset during
Bayesian inference, with the goal of reducing computational cost. Although past work has …

Fast Bayesian coresets via subsampling and quasi-Newton refinement

C Naik, J Rousseau… - Advances in Neural …, 2022 - proceedings.neurips.cc
Bayesian coresets approximate a posterior distribution by building a small weighted subset
of the data points. Any inference procedure that is too computationally expensive to be run …

Image quality assessment via inter-class and intra-class differences for efficient classification

J Yang, Y Yang, Y Li, Z Zhang, J Wen - Neural Processing Letters, 2023 - Springer
With the development of data-centric artificial intelligence, more and more people pay
attention to the importance of image information quality. Based on the core idea that images …

Black-box coreset variational inference

D Manousakas, H Ritter… - Advances in Neural …, 2022 - proceedings.neurips.cc
Recent advances in coreset methods have shown that a selection of representative
datapoints can replace massive volumes of data for Bayesian inference, preserving the …

Machine learning and the future of bayesian computation

S Winter, T Campbell, L Lin, S Srivastava… - arXiv preprint arXiv …, 2023 - arxiv.org
Bayesian models are a powerful tool for studying complex data, allowing the analyst to
encode rich hierarchical dependencies and leverage prior information. Most importantly …

Towards trustworthy large language models

B Wang - 2023 - ideals.illinois.edu
In the recent era of artificial intelligence, Large Language Models (LLMs) have achieved
unprecedented success in a wide range of Natural Language Processing (NLP) tasks …