Gaussian processes and kernel methods: A review on connections and equivalences

M Kanagawa, P Hennig, D Sejdinovic… - arXiv preprint arXiv …, 2018 - arxiv.org
This paper is an attempt to bridge the conceptual gaps between researchers working on the
two widely used approaches based on positive definite kernels: Bayesian learning or …

Galactica: A large language model for science

R Taylor, M Kardas, G Cucurull, T Scialom… - arXiv preprint arXiv …, 2022 - arxiv.org
Information overload is a major obstacle to scientific progress. The explosive growth in
scientific literature and data has made it ever harder to discover useful insights in a large …

Control functionals for Monte Carlo integration

CJ Oates, M Girolami, N Chopin - Journal of the Royal Statistical …, 2017 - academic.oup.com
A non-parametric extension of control variates is presented. These leverage gradient
information on the sampling density to achieve substantial variance reduction. It is not …

Probabilistic integration

FX Briol, CJ Oates, M Girolami, MA Osborne… - Statistical Science, 2019 - JSTOR
A research frontier has emerged in scientific computation, wherein discretisation error is
regarded as a source of epistemic uncertainty that can be modelled. This raises several …

Preferential bayesian optimization

J González, Z Dai, A Damianou… - … on Machine Learning, 2017 - proceedings.mlr.press
Bayesian optimization (BO) has emerged during the last few years as an effective approach
to optimize black-box functions where direct queries of the objective are expensive. We …

Monte Carlo with determinantal point processes

R Bardenet, A Hardy - 2020 - projecteuclid.org
We show that repulsive random variables can yield Monte Carlo methods with faster
convergence rates than the typical N^-1/2, where N is the number of integrand evaluations …

Variational bayesian monte carlo

L Acerbi - Advances in Neural Information Processing …, 2018 - proceedings.neurips.cc
Many probabilistic models of interest in scientific computing and machine learning have
expensive, black-box likelihoods that prevent the application of standard techniques for …

Kernel thinning

R Dwivedi, L Mackey - arXiv preprint arXiv:2105.05842, 2021 - arxiv.org
We introduce kernel thinning, a new procedure for compressing a distribution $\mathbb {P} $
more effectively than iid sampling or standard thinning. Given a suitable reproducing kernel …

Fast Bayesian inference with batch Bayesian quadrature via kernel recombination

M Adachi, S Hayakawa, M Jørgensen… - Advances in …, 2022 - proceedings.neurips.cc
Calculation of Bayesian posteriors and model evidences typically requires numerical
integration. Bayesian quadrature (BQ), a surrogate-model-based approach to numerical …

Positively weighted kernel quadrature via subsampling

S Hayakawa, H Oberhauser… - Advances in Neural …, 2022 - proceedings.neurips.cc
We study kernel quadrature rules with convex weights. Our approach combines the spectral
properties of the kernel with recombination results about point measures. This results in …