Game-theoretic statistics and safe anytime-valid inference

A Ramdas, P Grünwald, V Vovk, G Shafer - Statistical Science, 2023 - projecteuclid.org
Safe anytime-valid inference (SAVI) provides measures of statistical evidence and certainty—
e-processes for testing and confidence sequences for estimation—that remain valid at all …

Estimating means of bounded random variables by betting

I Waudby-Smith, A Ramdas - Journal of the Royal Statistical …, 2024 - academic.oup.com
We derive confidence intervals (CIs) and confidence sequences (CSs) for the classical
problem of estimating a bounded mean. Our approach generalizes and improves on the …

A unified recipe for deriving (time-uniform) PAC-Bayes bounds

B Chugg, H Wang, A Ramdas - Journal of Machine Learning Research, 2023 - jmlr.org
We present a unified framework for deriving PAC-Bayesian generalization bounds. Unlike
most previous literature on this topic, our bounds are anytime-valid (ie, time-uniform) …

Policy learning" without''overlap: Pessimism and generalized empirical Bernstein's inequality

Y Jin, Z Ren, Z Yang, Z Wang - arXiv preprint arXiv:2212.09900, 2022 - arxiv.org
This paper studies offline policy learning, which aims at utilizing observations collected a
priori (from either fixed or adaptively evolving behavior policies) to learn the optimal …

Auditing fairness by betting

B Chugg, S Cortes-Gomez, B Wilder… - Advances in Neural …, 2023 - proceedings.neurips.cc
We provide practical, efficient, and nonparametric methods for auditing the fairness of
deployed classification and regression models. Whereas previous work relies on a fixed …

Jiayi Li, Yuantong Li and Xiaowu Dai's contribution to the Discussion of 'Estimating means of bounded random variables by betting'by Waudby-Smith and Ramdas

J Li, Y Li, X Dai - Journal of the Royal Statistical Society Series …, 2024 - academic.oup.com
1 Methods Consider a sequence of random variables (X t) t= 1∞⁠, drawn from a distribution
P∈ P μ⁠, where P μ represents the set of all distributions on [0, 1]∞⁠. We assume EP [X t| X …

Comparing sequential forecasters

YJ Choe, A Ramdas - Operations Research, 2023 - pubsonline.informs.org
Consider two forecasters, each making a single prediction for a sequence of events over
time. We ask a relatively basic question: how might we compare these forecasters, either …

Art Owen's contribution to the Discussion of 'Estimating means of bounded random variables by betting'by Waudby-Smith and Ramdas

AB Owen - Journal of the Royal Statistical Society Series B …, 2024 - academic.oup.com
We derive confidence intervals (CIs) and confidence sequences (CSs) for the classical
problem of estimating a bounded mean. Our approach generalizes and improves on the …

Risk-limiting financial audits via weighted sampling without replacement

S Shekhar, Z Xu, Z Lipton, P Liang… - Uncertainty in …, 2023 - proceedings.mlr.press
We introduce the notion of risk-limiting financial audits (RLFA): procedures that manually
evaluate a subset of $ N $ financial transactions to check the validity of a claimed assertion …

Nonparametric extensions of randomized response for private confidence sets

I Waudby-Smith, S Wu… - … Conference on Machine …, 2023 - proceedings.mlr.press
This work derives methods for performing nonparametric, nonasymptotic statistical inference
for population means under the constraint of local differential privacy (LDP). Given bounded …