Statistical indistinguishability of learning algorithms

A Kalavasis, A Karbasi, S Moran… - … on Machine Learning, 2023 - proceedings.mlr.press
When two different parties use the same learning rule on their own data, how can we test
whether the distributions of the two outcomes are similar? In this paper, we study the …

Optimal learners for realizable regression: Pac learning and online learning

I Attias, S Hanneke, A Kalavasis… - Advances in …, 2023 - proceedings.neurips.cc
In this work, we aim to characterize the statistical complexity of realizable regression both in
the PAC learning setting and the online learning setting. Previous work had established the …

Universal Rates for Regression: Separations between Cut-Off and Absolute Loss

I Attias, S Hanneke, A Kalavasis… - The Thirty Seventh …, 2024 - proceedings.mlr.press
In this work we initiate the study of regression in the universal rates framework of Bousquet
et al. Unlike the traditional uniform learning setting, we are interested in obtaining learning …

Regularization and optimal multiclass learning

J Asilis, S Devic, S Dughmi… - The Thirty Seventh …, 2024 - proceedings.mlr.press
The quintessential learning algorithm of empirical risk minimization (ERM) is known to fail in
various settings for which uniform convergence does not characterize learning. Relatedly …

On the Limits of Language Generation: Trade-Offs Between Hallucination and Mode Collapse

A Kalavasis, A Mehrotra, G Velegkas - arXiv preprint arXiv:2411.09642, 2024 - arxiv.org
Specifying all desirable properties of a language model is challenging, but certain
requirements seem essential. Given samples from an unknown language, the trained model …

A characterization of list learnability

M Charikar, C Pabbaraju - Proceedings of the 55th Annual ACM …, 2023 - dl.acm.org
A classical result in learning theory shows the equivalence of PAC learnability of binary
hypothesis classes and the finiteness of VC dimension. Extending this to the multiclass …

Ramsey Theorems for Trees and a General 'Private Learning Implies Online Learning'Theorem

S Fioravanti, S Hanneke, S Moran… - 2024 IEEE 65th …, 2024 - ieeexplore.ieee.org
This work continues to investigate the link between differentially private (DP) and online
learning. Alon, Livni, Malliaris, and Moran [4] showed that for binary concept classes, DP …

Universal Rates for Multiclass Learning

S Hanneke, S Moran, Q Zhang - The Thirty Sixth Annual …, 2023 - proceedings.mlr.press
We study universal rates for multiclass classification, establishing the optimal rates (up to log
factors) for all hypothesis classes. This generalizes previous results on binary classification …

Optimal pac bounds without uniform convergence

I Aden-Ali, Y Cherapanamjeri, A Shetty… - 2023 IEEE 64th …, 2023 - ieeexplore.ieee.org
In statistical learning theory, determining the sample complexity of realizable binary
classification for VC classes was a long-standing open problem. The results of Simon [1] and …

Universal Rates of Empirical Risk Minimization

S Hanneke, M Xu - arXiv preprint arXiv:2412.02810, 2024 - arxiv.org
The well-known empirical risk minimization (ERM) principle is the basis of many widely used
machine learning algorithms, and plays an essential role in the classical PAC theory. A …