Efficient mean estimation with pure differential privacy via a sum-of-squares exponential mechanism

SB Hopkins, G Kamath, M Majid - Proceedings of the 54th Annual ACM …, 2022 - dl.acm.org
We give the first polynomial-time algorithm to estimate the mean of ad-variate probability
distribution with bounded covariance from Õ (d) independent samples subject to pure …

Private robust estimation by stabilizing convex relaxations

P Kothari, P Manurangsi… - Conference on Learning …, 2022 - proceedings.mlr.press
We give the first polynomial time and sample (epsilon, delta)-differentially private (DP)
algorithm to estimate the mean, covariance and higher moments in the presence of a …

Private distribution learning with public data: The view from sample compression

S Ben-David, A Bie, CL Canonne… - Advances in …, 2023 - proceedings.neurips.cc
We study the problem of private distribution learning with access to public data. In this setup,
which we refer to as* public-private learning*, the learner is given public and private …

Robust and differentially private mean estimation

X Liu, W Kong, S Kakade, S Oh - Advances in neural …, 2021 - proceedings.neurips.cc
In statistical learning and analysis from shared data, which is increasingly widely adopted in
platforms such as federated learning and meta-learning, there are two major concerns …

Private and polynomial time algorithms for learning Gaussians and beyond

H Ashtiani, C Liaw - Conference on Learning Theory, 2022 - proceedings.mlr.press
We present a fairly general framework for reducing $(\varepsilon,\delta) $-differentially
private (DP) statistical estimation to its non-private counterpart. As the main application of …

Private estimation algorithms for stochastic block models and mixture models

H Chen, V Cohen-Addad, T d'Orsi… - Advances in …, 2023 - proceedings.neurips.cc
We introduce general tools for designing efficient private estimation algorithms, in the high-
dimensional settings, whose statistical guarantees almost match those of the best known …

Private estimation with public data

A Bie, G Kamath, V Singhal - Advances in neural …, 2022 - proceedings.neurips.cc
We initiate the study of differentially private (DP) estimation with access to a small amount of
public data. For private estimation of $ d $-dimensional Gaussians, we assume that the …

Coinpress: Practical private mean and covariance estimation

S Biswas, Y Dong, G Kamath… - Advances in Neural …, 2020 - proceedings.neurips.cc
We present simple differentially private estimators for the parameters of multivariate sub-
Gaussian data that are accurate at small sample sizes. We demonstrate the effectiveness of …

A private and computationally-efficient estimator for unbounded gaussians

G Kamath, A Mouzakis, V Singhal… - … on Learning Theory, 2022 - proceedings.mlr.press
We give the first polynomial-time, polynomial-sample, differentially private estimator for the
mean and covariance of an arbitrary Gaussian distribution $ N (\mu,\Sigma) $ in $\R^ d $. All …

Private mean estimation of heavy-tailed distributions

G Kamath, V Singhal, J Ullman - Conference on Learning …, 2020 - proceedings.mlr.press
We give new upper and lower bounds on the minimax sample complexity of differentially
private mean estimation of distributions with bounded $ k $-th moments. Roughly speaking …