Breaking the communication-privacy-accuracy trilemma

WN Chen, P Kairouz, A Ozgur - Advances in Neural …, 2020 - proceedings.neurips.cc
Two major challenges in distributed learning and estimation are 1) preserving the privacy of
the local samples; and 2) communicating them efficiently to a central server, while achieving …

Communication-efficient accurate statistical estimation

J Fan, Y Guo, K Wang - Journal of the American Statistical …, 2023 - Taylor & Francis
When the data are stored in a distributed manner, direct applications of traditional statistical
inference procedures are often prohibitive due to communication costs and privacy …

Optimal compression of locally differentially private mechanisms

A Shah, WN Chen, J Balle… - International …, 2022 - proceedings.mlr.press
Compressing the output of $\epsilon $-locally differentially private (LDP) randomizers
naively leads to suboptimal utility. In this work, we demonstrate the benefits of using …

Lower bounds for learning distributions under communication constraints via fisher information

LP Barnes, Y Han, A Ozgur - Journal of Machine Learning Research, 2020 - jmlr.org
We consider the problem of learning high-dimensional, nonparametric and structured (eg,
Gaussian) distributions in distributed networks, where each node in the network observes an …

Inference under information constraints I: Lower bounds from chi-square contraction

J Acharya, CL Canonne, H Tyagi - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Multiple players are each given one independent sample, about which they can only provide
limited information to a central referee. Each player is allowed to describe its observed …

Geometric lower bounds for distributed parameter estimation under communication constraints

Y Han, A Özgür, T Weissman - Conference On Learning …, 2018 - proceedings.mlr.press
We consider parameter estimation in distributed networks, where each sensor in the network
observes an independent sample from an underlying distribution and has $ k $ bits to …

Interactive inference under information constraints

J Acharya, CL Canonne, Y Liu, Z Sun… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
We study the role of interactivity in distributed statistical inference under information
constraints, eg, communication constraints and local differential privacy. We focus on the …

Inference under information constraints II: Communication constraints and shared randomness

J Acharya, CL Canonne, H Tyagi - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
A central server needs to perform statistical inference based on samples that are distributed
over multiple users who can each send a message of limited length to the center. We study …

Unified lower bounds for interactive high-dimensional estimation under information constraints

J Acharya, CL Canonne, Z Sun… - Advances in Neural …, 2024 - proceedings.neurips.cc
We consider distributed parameter estimation using interactive protocols subject to local
information constraints such as bandwidth limitations, local differential privacy, and restricted …

Inference under information constraints: Lower bounds from chi-square contraction

J Acharya, CL Canonne… - Conference on Learning …, 2019 - proceedings.mlr.press
Multiple users getting one sample each from an unknown distribution seek to enable a
central server to conduct statistical inference. However, each player can only provide limited …