Disordered systems insights on computational hardness
D Gamarnik, C Moore… - Journal of Statistical …, 2022 - iopscience.iop.org
In this review article we discuss connections between the physics of disordered systems,
phase transitions in inference problems, and computational hardness. We introduce two …
phase transitions in inference problems, and computational hardness. We introduce two …
High-dimensional limit theorems for sgd: Effective dynamics and critical scaling
G Ben Arous, R Gheissari… - Advances in Neural …, 2022 - proceedings.neurips.cc
We study the scaling limits of stochastic gradient descent (SGD) with constant step-size in
the high-dimensional regime. We prove limit theorems for the trajectories of summary …
the high-dimensional regime. We prove limit theorems for the trajectories of summary …
Smoothing the landscape boosts the signal for sgd: Optimal sample complexity for learning single index models
We focus on the task of learning a single index model $\sigma (w^\star\cdot x) $ with respect
to the isotropic Gaussian distribution in $ d $ dimensions. Prior work has shown that the …
to the isotropic Gaussian distribution in $ d $ dimensions. Prior work has shown that the …
A unifying tutorial on approximate message passing
Over the last decade or so, Approximate Message Passing (AMP) algorithms have become
extremely popular in various structured high-dimensional statistical problems. Although the …
extremely popular in various structured high-dimensional statistical problems. Although the …
Notes on computational hardness of hypothesis testing: Predictions using the low-degree likelihood ratio
These notes survey and explore an emerging method, which we call the low-degree
method, for understanding statistical-versus-computational tradeoffs in high-dimensional …
method, for understanding statistical-versus-computational tradeoffs in high-dimensional …
Tensor SVD: Statistical and computational limits
In this paper, we propose a general framework for tensor singular value decomposition
(tensor singular value decomposition (SVD)), which focuses on the methodology and theory …
(tensor singular value decomposition (SVD)), which focuses on the methodology and theory …
Mixture models, robustness, and sum of squares proofs
SB Hopkins, J Li - Proceedings of the 50th Annual ACM SIGACT …, 2018 - dl.acm.org
We use the Sum of Squares method to develop new efficient algorithms for learning well-
separated mixtures of Gaussians and robust mean estimation, both in high dimensions, that …
separated mixtures of Gaussians and robust mean estimation, both in high dimensions, that …
Robust moment estimation and improved clustering via sum of squares
We develop efficient algorithms for estimating low-degree moments of unknown distributions
in the presence of adversarial outliers and design a new family of convex relaxations for k …
in the presence of adversarial outliers and design a new family of convex relaxations for k …
Reducibility and statistical-computational gaps from secret leakage
M Brennan, G Bresler - Conference on Learning Theory, 2020 - proceedings.mlr.press
Inference problems with conjectured statistical-computational gaps are ubiquitous
throughout modern statistics, computer science, statistical physics and discrete probability …
throughout modern statistics, computer science, statistical physics and discrete probability …
The power of sum-of-squares for detecting hidden structures
We study planted problems-finding hidden structures in random noisy inputs-through the
lens of the sum-of-squares semidefinite programming hierarchy (SoS). This family of …
lens of the sum-of-squares semidefinite programming hierarchy (SoS). This family of …