Disordered systems insights on computational hardness

D Gamarnik, C Moore… - Journal of Statistical …, 2022 - iopscience.iop.org
In this review article we discuss connections between the physics of disordered systems,
phase transitions in inference problems, and computational hardness. We introduce two …

High-dimensional limit theorems for sgd: Effective dynamics and critical scaling

G Ben Arous, R Gheissari… - Advances in Neural …, 2022 - proceedings.neurips.cc
We study the scaling limits of stochastic gradient descent (SGD) with constant step-size in
the high-dimensional regime. We prove limit theorems for the trajectories of summary …

Smoothing the landscape boosts the signal for sgd: Optimal sample complexity for learning single index models

A Damian, E Nichani, R Ge… - Advances in Neural …, 2024 - proceedings.neurips.cc
We focus on the task of learning a single index model $\sigma (w^\star\cdot x) $ with respect
to the isotropic Gaussian distribution in $ d $ dimensions. Prior work has shown that the …

A unifying tutorial on approximate message passing

OY Feng, R Venkataramanan, C Rush… - … and Trends® in …, 2022 - nowpublishers.com
Over the last decade or so, Approximate Message Passing (AMP) algorithms have become
extremely popular in various structured high-dimensional statistical problems. Although the …

Notes on computational hardness of hypothesis testing: Predictions using the low-degree likelihood ratio

D Kunisky, AS Wein, AS Bandeira - ISAAC Congress (International Society …, 2019 - Springer
These notes survey and explore an emerging method, which we call the low-degree
method, for understanding statistical-versus-computational tradeoffs in high-dimensional …

Tensor SVD: Statistical and computational limits

A Zhang, D Xia - IEEE Transactions on Information Theory, 2018 - ieeexplore.ieee.org
In this paper, we propose a general framework for tensor singular value decomposition
(tensor singular value decomposition (SVD)), which focuses on the methodology and theory …

Mixture models, robustness, and sum of squares proofs

SB Hopkins, J Li - Proceedings of the 50th Annual ACM SIGACT …, 2018 - dl.acm.org
We use the Sum of Squares method to develop new efficient algorithms for learning well-
separated mixtures of Gaussians and robust mean estimation, both in high dimensions, that …

Robust moment estimation and improved clustering via sum of squares

PK Kothari, J Steinhardt, D Steurer - … of the 50th Annual ACM SIGACT …, 2018 - dl.acm.org
We develop efficient algorithms for estimating low-degree moments of unknown distributions
in the presence of adversarial outliers and design a new family of convex relaxations for k …

Reducibility and statistical-computational gaps from secret leakage

M Brennan, G Bresler - Conference on Learning Theory, 2020 - proceedings.mlr.press
Inference problems with conjectured statistical-computational gaps are ubiquitous
throughout modern statistics, computer science, statistical physics and discrete probability …

The power of sum-of-squares for detecting hidden structures

SB Hopkins, PK Kothari, A Potechin… - 2017 IEEE 58th …, 2017 - ieeexplore.ieee.org
We study planted problems-finding hidden structures in random noisy inputs-through the
lens of the sum-of-squares semidefinite programming hierarchy (SoS). This family of …