Disordered systems insights on computational hardness

D Gamarnik, C Moore… - Journal of Statistical …, 2022 - iopscience.iop.org
In this review article we discuss connections between the physics of disordered systems,
phase transitions in inference problems, and computational hardness. We introduce two …

Frozen 1-RSB structure of the symmetric Ising perceptron

W Perkins, C Xu - Proceedings of the 53rd Annual ACM SIGACT …, 2021 - dl.acm.org
We prove, under an assumption on the critical points of a real-valued function, that the
symmetric Ising perceptron exhibits thefrozen 1-RSB'structure conjectured by Krauth and …

Gardner formula for Ising perceptron models at small densities

E Bolthausen, S Nakajima, N Sun… - Conference on Learning …, 2022 - proceedings.mlr.press
We consider the Ising perceptron model with N spins and M= N* alpha patterns, with a
general activation function U that is bounded above. For U bounded away from zero, or U a …

Binary perceptron: efficient algorithms can find solutions in a rare well-connected cluster

E Abbe, S Li, A Sly - Proceedings of the 54th Annual ACM SIGACT …, 2022 - dl.acm.org
It was recently shown that almost all solutions in the symmetric binary perceptron are
isolated, even at low constraint densities, suggesting that finding typical solutions is hard. In …

Algorithms and barriers in the symmetric binary perceptron model

D Gamarnik, EC Kızıldağ, W Perkins… - 2022 IEEE 63rd Annual …, 2022 - ieeexplore.ieee.org
The binary (or Ising) perceptron is a toy model of a single-layer neural network and can be
viewed as a random constraint satisfaction problem with a high degree of connectivity. The …

Proof of the contiguity conjecture and lognormal limit for the symmetric perceptron

E Abbe, S Li, A Sly - 2021 IEEE 62nd Annual Symposium on …, 2022 - ieeexplore.ieee.org
We consider the symmetric binary perceptron model, a simple model of neural networks that
has gathered significant attention in the statistical physics, information theory and probability …

Sharp threshold sequence and universality for ising perceptron models

S Nakajima, N Sun - Proceedings of the 2023 Annual ACM-SIAM …, 2023 - SIAM
We study a family of Ising perceptron models with {0, 1}-valued activation functions. This
includes the classical half-space models, as well as some of the symmetric models …

Geometric barriers for stable and online algorithms for discrepancy minimization

D Gamarnik, EC Kizildağ… - The Thirty Sixth Annual …, 2023 - proceedings.mlr.press
For many computational problems involving randomness, intricate geometric features of the
solution space have been used to rigorously rule out powerful classes of algorithms. This is …

Tractability from overparametrization: The example of the negative perceptron

A Montanari, Y Zhong, K Zhou - Probability Theory and Related Fields, 2024 - Springer
In the negative perceptron problem we are given n data points (xi, yi), where xi is ad-
dimensional vector and yi∈{+ 1,-1} is a binary label. The data are not linearly separable and …

Algorithmic pure states for the negative spherical perceptron

A El Alaoui, M Sellke - Journal of Statistical Physics, 2022 - Springer
We consider the spherical perceptron with Gaussian disorder. This is the set S of points σ∈
RN on the sphere of radius N satisfying⟨ ga, σ⟩≥ κ N for all 1≤ a≤ M, where (ga) a= 1 M …