Disordered systems insights on computational hardness
D Gamarnik, C Moore… - Journal of Statistical …, 2022 - iopscience.iop.org
In this review article we discuss connections between the physics of disordered systems,
phase transitions in inference problems, and computational hardness. We introduce two …
phase transitions in inference problems, and computational hardness. We introduce two …
Frozen 1-RSB structure of the symmetric Ising perceptron
W Perkins, C Xu - Proceedings of the 53rd Annual ACM SIGACT …, 2021 - dl.acm.org
We prove, under an assumption on the critical points of a real-valued function, that the
symmetric Ising perceptron exhibits thefrozen 1-RSB'structure conjectured by Krauth and …
symmetric Ising perceptron exhibits thefrozen 1-RSB'structure conjectured by Krauth and …
Gardner formula for Ising perceptron models at small densities
E Bolthausen, S Nakajima, N Sun… - Conference on Learning …, 2022 - proceedings.mlr.press
We consider the Ising perceptron model with N spins and M= N* alpha patterns, with a
general activation function U that is bounded above. For U bounded away from zero, or U a …
general activation function U that is bounded above. For U bounded away from zero, or U a …
Binary perceptron: efficient algorithms can find solutions in a rare well-connected cluster
It was recently shown that almost all solutions in the symmetric binary perceptron are
isolated, even at low constraint densities, suggesting that finding typical solutions is hard. In …
isolated, even at low constraint densities, suggesting that finding typical solutions is hard. In …
Algorithms and barriers in the symmetric binary perceptron model
The binary (or Ising) perceptron is a toy model of a single-layer neural network and can be
viewed as a random constraint satisfaction problem with a high degree of connectivity. The …
viewed as a random constraint satisfaction problem with a high degree of connectivity. The …
Proof of the contiguity conjecture and lognormal limit for the symmetric perceptron
We consider the symmetric binary perceptron model, a simple model of neural networks that
has gathered significant attention in the statistical physics, information theory and probability …
has gathered significant attention in the statistical physics, information theory and probability …
Sharp threshold sequence and universality for ising perceptron models
S Nakajima, N Sun - Proceedings of the 2023 Annual ACM-SIAM …, 2023 - SIAM
We study a family of Ising perceptron models with {0, 1}-valued activation functions. This
includes the classical half-space models, as well as some of the symmetric models …
includes the classical half-space models, as well as some of the symmetric models …
Geometric barriers for stable and online algorithms for discrepancy minimization
D Gamarnik, EC Kizildağ… - The Thirty Sixth Annual …, 2023 - proceedings.mlr.press
For many computational problems involving randomness, intricate geometric features of the
solution space have been used to rigorously rule out powerful classes of algorithms. This is …
solution space have been used to rigorously rule out powerful classes of algorithms. This is …
Tractability from overparametrization: The example of the negative perceptron
In the negative perceptron problem we are given n data points (xi, yi), where xi is ad-
dimensional vector and yi∈{+ 1,-1} is a binary label. The data are not linearly separable and …
dimensional vector and yi∈{+ 1,-1} is a binary label. The data are not linearly separable and …
Algorithmic pure states for the negative spherical perceptron
A El Alaoui, M Sellke - Journal of Statistical Physics, 2022 - Springer
We consider the spherical perceptron with Gaussian disorder. This is the set S of points σ∈
RN on the sphere of radius N satisfying⟨ ga, σ⟩≥ κ N for all 1≤ a≤ M, where (ga) a= 1 M …
RN on the sphere of radius N satisfying⟨ ga, σ⟩≥ κ N for all 1≤ a≤ M, where (ga) a= 1 M …