Phase transitions in the mini-batch size for sparse and dense two-layer neural networks

R Marino, F Ricci-Tersenghi - Machine Learning: Science and …, 2024 - iopscience.iop.org
The use of mini-batches of data in training artificial neural networks is nowadays very
common. Despite its broad usage, theories explaining quantitatively how large or small the …

Greed is good: correspondence recovery for unlabeled linear regression

H Zhang, P Li - Uncertainty in Artificial Intelligence, 2023 - proceedings.mlr.press
We consider the unlabeled linear regression reading as $\mathbf {Y}=\mathbf
{\Pi}^{*}\mathbf {X}\mathbf {B}^*+\mathbf {W} $, where $\mathbf {\Pi}^{*},\mathbf {B}^* $ and …

Where do hard problems really exist?

R Marino - arXiv preprint arXiv:2309.16253, 2023 - arxiv.org
This chapter delves into the realm of computational complexity, exploring the world of
challenging combinatorial problems and their ties with statistical physics. Our exploration …

[HTML][HTML] Replica-symmetry breaking transitions in the large deviations of the ground-state of a spherical spin-glass

B Lacroix-A-Chez-Toine, YV Fyodorov… - Journal of Statistical …, 2024 - Springer
We derive, within the replica formalism, a generalisation of the Crisanti–Sommers formula to
describe the large deviation function (LDF) L (e) for the speed-N atypical fluctuations of the …

Central limit theorems for combinatorial optimization problems on sparse Erdős–Rényi graphs

S Cao - The Annals of Applied Probability, 2021 - projecteuclid.org
For random combinatorial optimization problems, there has been much progress in
establishing laws of large numbers and computing limiting constants for the optimal values …

Large deviations of the free energy in the -spin glass spherical model

M Pastore, A Di Gioacchino, P Rotondo - Physical Review Research, 2019 - APS
We investigate the behavior of the rare fluctuations of the free energy in the p-spin spherical
model, evaluating the corresponding rate function via the Gärtner-Ellis theorem. This …

The Phase Transition Phenomenon of Shuffled Regression

H Zhang, P Li - arXiv preprint arXiv:2310.20438, 2023 - arxiv.org
We study the phase transition phenomenon inherent in the shuffled (permuted) regression
problem, which has found numerous applications in databases, privacy, data analysis, etc …

Random-link matching problems on random regular graphs

G Parisi, G Perrupato, G Sicuro - Journal of Statistical Mechanics …, 2020 - iopscience.iop.org
We study the random-link matching problem on random regular graphs, along with two
relaxed versions of the problem, namely the fractional matching and the so …

Replicas in complex systems: applications to large deviations and neural networks

M Pastore - 2020 - air.unimi.it
In this thesis, we apply methods from replica theory to deal with two contemporary problems
in the study of complex systems. In Part I, we discuss the behavior of the rare fluctuations of …

Identifying Phase Transition Thresholds of Permuted Linear Regression via Message Passing

H Zhang, P Li - openreview.net
This paper considers the permuted linear regression, ie, ${\mathbf {Y}}={\mathbf
{\Pi}}^{\natural}{\mathbf {X}}{\mathbf {B}}^{\natural}+{\mathbf {W}} $, where ${\mathbf …