Phase retrieval: From computational imaging to machine learning: A tutorial

J Dong, L Valzania, A Maillard, T Pham… - IEEE Signal …, 2023 - ieeexplore.ieee.org
Phase retrieval consists in the recovery of a complex-valued signal from intensity-only
measurements. As it pervades a broad variety of applications, many researchers have …

Spectral universality in regularized linear regression with nearly deterministic sensing matrices

R Dudeja, S Sen, YM Lu - IEEE Transactions on Information …, 2024 - ieeexplore.ieee.org
It has been observed that the performances of many high-dimensional estimation problems
are universal with respect to underlying sensing (or design) matrices. Specifically, matrices …

Optimal algorithms for the inhomogeneous spiked Wigner model

A Pak, J Ko, F Krzakala - Advances in Neural Information …, 2024 - proceedings.neurips.cc
We study a spiked Wigner problem with an inhomogeneous noise profile. Our aim in this
problem is to recover the signal passed through an inhomogeneous low-rank matrix …

Bayes-optimal learning of an extensive-width neural network from quadratically many samples

A Maillard, E Troiani, S Martin, F Krzakala… - arXiv preprint arXiv …, 2024 - arxiv.org
We consider the problem of learning a target function corresponding to a single hidden layer
neural network, with a quadratic activation function after the first layer, and random weights …

Precise asymptotics for spectral methods in mixed generalized linear models

Y Zhang, M Mondelli, R Venkataramanan - arXiv preprint arXiv …, 2022 - arxiv.org
In a mixed generalized linear model, the objective is to learn multiple signals from unlabeled
observations: each sample comes from exactly one signal, but it is not known which one. We …

Spectral estimators for structured generalized linear models via approximate message passing

Y Zhang, HC Ji, R Venkataramanan… - The Thirty Seventh …, 2024 - proceedings.mlr.press
We consider the problem of parameter estimation in a high-dimensional generalized linear
model. Spectral methods obtained via the principal eigenvector of a suitable data …

Spectral Phase Transition and Optimal PCA in Block-Structured Spiked models

P Mergny, J Ko, F Krzakala - arXiv preprint arXiv:2403.03695, 2024 - arxiv.org
We discuss the inhomogeneous spiked Wigner model, a theoretical framework recently
introduced to study structured noise in various learning scenarios, through the prism of …

Misspecified phase retrieval with generative priors

Z Liu, X Wang, J Liu - Advances in Neural Information …, 2022 - proceedings.neurips.cc
In this paper, we study phase retrieval under model misspecification and generative priors.
In particular, we aim to estimate an $ n $-dimensional signal $\mathbf {x} $ from $ m $ iid …

Nishimori meets Bethe: a spectral method for node classification in sparse weighted graphs

L Dall'Amico, R Couillet… - Journal of Statistical …, 2021 - iopscience.iop.org
This article unveils a new relation between the Nishimori temperature parametrizing a
distribution P and the Bethe free energy on random Erdős–Rényi graphs with edge weights …

Sparse superposition codes under VAMP decoding with generic rotational invariant coding matrices

TQ Hou, YH Liu, T Fu, J Barbier - 2022 IEEE International …, 2022 - ieeexplore.ieee.org
Sparse superposition codes were originally proposed as a capacity-achieving
communication scheme over the gaussian channel, whose coding matrices were made of iid …