Matrix factorization with neural networks

F Camilli, M Mézard - Physical Review E, 2023 - APS
Matrix factorization is an important mathematical problem encountered in the context of
dictionary learning, recommendation systems, and machine learning. We introduce a …

The decimation scheme for symmetric matrix factorization

F Camilli, M Mézard - Journal of Physics A: Mathematical and …, 2024 - iopscience.iop.org
Matrix factorization is an inference problem that has acquired importance due to its vast
range of applications that go from dictionary learning to recommendation systems and …

Statistical limits of dictionary learning: random matrix theory and the spectral replica method

J Barbier, N Macris - Physical Review E, 2022 - APS
We consider increasingly complex models of matrix denoising and dictionary learning in the
Bayes-optimal setting, in the challenging regime where the matrices to infer have a rank …

Optimal denoising of rotationally invariant rectangular matrices

E Troiani, V Erba, F Krzakala… - Mathematical and …, 2022 - proceedings.mlr.press
In this manuscript we consider denoising of large rectangular matrices: given a noisy
observation of a signal matrix, what is the best way of recovering the signal matrix itself? For …

A concise tutorial on approximate message passing

Q Zou, H Yang - arXiv preprint arXiv:2201.07487, 2022 - arxiv.org
High-dimensional signal recovery of standard linear regression is a key challenge in many
engineering fields, such as, communications, compressed sensing, and image processing …

Matrix inference in growing rank regimes

F Pourkamali, J Barbier, N Macris - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
The inference of a large symmetric signal-matrix S∈ RN× N corrupted by additive Gaussian
noise, is considered for two regimes of growth of the rank M as a function of N. For sub-linear …

Rectangular rotational invariant estimator for general additive noise matrices

F Pourkamali, N Macris - 2023 IEEE International Symposium …, 2023 - ieeexplore.ieee.org
We propose a rectangular rotational invariant estimator to recover a real matrix from noisy
matrix observations coming from an arbitrary additive rotational invariant perturbation, in the …

Bayesian extensive-rank matrix factorization with rotational invariant priors

F Pourkamali, N Macris - Advances in Neural Information …, 2024 - proceedings.neurips.cc
We consider a statistical model for matrix factorization in a regime where the rank of the two
hidden matrix factors grows linearly with their dimension and their product is corrupted by …

Deep learning via message passing algorithms based on belief propagation

C Lucibello, F Pittorino, G Perugini… - … Learning: Science and …, 2022 - iopscience.iop.org
Message-passing algorithms based on the belief propagation (BP) equations constitute a
well-known distributed computational scheme. They yield exact marginals on tree-like …

Matrix denoising: Bayes-optimal estimators via low-degree polynomials

G Semerjian - arXiv preprint arXiv:2402.16719, 2024 - arxiv.org
We consider the additive version of the matrix denoising problem, where a random
symmetric matrix $ S $ of size $ n $ has to be inferred from the observation of $ Y= S+ Z …