Complete dictionary recovery over the sphere I: Overview and the geometric picture
We consider the problem of recovering a complete (ie, square and invertible) matrix A 0,
from Y∈ R n× p with Y= A 0 X 0, provided X 0 is sufficiently sparse. This recovery problem is …
from Y∈ R n× p with Y= A 0 X 0, provided X 0 is sufficiently sparse. This recovery problem is …
Model-based deep learning
Signal processing, communications, and control have traditionally relied on classical
statistical modeling techniques. Such model-based methods utilize mathematical …
statistical modeling techniques. Such model-based methods utilize mathematical …
Non-convex optimization for machine learning
P Jain, P Kar - Foundations and Trends® in Machine …, 2017 - nowpublishers.com
A vast majority of machine learning algorithms train their models and perform inference by
solving optimization problems. In order to capture the learning and prediction problems …
solving optimization problems. In order to capture the learning and prediction problems …
A geometric analysis of phase retrieval
Can we recover a complex signal from its Fourier magnitudes? More generally, given a set
of m measurements, y_k=\left| a _k^* x\right| yk= ak∗ x for k= 1, ..., mk= 1,…, m, is it possible …
of m measurements, y_k=\left| a _k^* x\right| yk= ak∗ x for k= 1, ..., mk= 1,…, m, is it possible …
Feature purification: How adversarial training performs robust deep learning
Z Allen-Zhu, Y Li - 2021 IEEE 62nd Annual Symposium on …, 2022 - ieeexplore.ieee.org
Despite the empirical success of using adversarial training to defend deep learning models
against adversarial perturbations, so far, it still remains rather unclear what the principles are …
against adversarial perturbations, so far, it still remains rather unclear what the principles are …
Phase retrieval using alternating minimization
Phase retrieval problems involve solving linear equations, but with missing sign (or phase,
for complex numbers) information. Over the last two decades, a popular generic empirical …
for complex numbers) information. Over the last two decades, a popular generic empirical …
Generalized low rank models
Principal components analysis (PCA) is a well-known technique for approximating a tabular
data set by a low rank matrix. Here, we extend the idea of PCA to handle arbitrary data sets …
data set by a low rank matrix. Here, we extend the idea of PCA to handle arbitrary data sets …
A statistical perspective on algorithmic leveraging
One popular method for dealing with large-scale data sets is sampling. Using the empirical
statistical leverage scores as an importance sampling distribution, the method of algorithmic …
statistical leverage scores as an importance sampling distribution, the method of algorithmic …
Non-convex robust PCA
P Netrapalli, N UN, S Sanghavi… - Advances in neural …, 2014 - proceedings.neurips.cc
We propose a new provable method for robust PCA, where the task is to recover a low-rank
matrix, which is corrupted with sparse perturbations. Our method consists of simple …
matrix, which is corrupted with sparse perturbations. Our method consists of simple …
Sparse modeling for image and vision processing
In recent years, a large amount of multi-disciplinary research has been conducted on sparse
models and their applications. In statistics and machine learning, the sparsity principle is …
models and their applications. In statistics and machine learning, the sparsity principle is …