Nonconvex optimization meets low-rank matrix factorization: An overview

Y Chi, YM Lu, Y Chen - IEEE Transactions on Signal …, 2019 - ieeexplore.ieee.org
Substantial progress has been made recently on developing provably accurate and efficient
algorithms for low-rank matrix factorization via nonconvex optimization. While conventional …

An overview of low-rank matrix recovery from incomplete observations

MA Davenport, J Romberg - IEEE Journal of Selected Topics in …, 2016 - ieeexplore.ieee.org
Low-rank matrices play a fundamental role in modeling and computational methods for
signal processing and machine learning. In many applications where low-rank matrices …

Non-convex optimization for machine learning

P Jain, P Kar - Foundations and Trends® in Machine …, 2017 - nowpublishers.com
A vast majority of machine learning algorithms train their models and perform inference by
solving optimization problems. In order to capture the learning and prediction problems …

Sparse local embeddings for extreme multi-label classification

K Bhatia, H Jain, P Kar, M Varma… - Advances in neural …, 2015 - proceedings.neurips.cc
The objective in extreme multi-label learning is to train a classifier that can automatically tag
a novel data point with the most relevant subset of labels from an extremely large label set …

Global optimality of local search for low rank matrix recovery

S Bhojanapalli, B Neyshabur… - Advances in Neural …, 2016 - proceedings.neurips.cc
We show that there are no spurious local minima in the non-convex factorized
parametrization of low-rank matrix recovery from incoherent linear measurements. With …

Low-rank matrix completion: A contemporary survey

LT Nguyen, J Kim, B Shim - IEEE Access, 2019 - ieeexplore.ieee.org
As a paradigm to recover unknown entries of a matrix from partial observations, low-rank
matrix completion (LRMC) has generated a great deal of interest. Over the years, there have …

Low-rank matrix completion using alternating minimization

P Jain, P Netrapalli, S Sanghavi - Proceedings of the forty-fifth annual …, 2013 - dl.acm.org
Alternating minimization represents a widely applicable and empirically successful
approach for finding low-rank matrices that best fit the given data. For example, for the …

Fast and accurate matrix completion via truncated nuclear norm regularization

Y Hu, D Zhang, J Ye, X Li, X He - IEEE transactions on pattern …, 2012 - ieeexplore.ieee.org
Recovering a large matrix from a small subset of its entries is a challenging problem arising
in many real applications, such as image inpainting and recommender systems. Many …

Fast low-rank estimation by projected gradient descent: General statistical and algorithmic guarantees

Y Chen, MJ Wainwright - arXiv preprint arXiv:1509.03025, 2015 - arxiv.org
Optimization problems with rank constraints arise in many applications, including matrix
regression, structured PCA, matrix completion and matrix decomposition problems. An …

Matrix completion from a few entries

RH Keshavan, A Montanari, S Oh - IEEE transactions on …, 2010 - ieeexplore.ieee.org
Let M be an n¿× n matrix of rank r, and assume that a uniformly random subset E of its
entries is observed. We describe an efficient algorithm, which we call OptSpace, that …