Non-convex optimization for machine learning

P Jain, P Kar - Foundations and Trends® in Machine …, 2017 - nowpublishers.com
A vast majority of machine learning algorithms train their models and perform inference by
solving optimization problems. In order to capture the learning and prediction problems …

Low-rank matrix completion using alternating minimization

P Jain, P Netrapalli, S Sanghavi - Proceedings of the forty-fifth annual …, 2013 - dl.acm.org
Alternating minimization represents a widely applicable and empirically successful
approach for finding low-rank matrices that best fit the given data. For example, for the …

Guaranteed rank minimization via singular value projection

P Jain, R Meka, I Dhillon - Advances in Neural Information …, 2010 - proceedings.neurips.cc
Minimizing the rank of a matrix subject to affine constraints is a fundamental problem with
many important applications in machine learning and statistics. In this paper we propose a …

A convergent gradient descent algorithm for rank minimization and semidefinite programming from random linear measurements

Q Zheng, J Lafferty - Advances in Neural Information …, 2015 - proceedings.neurips.cc
We propose a simple, scalable, and fast gradient descent algorithm to optimize a nonconvex
objective for the rank minimization problem and a closely related family of semidefinite …

Admira: Atomic decomposition for minimum rank approximation

K Lee, Y Bresler - IEEE Transactions on Information Theory, 2010 - ieeexplore.ieee.org
In this paper, we address compressed sensing of a low-rank matrix posing the inverse
problem as an approximation problem with a specified target rank of the solution. A simple …

Necessary and sufficient conditions for success of the nuclear norm heuristic for rank minimization

B Recht, W Xu, B Hassibi - 2008 47th IEEE Conference on …, 2008 - ieeexplore.ieee.org
Minimizing the rank of a matrix subject to constraints is a challenging is a challenging
problem that arises in many control applications including controller design, realization …

[HTML][HTML] A computational framework for influenza antigenic cartography

Z Cai, T Zhang, XF Wan - PLoS computational biology, 2010 - journals.plos.org
Influenza viruses have been responsible for large losses of lives around the world and
continue to present a great public health challenge. Antigenic characterization based on …

Null space conditions and thresholds for rank minimization

B Recht, W Xu, B Hassibi - Mathematical programming, 2011 - Springer
Minimizing the rank of a matrix subject to constraints is a challenging problem that arises in
many applications in machine learning, control theory, and discrete geometry. This class of …

Harnessing the power of sample abundance: Theoretical guarantees and algorithms for accelerated one-bit sensing

A Eamaz, F Yeganegi, D Needell… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
One-bit quantization with time-varying sampling thresholds (also known as random
dithering) has recently found significant utilization potential in statistical signal processing …

Rank-constrained optimization and its applications

C Sun, R Dai - Automatica, 2017 - Elsevier
This paper investigates an iterative approach to solve the general rank-constrained
optimization problems (RCOPs) defined to optimize a convex objective function subject to a …