An introduction to continuous optimization for imaging

A Chambolle, T Pock - Acta Numerica, 2016 - cambridge.org
A large number of imaging problems reduce to the optimization of a cost function, with
typical structural properties. The aim of this paper is to describe the state of the art in …

Theoretical linear convergence of unfolded ISTA and its practical weights and thresholds

X Chen, J Liu, Z Wang, W Yin - Advances in Neural …, 2018 - proceedings.neurips.cc
In recent years, unfolding iterative algorithms as neural networks has become an empirical
success in solving sparse recovery problems. However, its theoretical understanding is still …

Deep subspace clustering

X Peng, J Feng, JT Zhou, Y Lei… - IEEE transactions on …, 2020 - ieeexplore.ieee.org
In this article, we propose a deep extension of sparse subspace clustering, termed deep
subspace clustering with L1-norm (DSC-L1). Regularized by the unit sphere distribution …

Implicit regularization for optimal sparse recovery

T Vaskevicius, V Kanade… - Advances in Neural …, 2019 - proceedings.neurips.cc
We investigate implicit regularization schemes for gradient descent methods applied to
unpenalized least squares regression to solve the problem of reconstructing a sparse signal …

Group sparse optimization via lp, q regularization

Y Hu, C Li, K Meng, J Qin, X Yang - Journal of Machine Learning Research, 2017 - jmlr.org
In this paper, we investigate a group sparse optimization problem via lp, q regularization in
three aspects: theory, algorithm and application. In the theoretical aspect, by introducing a …

Activity identification and local linear convergence of forward--backward-type methods

J Liang, J Fadili, G Peyré - SIAM Journal on Optimization, 2017 - SIAM
In this paper, we consider a class of Forward--Backward (FB) splitting methods that includes
several variants (eg, inertial schemes, FISTA) for minimizing the sum of two proper convex …

Linear convergence of proximal gradient algorithm with extrapolation for a class of nonconvex nonsmooth minimization problems

B Wen, X Chen, TK Pong - SIAM Journal on Optimization, 2017 - SIAM
In this paper, we study the proximal gradient algorithm with extrapolation for minimizing the
sum of a Lipschitz differentiable function and a proper closed convex function. Under the …

A generic online acceleration scheme for optimization algorithms via relaxation and inertia

F Iutzeler, JM Hendrickx - Optimization Methods and Software, 2019 - Taylor & Francis
We propose generic acceleration schemes for a wide class of optimization and iterative
schemes based on relaxation and inertia. In particular, we introduce methods that …

Backtracking strategies for accelerated descent methods with smooth composite objectives

L Calatroni, A Chambolle - SIAM journal on optimization, 2019 - SIAM
We present and analyze a backtracking strategy for a general fast iterative shrinkage/
thresholding algorithm proposed by Chambolle and Pock [Acta Numer., 25 (2016), pp. 161 …

Sparse supervised representation-based classifier for uncontrolled and imbalanced classification

T Shu, B Zhang, YY Tang - IEEE transactions on neural …, 2018 - ieeexplore.ieee.org
The sparse representation-based classification (SRC) has been utilized in many
applications and is an effective algorithm in machine learning. However, the performance of …