Investigating bi-level optimization for learning and vision from a unified perspective: A survey and beyond

R Liu, J Gao, J Zhang, D Meng… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Bi-Level Optimization (BLO) is originated from the area of economic game theory and then
introduced into the optimization community. BLO is able to handle problems with a …

A first order method for solving convex bilevel optimization problems

S Sabach, S Shtern - SIAM Journal on Optimization, 2017 - SIAM
In this paper we study convex bilevel optimization problems for which the inner level
consists of minimization of the sum of smooth and nonsmooth functions. The outer level aims …

An inertial extrapolation method for convex simple bilevel optimization

Y Shehu, PT Vuong, A Zemkoho - Optimization Methods and …, 2021 - Taylor & Francis
We consider a scalar objective minimization problem over the solution set of another
optimization problem. This problem is known as a simple bilevel optimization problem and …

Superiorization: An optimization heuristic for medical physics

GT Herman, E Garduño, R Davidi, Y Censor - Medical physics, 2012 - Wiley Online Library
Purpose: To describe and mathematically validate the superiorization methodology, which is
a recently developed heuristic approach to optimization, and to discuss its applicability to …

Projected subgradient minimization versus superiorization

Y Censor, R Davidi, GT Herman, RW Schulte… - Journal of Optimization …, 2014 - Springer
The projected subgradient method for constrained minimization repeatedly interlaces
subgradient steps for the objective function with projections onto the feasible region, which …

Alternated and multi-step inertial approximation methods for solving convex bilevel optimization problems

P Duan, Y Zhang - Optimization, 2023 - Taylor & Francis
In this paper, we propose three kinds of inertial approximation methods based on the
proximal gradient algorithm to accelerate the convergence of the algorithm for solving …

An iterative regularized incremental projected subgradient method for a class of bilevel optimization problems

M Amini, F Yousefian - 2019 American Control Conference …, 2019 - ieeexplore.ieee.org
We study a class of bilevel convex optimization problems where the goal is to find the
minimizer of an objective function in the upper level, among the set of all optimal solutions of …

ϵ-subgradient algorithms for bilevel convex optimization

ES Helou, LEA Simões - Inverse problems, 2017 - iopscience.iop.org
This paper introduces and studies the convergence properties of a new class of explicit
epsilon-subgradient methods for the task of minimizing a convex function over a set of …

An iterative regularized mirror descent method for ill-posed nondifferentiable stochastic optimization

M Amini, F Yousefian - arXiv preprint arXiv:1901.09506, 2019 - arxiv.org
A wide range of applications arising in machine learning and signal processing can be cast
as convex optimization problems. These problems are often ill-posed, ie, the optimal …

Superiorization for image analysis

GT Herman - … Image Analysis: 16th International Workshop, IWCIA …, 2014 - Springer
Many scientific, engineering and medical applications of image analysis use constrained
optimization, with the constraints arising from the desire to produce a solution that is …