Alternating projected sgd for equality-constrained bilevel optimization

Q Xiao, H Shen, W Yin, T Chen - … Conference on Artificial …, 2023 - proceedings.mlr.press
Bilevel optimization, which captures the inherent nested structure of machine learning
problems, is gaining popularity in many recent applications. Existing works on bilevel …

Optimal algorithms for stochastic bilevel optimization under relaxed smoothness conditions

X Chen, T Xiao, K Balasubramanian - Journal of Machine Learning …, 2024 - jmlr.org
We consider stochastic bilevel optimization problems involving minimizing an upper-level
($\texttt {UL} $) function that is dependent on the arg-min of a strongly-convex lower-level …

Constrained bi-level optimization: Proximal lagrangian value function approach and hessian-free algorithm

W Yao, C Yu, S Zeng, J Zhang - arXiv preprint arXiv:2401.16164, 2024 - arxiv.org
This paper presents a new approach and algorithm for solving a class of constrained Bi-
Level Optimization (BLO) problems in which the lower-level problem involves constraints …

An alternating optimization method for bilevel problems under the Polyak-Łojasiewicz condition

Q Xiao, S Lu, T Chen - Advances in Neural Information …, 2024 - proceedings.neurips.cc
Bilevel optimization has recently regained interest owing to its applications in emerging
machine learning fields such as hyperparameter optimization, meta-learning, and …

[PDF][PDF] A Generalized Alternating Method for Bilevel Learning under the Polyak-{\L} ojasiewicz Condition

Q Xiao, S Lu, T Chen - arXiv preprint arXiv:2306.02422, 2023 - proceedings.neurips.cc
Bilevel optimization has recently regained interest owing to its applications in emerging
machine learning fields such as hyperparameter optimization, metalearning, and …

A framework for bilevel optimization on Riemannian manifolds

A Han, B Mishra, P Jawanpuria, A Takeda - arXiv preprint arXiv …, 2024 - arxiv.org
Bilevel optimization has seen an increasing presence in various domains of applications. In
this work, we propose a framework for solving bilevel optimization problems where variables …

Alternating implicit projected sgd and its efficient variants for equality-constrained bilevel optimization

Q Xiao, H Shen, W Yin, T Chen - arXiv preprint arXiv:2211.07096, 2022 - arxiv.org
Stochastic bilevel optimization, which captures the inherent nested structure of machine
learning problems, is gaining popularity in many recent applications. Existing works on …

An implicit gradient method for constrained bilevel problems using barrier approximation

I Tsaknakis, P Khanduri, M Hong - ICASSP 2023-2023 IEEE …, 2023 - ieeexplore.ieee.org
In this work, we propose algorithms for solving a class of Bilevel Optimization (BLO)
problems, with applications in areas such as signal processing, networking and machine …

First-Order Methods for Linearly Constrained Bilevel Optimization

G Kornowski, S Padmanabhan, K Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
Algorithms for bilevel optimization often encounter Hessian computations, which are
prohibitive in high dimensions. While recent works offer first-order methods for …

Overcoming Lower-Level Constraints in Bilevel Optimization: A Novel Approach with Regularized Gap Functions

W Yao, H Yin, S Zeng, J Zhang - arXiv preprint arXiv:2406.01992, 2024 - arxiv.org
Constrained bilevel optimization tackles nested structures present in constrained learning
tasks like constrained meta-learning, adversarial learning, and distributed bilevel …