∇-prox: Differentiable proximal algorithm modeling for large-scale optimization

Z Lai, K Wei, Y Fu, P Härtel, F Heide - ACM Transactions on Graphics …, 2023 - dl.acm.org
Tasks across diverse application domains can be posed as large-scale optimization
problems, these include graphics, vision, machine learning, imaging, health, scheduling …

Proximal: Efficient image optimization using proximal algorithms

F Heide, S Diamond, M Nießner… - ACM Transactions on …, 2016 - dl.acm.org
Computational photography systems are becoming increasingly diverse, while
computational resources---for example on mobile platforms---are rapidly increasing. As …

Torchopt: An efficient library for differentiable optimization

J Ren, X Feng, B Liu, X Pan, Y Fu, L Mai… - Journal of Machine …, 2023 - jmlr.org
Differentiable optimization algorithms often involve expensive computations of various meta-
gradients. To address this, we design and implement TorchOpt, a new PyTorch-based …

Tfpnp: Tuning-free plug-and-play proximal algorithms with applications to inverse imaging problems

K Wei, A Aviles-Rivero, J Liang, Y Fu, H Huang… - Journal of Machine …, 2022 - jmlr.org
Plug-and-Play (PnP) is a non-convex optimization framework that combines proximal
algorithms, for example, the alternating direction method of multipliers (ADMM), with …

Backpropagation with callbacks: Foundations for efficient and expressive differentiable programming

F Wang, J Decker, X Wu, G Essertel… - Advances in Neural …, 2018 - proceedings.neurips.cc
Training of deep learning models depends on gradient descent and end-to-end
differentiation. Under the slogan of differentiable programming, there is an increasing …

iPiano: Inertial proximal algorithm for nonconvex optimization

P Ochs, Y Chen, T Brox, T Pock - SIAM Journal on Imaging Sciences, 2014 - SIAM
In this paper we study an algorithm for solving a minimization problem composed of a
differentiable (possibly nonconvex) and a convex (possibly nondifferentiable) function. The …

Recapp: Crafting a more efficient catalyst for convex optimization

Y Carmon, A Jambulapati, Y Jin… - … on Machine Learning, 2022 - proceedings.mlr.press
The accelerated proximal point method (APPA), also known as" Catalyst", is a well-
established reduction from convex optimization to approximate proximal point computation …

Scalable learning to optimize: A learned optimizer can train big models

X Chen, T Chen, Y Cheng, W Chen… - … on Computer Vision, 2022 - Springer
Learning to optimize (L2O) has gained increasing attention since it demonstrates a
promising path to automating and accelerating the optimization of complicated problems …

Efficient continuous relaxations for dense CRF

A Desmaison, R Bunel, P Kohli, PHS Torr… - Computer Vision–ECCV …, 2016 - Springer
Dense conditional random fields (CRF) with Gaussian pairwise potentials have emerged as
a popular framework for several computer vision applications such as stereo …

Theseus: A library for differentiable nonlinear optimization

L Pineda, T Fan, M Monge… - Advances in …, 2022 - proceedings.neurips.cc
We present Theseus, an efficient application-agnostic open source library for differentiable
nonlinear least squares (DNLS) optimization built on PyTorch, providing a common …