On neural differential equations

P Kidger - arXiv preprint arXiv:2202.02435, 2022 - arxiv.org
The conjoining of dynamical systems and deep learning has become a topic of great
interest. In particular, neural differential equations (NDEs) demonstrate that neural networks …

Att3d: Amortized text-to-3d object synthesis

J Lorraine, K Xie, X Zeng, CH Lin… - Proceedings of the …, 2023 - openaccess.thecvf.com
Text-to-3D modelling has seen exciting progress by combining generative text-to-image
models with image-to-3D methods like Neural Radiance Fields. DreamFusion recently …

Independent policy gradient methods for competitive reinforcement learning

C Daskalakis, DJ Foster… - Advances in neural …, 2020 - proceedings.neurips.cc
We obtain global, non-asymptotic convergence guarantees for independent learning
algorithms in competitive reinforcement learning settings with two agents (ie, zero-sum …

What is local optimality in nonconvex-nonconcave minimax optimization?

C Jin, P Netrapalli, M Jordan - International conference on …, 2020 - proceedings.mlr.press
Minimax optimization has found extensive applications in modern machine learning, in
settings such as generative adversarial networks (GANs), adversarial training and multi …

Solving a class of non-convex min-max games using iterative first order methods

M Nouiehed, M Sanjabi, T Huang… - Advances in …, 2019 - proceedings.neurips.cc
Recent applications that arise in machine learning have surged significant interest in solving
min-max saddle point games. This problem has been extensively studied in the convex …

The complexity of constrained min-max optimization

C Daskalakis, S Skoulakis, M Zampetakis - Proceedings of the 53rd …, 2021 - dl.acm.org
Despite its important applications in Machine Learning, min-max optimization of objective
functions that are nonconvex-nonconcave remains elusive. Not only are there no known first …

Accelerated Algorithms for Smooth Convex-Concave Minimax Problems with O (1/k^ 2) Rate on Squared Gradient Norm

TH Yoon, EK Ryu - International Conference on Machine …, 2021 - proceedings.mlr.press
In this work, we study the computational complexity of reducing the squared gradient
magnitude for smooth minimax optimization problems. First, we present algorithms with …

On the convergence of single-call stochastic extra-gradient methods

YG Hsieh, F Iutzeler, J Malick… - Advances in Neural …, 2019 - proceedings.neurips.cc
Variational inequalities have recently attracted considerable interest in machine learning as
a flexible paradigm for models that go beyond ordinary loss function minimization (such as …

Efficient methods for structured nonconvex-nonconcave min-max optimization

J Diakonikolas, C Daskalakis… - … Conference on Artificial …, 2021 - proceedings.mlr.press
The use of min-max optimization in the adversarial training of deep neural network
classifiers, and the training of generative adversarial networks has motivated the study of …

Adversarial score matching and improved sampling for image generation

A Jolicoeur-Martineau, R Piché-Taillefer… - arXiv preprint arXiv …, 2020 - arxiv.org
Denoising Score Matching with Annealed Langevin Sampling (DSM-ALS) has recently
found success in generative modeling. The approach works by first training a neural network …