On neural differential equations
P Kidger - arXiv preprint arXiv:2202.02435, 2022 - arxiv.org
The conjoining of dynamical systems and deep learning has become a topic of great
interest. In particular, neural differential equations (NDEs) demonstrate that neural networks …
interest. In particular, neural differential equations (NDEs) demonstrate that neural networks …
Att3d: Amortized text-to-3d object synthesis
Text-to-3D modelling has seen exciting progress by combining generative text-to-image
models with image-to-3D methods like Neural Radiance Fields. DreamFusion recently …
models with image-to-3D methods like Neural Radiance Fields. DreamFusion recently …
Independent policy gradient methods for competitive reinforcement learning
C Daskalakis, DJ Foster… - Advances in neural …, 2020 - proceedings.neurips.cc
We obtain global, non-asymptotic convergence guarantees for independent learning
algorithms in competitive reinforcement learning settings with two agents (ie, zero-sum …
algorithms in competitive reinforcement learning settings with two agents (ie, zero-sum …
What is local optimality in nonconvex-nonconcave minimax optimization?
Minimax optimization has found extensive applications in modern machine learning, in
settings such as generative adversarial networks (GANs), adversarial training and multi …
settings such as generative adversarial networks (GANs), adversarial training and multi …
Solving a class of non-convex min-max games using iterative first order methods
Recent applications that arise in machine learning have surged significant interest in solving
min-max saddle point games. This problem has been extensively studied in the convex …
min-max saddle point games. This problem has been extensively studied in the convex …
The complexity of constrained min-max optimization
C Daskalakis, S Skoulakis, M Zampetakis - Proceedings of the 53rd …, 2021 - dl.acm.org
Despite its important applications in Machine Learning, min-max optimization of objective
functions that are nonconvex-nonconcave remains elusive. Not only are there no known first …
functions that are nonconvex-nonconcave remains elusive. Not only are there no known first …
Accelerated Algorithms for Smooth Convex-Concave Minimax Problems with O (1/k^ 2) Rate on Squared Gradient Norm
In this work, we study the computational complexity of reducing the squared gradient
magnitude for smooth minimax optimization problems. First, we present algorithms with …
magnitude for smooth minimax optimization problems. First, we present algorithms with …
On the convergence of single-call stochastic extra-gradient methods
Variational inequalities have recently attracted considerable interest in machine learning as
a flexible paradigm for models that go beyond ordinary loss function minimization (such as …
a flexible paradigm for models that go beyond ordinary loss function minimization (such as …
Efficient methods for structured nonconvex-nonconcave min-max optimization
J Diakonikolas, C Daskalakis… - … Conference on Artificial …, 2021 - proceedings.mlr.press
The use of min-max optimization in the adversarial training of deep neural network
classifiers, and the training of generative adversarial networks has motivated the study of …
classifiers, and the training of generative adversarial networks has motivated the study of …
Adversarial score matching and improved sampling for image generation
A Jolicoeur-Martineau, R Piché-Taillefer… - arXiv preprint arXiv …, 2020 - arxiv.org
Denoising Score Matching with Annealed Langevin Sampling (DSM-ALS) has recently
found success in generative modeling. The approach works by first training a neural network …
found success in generative modeling. The approach works by first training a neural network …