Neural delay differential equations

Q Zhu, Y Guo, W Lin - arXiv preprint arXiv:2102.10801, 2021 - arxiv.org
Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural
networks, have been widely applied, showing exceptional efficacy in coping with some …

Neural piecewise-constant delay differential equations

Q Zhu, Y Shen, D Li, W Lin - Proceedings of the AAAI Conference on …, 2022 - ojs.aaai.org
Continuous-depth neural networks, such as the Neural Ordinary Differential Equations
(ODEs), have aroused a great deal of interest from the communities of machine learning and …

Generalization bounds for neural ordinary differential equations and deep residual networks

P Marion - Advances in Neural Information Processing …, 2024 - proceedings.neurips.cc
Neural ordinary differential equations (neural ODEs) are a popular family of continuous-
depth deep learning models. In this work, we consider a large family of parameterized ODEs …

Dissecting neural odes

S Massaroli, M Poli, J Park… - Advances in Neural …, 2020 - proceedings.neurips.cc
Continuous deep learning architectures have recently re-emerged as Neural Ordinary
Differential Equations (Neural ODEs). This infinite-depth approach theoretically bridges the …

LFT: Neural ordinary differential equations with learnable final-time

D Pang, X Le, X Guan, J Wang - IEEE Transactions on Neural …, 2022 - ieeexplore.ieee.org
Since the last decade, deep neural networks have shown remarkable capability in learning
representations. The recently proposed neural ordinary differential equations (NODEs) can …

Taylor-lagrange neural ordinary differential equations: Toward fast training and evaluation of neural odes

F Djeumou, C Neary, E Goubault, S Putot… - arXiv preprint arXiv …, 2022 - arxiv.org
Neural ordinary differential equations (NODEs)--parametrizations of differential equations
using neural networks--have shown tremendous promise in learning models of unknown …

Neural laplace: Learning diverse classes of differential equations in the laplace domain

SI Holt, Z Qian… - … Conference on Machine …, 2022 - proceedings.mlr.press
Abstract Neural Ordinary Differential Equations model dynamical systems with ODEs
learned by neural networks. However, ODEs are fundamentally inadequate to model …

On neural differential equations

P Kidger - arXiv preprint arXiv:2202.02435, 2022 - arxiv.org
The conjoining of dynamical systems and deep learning has become a topic of great
interest. In particular, neural differential equations (NDEs) demonstrate that neural networks …

Time dependence in non-autonomous neural odes

JQ Davis, K Choromanski, J Varley, H Lee… - arXiv preprint arXiv …, 2020 - arxiv.org
Neural Ordinary Differential Equations (ODEs) are elegant reinterpretations of deep
networks where continuous time can replace the discrete notion of depth, ODE solvers …

Toward equation of motion for deep neural networks: Continuous-time gradient descent and discretization error analysis

T Miyagawa - Advances in Neural Information Processing …, 2022 - proceedings.neurips.cc
We derive and solve an``Equation of Motion''(EoM) for deep neural networks (DNNs), a
differential equation that precisely describes the discrete learning dynamics of DNNs …