On neural differential equations

P Kidger - arXiv preprint arXiv:2202.02435, 2022 - arxiv.org
The conjoining of dynamical systems and deep learning has become a topic of great
interest. In particular, neural differential equations (NDEs) demonstrate that neural networks …

Heavy ball neural ordinary differential equations

H Xia, V Suliafu, H Ji, T Nguyen… - Advances in …, 2021 - proceedings.neurips.cc
We propose heavy ball neural ordinary differential equations (HBNODEs), leveraging the
continuous limit of the classical momentum accelerated gradient descent, to improve neural …

Normalizing flow-based neural process for few-shot knowledge graph completion

L Luo, YF Li, G Haffari, S Pan - … of the 46th International ACM SIGIR …, 2023 - dl.acm.org
Knowledge graphs (KGs), as a structured form of knowledge representation, have been
widely applied in the real world. Recently, few-shot knowledge graph completion (FKGC) …

Integrating expert ODEs into neural ODEs: pharmacology and disease progression

Z Qian, W Zame, L Fleuren, P Elbers… - Advances in …, 2021 - proceedings.neurips.cc
Modeling a system's temporal behaviour in reaction to external stimuli is a fundamental
problem in many areas. Pure Machine Learning (ML) approaches often fail in the small …

On numerical integration in neural ordinary differential equations

A Zhu, P Jin, B Zhu, Y Tang - International Conference on …, 2022 - proceedings.mlr.press
The combination of ordinary differential equations and neural networks, ie, neural ordinary
differential equations (Neural ODE), has been widely studied from various angles. However …

What matters for meta-learning vision regression tasks?

N Gao, H Ziesche, NA Vien, M Volpp… - Proceedings of the …, 2022 - openaccess.thecvf.com
Meta-learning is widely used in few-shot classification and function regression due to its
ability to quickly adapt to unseen tasks. However, it has not yet been well explored on …

Efficient and accurate gradients for neural sdes

P Kidger, J Foster, XC Li… - Advances in Neural …, 2021 - proceedings.neurips.cc
Neural SDEs combine many of the best qualities of both RNNs and SDEs, and as such are a
natural choice for modelling many types of temporal dynamics. They offer memory efficiency …

The neural process family: Survey, applications and perspectives

S Jha, D Gong, X Wang, RE Turner, L Yao - arXiv preprint arXiv …, 2022 - arxiv.org
The standard approaches to neural network implementation yield powerful function
approximation capabilities but are limited in their abilities to learn meta representations and …

Neural controlled differential equations for online prediction tasks

J Morrill, P Kidger, L Yang, T Lyons - arXiv preprint arXiv:2106.11028, 2021 - arxiv.org
Neural controlled differential equations (Neural CDEs) are a continuous-time extension of
recurrent neural networks (RNNs), achieving state-of-the-art (SOTA) performance at …

Neural point process for learning spatiotemporal event dynamics

Z Zhou, X Yang, R Rossi, H Zhao… - Learning for Dynamics …, 2022 - proceedings.mlr.press
Learning the dynamics of spatiotemporal events is a fundamental problem. Neural point
processes enhance the expressivity of point process models with deep neural networks …