Differentiable modelling to unify machine learning and physical models for geosciences

C Shen, AP Appling, P Gentine, T Bandai… - Nature Reviews Earth & …, 2023 - nature.com
Process-based modelling offers interpretability and physical consistency in many domains of
geosciences but struggles to leverage large datasets efficiently. Machine-learning methods …

Machine learning and deep learning—A review for ecologists

M Pichler, F Hartig - Methods in Ecology and Evolution, 2023 - Wiley Online Library
The popularity of machine learning (ML), deep learning (DL) and artificial intelligence (AI)
has risen sharply in recent years. Despite this spike in popularity, the inner workings of ML …

Universal differential equations for scientific machine learning

C Rackauckas, Y Ma, J Martensen, C Warner… - arXiv preprint arXiv …, 2020 - arxiv.org
In the context of science, the well-known adage" a picture is worth a thousand words" might
well be" a model is worth a thousand datasets." In this manuscript we introduce the SciML …

Neural ordinary differential equations

RTQ Chen, Y Rubanova… - Advances in neural …, 2018 - proceedings.neurips.cc
We introduce a new family of deep neural network models. Instead of specifying a discrete
sequence of hidden layers, we parameterize the derivative of the hidden state using a …

Graph neural ordinary differential equations

M Poli, S Massaroli, J Park, A Yamashita… - arXiv preprint arXiv …, 2019 - arxiv.org
We introduce the framework of continuous--depth graph neural networks (GNNs). Graph
neural ordinary differential equations (GDEs) are formalized as the counterpart to GNNs …

Difftaichi: Differentiable programming for physical simulation

Y Hu, L Anderson, TM Li, Q Sun, N Carr… - arXiv preprint arXiv …, 2019 - arxiv.org
We present DiffTaichi, a new differentiable programming language tailored for building high-
performance differentiable physical simulators. Based on an imperative programming …

Scalable gradients for stochastic differential equations

X Li, TKL Wong, RTQ Chen… - … Conference on Artificial …, 2020 - proceedings.mlr.press
The adjoint sensitivity method scalably computes gradients of solutions to ordinary
differential equations. We generalize this method to stochastic differential equations …

Simulation intelligence: Towards a new generation of scientific methods

A Lavin, D Krakauer, H Zenil, J Gottschlich… - arXiv preprint arXiv …, 2021 - arxiv.org
The original" Seven Motifs" set forth a roadmap of essential methods for the field of scientific
computing, where a motif is an algorithmic method that captures a pattern of computation …

Neural sdes as infinite-dimensional gans

P Kidger, J Foster, X Li… - … conference on machine …, 2021 - proceedings.mlr.press
Stochastic differential equations (SDEs) are a staple of mathematical modelling of temporal
dynamics. However, a fundamental limitation has been that such models have typically been …

Kohn-Sham equations as regularizer: Building prior knowledge into machine-learned physics

L Li, S Hoyer, R Pederson, R Sun, ED Cubuk, P Riley… - Physical review …, 2021 - APS
Including prior knowledge is important for effective machine learning models in physics and
is usually achieved by explicitly adding loss terms or constraints on model architectures …