A brief survey on the approximation theory for sequence modelling

H Jiang, Q Li, Z Li, S Wang - arXiv preprint arXiv:2302.13752, 2023 - arxiv.org
We survey current developments in the approximation theory of sequence modelling in
machine learning. Particular emphasis is placed on classifying existing results for various …

Neural stochastic pdes: Resolution-invariant learning of continuous spatiotemporal dynamics

C Salvi, M Lemercier… - Advances in Neural …, 2022 - proceedings.neurips.cc
Stochastic partial differential equations (SPDEs) are the mathematical tool of choice for
modelling spatiotemporal PDE-dynamics under the influence of randomness. Based on the …

Transformer meets boundary value inverse problems

R Guo, S Cao, L Chen - arXiv preprint arXiv:2209.14977, 2022 - arxiv.org
A Transformer-based deep direct sampling method is proposed for electrical impedance
tomography, a well-known severely ill-posed nonlinear boundary value inverse problem. A …

Infinite-dimensional reservoir computing

L Gonon, L Grigoryeva, JP Ortega - Neural Networks, 2024 - Elsevier
Reservoir computing approximation and generalization bounds are proved for a new
concept class of input/output systems that extends the so-called generalized Barron …

Deep latent regularity network for modeling stochastic partial differential equations

S Gong, P Hu, Q Meng, Y Wang, R Zhu… - Proceedings of the …, 2023 - ojs.aaai.org
Stochastic partial differential equations (SPDEs) are crucial for modelling dynamics with
randomness in many areas including economics, physics, and atmospheric sciences …

Stochastic latent transformer: Efficient modeling of stochastically forced zonal jets

IJS Shokar, RR Kerswell… - Journal of Advances in …, 2024 - Wiley Online Library
We present a novel probabilistic deep learning approach, the “stochastic latent
transformer”(SLT), designed for the efficient reduced‐order modeling of stochastic partial …

Better Neural PDE Solvers Through Data-Free Mesh Movers

P Hu, Y Wang, ZM Ma - arXiv preprint arXiv:2312.05583, 2023 - arxiv.org
Recently, neural networks have been extensively employed to solve partial differential
equations (PDEs) in physical system modeling. While major studies focus on learning …