A review of irregular time series data handling with gated recurrent neural networks

PB Weerakody, KW Wong, G Wang, W Ela - Neurocomputing, 2021 - Elsevier
Irregular time series data is becoming increasingly prevalent with the growth of multi-sensor
systems as well as the continued use of unstructured manual data recording mechanisms …

A tutorial review of neural network modeling approaches for model predictive control

YM Ren, MS Alhajeri, J Luo, S Chen, F Abdullah… - Computers & Chemical …, 2022 - Elsevier
An overview of the recent developments of time-series neural network modeling is
presented along with its use in model predictive control (MPC). A tutorial on the construction …

Efficiently modeling long sequences with structured state spaces

A Gu, K Goel, C Ré - arXiv preprint arXiv:2111.00396, 2021 - arxiv.org
A central goal of sequence modeling is designing a single principled model that can
address sequence data across a range of modalities and tasks, particularly on long-range …

Nhits: Neural hierarchical interpolation for time series forecasting

C Challu, KG Olivares, BN Oreshkin… - Proceedings of the …, 2023 - ojs.aaai.org
Recent progress in neural forecasting accelerated improvements in the performance of large-
scale forecasting systems. Yet, long-horizon forecasting remains a very difficult task. Two …

Simplified state space layers for sequence modeling

JTH Smith, A Warrington, SW Linderman - arXiv preprint arXiv:2208.04933, 2022 - arxiv.org
Models using structured state space sequence (S4) layers have achieved state-of-the-art
performance on long-range sequence modeling tasks. An S4 layer combines linear state …

Combining recurrent, convolutional, and continuous-time models with linear state space layers

A Gu, I Johnson, K Goel, K Saab… - Advances in neural …, 2021 - proceedings.neurips.cc
Recurrent neural networks (RNNs), temporal convolutions, and neural differential equations
(NDEs) are popular families of deep learning models for time-series data, each with unique …

On neural differential equations

P Kidger - arXiv preprint arXiv:2202.02435, 2022 - arxiv.org
The conjoining of dynamical systems and deep learning has become a topic of great
interest. In particular, neural differential equations (NDEs) demonstrate that neural networks …

Csdi: Conditional score-based diffusion models for probabilistic time series imputation

Y Tashiro, J Song, Y Song… - Advances in Neural …, 2021 - proceedings.neurips.cc
The imputation of missing values in time series has many applications in healthcare and
finance. While autoregressive models are natural candidates for time series imputation …

Universal differential equations for scientific machine learning

C Rackauckas, Y Ma, J Martensen, C Warner… - arXiv preprint arXiv …, 2020 - arxiv.org
In the context of science, the well-known adage" a picture is worth a thousand words" might
well be" a model is worth a thousand datasets." In this manuscript we introduce the SciML …

Neural controlled differential equations for irregular time series

P Kidger, J Morrill, J Foster… - Advances in Neural …, 2020 - proceedings.neurips.cc
Neural ordinary differential equations are an attractive option for modelling temporal
dynamics. However, a fundamental issue is that the solution to an ordinary differential …