Exact solutions to the nonlinear dynamics of learning in deep linear neural networks

AM Saxe, JL McClelland, S Ganguli - arXiv preprint arXiv:1312.6120, 2013 - arxiv.org
… of the dynamics of learning in deep neural networks remains quite … , such networks have
nonlinear gradient descent dynamics on … We show that deep linear networks exhibit nonlinear

A dynamic neural network approach to nonlinear process modeling

AM Shaw, FJ Doyle III, JS Schwaber - Computers & chemical engineering, 1997 - Elsevier
… a network which incorporates dynamic elements with continuous feedback. Two case studies
show that the recurrent dynamic neuron network … such as asymmetric dynamic response. In …

Direct adaptive regulation of unknown nonlinear dynamical systems via dynamic neural networks

GA Rovithakis, MA Christodoulou - IEEE Transactions on …, 1995 - ieeexplore.ieee.org
… scheme for unknown nonlinear dynamical systems, with … In this paper, dynamical neural
networks, of the form that will … unknown system, to a dynamic neural network model, which is of …

[图书][B] Nonlinear dynamical systems: feedforward neural network perspectives

IW Sandberg, JT Lo, CL Fancourt, JC Principe… - 2001 - books.google.com
… systems can be approximated (or identified) by neural networks to … neural networks for
universal risk-sensitive approximations of functions and dynamic systems qualify neural networks

Nonlinear dynamic systems identification with dynamic neural networks for fault diagnosis in technical processes

M Ayoubi - Proceedings of IEEE international conference on …, 1994 - ieeexplore.ieee.org
neuron activity depends on internal neuron states. Integrating an ARMA-filter within the neuron
allows the neuron to … of such a dynamic neuron model, the so called Dynamic Elementary …

Multistep neural networks for data-driven discovery of nonlinear dynamical systems

M Raissi, P Perdikaris, GE Karniadakis - arXiv preprint arXiv:1801.01236, 2018 - arxiv.org
… As an example of a high dimensional dynamical systems, in section 3.3, … dynamics, we
consider the Hopf normal form in section 3.4. As an example of complicated nonlinear dynamics

Neural networks for nonlinear dynamic system modelling and identification

S Chen, SA Billings - International journal of control, 1992 - Taylor & Francis
… of modelling complicated nonlinear systems. This paper addresses the issues related to
the identification of nonlinear discrete-time dynamic systems using neural networks. Three …

[HTML][HTML] New approach to applying neural network in nonlinear dynamic model

FP Härter, HF de Campos Velho - Applied Mathematical Modelling, 2008 - Elsevier
… In this work, radial basis function neural network (RBF-NN) is applied to emulate an extended
Kalman filter (EKF) in a data assimilation scenario. The dynamical model studied here is …

Neural-network predictive control for nonlinear dynamic systems with time-delay

JQ Huang, FL Lewis - IEEE Transactions on Neural Networks, 2003 - ieeexplore.ieee.org
… estimator to identify the dynamics of the nonlinear plant. If the … local nonlinear compensator,
to cancel the nonlinear effects. … model to approximate the nonlinear dynamic plant. As will be …

Nonlinear dynamics and chaos in fractional-order neural networks

E Kaslik, S Sivasundaram - Neural networks, 2012 - Elsevier
… The numerical examples presented in this paper unveil highly complex dynamical behavior
in fractional-order neural networks, such as the co-existence of strange attractors with …