Dynamics and perturbations of overparameterized linear neural networks

ACB de Oliveira, M Siami… - 2023 62nd IEEE …, 2023 - ieeexplore.ieee.org
Recent research in neural networks and machine learning suggests that using many more
parameters than strictly required by the initial complexity of a regression problem can result …

On the ISS property of the gradient flow for single hidden-layer neural networks with linear activations

ACB de Oliveira, M Siami, ED Sontag - arXiv preprint arXiv:2305.09904, 2023 - arxiv.org
Recent research in neural networks and machine learning suggests that using many more
parameters than strictly required by the initial complexity of a regression problem can result …

A weighted linearization approach to gradient descent optimization

D Rotondo, MS Jha - 2024 European Control Conference (ECC …, 2024 - ieeexplore.ieee.org
The weighted linearization is a generalization of the first-order Taylor approximation where
the computation of the Jacobian matrices at the point of interest is replaced by the …

Linear regularizers enforce the strict saddle property

M Ubl, M Hale, K Yazdani - Proceedings of the AAAI Conference on …, 2023 - ojs.aaai.org
Satisfaction of the strict saddle property has become a standard assumption in non-convex
optimization, and it ensures that many first-order optimization algorithms will almost always …

[图书][B] Regularization and Parallelization Techniques for Modern Engineering Optimization

M Ubl - 2023 - search.proquest.com
Large-scale optimization and control problems appear in applications such as robotics,
machine learning, smart power grids, and sensor networks. These problems involve many …

[PDF][PDF] AFRL-AFOSR-VA-TR-2020-0086

H Schaeffer - apps.dtic.mil
The main goal of the grant was to construct new approaches and algorithms for learning
dynamical systems from data. The objective of this research was to develop and analyze …

[PDF][PDF] A Complete Bibliography of Publications in the SIAM Journal on Mathematics of Data Science

NHF Beebe - 2024 - netlib.org
A Complete Bibliography of Publications in the SIAM Journal on Mathematics of Data Science
Page 1 A Complete Bibliography of Publications in the SIAM Journal on Mathematics of Data …

Sparse Modeling and Machine Learning for Nonlinear Partial Differential Equations

H Schaeffer, Carnegie Mellon University - 2020 - apps.dtic.mil
The main goal of the grant was to construct new approaches and algorithms for learning
dynamical systems from data. The objective of this research was to develop and analyze …