Neural spectrahedra and semidefinite lifts: Global convex optimization of polynomial activation neural networks in fully polynomial-time

B Bartan, M Pilanci - arXiv preprint arXiv:2101.02429, 2021 - arxiv.org
The training of two-layer neural networks with nonlinear activation functions is an important
non-convex optimization problem with numerous applications and promising performance in …

Improved polynomial neural networks with normalised activations

M Goyal, R Goyal, B Lall - 2020 International Joint Conference …, 2020 - ieeexplore.ieee.org
Polynomials, which are widely used to study non-linear systems, have been shown to be
extremely useful in analyzing neural networks (NNs). However, the existing methods for …

Neural spectrahedra and semidefinite lifts: global convex optimization of degree-two polynomial activation neural networks in polynomial-time

B Bartan, M Pilanci - Mathematical Programming, 2024 - Springer
The training of two-layer neural networks with nonlinear activation functions is an important
non-convex optimization problem with numerous applications and promising performance in …

Electromagnetic actuator system using Witty control system

DF Chen, SPC Chiu, AB Cheng, JC Ting - Actuators, 2021 - mdpi.com
Electromagnetic actuator systems composed of an induction servo motor (ISM) drive system
and a rice milling machine system have widely been used in agricultural applications. In …

Self-regularity of non-negative output weights for overparameterized two-layer neural networks

D Gamarnik, EC Kızıldağ, I Zadik - IEEE Transactions on Signal …, 2022 - ieeexplore.ieee.org
We consider the problem of finding a two-layer neural network with sigmoid, rectified linear
unit (ReLU), or binary step activation functions that “fits” a training data set as accurately as …

Algorithms and Algorithmic Barriers in High-Dimensional Statistics and Random Combinatorial Structures

EC Kizildag - 2022 - dspace.mit.edu
We focus on several algorithmic problems arising from the study of random combinatorial
structures and of neural network models, with a particular emphasis on computational …

Hybrid Ensemble Polynomial Neural Network Classifier: Analysis and Design

M Gao, W Huang, Z Xu… - 2024 27th International …, 2024 - ieeexplore.ieee.org
In this paper, we propose a hybrid ensemble polynomial neural network (HEPNN) with the
aid of polynomial neural network (PNN) and hybrid ensemble polynomials neurons …

Ladder polynomial neural networks

LP Liu, R Gu, X Hu - arXiv preprint arXiv:2106.13834, 2021 - arxiv.org
Polynomial functions have plenty of useful analytical properties, but they are rarely used as
learning models because their function class is considered to be restricted. This work shows …

Ladder Polynomial Neural Networks

R Gu - 2022 - search.proquest.com
A combination of neural networks and polynomial functions offers some favorable theoretical
properties to neural network. Polynomial neural networks limit the model functions to …