On training efficiency and computational costs of a feed forward neural network: A review

A Laudani, GM Lozito… - Computational …, 2015 - Wiley Online Library
A comprehensive review on the problem of choosing a suitable activation function for the
hidden layer of a feed forward neural network has been widely investigated. Since the …

Leveraging neuro-inspired AI accelerator for high-speed computing in 6G networks

C Lin, MF Azmine, Y Liang, Y Yi - Frontiers in Computational …, 2024 - frontiersin.org
The field of wireless communication is currently being pushed to new boundaries with the
emergence of 6G technology. This advanced technology requires substantially increased …

A novel approximation methodology and its efficient vlsi implementation for the sigmoid function

Z Qin, Y Qiu, H Sun, Z Lu, Z Wang… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
In this brief, a novel approximation method and its optimized hardware implementation are
proposed for the sigmoid function used in Deep Neural Networks (DNNs). Based on …

Efficient hardware implementation of DNN-based speech enhancement algorithm with precise sigmoid activation function

SR Chiluveru, S Chunarkar, M Tripathy… - … on Circuits and …, 2021 - ieeexplore.ieee.org
This brief presents the hardware implementation of deep neural network-based speech
enhancement algorithm (DNN-SEA) with a precise sigmoid activation function. Further, an …

A cost-efficient digital esn architecture on fpga for ofdm symbol detection

VM Gan, Y Liang, L Li, L Liu, Y Yi - ACM Journal on Emerging …, 2021 - dl.acm.org
The echo state network (ESN) is a recently developed machine-learning paradigm whose
processing capabilities rely on the dynamical behavior of recurrent neural networks. Its …

Accelerating next-g wireless communications with fpga-based ai accelerators

C Lin, MF Azmine, Y Yi - 2023 IEEE/ACM International …, 2023 - ieeexplore.ieee.org
5G and beyond 5G wireless communication has revolutionized our daily lives. However, the
increased bandwidth and data rate transfer in 5G present challenges, particularly in the …

Low-error digital hardware implementation of artificial neuron activation functions and their derivative

A Armato, L Fanucci, EP Scilingo, D De Rossi - Microprocessors and …, 2011 - Elsevier
In this paper we propose a low-error approximation of the sigmoid function and hyperbolic
tangent, which are mainly used to activate the artificial neuron, based on the piecewise …

[PDF][PDF] Hardware implementation of hyperbolic tangent and sigmoid activation functions

Z Hajduk - Bulletin of the Polish Academy of Sciences. Technical …, 2018 - bibliotekanauki.pl
This paper presents the high accuracy hardware implementation of the hyperbolic tangent
and sigmoid activation functions for artificial neural networks. A kind of a direct …

Accuracy controlled iterative method for efficient sigmoid function approximation

SR Chiluveru, M Tripathy, B Mohapatra - Electronics Letters, 2020 - Wiley Online Library
The sigmoid activation function plays an essential role in implementing neural networks in
hardware. However, due to a high degree of non‐linearity, the hardware implementation of …

Reconfigurable field‐programmable gate array‐based on‐chip learning neuromorphic digital implementation for nonlinear function approximation

M Gholami, E Zaman Farsa… - International Journal of …, 2021 - Wiley Online Library
Hardware implementations of spiking neural networks, which are known as neuromorphic
architectures, provide an explicit understanding of brain performance. As a result, biological …