A survey of techniques for optimizing transformer inference

KT Chitty-Venkata, S Mittal, M Emani… - Journal of Systems …, 2023 - Elsevier
Recent years have seen a phenomenal rise in the performance and applications of
transformer neural networks. The family of transformer networks, including Bidirectional …

Neural architecture search as multiobjective optimization benchmarks: Problem formulation and performance assessment

Z Lu, R Cheng, Y Jin, KC Tan… - IEEE transactions on …, 2023 - ieeexplore.ieee.org
The ongoing advancements in network architecture design have led to remarkable
achievements in deep learning across various challenging computer vision tasks …

Neural architecture search for transformers: A survey

KT Chitty-Venkata, M Emani, V Vishwanath… - IEEE …, 2022 - ieeexplore.ieee.org
Transformer-based Deep Neural Network architectures have gained tremendous interest
due to their effectiveness in various applications across Natural Language Processing (NLP) …

A survey on deep learning hardware accelerators for heterogeneous hpc platforms

C Silvano, D Ielmini, F Ferrandi, L Fiorin… - arXiv preprint arXiv …, 2023 - arxiv.org
Recent trends in deep learning (DL) imposed hardware accelerators as the most viable
solution for several classes of high-performance computing (HPC) applications such as …

Embedded deep learning accelerators: A survey on recent advances

G Akkad, A Mansour, E Inaty - IEEE Transactions on Artificial …, 2023 - ieeexplore.ieee.org
The exponential increase in generated data as well as the advances in high-performance
computing has paved the way for the use of complex machine learning methods. Indeed, the …

[图书][B] Deep learning: A beginners' guide

D Meedeniya - 2023 - books.google.com
This book focuses on deep learning (DL), which is an important aspect of data science, that
includes predictive modeling. DL applications are widely used in domains such as finance …

Neural architecture search benchmarks: Insights and survey

KT Chitty-Venkata, M Emani, V Vishwanath… - IEEE …, 2023 - ieeexplore.ieee.org
Neural Architecture Search (NAS), a promising and fast-moving research field, aims to
automate the architectural design of Deep Neural Networks (DNNs) to achieve better …

Computation-efficient deep learning for computer vision: A survey

Y Wang, Y Han, C Wang, S Song… - Cybernetics and …, 2024 - ieeexplore.ieee.org
Over the past decade, deep learning models have exhibited considerable advancements,
reaching or even exceeding human-level performance in a range of visual perception tasks …

Determining the fullness of garbage containers by deep learning

A Oğuz, ÖF Ertuğrul - Expert Systems with Applications, 2023 - Elsevier
An essential point in waste management, which is a matter of great importance for the
environment and nature, is waste collection from temporary storage points. Since the …

Multiobjective evolutionary pruning of Deep Neural Networks with Transfer Learning for improving their performance and robustness

J Poyatos, D Molina, A Martínez-Seras, J Del Ser… - Applied Soft …, 2023 - Elsevier
Evolutionary Computation algorithms have been used to solve optimization problems in
relation with architectural, hyper-parameter or training configuration, forging the field known …