Evolutionary large-scale multi-objective optimization: A survey

Y Tian, L Si, X Zhang, R Cheng, C He… - ACM Computing …, 2021 - dl.acm.org
Multi-objective evolutionary algorithms (MOEAs) have shown promising performance in
solving various optimization problems, but their performance may deteriorate drastically …

A survey on evolutionary neural architecture search

Y Liu, Y Sun, B Xue, M Zhang, GG Yen… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Deep neural networks (DNNs) have achieved great success in many applications. The
architectures of DNNs play a crucial role in their performance, which is usually manually …

Neural architecture search: A survey

T Elsken, JH Metzen, F Hutter - Journal of Machine Learning Research, 2019 - jmlr.org
Deep Learning has enabled remarkable progress over the last years on a variety of tasks,
such as image recognition, speech recognition, and machine translation. One crucial aspect …

Neural architecture search: Insights from 1000 papers

C White, M Safari, R Sukthanker, B Ru, T Elsken… - arXiv preprint arXiv …, 2023 - arxiv.org
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …

A genetic programming approach to designing convolutional neural network architectures

M Suganuma, S Shirakawa, T Nagao - Proceedings of the genetic and …, 2017 - dl.acm.org
The convolutional neural network (CNN), which is one of the deep learning models, has
seen much success in a variety of computer vision tasks. However, designing CNN …

Dual residual networks leveraging the potential of paired operations for image restoration

X Liu, M Suganuma, Z Sun… - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
In this paper, we study design of deep neural networks for tasks of image restoration. We
propose a novel style of residual connections dubbed" dual residual connection", which …

Attentivenas: Improving neural architecture search via attentive sampling

D Wang, M Li, C Gong… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Neural architecture search (NAS) has shown great promise in designing state-of-the-art
(SOTA) models that are both accurate and efficient. Recently, two-stage NAS, eg BigNAS …

Neuroevolution in deep neural networks: Current trends and future challenges

E Galván, P Mooney - IEEE Transactions on Artificial …, 2021 - ieeexplore.ieee.org
A variety of methods have been applied to the architectural configuration and learning or
training of artificial deep neural networks (DNN). These methods play a crucial role in the …

Best practices for scientific research on neural architecture search

M Lindauer, F Hutter - Journal of Machine Learning Research, 2020 - jmlr.org
Finding a well-performing architecture is often tedious for both deep learning practitioners
and researchers, leading to tremendous interest in the automation of this task by means of …

Efficient residual dense block search for image super-resolution

D Song, C Xu, X Jia, Y Chen, C Xu, Y Wang - Proceedings of the AAAI …, 2020 - aaai.org
Although remarkable progress has been made on single image super-resolution due to the
revival of deep convolutional neural networks, deep learning methods are confronted with …