A survey on evolutionary neural architecture search
Deep neural networks (DNNs) have achieved great success in many applications. The
architectures of DNNs play a crucial role in their performance, which is usually manually …
architectures of DNNs play a crucial role in their performance, which is usually manually …
Weight-sharing neural architecture search: A battle to shrink the optimization gap
Neural architecture search (NAS) has attracted increasing attention. In recent years,
individual search methods have been replaced by weight-sharing search methods for higher …
individual search methods have been replaced by weight-sharing search methods for higher …
Bananas: Bayesian optimization with neural architectures for neural architecture search
Over the past half-decade, many methods have been considered for neural architecture
search (NAS). Bayesian optimization (BO), which has long had success in hyperparameter …
search (NAS). Bayesian optimization (BO), which has long had success in hyperparameter …
How powerful are performance predictors in neural architecture search?
Early methods in the rapidly developing field of neural architecture search (NAS) required
fully training thousands of neural networks. To reduce this extreme computational cost …
fully training thousands of neural networks. To reduce this extreme computational cost …
Nas-bench-suite-zero: Accelerating research on zero cost proxies
Zero-cost proxies (ZC proxies) are a recent architecture performance prediction technique
aiming to significantly speed up algorithms for neural architecture search (NAS). Recent …
aiming to significantly speed up algorithms for neural architecture search (NAS). Recent …
A study on encodings for neural architecture search
C White, W Neiswanger, S Nolen… - Advances in neural …, 2020 - proceedings.neurips.cc
Neural architecture search (NAS) has been extensively studied in the past few years. A
popular approach is to represent each neural architecture in the search space as a directed …
popular approach is to represent each neural architecture in the search space as a directed …
Renas: Relativistic evaluation of neural architecture search
An effective and efficient architecture performance evaluation scheme is essential for the
success of Neural Architecture Search (NAS). To save computational cost, most of existing …
success of Neural Architecture Search (NAS). To save computational cost, most of existing …
Nas-bench-suite: Nas evaluation is (now) surprisingly easy
The release of tabular benchmarks, such as NAS-Bench-101 and NAS-Bench-201, has
significantly lowered the computational overhead for conducting scientific research in neural …
significantly lowered the computational overhead for conducting scientific research in neural …
EMONAS-Net: Efficient multiobjective neural architecture search using surrogate-assisted evolutionary algorithm for 3D medical image segmentation
MB Calisto, SK Lai-Yuen - Artificial intelligence in medicine, 2021 - Elsevier
Deep learning plays a critical role in medical image segmentation. Nevertheless, manually
designing a neural network for a specific segmentation problem is a very difficult and time …
designing a neural network for a specific segmentation problem is a very difficult and time …
Efficient federated learning for modern nlp
Transformer-based pre-trained models have revolutionized NLP for superior performance
and generality. Fine-tuning pre-trained models for downstream tasks often requires private …
and generality. Fine-tuning pre-trained models for downstream tasks often requires private …