Weight-sharing neural architecture search: A battle to shrink the optimization gap

L Xie, X Chen, K Bi, L Wei, Y Xu, L Wang… - ACM Computing …, 2021 - dl.acm.org
Neural architecture search (NAS) has attracted increasing attention. In recent years,
individual search methods have been replaced by weight-sharing search methods for higher …

Proxylessnas: Direct neural architecture search on target task and hardware

H Cai, L Zhu, S Han - arXiv preprint arXiv:1812.00332, 2018 - arxiv.org
Neural architecture search (NAS) has a great impact by automatically designing effective
neural network architectures. However, the prohibitive computational demand of …

Data: Differentiable architecture approximation

J Chang, Y Guo, G Meng, S Xiang… - Advances in Neural …, 2019 - proceedings.neurips.cc
Neural architecture search (NAS) is inherently subject to the gap of architectures during
searching and validating. To bridge this gap, we develop Differentiable ArchiTecture …

EENA: Efficient evolution of neural architecture

H Zhu, Z An, C Yang, K Xu… - Proceedings of the …, 2019 - openaccess.thecvf.com
Latest algorithms for automatic neural architecture search perform remarkable but are
basically directionless in search space and computational expensive in the training of every …

Katib: A Distributed General {AutoML} Platform on Kubernetes

J Zhou, A Velichkevich, K Prosvirov, A Garg… - … USENIX Conference on …, 2019 - usenix.org
Automatic Machine Learning (AutoML) is a powerful mechanism to design and tune models.
We present Katib, a scalable Kubernetes-native general AutoML platform that can support a …

DATA: Differentiable architecture approximation with distribution guided sampling

X Zhang, J Chang, Y Guo, G Meng… - … on Pattern Analysis …, 2020 - ieeexplore.ieee.org
Neural architecture search (NAS) is inherently subject to the gap of architectures during
searching and validating. To bridge this gap effectively, we develop Differentiable …

Hetconv: Beyond homogeneous convolution kernels for deep cnns

P Singh, VK Verma, P Rai, VP Namboodiri - International Journal of …, 2020 - Springer
While usage of convolutional neural networks (CNN) is widely prevalent, methods proposed
so far always have considered homogeneous kernels for this task. In this paper, we propose …

Differentiable architecture search with ensemble gumbel-softmax

J Chang, X Zhang, Y Guo, G Meng, S Xiang… - arXiv preprint arXiv …, 2019 - arxiv.org
For network architecture search (NAS), it is crucial but challenging to simultaneously
guarantee both effectiveness and efficiency. Towards achieving this goal, we develop a …

Adaptive Neural Network Structure Optimization Algorithm Based on Dynamic Nodes

M Wang, X Yang, Y Qian, Y Lei, J Cai, Z Huan… - Current Issues in …, 2022 - mdpi.com
Large-scale artificial neural networks have many redundant structures, making the network
fall into the issue of local optimization and extended training time. Moreover, existing neural …

[PDF][PDF] AMLA: an AutoML frAmework for neural network design

P Kamath, A Singh, D Dutta - Automatic Machine Learning Workshop at ICML - pkamath.com
AMLA is an Automatic Machine Learning frAmework for implementing and deploying neural
architecture search algorithms. Neural architecture search algorithms are AutoML algorithms …