From federated learning to federated neural architecture search: a survey

H Zhu, H Zhang, Y Jin - Complex & Intelligent Systems, 2021 - Springer
Federated learning is a recently proposed distributed machine learning paradigm for privacy
preservation, which has found a wide range of applications where data privacy is of primary …

A comprehensive survey on hardware-aware neural architecture search

H Benmeziane, KE Maghraoui, H Ouarnoughi… - arXiv preprint arXiv …, 2021 - arxiv.org
Neural Architecture Search (NAS) methods have been growing in popularity. These
techniques have been fundamental to automate and speed up the time consuming and error …

Movinets: Mobile video networks for efficient video recognition

D Kondratyuk, L Yuan, Y Li, L Zhang… - Proceedings of the …, 2021 - openaccess.thecvf.com
Abstract We present Mobile Video Networks (MoViNets), a family of computation and
memory efficient video networks that can operate on streaming video for online inference …

EvoPrompting: language models for code-level neural architecture search

A Chen, D Dohan, D So - Advances in Neural Information …, 2024 - proceedings.neurips.cc
Given the recent impressive accomplishments of language models (LMs) for code
generation, we explore the use of LMs as general adaptive mutation and crossover …

Searching for efficient transformers for language modeling

D So, W Mańke, H Liu, Z Dai… - Advances in neural …, 2021 - proceedings.neurips.cc
Large Transformer models have been central to recent advances in natural language
processing. The training and inference costs of these models, however, have grown rapidly …

Neural architecture search: Insights from 1000 papers

C White, M Safari, R Sukthanker, B Ru, T Elsken… - arXiv preprint arXiv …, 2023 - arxiv.org
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …

Nats-bench: Benchmarking nas algorithms for architecture topology and size

X Dong, L Liu, K Musial… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Neural architecture search (NAS) has attracted a lot of attention and has been illustrated to
bring tangible benefits in a large number of applications in the past few years. Architecture …

Neural predictor for neural architecture search

W Wen, H Liu, Y Chen, H Li, G Bender… - … on Computer Vision, 2020 - Springer
Abstract Neural Architecture Search methods are effective but often use complex algorithms
to come up with the best architecture. We propose an approach with three basic steps that is …

Bossnas: Exploring hybrid cnn-transformers with block-wisely self-supervised neural architecture search

C Li, T Tang, G Wang, J Peng… - Proceedings of the …, 2021 - openaccess.thecvf.com
A myriad of recent breakthroughs in hand-crafted neural architectures for visual recognition
have highlighted the urgent need to explore hybrid architectures consisting of diversified …

Mobiledets: Searching for object detection architectures for mobile accelerators

Y Xiong, H Liu, S Gupta, B Akin… - Proceedings of the …, 2021 - openaccess.thecvf.com
Inverted bottleneck layers, which are built upon depthwise convolutions, have been the
predominant building blocks in state-of-the-art object detection models on mobile devices. In …