Federated learning for internet of things: Recent advances, taxonomy, and open challenges

LU Khan, W Saad, Z Han, E Hossain… - … Surveys & Tutorials, 2021 - ieeexplore.ieee.org
The Internet of Things (IoT) will be ripe for the deployment of novel machine learning
algorithm for both network and application management. However, given the presence of …

A survey on evolutionary neural architecture search

Y Liu, Y Sun, B Xue, M Zhang, GG Yen… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Deep neural networks (DNNs) have achieved great success in many applications. The
architectures of DNNs play a crucial role in their performance, which is usually manually …

Symbolic discovery of optimization algorithms

X Chen, C Liang, D Huang, E Real… - Advances in neural …, 2024 - proceedings.neurips.cc
We present a method to formulate algorithm discovery as program search, and apply it to
discover optimization algorithms for deep neural network training. We leverage efficient …

Dataset condensation with distribution matching

B Zhao, H Bilen - Proceedings of the IEEE/CVF Winter …, 2023 - openaccess.thecvf.com
Computational cost of training state-of-the-art deep models in many learning problems is
rapidly increasing due to more sophisticated models and larger datasets. A recent promising …

Meta-learning in neural networks: A survey

T Hospedales, A Antoniou, P Micaelli… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
The field of meta-learning, or learning-to-learn, has seen a dramatic rise in interest in recent
years. Contrary to conventional approaches to AI where tasks are solved from scratch using …

A comprehensive survey of neural architecture search: Challenges and solutions

P Ren, Y Xiao, X Chang, PY Huang, Z Li… - ACM Computing …, 2021 - dl.acm.org
Deep learning has made substantial breakthroughs in many fields due to its powerful
automatic representation capabilities. It has been proven that neural architecture design is …

AutoML: A survey of the state-of-the-art

X He, K Zhao, X Chu - Knowledge-based systems, 2021 - Elsevier
Deep learning (DL) techniques have obtained remarkable achievements on various tasks,
such as image recognition, object detection, and language modeling. However, building a …

MFDNet: Collaborative poses perception and matrix Fisher distribution for head pose estimation

H Liu, S Fang, Z Zhang, D Li, K Lin… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Head pose estimation suffers from several problems, including low pose tolerance under
different disturbances and ambiguity arising from common head pose representation. In this …

Zero-cost proxies for lightweight nas

MS Abdelfattah, A Mehrotra, Ł Dudziak… - arXiv preprint arXiv …, 2021 - arxiv.org
Neural Architecture Search (NAS) is quickly becoming the standard methodology to design
neural network models. However, NAS is typically compute-intensive because multiple …

Neural architecture search without training

J Mellor, J Turner, A Storkey… - … conference on machine …, 2021 - proceedings.mlr.press
The time and effort involved in hand-designing deep neural networks is immense. This has
prompted the development of Neural Architecture Search (NAS) techniques to automate this …