Revisiting random channel pruning for neural network compression
Channel (or 3D filter) pruning serves as an effective way to accelerate the inference of
neural networks. There has been a flurry of algorithms that try to solve this practical problem …
neural networks. There has been a flurry of algorithms that try to solve this practical problem …
Multi-Objective Hyperparameter Optimization--An Overview
Hyperparameter optimization constitutes a large part of typical modern machine learning
workflows. This arises from the fact that machine learning methods and corresponding …
workflows. This arises from the fact that machine learning methods and corresponding …
A survey on multi-objective hyperparameter optimization algorithms for machine learning
A Morales-Hernández, I Van Nieuwenhuyse… - Artificial Intelligence …, 2023 - Springer
Hyperparameter optimization (HPO) is a necessary step to ensure the best possible
performance of Machine Learning (ML) algorithms. Several methods have been developed …
performance of Machine Learning (ML) algorithms. Several methods have been developed …
Attentivenas: Improving neural architecture search via attentive sampling
Neural architecture search (NAS) has shown great promise in designing state-of-the-art
(SOTA) models that are both accurate and efficient. Recently, two-stage NAS, eg BigNAS …
(SOTA) models that are both accurate and efficient. Recently, two-stage NAS, eg BigNAS …
Multi-objective hyperparameter optimization in machine learning—An overview
Hyperparameter optimization constitutes a large part of typical modern machine learning
(ML) workflows. This arises from the fact that ML methods and corresponding preprocessing …
(ML) workflows. This arises from the fact that ML methods and corresponding preprocessing …
Efficient controllable multi-task architectures
A Aich, S Schulter… - Proceedings of the …, 2023 - openaccess.thecvf.com
We aim to train a multi-task model such that users can adjust the desired compute budget
and relative importance of task performances after deployment, without retraining. This …
and relative importance of task performances after deployment, without retraining. This …
Enabling design methodologies and future trends for edge AI: Specialization and codesign
This work is an introduction and a survey for the Special Issue on Machine Intelligence at the
Edge. The authors argue that workloads that were formerly performed in the cloud are …
Edge. The authors argue that workloads that were formerly performed in the cloud are …
Unified Local-Cloud Decision-Making via Reinforcement Learning
Embodied vision-based real-world systems, such as mobile robots, require a careful
balance between energy consumption, compute latency, and safety constraints to optimize …
balance between energy consumption, compute latency, and safety constraints to optimize …
FedSNN: Training Slimmable Neural Network With Federated Learning in Edge Computing
To provide a flexible tradeoff between inference accuracy and resource requirement at
runtime, the slimmable neural network (SNN), a single network executable at different widths …
runtime, the slimmable neural network (SNN), a single network executable at different widths …
ScaleNAS: Multi-path one-shot NAS for scale-aware high-resolution representation
Scale variance among different sizes of body parts and objects is a challenging problem for
visual recognition tasks. Existing works usually design dedicated backbone or apply Neural …
visual recognition tasks. Existing works usually design dedicated backbone or apply Neural …