Edgevits: Competing light-weight cnns on mobile devices with vision transformers
Self-attention based models such as vision transformers (ViTs) have emerged as a very
competitive architecture alternative to convolutional neural networks (CNNs) in computer …
competitive architecture alternative to convolutional neural networks (CNNs) in computer …
Revisiting random channel pruning for neural network compression
Channel (or 3D filter) pruning serves as an effective way to accelerate the inference of
neural networks. There has been a flurry of algorithms that try to solve this practical problem …
neural networks. There has been a flurry of algorithms that try to solve this practical problem …
Bignas: Scaling up neural architecture search with big single-stage models
Neural architecture search (NAS) has shown promising results discovering models that are
both accurate and fast. For NAS, training a one-shot model has become a popular strategy …
both accurate and fast. For NAS, training a one-shot model has become a popular strategy …
Channel pruning via lookahead search guided reinforcement learning
Z Wang, C Li - Proceedings of the IEEE/CVF winter …, 2022 - openaccess.thecvf.com
Channel pruning has become an effective yet still challenging approach to achieve compact
neural networks. It aims to prune the optimal set of filters whose removal results in minimal …
neural networks. It aims to prune the optimal set of filters whose removal results in minimal …
Dance: Differentiable accelerator/network co-exploration
This work presents DANCE, a differentiable approach towards the co-exploration of
hardware accelerator and network architecture design. At the heart of DANCE is a …
hardware accelerator and network architecture design. At the heart of DANCE is a …
Real-Time Semantic Segmentation: A brief survey and comparative study in remote sensing
Real-time semantic segmentation of remote sensing imagery is a challenging task that
requires a tradeoff between effectiveness and efficiency. It has many applications, including …
requires a tradeoff between effectiveness and efficiency. It has many applications, including …
Hardware-adaptive efficient latency prediction for nas via meta-learning
H Lee, S Lee, S Chong… - Advances in Neural …, 2021 - proceedings.neurips.cc
For deployment, neural architecture search should be hardware-aware, in order to satisfy
the device-specific constraints (eg, memory usage, latency and energy consumption) and …
the device-specific constraints (eg, memory usage, latency and energy consumption) and …
Searching by generating: Flexible and efficient one-shot NAS with architecture generator
In one-shot NAS, sub-networks need to be searched from the supernet to meet different
hardware constraints. However, the search cost is high and N times of searches are needed …
hardware constraints. However, the search cost is high and N times of searches are needed …
The Myth of the Pyramid
R Izquierdo-Cordova… - Proceedings of the …, 2024 - openaccess.thecvf.com
A deep-rooted strategy for building convolutional neural networks in computer vision is to
increase the number of filters every time the feature map resolution is decreased. The notion …
increase the number of filters every time the feature map resolution is decreased. The notion …
Help: Hardware-adaptive efficient latency prediction for nas via meta-learning
For deployment, neural architecture search should be hardware-aware, in order to satisfy
the device-specific constraints (eg, memory usage, latency and energy consumption) and …
the device-specific constraints (eg, memory usage, latency and energy consumption) and …