Efficient Deep Learning Infrastructures for Embedded Computing Systems: A Comprehensive Survey and Future Envision

X Luo, D Liu, H Kong, S Huai, H Chen… - ACM Transactions on …, 2024 - dl.acm.org
Deep neural networks (DNNs) have recently achieved impressive success across a wide
range of real-world vision and language processing tasks, spanning from image …

Domino-Pro-Max: Towards Efficient Network Simplification and Reparameterization for Embedded Hardware Systems

X Luo, D Liu, H Kong, S Huai… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
The prohibitive complexity of convolutional neural networks (CNNs) has triggered an
increasing demand for network simplification. To this end, one natural solution is to remove …

[HTML][HTML] LMD-DARTS: Low-Memory, Densely Connected, Differentiable Architecture Search

Z Li, Y Xu, P Ying, H Chen, R Sun, X Xu - Electronics, 2024 - mdpi.com
Neural network architecture search (NAS) technology is pivotal for designing lightweight
convolutional neural networks (CNNs), facilitating the automatic search for network …

DGL: device generic latency model for neural architecture search on mobile devices

Q Wang, S Zhang - IEEE Transactions on Mobile Computing, 2023 - ieeexplore.ieee.org
The low-cost Neural Architecture Search (NAS) for lightweight networks working on massive
mobile devices is essential for fast-developing ICT technology. Current NAS work can not …

Multi-Hardware Adaptive Latency Prediction for Neural Architecture Search

C Lin, P Yang, Q Wang, Y Guo… - IEEE Internet of Things …, 2024 - ieeexplore.ieee.org
In hardware-aware neural architecture search (NAS), accurately assessing a model's
inference efficiency is crucial for search optimization. Traditional approaches, which …

Small temperature is all you need for differentiable architecture search

J Zhang, Z Ding - Pacific-Asia Conference on Knowledge Discovery and …, 2023 - Springer
Differentiable architecture search (DARTS) yields highly efficient gradient-based neural
architecture search (NAS) by relaxing the discrete operation selection to optimize …

Multi-conditioned Graph Diffusion for Neural Architecture Search

R Asthana, J Conrad, Y Dawoud, M Ortmanns… - arXiv preprint arXiv …, 2024 - arxiv.org
Neural architecture search automates the design of neural network architectures usually by
exploring a large and thus complex architecture search space. To advance the architecture …

HGNAS: Hardware-Aware Graph Neural Architecture Search for Edge Devices

A Zhou, J Yang, Y Qi, T Qiao, Y Shi… - IEEE Transactions …, 2024 - ieeexplore.ieee.org
Graph Neural Networks (GNNs) are becoming increasingly popular for graph-based
learning tasks such as point cloud processing due to their state-of-the-art (SOTA) …

Rethink DARTS search space and renovate a new benchmark

J Zhang, Z Ding - International Conference on Machine …, 2023 - proceedings.mlr.press
DARTS search space (DSS) has become a canonical benchmark for NAS whereas some
emerging works pointed out the issue of narrow accuracy range and claimed it would hurt …

EvoLP: Self-Evolving Latency Predictor for Model Compression in Real-Time Edge Systems

S Huai, H Kong, S Li, X Luo… - IEEE Embedded …, 2023 - ieeexplore.ieee.org
Edge devices are increasingly utilized for deploying deep learning applications on
embedded systems. The real-time nature of many applications and the limited resources of …