Scaling up your kernels to 31x31: Revisiting large kernel design in cnns

X Ding, X Zhang, J Han, G Ding - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
We revisit large kernel design in modern convolutional neural networks (CNNs). Inspired by
recent advances in vision transformers (ViTs), in this paper, we demonstrate that using a few …

Boosted dynamic neural networks

H Yu, H Li, G Hua, G Huang, H Shi - … of the AAAI conference on artificial …, 2023 - ojs.aaai.org
Early-exiting dynamic neural networks (EDNN), as one type of dynamic neural networks, has
been widely studied recently. A typical EDNN has multiple prediction heads at different …

NeuLens: spatial-based dynamic acceleration of convolutional neural networks on edge

X Hou, Y Guan, T Han - Proceedings of the 28th Annual International …, 2022 - dl.acm.org
Convolutional neural networks (CNNs) play an important role in today's mobile and edge
computing systems for vision-based tasks like object classification and detection. However …

Layer Compression of Deep Networks with Straight Flows

C Gong, X Du, B Bhushanam, L Wu, X Liu… - Proceedings of the …, 2024 - ojs.aaai.org
Very deep neural networks lead to significantly better performance on various real tasks.
However, it usually causes slow inference and is hard to be deployed on real-world devices …

Training on the test set: Mapping the system-problem space in ai

J Hernández-Orallo, W Schellaert… - Proceedings of the …, 2022 - ojs.aaai.org
Many present and future problems associated with artificial intelligence are not due to its
limitations, but to our poor assessment of its behaviour. Our evaluation procedures produce …

[HTML][HTML] ResnetCPS for Power Equipment and Defect Detection

X Yan, L Jia, X Liao, W Cui, S Xue, D Yan, H Cao - Applied Sciences, 2024 - mdpi.com
Routine visual inspection is fundamental to the preventive maintenance of power
equipment. Convolutional neural networks (CNNs) substantially reduce the number of …

Activation Control of Vision Models for Sustainable AI Systems

J Burton-Barr, B Fernando… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
As AI systems become more complex and widespread, they require significant
computational power, increasing energy consumption. Addressing this challenge is …

Revisiting Single-gated Mixtures of Experts

A Royer, I Karmanov, A Skliar, BE Bejnordi… - arXiv preprint arXiv …, 2023 - arxiv.org
Mixture of Experts (MoE) are rising in popularity as a means to train extremely large-scale
models, yet allowing for a reasonable computational cost at inference time. Recent state-of …

Co-creation of Interactive E-Courses by Multidisciplinary Teams of Educators-Researchers-Practitioners-Stakeholders

T Sergeyeva, S Bronin - International Conference on Interactive …, 2023 - Springer
The article proposes model of human-centered and impact-oriented e-training course
development. Multi-actor, multi-sector and multidisciplinary co-creation is considered a key …

Knowledge accumulating: The general pattern of learning

Z Xu, H Liu - arXiv preprint arXiv:2108.03988, 2021 - arxiv.org
Artificial Intelligence has been developed for decades with the achievement of great
progress. Recently, deep learning shows its ability to solve many real world problems, eg …