Scaling up your kernels to 31x31: Revisiting large kernel design in cnns
We revisit large kernel design in modern convolutional neural networks (CNNs). Inspired by
recent advances in vision transformers (ViTs), in this paper, we demonstrate that using a few …
recent advances in vision transformers (ViTs), in this paper, we demonstrate that using a few …
Boosted dynamic neural networks
Early-exiting dynamic neural networks (EDNN), as one type of dynamic neural networks, has
been widely studied recently. A typical EDNN has multiple prediction heads at different …
been widely studied recently. A typical EDNN has multiple prediction heads at different …
NeuLens: spatial-based dynamic acceleration of convolutional neural networks on edge
Convolutional neural networks (CNNs) play an important role in today's mobile and edge
computing systems for vision-based tasks like object classification and detection. However …
computing systems for vision-based tasks like object classification and detection. However …
Layer Compression of Deep Networks with Straight Flows
Very deep neural networks lead to significantly better performance on various real tasks.
However, it usually causes slow inference and is hard to be deployed on real-world devices …
However, it usually causes slow inference and is hard to be deployed on real-world devices …
Training on the test set: Mapping the system-problem space in ai
J Hernández-Orallo, W Schellaert… - Proceedings of the …, 2022 - ojs.aaai.org
Many present and future problems associated with artificial intelligence are not due to its
limitations, but to our poor assessment of its behaviour. Our evaluation procedures produce …
limitations, but to our poor assessment of its behaviour. Our evaluation procedures produce …
[HTML][HTML] ResnetCPS for Power Equipment and Defect Detection
Routine visual inspection is fundamental to the preventive maintenance of power
equipment. Convolutional neural networks (CNNs) substantially reduce the number of …
equipment. Convolutional neural networks (CNNs) substantially reduce the number of …
Activation Control of Vision Models for Sustainable AI Systems
J Burton-Barr, B Fernando… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
As AI systems become more complex and widespread, they require significant
computational power, increasing energy consumption. Addressing this challenge is …
computational power, increasing energy consumption. Addressing this challenge is …
Revisiting Single-gated Mixtures of Experts
Mixture of Experts (MoE) are rising in popularity as a means to train extremely large-scale
models, yet allowing for a reasonable computational cost at inference time. Recent state-of …
models, yet allowing for a reasonable computational cost at inference time. Recent state-of …
Co-creation of Interactive E-Courses by Multidisciplinary Teams of Educators-Researchers-Practitioners-Stakeholders
T Sergeyeva, S Bronin - International Conference on Interactive …, 2023 - Springer
The article proposes model of human-centered and impact-oriented e-training course
development. Multi-actor, multi-sector and multidisciplinary co-creation is considered a key …
development. Multi-actor, multi-sector and multidisciplinary co-creation is considered a key …
Knowledge accumulating: The general pattern of learning
Z Xu, H Liu - arXiv preprint arXiv:2108.03988, 2021 - arxiv.org
Artificial Intelligence has been developed for decades with the achievement of great
progress. Recently, deep learning shows its ability to solve many real world problems, eg …
progress. Recently, deep learning shows its ability to solve many real world problems, eg …