Toward large kernel models

A Abedsoltan, M Belkin… - … Conference on Machine …, 2023 - proceedings.mlr.press
… , scaling kernel machines to large data … large-scale general kernel models, which are a
generalization of kernel machines that decouples the model and data, allowing training on large

Scaling up your kernels to 31x31: Revisiting large kernel design in cnns

X Ding, X Zhang, J Han, G Ding - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
… best model obtains very competitive results among the stateof-the-arts with similar model
on ADE20K, which shows excellent scalability towards large-scale applications. We believe …

Scaling Up Your Kernels: Large Kernel Design in ConvNets towards Universal Representations

Y Zhang, X Ding, X Yue - arXiv preprint arXiv:2410.08049, 2024 - arxiv.org
… We establish that employing a few large kernels, instead of stacking … large kernels to build
up a deeper model, but we argue that a large-kernel ConvNet may not benefit from more large

Large separable kernel attention: Rethinking the large kernel attention design in cnn

KW Lau, LM Po, YAU Rehman - Expert Systems with Applications, 2024 - Elsevier
… design biases the VAN more toward the shape of the … the large kernel in LSKA-based VAN
encode more shape information and less texture compared to ViTs and previous large kernel

[PDF][PDF] Large scale multiple kernel learning

S Sonnenburg, G Rätsch, C Schäfer… - The Journal of Machine …, 2006 - jmlr.org
… of kernels to be combined, and helps for automatic model selection, … for string kernels, allowing
us to train a string kernel SVM on a … We integrated multiple kernel learning in our machine …

Advances in kernel methods: towards general-purpose and scalable models

Y Samo - 2017 - ora.ox.ac.uk
kernel machines that perform very well over a wide range of input dimensions and sample
sizes. This thesis aims to contribute towards bridging the gap between kernel … and large scale …

Majority Kernels: An Approach to Leverage Big Model Dynamics for Efficient Small Model Training

H Mazzawi, P Awasthi, J Gonzalvo… - Workshop on Machine … - openreview.net
… the model’s parameters converge towards optimal values over time, influenced by factors
such as learning rate, gradient behavior, and the chosen optimization algorithm). This helps us …

Largekernel3d: Scaling up kernels in 3d sparse cnns

Y Chen, J Liu, X Zhang, X Qi… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
… ×17×17 kernel size on Waymo 3D object detection. For the first time, we show that large
kernels are feasible and essential for 3D visual tasks. Our code and models is available at github…

Partial Large Kernel CNNs for Efficient Super-Resolution

D Lee, S Yun, Y Ro - arXiv preprint arXiv:2404.11848, 2024 - arxiv.org
… a large computational overhead. To overcome this, we propose novel approaches to
employing the large kernel, … ure 4, It can be shown that large kernels lean towards lowfrequency …

The human kernel

AG Wilson, C Dann, C Lucas… - Advances in neural …, 2015 - proceedings.neurips.cc
… are difficult for conventional GP models. • We study Occam’s … based model selection, which
we show is biased towards under-… step towards building probabilistic kernel machines that en…