Expectation propagation on the diluted Bayesian classifier

A Braunstein, T Gueudré, A Pagnani, M Pieropan - Physical Review E, 2021 - APS
Efficient feature selection from high-dimensional datasets is a very important challenge in
many data-driven fields of science and engineering. We introduce a statistical mechanics …

[图书][B] On Sparse and Efficient Deep Learning

Y Lu - 2021 - search.proquest.com
Rapid and ongoing technology developments enable researchers to collect large scale,
high-dimensional data in a wide range of areas in science and technology. The availability …

Hyperparameter Estimation for Sparse Bayesian Learning Models

F Yu, L Shen, G Song - arXiv preprint arXiv:2401.02544, 2024 - arxiv.org
Sparse Bayesian Learning (SBL) models are extensively used in signal processing and
machine learning for promoting sparsity through hierarchical priors. The hyperparameters in …

Complexity-Optimized Sparse Bayesian Learning for Scalable Classification Tasks

J Luo, CM Wong, CM Vong - arXiv preprint arXiv:2107.08195, 2021 - arxiv.org
Sparse Bayesian Learning (SBL) constructs an extremely sparse probabilistic model with
very competitive generalization. However, SBL needs to invert a big covariance matrix with …

Misclassification bounds for PAC-Bayesian sparse deep learning

TT Mai - arXiv preprint arXiv:2405.01304, 2024 - arxiv.org
Recently, there has been a significant focus on exploring the theoretical aspects of deep
learning, especially regarding its performance in classification tasks. Bayesian deep …

Bayesian model averaging naive bayes (bma-nb): Averaging over an exponential number of feature models in linear time

G Wu, S Sanner, R Oliveira - Proceedings of the AAAI Conference on …, 2015 - ojs.aaai.org
Naive Bayes (NB) is well-known to be a simple but effective classifier, especially when
combined with feature selection. Unfortunately, feature selection methods are often greedy …

[PDF][PDF] Fast Laplace Approximation for Sparse Bayesian Spike and Slab Models.

SAZ Naqvi, S Zhe, Y Qi, Y Yang, J Ye - IJCAI, 2016 - users.cs.utah.edu
We consider the application of Bayesian spike-andslab models in high-dimensional feature
selection problems. To do so, we propose a simple yet effective fast approximate Bayesian …

Naive feature selection: Sparsity in naive bayes

A Askari, A d'Aspremont… - … Conference on Artificial …, 2020 - proceedings.mlr.press
Due to its linear complexity, naive Bayes classification remains an attractive supervised
learning method, especially in very large-scale settings. We propose a sparse version of …

Are random decompositions all we need in high dimensional Bayesian optimisation?

JK Ziomek, HB Ammar - International Conference on …, 2023 - proceedings.mlr.press
Learning decompositions of expensive-to-evaluate black-box functions promises to scale
Bayesian optimisation (BO) to high-dimensional problems. However, the success of these …

Recursive Sparse Bayesian Learning

X Qiao, Y Wang - 2022 China Automation Congress (CAC), 2022 - ieeexplore.ieee.org
While sparse Bayesian learning (SBL) has attracted a great amount of attention in a wide
range of areas, its practical utility is limited due to the high computational cost. To address …