Simultaneous feature selection and discretization based on mutual information

S Sharmin, M Shoyaib, AA Ali, MAH Khan, O Chae - Pattern Recognition, 2019 - Elsevier
… Spectral Conditional Mutual Information (SPEC_CMI) which formulates the mRMR feature
selection criteria into a semi-definite programming model and solves it via spectral relaxation. …

On mutual information maximization for representation learning

M Tschannen, J Djolonga, PK Rubenstein… - arXiv preprint arXiv …, 2019 - arxiv.org
… by maximizing an estimate of the mutual information (MI) between different views … model
from Section 3.1 adversarially. We model g1 with the same RealNVP architecture as in the first

Learning disentangled representations via mutual information estimation

EH Sanchez, M Serrurier, M Ortner - … , Glasgow, UK, August 23–28, 2020 …, 2020 - Springer
model based on mutual information estimation without relying on image reconstruction or
image generation. Mutual information … is to perform dimensionality reduction while keeping the …

On variational bounds of mutual information

B Poole, S Ozair, A Van Den Oord… - International …, 2019 - proceedings.mlr.press
mutual information do not require direct knowledge of any conditional densities. To establish
an initial lower bound on mutual information, … restrict our model to pρ(yi|xi) = N(ρix, √1 − ρ2 …

Overview and comparative study of dimensionality reduction techniques for high dimensional data

S Ayesha, MK Hanif, R Talib - Information Fusion, 2020 - Elsevier
… means that if the amount of data for which to train a model is fixed, then increasing
dimensionality can lead to overfitting. This issue can be avoided by bringing in exponentially more …

Feature selection based on conditional mutual information: minimum conditional relevance and minimum conditional redundancy

HF Zhou, Y Zhang, YJ Zhang, HJ Liu - Applied Intelligence, 2019 - Springer
… Lots of feature selection methods based on low-order mutual information [9,10,11,12… using
low-order mutual information is Mutual Information Maximum (MIM) [9] that applies information

Feature selection using bare-bones particle swarm optimization with mutual information

X Song, Y Zhang, D Gong, X Sun - Pattern Recognition, 2021 - Elsevier
… ) limit their performance on dealing with high-dimensionalmutual information. Firstly, an
effective swarm initialization strategy based on label correlation is developed, making full use

Understanding the limitations of variational mutual information estimators

J Song, S Ermon - arXiv preprint arXiv:1910.06222, 2019 - arxiv.org
… methods for variational mutual information estimation. We first show that variational mutual
information estimation can … We train all models for 20k iterations, with the ground truth mutual

Feature selection via mutual information: New theoretical insights

M Beraha, AM Metelli, M Papini… - … joint conference on …, 2019 - ieeexplore.ieee.org
… features using as a score the conditional mutual information (… mutual information of a feature
set and the prediction error, which, of course, will depend on the specific choice of the model

Graph representation learning via graphical mutual information maximization

Z Peng, W Huang, M Luo, Q Zheng, Y Rong… - Proceedings of The …, 2020 - dl.acm.org
… Following the inductive setup in [16], on Reddit, we feed posts made in the first 20 days
into the model for training, while the remaining are used for testing (with 30% used for validation); …