Simultaneous feature selection and discretization based on mutual information
… Spectral Conditional Mutual Information (SPEC_CMI) which formulates the mRMR feature
selection criteria into a semi-definite programming model and solves it via spectral relaxation. …
selection criteria into a semi-definite programming model and solves it via spectral relaxation. …
On mutual information maximization for representation learning
… by maximizing an estimate of the mutual information (MI) between different views … model
from Section 3.1 adversarially. We model g1 with the same RealNVP architecture as in the first …
from Section 3.1 adversarially. We model g1 with the same RealNVP architecture as in the first …
Learning disentangled representations via mutual information estimation
EH Sanchez, M Serrurier, M Ortner - … , Glasgow, UK, August 23–28, 2020 …, 2020 - Springer
… model based on mutual information estimation without relying on image reconstruction or
image generation. Mutual information … is to perform dimensionality reduction while keeping the …
image generation. Mutual information … is to perform dimensionality reduction while keeping the …
On variational bounds of mutual information
… mutual information do not require direct knowledge of any conditional densities. To establish
an initial lower bound on mutual information, … restrict our model to pρ(yi|xi) = N(ρix, √1 − ρ2 …
an initial lower bound on mutual information, … restrict our model to pρ(yi|xi) = N(ρix, √1 − ρ2 …
Overview and comparative study of dimensionality reduction techniques for high dimensional data
S Ayesha, MK Hanif, R Talib - Information Fusion, 2020 - Elsevier
… means that if the amount of data for which to train a model is fixed, then increasing
dimensionality can lead to overfitting. This issue can be avoided by bringing in exponentially more …
dimensionality can lead to overfitting. This issue can be avoided by bringing in exponentially more …
Feature selection based on conditional mutual information: minimum conditional relevance and minimum conditional redundancy
HF Zhou, Y Zhang, YJ Zhang, HJ Liu - Applied Intelligence, 2019 - Springer
… Lots of feature selection methods based on low-order mutual information [9,10,11,12… using
low-order mutual information is Mutual Information Maximum (MIM) [9] that applies information …
low-order mutual information is Mutual Information Maximum (MIM) [9] that applies information …
Feature selection using bare-bones particle swarm optimization with mutual information
X Song, Y Zhang, D Gong, X Sun - Pattern Recognition, 2021 - Elsevier
… ) limit their performance on dealing with high-dimensional … mutual information. Firstly, an
effective swarm initialization strategy based on label correlation is developed, making full use …
effective swarm initialization strategy based on label correlation is developed, making full use …
Understanding the limitations of variational mutual information estimators
… methods for variational mutual information estimation. We first show that variational mutual
information estimation can … We train all models for 20k iterations, with the ground truth mutual …
information estimation can … We train all models for 20k iterations, with the ground truth mutual …
Feature selection via mutual information: New theoretical insights
… features using as a score the conditional mutual information (… mutual information of a feature
set and the prediction error, which, of course, will depend on the specific choice of the model …
set and the prediction error, which, of course, will depend on the specific choice of the model …
Graph representation learning via graphical mutual information maximization
… Following the inductive setup in [16], on Reddit, we feed posts made in the first 20 days
into the model for training, while the remaining are used for testing (with 30% used for validation); …
into the model for training, while the remaining are used for testing (with 30% used for validation); …