[图书][B] Entropy and diversity: the axiomatic approach

T Leinster - 2021 - books.google.com
The global biodiversity crisis is one of humanity's most urgent problems, but even
quantifying biological diversity is a difficult mathematical and conceptual challenge. This …

Empirical regularized optimal transport: Statistical theory and applications

M Klatt, C Tameling, A Munk - SIAM Journal on Mathematics of Data Science, 2020 - SIAM
We derive limit distributions for various empirical regularized optimal transport quantities
between probability distributions supported on a finite metric space and show their bootstrap …

A novel approach to the partial information decomposition

A Kolchinsky - Entropy, 2022 - mdpi.com
We consider the “partial information decomposition”(PID) problem, which aims to
decompose the information that a set of source random variables provide about a target …

Multimodal learning without labeled multimodal data: Guarantees and applications

PP Liang, CK Ling, Y Cheng, A Obolenskiy… - arXiv preprint arXiv …, 2023 - arxiv.org
In many machine learning systems that jointly learn from multiple modalities, a core research
question is to understand the nature of multimodal interactions: the emergence of new task …

Minimum-entropy coupling approximation guarantees beyond the majorization barrier

S Compton, D Katz, B Qi… - International …, 2023 - proceedings.mlr.press
Given a set of discrete probability distributions, the minimum entropy coupling is the
minimum entropy joint distribution that has the input distributions as its marginals. This has …

Entropy bounds for discrete random variables via maximal coupling

I Sason - IEEE Transactions on Information Theory, 2013 - ieeexplore.ieee.org
This paper derives new bounds on the difference of the entropies of two discrete random
variables in terms of the local and total variation distances between their probability mass …

Communicating via markov decision processes

S Sokota, CAS De Witt, M Igl… - International …, 2022 - proceedings.mlr.press
We consider the problem of communicating exogenous information by means of Markov
decision process trajectories. This setting, which we call a Markov coding game (MCG) …

Minimum-entropy couplings and their applications

F Cicalese, L Gargano… - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
Given two discrete random variables X and Y, with probability distributions p=(p 1,..., pn) and
q=(q 1,..., qm), respectively, let us denote by C (p, q) the set of all couplings of p and q, that …

Bounds on the entropy of a function of a random variable and their applications

F Cicalese, L Gargano… - IEEE Transactions on …, 2017 - ieeexplore.ieee.org
It is well known that the entropy H (X) of a discrete random variable X is always greater than
or equal to the entropy H (f (X)) of a function f of X, with equality if and only if f is one-to-one …

Entropy and Diversity: The Axiomatic Approach

T Leinster - arXiv preprint arXiv:2012.02113, 2020 - arxiv.org
This book brings new mathematical rigour to the ongoing vigorous debate on how to
quantify biological diversity. The question" what is diversity?" has surprising mathematical …