Undecidability of network coding, conditional information inequalities, and conditional independence implication

CT Li - IEEE Transactions on Information Theory, 2023 - ieeexplore.ieee.org
We resolve three long-standing open problems, namely the (algorithmic) decidability of
network coding, the decidability of conditional information inequalities, and the decidability …

An automated theorem proving framework for information-theoretic results

CT Li - IEEE Transactions on Information Theory, 2023 - ieeexplore.ieee.org
We present a versatile automated theorem proving framework capable of automated
discovery, simplification and proofs of inner and outer bounds in network information theory …

A Pair of Bayesian Network Structures has Undecidable Conditional Independencies

CT Li - arXiv preprint arXiv:2405.07107, 2024 - arxiv.org
Given a Bayesian network structure (directed acyclic graph), the celebrated d-separation
algorithm efficiently determines whether the network structure implies a given conditional …

A new approach to compute information theoretic outer bounds and its application to regenerating codes

W Chen, C Tian - 2022 IEEE International Symposium on …, 2022 - ieeexplore.ieee.org
The study of the fundamental limits of information systems is a central theme in information
theory. Both the traditional analytical approach and the recently proposed computational …

A Characterization of Entropy as a Universal Monoidal Natural Transformation

CT Li - arXiv preprint arXiv:2308.05742, 2023 - arxiv.org
We show that the essential properties of entropy (monotonicity, additivity and subadditivity)
are consequences of entropy being a monoidal natural transformation from the under …

A Poisson decomposition for information and the information-event diagram

CT Li - 2024 IEEE International Symposium on Information …, 2024 - ieeexplore.ieee.org
Information diagram and the I-measure are useful mnemonics where random variables are
treated as sets, and entropy and mutual information are treated as a signed measure. The …

Proving information inequalities and identities with symbolic computation

L Guo, RW Yeung, XS Gao - IEEE Transactions on Information …, 2023 - ieeexplore.ieee.org
Proving linear inequalities and identities of Shannon's information measures, possibly with
linear constraints on the information measures, is an important problem in information …

Proving Information Inequalities by Gaussian Elimination

L Guo, RW Yeung, XS Gao - arXiv preprint arXiv:2401.14916, 2024 - arxiv.org
The proof of information inequalities and identities under linear constraints on the
information measures is an important problem in information theory. For this purpose, ITIP …

Square Root Convexity of Fisher Information along Heat Flow in Dimension Two

J Liu, X Gao - Entropy, 2023 - mdpi.com
Recently, Ledoux, Nair, and Wang proved that the Fisher information along the heat flow is
log-convex in dimension one, that is d 2 dt 2 log (I (X t))≥ 0 for n= 1, where X t is a random …