Undecidability of network coding, conditional information inequalities, and conditional independence implication
CT Li - IEEE Transactions on Information Theory, 2023 - ieeexplore.ieee.org
We resolve three long-standing open problems, namely the (algorithmic) decidability of
network coding, the decidability of conditional information inequalities, and the decidability …
network coding, the decidability of conditional information inequalities, and the decidability …
An automated theorem proving framework for information-theoretic results
CT Li - IEEE Transactions on Information Theory, 2023 - ieeexplore.ieee.org
We present a versatile automated theorem proving framework capable of automated
discovery, simplification and proofs of inner and outer bounds in network information theory …
discovery, simplification and proofs of inner and outer bounds in network information theory …
A Pair of Bayesian Network Structures has Undecidable Conditional Independencies
CT Li - arXiv preprint arXiv:2405.07107, 2024 - arxiv.org
Given a Bayesian network structure (directed acyclic graph), the celebrated d-separation
algorithm efficiently determines whether the network structure implies a given conditional …
algorithm efficiently determines whether the network structure implies a given conditional …
A new approach to compute information theoretic outer bounds and its application to regenerating codes
The study of the fundamental limits of information systems is a central theme in information
theory. Both the traditional analytical approach and the recently proposed computational …
theory. Both the traditional analytical approach and the recently proposed computational …
A Characterization of Entropy as a Universal Monoidal Natural Transformation
CT Li - arXiv preprint arXiv:2308.05742, 2023 - arxiv.org
We show that the essential properties of entropy (monotonicity, additivity and subadditivity)
are consequences of entropy being a monoidal natural transformation from the under …
are consequences of entropy being a monoidal natural transformation from the under …
A Poisson decomposition for information and the information-event diagram
CT Li - 2024 IEEE International Symposium on Information …, 2024 - ieeexplore.ieee.org
Information diagram and the I-measure are useful mnemonics where random variables are
treated as sets, and entropy and mutual information are treated as a signed measure. The …
treated as sets, and entropy and mutual information are treated as a signed measure. The …
Proving information inequalities and identities with symbolic computation
Proving linear inequalities and identities of Shannon's information measures, possibly with
linear constraints on the information measures, is an important problem in information …
linear constraints on the information measures, is an important problem in information …
Proving Information Inequalities by Gaussian Elimination
The proof of information inequalities and identities under linear constraints on the
information measures is an important problem in information theory. For this purpose, ITIP …
information measures is an important problem in information theory. For this purpose, ITIP …
Square Root Convexity of Fisher Information along Heat Flow in Dimension Two
J Liu, X Gao - Entropy, 2023 - mdpi.com
Recently, Ledoux, Nair, and Wang proved that the Fisher information along the heat flow is
log-convex in dimension one, that is d 2 dt 2 log (I (X t))≥ 0 for n= 1, where X t is a random …
log-convex in dimension one, that is d 2 dt 2 log (I (X t))≥ 0 for n= 1, where X t is a random …