Coarse-graining as a downward causation mechanism

JC Flack - … Transactions of the Royal Society A …, 2017 - royalsocietypublishing.org
Downward causation is the controversial idea that 'higher'levels of organization can causally
influence behaviour at 'lower'levels of organization. Here I propose that we can gain traction …

Semantic information, autonomous agency and non-equilibrium statistical physics

A Kolchinsky, DH Wolpert - Interface focus, 2018 - royalsocietypublishing.org
Shannon information theory provides various measures of so-called syntactic information,
which reflect the amount of statistical correlation between systems. By contrast, the concept …

Information decomposition of target effects from multi-source interactions: Perspectives on previous, current and future work

JT Lizier, N Bertschinger, J Jost, M Wibral - Entropy, 2018 - mdpi.com
The formulation of the Partial Information Decomposition (PID) framework by Williams and
Beer in 2010 attracted a significant amount of attention to the problem of defining redundant …

Aleatoric and epistemic discrimination: Fundamental limits of fairness interventions

H Wang, L He, R Gao… - Advances in Neural …, 2024 - proceedings.neurips.cc
Abstract Machine learning (ML) models can underperform on certain population groups due
to choices made during model development and bias inherent in the data. We categorize …

Pointwise partial information decompositionusing the specificity and ambiguity lattices

C Finn, JT Lizier - Entropy, 2018 - mdpi.com
What are the distinct ways in which a set of predictor variables can provide information about
a target variable? When does a variable provide unique information, when do variables …

A novel approach to the partial information decomposition

A Kolchinsky - Entropy, 2022 - mdpi.com
We consider the “partial information decomposition”(PID) problem, which aims to
decompose the information that a set of source random variables provide about a target …

Synthetic cells extract semantic information from their environment

B Ruzzante, L Del Moro, M Magarini… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Based on a recently reported operative definition of semantic information, due to Kolchinsky
and Wolpert (2018), here we present a research program based on the intersection between …

Extending the agent in QBism

J Pienaar - Foundations of Physics, 2020 - Springer
According to the subjective Bayesian interpretation of quantum mechanics (QBism), the
instruments used to measure quantum systems are to be regarded as an extension of the …

Information processing equalities and the information–risk bridge

RC Williamson, Z Cranko - Journal of Machine Learning Research, 2024 - jmlr.org
We introduce two new classes of measures of information for statistical experiments which
generalise and subsume φ-divergences, integral probability metrics, N-distances (MMD) …

Generalised measures of multivariate information content

C Finn, JT Lizier - Entropy, 2020 - mdpi.com
The entropy of a pair of random variables is commonly depicted using a Venn diagram. This
representation is potentially misleading, however, since the multivariate mutual information …