Sequential memory with temporal predictive coding

M Tang, H Barron, R Bogacz - Advances in Neural …, 2024 - proceedings.neurips.cc
Forming accurate memory of sequential stimuli is a fundamental function of biological
agents. However, the computational mechanism underlying sequential memory in the brain …

Brain-inspired computational intelligence via predictive coding

T Salvatori, A Mali, CL Buckley, T Lukasiewicz… - arXiv preprint arXiv …, 2023 - arxiv.org
Artificial intelligence (AI) is rapidly becoming one of the key technologies of this century. The
majority of results in AI thus far have been achieved using deep neural networks trained with …

[HTML][HTML] A sparse quantized hopfield network for online-continual memory

N Alonso, JL Krichmar - Nature Communications, 2024 - nature.com
An important difference between brains and deep neural networks is the way they learn.
Nervous systems learn online where a stream of noisy data points are presented in a non …

Brain-inspired machine intelligence: A survey of neurobiologically-plausible credit assignment

AG Ororbia - arXiv preprint arXiv:2312.09257, 2023 - arxiv.org
In this survey, we examine algorithms for conducting credit assignment in artificial neural
networks that are inspired or motivated by neurobiology, unifying these various processes …

Uniform Memory Retrieval with Larger Capacity for Modern Hopfield Models

D Wu, JYC Hu, TY Hsiao, H Liu - arXiv preprint arXiv:2404.03827, 2024 - arxiv.org
We propose a two-stage memory retrieval dynamics for modern Hopfield models, termed
$\mathtt {U\text {-} Hop} $, with enhanced memory capacity. Our key contribution is a …

Causal Inference via Predictive Coding

T Salvatori, L Pinchetti, A M'Charrak, B Millidge… - arXiv preprint arXiv …, 2023 - arxiv.org
Bayesian and causal inference are fundamental processes for intelligence. Bayesian
inference models observations: what can be inferred about y if we observe a related variable …

Associative Memories in the Feature Space

T Salvatori, B Millidge, Y Song, R Bogcaz… - ECAI 2023, 2023 - ebooks.iospress.nl
An autoassociative memory model is a function that, given a set of data points, takes as input
an arbitrary vector and outputs the most similar data point from the memorized set. However …

Saliency-Guided Hidden Associative Replay for Continual Learning

G Bai, Q Zhao, X Jiang, Y Zhang, L Zhao - arXiv preprint arXiv:2310.04334, 2023 - arxiv.org
Continual Learning is a burgeoning domain in next-generation AI, focusing on training
neural networks over a sequence of tasks akin to human learning. While CL provides an …

Predictive Coding beyond Correlations

T Salvatori, L Pinchetti, A M'Charrak, B Millidge… - 2023 - openreview.net
Bayesian and causal inference are fundamental processes for intelligence. Bayesian
inference models observations: what can be inferred about $ y $ if we observe a related …