Self-attentive associative memory

H Le, T Tran, S Venkatesh - International Conference on …, 2020 - proceedings.mlr.press
Heretofore, neural networks with external memory are restricted to single memory with lossy
representations of memory interactions. A rich representation of relationships between …

Hierarchical associative memory

D Krotov - arXiv preprint arXiv:2107.06446, 2021 - arxiv.org
Dense Associative Memories or Modern Hopfield Networks have many appealing properties
of associative memory. They can do pattern completion, store a large number of memories …

BayesPCN: A continually learnable predictive coding associative memory

J Yoo, F Wood - Advances in Neural Information Processing …, 2022 - proceedings.neurips.cc
Associative memory plays an important role in human intelligence and its mechanisms have
been linked to attention in machine learning. While the machine learning community's …

[PDF][PDF] Learning large-scale heteroassociative memories in spiking neurons

AR Voelker, E Crawford… - … Computation and Natural …, 2014 - e2crawfo.github.io
Associative memories have been an active area of research over the last forty years
(Willshaw et al., 1969; Kohonen, 1972; Hopfield, 1982) because they form a central …

Universal hopfield networks: A general framework for single-shot associative memory models

B Millidge, T Salvatori, Y Song… - International …, 2022 - proceedings.mlr.press
A large number of neural network models of associative memory have been proposed in the
literature. These include the classical Hopfield networks (HNs), sparse distributed memories …

Deep associative neural network for associative memory based on unsupervised representation learning

J Liu, M Gong, H He - Neural Networks, 2019 - Elsevier
This paper presents a deep associative neural network (DANN) based on unsupervised
representation learning for associative memory. In brain, the knowledge is learnt by …

Associative memories via predictive coding

T Salvatori, Y Song, Y Hong, L Sha… - Advances in …, 2021 - proceedings.neurips.cc
Associative memories in the brain receive and store patterns of activity registered by the
sensory neurons, and are able to retrieve them when necessary. Due to their importance in …

An autoassociative neural network model of paired-associate learning

DS Rizzuto, MJ Kahana - Neural Computation, 2001 - ieeexplore.ieee.org
Hebbian heteroassociative learning is inherently asymmetric. Storing a forward association,
from item A to item B, enables recall of B (given A), but does not permit recall of A (given B) …

Overparameterized neural networks implement associative memory

A Radhakrishnan, M Belkin… - Proceedings of the …, 2020 - National Acad Sciences
Identifying computational mechanisms for memorization and retrieval of data is a long-
standing problem at the intersection of machine learning and neuroscience. Our main …

A sequential dynamic heteroassociative memory for multistep pattern recognition and one-to-many association

S Chartier, M Boukadoum - IEEE Transactions on Neural …, 2006 - ieeexplore.ieee.org
Bidirectional associative memories (BAMs) have been widely used for auto and
heteroassociative learning. However, few research efforts have addressed the issue of …