Artificial neural networks for neuroscientists: a primer

GR Yang, XJ Wang - Neuron, 2020 - cell.com
Artificial neural networks (ANNs) are essential tools in machine learning that have drawn
increasing attention in neuroscience. Besides offering powerful techniques for data analysis …

The relational bottleneck as an inductive bias for efficient abstraction

TW Webb, SM Frankland, A Altabaa, S Segert… - Trends in Cognitive …, 2024 - cell.com
A central challenge for cognitive science is to explain how abstract concepts are acquired
from limited experience. This has often been framed in terms of a dichotomy between …

Consciousness in artificial intelligence: insights from the science of consciousness

P Butlin, R Long, E Elmoznino, Y Bengio… - arXiv preprint arXiv …, 2023 - arxiv.org
Whether current or near-term AI systems could be conscious is a topic of scientific interest
and increasing public concern. This report argues for, and exemplifies, a rigorous and …

Is attention explanation? an introduction to the debate

A Bibal, R Cardon, D Alfter, R Wilkens… - Proceedings of the …, 2022 - aclanthology.org
The performance of deep learning models in NLP and other fields of machine learning has
led to a rise in their popularity, and so the need for explanations of these models becomes …

RADANet: Road augmented deformable attention network for road extraction from complex high-resolution remote-sensing images

L Dai, G Zhang, R Zhang - IEEE Transactions on Geoscience …, 2023 - ieeexplore.ieee.org
Extracting roads from complex high-resolution remote sensing images to update road
networks has become a recent research focus. How to apply the contextual spatial …

Exploring transformers in natural language generation: Gpt, bert, and xlnet

MO Topal, A Bas, I van Heerden - arXiv preprint arXiv:2102.08036, 2021 - arxiv.org
Recent years have seen a proliferation of attention mechanisms and the rise of Transformers
in Natural Language Generation (NLG). Previously, state-of-the-art NLG architectures such …

Biological constraints on neural network models of cognitive function

F Pulvermüller, R Tomasello… - Nature Reviews …, 2021 - nature.com
Neural network models are potential tools for improving our understanding of complex brain
functions. To address this goal, these models need to be neurobiologically realistic …

Deep learning and the global workspace theory

R VanRullen, R Kanai - Trends in Neurosciences, 2021 - cell.com
Recent advances in deep learning have allowed artificial intelligence (AI) to reach near
human-level performance in many sensory, perceptual, linguistic, and cognitive tasks. There …

Human representation learning

A Radulescu, YS Shin, Y Niv - Annual Review of Neuroscience, 2021 - annualreviews.org
The central theme of this review is the dynamic interaction between information selection
and learning. We pose a fundamental question about this interaction: How do we learn what …

ATSE: a peptide toxicity predictor by exploiting structural and evolutionary information based on graph neural network and attention mechanism

L Wei, X Ye, Y Xue, T Sakurai… - Briefings in Bioinformatics, 2021 - academic.oup.com
Motivation: Peptides have recently emerged as promising therapeutic agents against
various diseases. For both research and safety regulation purposes, it is of high importance …