Artificial neural networks for neuroscientists: a primer
Artificial neural networks (ANNs) are essential tools in machine learning that have drawn
increasing attention in neuroscience. Besides offering powerful techniques for data analysis …
increasing attention in neuroscience. Besides offering powerful techniques for data analysis …
The relational bottleneck as an inductive bias for efficient abstraction
A central challenge for cognitive science is to explain how abstract concepts are acquired
from limited experience. This has often been framed in terms of a dichotomy between …
from limited experience. This has often been framed in terms of a dichotomy between …
Consciousness in artificial intelligence: insights from the science of consciousness
Whether current or near-term AI systems could be conscious is a topic of scientific interest
and increasing public concern. This report argues for, and exemplifies, a rigorous and …
and increasing public concern. This report argues for, and exemplifies, a rigorous and …
Is attention explanation? an introduction to the debate
The performance of deep learning models in NLP and other fields of machine learning has
led to a rise in their popularity, and so the need for explanations of these models becomes …
led to a rise in their popularity, and so the need for explanations of these models becomes …
RADANet: Road augmented deformable attention network for road extraction from complex high-resolution remote-sensing images
L Dai, G Zhang, R Zhang - IEEE Transactions on Geoscience …, 2023 - ieeexplore.ieee.org
Extracting roads from complex high-resolution remote sensing images to update road
networks has become a recent research focus. How to apply the contextual spatial …
networks has become a recent research focus. How to apply the contextual spatial …
Exploring transformers in natural language generation: Gpt, bert, and xlnet
Recent years have seen a proliferation of attention mechanisms and the rise of Transformers
in Natural Language Generation (NLG). Previously, state-of-the-art NLG architectures such …
in Natural Language Generation (NLG). Previously, state-of-the-art NLG architectures such …
Biological constraints on neural network models of cognitive function
F Pulvermüller, R Tomasello… - Nature Reviews …, 2021 - nature.com
Neural network models are potential tools for improving our understanding of complex brain
functions. To address this goal, these models need to be neurobiologically realistic …
functions. To address this goal, these models need to be neurobiologically realistic …
Deep learning and the global workspace theory
R VanRullen, R Kanai - Trends in Neurosciences, 2021 - cell.com
Recent advances in deep learning have allowed artificial intelligence (AI) to reach near
human-level performance in many sensory, perceptual, linguistic, and cognitive tasks. There …
human-level performance in many sensory, perceptual, linguistic, and cognitive tasks. There …
Human representation learning
The central theme of this review is the dynamic interaction between information selection
and learning. We pose a fundamental question about this interaction: How do we learn what …
and learning. We pose a fundamental question about this interaction: How do we learn what …
ATSE: a peptide toxicity predictor by exploiting structural and evolutionary information based on graph neural network and attention mechanism
Motivation: Peptides have recently emerged as promising therapeutic agents against
various diseases. For both research and safety regulation purposes, it is of high importance …
various diseases. For both research and safety regulation purposes, it is of high importance …