Probing classifiers: Promises, shortcomings, and advances
Y Belinkov - Computational Linguistics, 2022 - direct.mit.edu
Probing classifiers have emerged as one of the prominent methodologies for interpreting
and analyzing deep neural network models of natural language processing. The basic idea …
and analyzing deep neural network models of natural language processing. The basic idea …
Convolutional neural networks as a model of the visual system: Past, present, and future
GW Lindsay - Journal of cognitive neuroscience, 2021 - direct.mit.edu
Convolutional neural networks (CNNs) were inspired by early findings in the study of
biological vision. They have since become successful tools in computer vision and state-of …
biological vision. They have since become successful tools in computer vision and state-of …
A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence
Extensive sampling of neural activity during rich cognitive phenomena is critical for robust
understanding of brain function. Here we present the Natural Scenes Dataset (NSD), in …
understanding of brain function. Here we present the Natural Scenes Dataset (NSD), in …
Do vision transformers see like convolutional neural networks?
Convolutional neural networks (CNNs) have so far been the de-facto model for visual data.
Recent work has shown that (Vision) Transformer models (ViT) can achieve comparable or …
Recent work has shown that (Vision) Transformer models (ViT) can achieve comparable or …
Brains and algorithms partially converge in natural language processing
C Caucheteux, JR King - Communications biology, 2022 - nature.com
Deep learning algorithms trained to predict masked words from large amount of text have
recently been shown to generate activations similar to those of the human brain. However …
recently been shown to generate activations similar to those of the human brain. However …
Multi-task learning with deep neural networks: A survey
M Crawshaw - arXiv preprint arXiv:2009.09796, 2020 - arxiv.org
Multi-task learning (MTL) is a subfield of machine learning in which multiple tasks are
simultaneously learned by a shared model. Such approaches offer advantages like …
simultaneously learned by a shared model. Such approaches offer advantages like …
Similarity of neural network representations revisited
Recent work has sought to understand the behavior of neural networks by comparing
representations between layers and between different trained models. We examine methods …
representations between layers and between different trained models. We examine methods …
The neuroconnectionist research programme
A Doerig, RP Sommers, K Seeliger… - Nature Reviews …, 2023 - nature.com
Artificial neural networks (ANNs) inspired by biology are beginning to be widely used to
model behavioural and neural data, an approach we call 'neuroconnectionism'. ANNs have …
model behavioural and neural data, an approach we call 'neuroconnectionism'. ANNs have …
Deep problems with neural network models of human vision
Deep neural networks (DNNs) have had extraordinary successes in classifying
photographic images of objects and are often described as the best models of biological …
photographic images of objects and are often described as the best models of biological …
If deep learning is the answer, what is the question?
Neuroscience research is undergoing a minor revolution. Recent advances in machine
learning and artificial intelligence research have opened up new ways of thinking about …
learning and artificial intelligence research have opened up new ways of thinking about …