[HTML][HTML] Many but not all deep neural network audio models capture brain responses and exhibit correspondence between model stages and brain regions

G Tuckute, J Feather, D Boebinger, JH McDermott - Plos Biology, 2023 - journals.plos.org
Models that predict brain responses to stimuli provide one measure of understanding of a
sensory system and have many potential applications in science and engineering. Deep …

Energy guided diffusion for generating neurally exciting images

P Pierzchlewicz, K Willeke, A Nix… - Advances in …, 2024 - proceedings.neurips.cc
In recent years, most exciting inputs (MEIs) synthesized from encoding models of neuronal
activity have become an established method for studying tuning properties of biological and …

[HTML][HTML] Self-attention in vision transformers performs perceptual grouping, not attention

P Mehrani, JK Tsotsos - Frontiers in Computer Science, 2023 - frontiersin.org
Recently, a considerable number of studies in computer vision involve deep neural
architectures called vision transformers. Visual processing in these models incorporates …

A spectral theory of neural prediction and alignment

A Canatar, J Feather, A Wakhloo… - Advances in Neural …, 2024 - proceedings.neurips.cc
The representations of neural networks are often compared to those of biological systems by
performing regression between the neural network responses and those measured from …

Deep learning-driven characterization of single cell tuning in primate visual area V4 unveils topological organization

KF Willeke, K Restivo, K Franke, AF Nix, SA Cadena… - bioRxiv, 2023 - biorxiv.org
Deciphering the brain's structure-function relationship is key to understanding the neuronal
mechanisms underlying perception and cognition. The cortical column, a vertical …

[HTML][HTML] Large-scale calcium imaging reveals a systematic V4 map for encoding natural scenes

T Wang, TS Lee, H Yao, J Hong, Y Li, H Jiang… - Nature …, 2024 - nature.com
Biological visual systems have evolved to process natural scenes. A full understanding of
visual cortical functions requires a comprehensive characterization of how neuronal …

Strong and precise modulation of human percepts via robustified ANNs

G Gaziv, M Lee, JJ DiCarlo - Advances in Neural …, 2024 - proceedings.neurips.cc
The visual object category reports of artificial neural networks (ANNs) are notoriously
sensitive to tiny, adversarial image perturbations. Because human category reports (aka …

Exploring perceptual straightness in learned visual representations

A Harrington, V DuTell, A Tewari… - The Eleventh …, 2023 - openreview.net
Humans have been shown to use a''straightened''encoding to represent the natural visual
world as it evolves in time (Henaff et al. 2019). In the context of discrete video sequences,'' …

Exploring the perceptual straightness of adversarially robust and biologically-inspired visual representations

A Harrington, V DuTell, A Tewari… - SVRHM 2022 …, 2022 - openreview.net
Humans have been shown to use a''straightened''encoding to represent the natural visual
world as it evolves in time (H\'enaff et al.~ 2019). In the context of discrete video sequences,'' …

Layerwise complexity-matched learning yields an improved model of cortical area V2

N Parthasarathy, OJ Hénaff, EP Simoncelli - arXiv preprint arXiv …, 2023 - arxiv.org
Human ability to recognize complex visual patterns arises through transformations
performed by successive areas in the ventral visual cortex. Deep neural networks trained …