Brain-conditional multimodal synthesis: A survey and taxonomy

W Mai, J Zhang, P Fang, Z Zhang - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
In the era of Artificial Intelligence Generated Content (AIGC), conditional multimodal
synthesis technologies (eg, text-to-image) are dynamically reshaping the natural content …

Visual representations: Insights from neural decoding

AK Robinson, GL Quek… - Annual Review of Vision …, 2023 - annualreviews.org
Patterns of brain activity contain meaningful information about the perceived world. Recent
decades have welcomed a new era in neural analyses, with computational techniques from …

Dreamsim: Learning new dimensions of human visual similarity using synthetic data

S Fu, N Tamir, S Sundaram, L Chai, R Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Current perceptual similarity metrics operate at the level of pixels and patches. These
metrics compare images in terms of their low-level colors and textures, but fail to capture mid …

Better models of human high-level visual cortex emerge from natural language supervision with a large and diverse dataset

AY Wang, K Kay, T Naselaris, MJ Tarr… - Nature Machine …, 2023 - nature.com
High-performing neural networks for vision have dramatically advanced our ability to
account for neural data in biological systems. Recently, further improvement in performance …

Modeling short visual events through the BOLD moments video fMRI dataset and metadata

B Lahner, K Dwivedi, P Iamshchinina… - Nature …, 2024 - nature.com
Studying the neural basis of human dynamic visual perception requires extensive
experimental data to evaluate the large swathes of functionally diverse brain neural …

Distributed representations of behaviour-derived object dimensions in the human visual system

O Contier, CI Baker, MN Hebart - Nature Human Behaviour, 2024 - nature.com
Object vision is commonly thought to involve a hierarchy of brain regions processing
increasingly complex image features, with high-level visual cortex supporting object …

Improving neural network representations using human similarity judgments

L Muttenthaler, L Linhardt, J Dippel… - Advances in …, 2024 - proceedings.neurips.cc
Deep neural networks have reached human-level performance on many computer vision
tasks. However, the objectives used to train these networks enforce only that similar images …

Cortical topographic motifs emerge in a self-organized map of object space

FR Doshi, T Konkle - Science Advances, 2023 - science.org
The human ventral visual stream has a highly systematic organization of object information,
but the causal pressures driving these topographic motifs are highly debated. Here, we use …

[HTML][HTML] A large and rich EEG dataset for modeling human visual object recognition

AT Gifford, K Dwivedi, G Roig, RM Cichy - NeuroImage, 2022 - Elsevier
The human brain achieves visual object recognition through multiple stages of linear and
nonlinear transformations operating at a millisecond scale. To predict and explain these …

Brain decoding: toward real-time reconstruction of visual perception

Y Benchetrit, H Banville, JR King - arXiv preprint arXiv:2310.19812, 2023 - arxiv.org
In the past five years, the use of generative and foundational AI systems has greatly
improved the decoding of brain activity. Visual perception, in particular, can now be decoded …