A primer on pattern-based approaches to fMRI: principles, pitfalls, and perspectives

JD Haynes - Neuron, 2015 - cell.com
Human fMRI signals exhibit a spatial patterning that contains detailed information about a
person's mental states. Using classifiers it is possible to access this information and study …

Reconstructing the mind's eye: fMRI-to-image with contrastive learning and diffusion priors

P Scotti, A Banerjee, J Goode… - Advances in …, 2024 - proceedings.neurips.cc
We present MindEye, a novel fMRI-to-image approach to retrieve and reconstruct viewed
images from brain activity. Our model comprises two parallel submodules that are …

Natural image reconstruction from fmri using deep learning: A survey

Z Rakhimberdina, Q Jodelet, X Liu… - Frontiers in …, 2021 - frontiersin.org
With the advent of brain imaging techniques and machine learning tools, much effort has
been devoted to building computational models to capture the encoding of visual …

Deep image reconstruction from human brain activity

G Shen, T Horikawa, K Majima… - PLoS computational …, 2019 - journals.plos.org
The mental contents of perception and imagery are thought to be encoded in hierarchical
representations in the brain, but previous attempts to visualize perceptual contents have …

Generative adversarial networks for reconstructing natural images from brain activity

K Seeliger, U Güçlü, L Ambrogioni, Y Güçlütürk… - NeuroImage, 2018 - Elsevier
We explore a method for reconstructing visual stimuli from brain activity. Using large
databases of natural images we trained a deep convolutional generative adversarial …

Variational autoencoder: An unsupervised model for encoding and decoding fMRI activity in visual cortex

K Han, H Wen, J Shi, KH Lu, Y Zhang, D Fu, Z Liu - NeuroImage, 2019 - Elsevier
Goal-driven and feedforward-only convolutional neural networks (CNN) have been shown to
be able to predict and decode cortical responses to natural images or videos. Here, we …

Reconstruction of perceived images from fmri patterns and semantic brain exploration using instance-conditioned gans

F Ozcelik, B Choksi, M Mozafari… - … Joint Conference on …, 2022 - ieeexplore.ieee.org
Reconstructing perceived natural images from fMRI signals is one of the most engaging
topics of neural decoding research. Prior studies had success in reconstructing either the …

Controllable mind visual diffusion model

B Zeng, S Li, X Liu, S Gao, X Jiang, X Tang… - Proceedings of the …, 2024 - ojs.aaai.org
Brain signal visualization has emerged as an active research area, serving as a critical
interface between the human visual system and computer vision models. Diffusion-based …

[HTML][HTML] Reconstructing seen image from brain activity by visually-guided cognitive representation and adversarial learning

Z Ren, J Li, X Xue, X Li, F Yang, Z Jiao, X Gao - NeuroImage, 2021 - Elsevier
Reconstructing perceived stimulus (image) only from human brain activity measured with
functional Magnetic Resonance Imaging (fMRI) is a significant task in brain decoding …

Convolutional neural network-based encoding and decoding of visual object recognition in space and time

K Seeliger, M Fritsche, U Güçlü, S Schoenmakers… - NeuroImage, 2018 - Elsevier
Abstract Representations learned by deep convolutional neural networks (CNNs) for object
recognition are a widely investigated model of the processing hierarchy in the human visual …