High-resolution image reconstruction with latent diffusion models from human brain activity

Y Takagi, S Nishimoto - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Reconstructing visual experiences from human brain activity offers a unique way to
understand how the brain represents the world, and to interpret the connection between …

Toward a realistic model of speech processing in the brain with self-supervised learning

J Millet, C Caucheteux, Y Boubenec… - Advances in …, 2022 - proceedings.neurips.cc
Several deep neural networks have recently been shown to generate activations similar to
those of the brain in response to the same input. These algorithms, however, remain largely …

Many but not all deep neural network audio models capture brain responses and exhibit correspondence between model stages and brain regions

G Tuckute, J Feather, D Boebinger, JH McDermott - Plos Biology, 2023 - journals.plos.org
Models that predict brain responses to stimuli provide one measure of understanding of a
sensory system and have many potential applications in science and engineering. Deep …

Improving visual image reconstruction from human brain activity using latent diffusion models via multiple decoded inputs

Y Takagi, S Nishimoto - arXiv preprint arXiv:2306.11536, 2023 - arxiv.org
The integration of deep learning and neuroscience has been advancing rapidly, which has
led to improvements in the analysis of brain activity and the understanding of deep learning …

Inductive biases, pretraining and fine-tuning jointly account for brain responses to speech

J Millet, JR King - arXiv preprint arXiv:2103.01032, 2021 - arxiv.org
Our ability to comprehend speech remains, to date, unrivaled by deep learning models. This
feat could result from the brain's ability to fine-tune generic sound representations for speech …

Human Auditory Ecology: Extending Hearing Research to the Perception of Natural Soundscapes by Humans in Rapidly Changing Environments

C Lorenzi, F Apoux, E Grinfeder, B Krause… - Trends in …, 2023 - journals.sagepub.com
Research in hearing sciences has provided extensive knowledge about how the human
auditory system processes speech and assists communication. In contrast, little is known …

Artificial neural network modelling of the neural population code underlying mathematical operations

T Nakai, S Nishimoto - NeuroImage, 2023 - Elsevier
Mathematical operations have long been regarded as a sparse, symbolic process in
neuroimaging studies. In contrast, advances in artificial neural networks (ANN) have …

Encoding of speech in convolutional layers and the brain stem based on language experience

G Beguš, A Zhou, TC Zhao - Scientific Reports, 2023 - nature.com
Comparing artificial neural networks with outputs of neuroimaging techniques has recently
seen substantial advances in (computer) vision and text-based language models. Here, we …

Effects of modulation phase on relaxation oscillations in the Duffing system

J Song, X Han - Chaos, Solitons & Fractals, 2024 - Elsevier
Amplitude modulation, a recently focused mode of modulation in fast–slow dynamics, plays
a crucial role in governing the behaviors of relaxation oscillations. This modulation mode …

Human-like modulation sensitivity emerging through optimization to natural sound recognition

T Koumura, H Terashima, S Furukawa - Journal of Neuroscience, 2023 - Soc Neuroscience
Natural sounds contain rich patterns of amplitude modulation (AM), which is one of the
essential sound dimensions for auditory perception. The sensitivity of human hearing to AM …