High-resolution image reconstruction with latent diffusion models from human brain activity
Y Takagi, S Nishimoto - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Reconstructing visual experiences from human brain activity offers a unique way to
understand how the brain represents the world, and to interpret the connection between …
understand how the brain represents the world, and to interpret the connection between …
Toward a realistic model of speech processing in the brain with self-supervised learning
Several deep neural networks have recently been shown to generate activations similar to
those of the brain in response to the same input. These algorithms, however, remain largely …
those of the brain in response to the same input. These algorithms, however, remain largely …
Many but not all deep neural network audio models capture brain responses and exhibit correspondence between model stages and brain regions
Models that predict brain responses to stimuli provide one measure of understanding of a
sensory system and have many potential applications in science and engineering. Deep …
sensory system and have many potential applications in science and engineering. Deep …
Improving visual image reconstruction from human brain activity using latent diffusion models via multiple decoded inputs
Y Takagi, S Nishimoto - arXiv preprint arXiv:2306.11536, 2023 - arxiv.org
The integration of deep learning and neuroscience has been advancing rapidly, which has
led to improvements in the analysis of brain activity and the understanding of deep learning …
led to improvements in the analysis of brain activity and the understanding of deep learning …
Inductive biases, pretraining and fine-tuning jointly account for brain responses to speech
Our ability to comprehend speech remains, to date, unrivaled by deep learning models. This
feat could result from the brain's ability to fine-tune generic sound representations for speech …
feat could result from the brain's ability to fine-tune generic sound representations for speech …
Human Auditory Ecology: Extending Hearing Research to the Perception of Natural Soundscapes by Humans in Rapidly Changing Environments
Research in hearing sciences has provided extensive knowledge about how the human
auditory system processes speech and assists communication. In contrast, little is known …
auditory system processes speech and assists communication. In contrast, little is known …
Artificial neural network modelling of the neural population code underlying mathematical operations
T Nakai, S Nishimoto - NeuroImage, 2023 - Elsevier
Mathematical operations have long been regarded as a sparse, symbolic process in
neuroimaging studies. In contrast, advances in artificial neural networks (ANN) have …
neuroimaging studies. In contrast, advances in artificial neural networks (ANN) have …
Encoding of speech in convolutional layers and the brain stem based on language experience
Comparing artificial neural networks with outputs of neuroimaging techniques has recently
seen substantial advances in (computer) vision and text-based language models. Here, we …
seen substantial advances in (computer) vision and text-based language models. Here, we …
Effects of modulation phase on relaxation oscillations in the Duffing system
J Song, X Han - Chaos, Solitons & Fractals, 2024 - Elsevier
Amplitude modulation, a recently focused mode of modulation in fast–slow dynamics, plays
a crucial role in governing the behaviors of relaxation oscillations. This modulation mode …
a crucial role in governing the behaviors of relaxation oscillations. This modulation mode …
Human-like modulation sensitivity emerging through optimization to natural sound recognition
T Koumura, H Terashima, S Furukawa - Journal of Neuroscience, 2023 - Soc Neuroscience
Natural sounds contain rich patterns of amplitude modulation (AM), which is one of the
essential sound dimensions for auditory perception. The sensitivity of human hearing to AM …
essential sound dimensions for auditory perception. The sensitivity of human hearing to AM …