Hungry hungry hippos: Towards language modeling with state space models
State space models (SSMs) have demonstrated state-of-the-art sequence modeling
performance in some modalities, but underperform attention in language modeling …
performance in some modalities, but underperform attention in language modeling …
Decoding speech perception from non-invasive brain recordings
Decoding speech from brain activity is a long-awaited goal in both healthcare and
neuroscience. Invasive devices have recently led to major milestones in this regard: deep …
neuroscience. Invasive devices have recently led to major milestones in this regard: deep …
Simple hardware-efficient long convolutions for sequence modeling
State space models (SSMs) have high performance on long sequence modeling but require
sophisticated initialization techniques and specialized implementations for high quality and …
sophisticated initialization techniques and specialized implementations for high quality and …
Interpreting mental state decoding with deep learning models
In mental state decoding, researchers aim to identify the set of mental states (eg,
experiencing happiness or fear) that can be reliably identified from the activity patterns of a …
experiencing happiness or fear) that can be reliably identified from the activity patterns of a …
Brain decoding: toward real-time reconstruction of visual perception
Y Benchetrit, H Banville, JR King - arXiv preprint arXiv:2310.19812, 2023 - arxiv.org
In the past five years, the use of generative and foundational AI systems has greatly
improved the decoding of brain activity. Visual perception, in particular, can now be decoded …
improved the decoding of brain activity. Visual perception, in particular, can now be decoded …
[PDF][PDF] Neuro-GPT: developing a foundation model for EEG
To handle the scarcity and heterogeneity of electroencephalography (EEG) data for Brain-
Computer Interface (BCI) tasks, and to harness the power of large publicly available data …
Computer Interface (BCI) tasks, and to harness the power of large publicly available data …
CSLP-AE: A contrastive split-latent permutation autoencoder framework for zero-shot electroencephalography signal conversion
A Nørskov, A Neergaard Zahid… - Advances in Neural …, 2024 - proceedings.neurips.cc
Electroencephalography (EEG) is a prominent non-invasive neuroimaging technique
providing insights into brain function. Unfortunately, EEG data exhibit a high degree of noise …
providing insights into brain function. Unfortunately, EEG data exhibit a high degree of noise …
fmri-pte: A large-scale fmri pretrained transformer encoder for multi-subject brain activity decoding
The exploration of brain activity and its decoding from fMRI data has been a longstanding
pursuit, driven by its potential applications in brain-computer interfaces, medical diagnostics …
pursuit, driven by its potential applications in brain-computer interfaces, medical diagnostics …
Should one go for individual-or group-level brain parcellations? A deep-phenotyping benchmark
The analysis and understanding of brain characteristics often require considering region-
level information rather than voxel-sampled data. Subject-specific parcellations have been …
level information rather than voxel-sampled data. Subject-specific parcellations have been …
[HTML][HTML] Benchmarking explanation methods for mental state decoding with deep learning models
Deep learning (DL) models find increasing application in mental state decoding, where
researchers seek to understand the mapping between mental states (eg, experiencing …
researchers seek to understand the mapping between mental states (eg, experiencing …