Hungry hungry hippos: Towards language modeling with state space models

DY Fu, T Dao, KK Saab, AW Thomas, A Rudra… - arXiv preprint arXiv …, 2022 - arxiv.org
State space models (SSMs) have demonstrated state-of-the-art sequence modeling
performance in some modalities, but underperform attention in language modeling …

Decoding speech perception from non-invasive brain recordings

A Défossez, C Caucheteux, J Rapin, O Kabeli… - Nature Machine …, 2023 - nature.com
Decoding speech from brain activity is a long-awaited goal in both healthcare and
neuroscience. Invasive devices have recently led to major milestones in this regard: deep …

Simple hardware-efficient long convolutions for sequence modeling

DY Fu, EL Epstein, E Nguyen… - International …, 2023 - proceedings.mlr.press
State space models (SSMs) have high performance on long sequence modeling but require
sophisticated initialization techniques and specialized implementations for high quality and …

Interpreting mental state decoding with deep learning models

AW Thomas, C Ré, RA Poldrack - Trends in Cognitive Sciences, 2022 - cell.com
In mental state decoding, researchers aim to identify the set of mental states (eg,
experiencing happiness or fear) that can be reliably identified from the activity patterns of a …

Brain decoding: toward real-time reconstruction of visual perception

Y Benchetrit, H Banville, JR King - arXiv preprint arXiv:2310.19812, 2023 - arxiv.org
In the past five years, the use of generative and foundational AI systems has greatly
improved the decoding of brain activity. Visual perception, in particular, can now be decoded …

[PDF][PDF] Neuro-GPT: developing a foundation model for EEG

W Cui, W Jeong, P Thölke, T Medani… - arXiv preprint arXiv …, 2023 - researchgate.net
To handle the scarcity and heterogeneity of electroencephalography (EEG) data for Brain-
Computer Interface (BCI) tasks, and to harness the power of large publicly available data …

CSLP-AE: A contrastive split-latent permutation autoencoder framework for zero-shot electroencephalography signal conversion

A Nørskov, A Neergaard Zahid… - Advances in Neural …, 2024 - proceedings.neurips.cc
Electroencephalography (EEG) is a prominent non-invasive neuroimaging technique
providing insights into brain function. Unfortunately, EEG data exhibit a high degree of noise …

fmri-pte: A large-scale fmri pretrained transformer encoder for multi-subject brain activity decoding

X Qian, Y Wang, J Huo, J Feng, Y Fu - arXiv preprint arXiv:2311.00342, 2023 - arxiv.org
The exploration of brain activity and its decoding from fMRI data has been a longstanding
pursuit, driven by its potential applications in brain-computer interfaces, medical diagnostics …

Should one go for individual-or group-level brain parcellations? A deep-phenotyping benchmark

B Thirion, H Aggarwal, AF Ponce, AL Pinho… - Brain Structure and …, 2024 - Springer
The analysis and understanding of brain characteristics often require considering region-
level information rather than voxel-sampled data. Subject-specific parcellations have been …

[HTML][HTML] Benchmarking explanation methods for mental state decoding with deep learning models

AW Thomas, C Ré, RA Poldrack - Neuroimage, 2023 - Elsevier
Deep learning (DL) models find increasing application in mental state decoding, where
researchers seek to understand the mapping between mental states (eg, experiencing …