Transformers have rapidly overtaken CNN-based architectures as the new standard in audio
classification. Transformer-based models, such as the Audio Spectrogram Transformers …

Transformers have become central to recent advances in audio classification. However,
training an audio spectrogram transformer, eg AST, from scratch can be resource and time …

Recently, MLP structures have regained popularity, with MLP-Mixer standing out as a
prominent example. In the field of computer vision, MLP-Mixer is noted for its ability to extract …