Applications of knowledge distillation in remote sensing: A survey

Y Himeur, N Aburaed, O Elharrouss, I Varlamis… - Information …, 2024 - Elsevier
With the ever-growing complexity of models in the field of remote sensing (RS), there is an
increasing demand for solutions that balance model accuracy with computational efficiency …

[PDF][PDF] EFFUSE: Efficient Self-Supervised Feature Fusion for E2E ASR in Low Resource and Multilingual Scenarios

T Srivastava, J Shi, W Chen, S Watanabe - Proc. Interspeech 2024, 2024 - isca-archive.org
Abstract Self-Supervised Learning (SSL) models have demonstrated exceptional
performance in various speech tasks, particularly in low-resource and multilingual domains …

One-pass Multiple Conformer and Foundation Speech Systems Compression and Quantization Using An All-in-one Neural Model

Z Li, H Xu, T Wang, S Hu, Z Jin, S Hu, J Deng… - arXiv preprint arXiv …, 2024 - arxiv.org
We propose a novel one-pass multiple ASR systems joint compression and quantization
approach using an all-in-one neural model. A single compression cycle allows multiple …