[PDF][PDF] Recent advances in end-to-end automatic speech recognition

J Li - APSIPA Transactions on Signal and Information …, 2022 - nowpublishers.com
Recently, the speech community is seeing a significant trend of moving from deep neural
network based hybrid modeling to end-to-end (E2E) modeling for automatic speech …

Speech recognition using deep neural networks: A systematic review

AB Nassif, I Shahin, I Attili, M Azzeh, K Shaalan - IEEE access, 2019 - ieeexplore.ieee.org
Over the past decades, a tremendous amount of research has been done on the use of
machine learning for speech processing applications, especially speech recognition …

Unsupervised cross-lingual representation learning for speech recognition

A Conneau, A Baevski, R Collobert… - arXiv preprint arXiv …, 2020 - arxiv.org
This paper presents XLSR which learns cross-lingual speech representations by pretraining
a single model from the raw waveform of speech in multiple languages. We build on …

Parameter-efficient transfer learning for NLP

N Houlsby, A Giurgiu, S Jastrzebski… - International …, 2019 - proceedings.mlr.press
Fine-tuning large pretrained models is an effective transfer mechanism in NLP. However, in
the presence of many downstream tasks, fine-tuning is parameter inefficient: an entire new …

Multi-task learning as multi-objective optimization

O Sener, V Koltun - Advances in neural information …, 2018 - proceedings.neurips.cc
In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them.
Multi-task learning is inherently a multi-objective problem because different tasks may …

A survey on deep transfer learning

C Tan, F Sun, T Kong, W Zhang, C Yang… - Artificial Neural Networks …, 2018 - Springer
As a new classification platform, deep learning has recently received increasing attention
from researchers and has been successfully applied to many domains. In some domains …

Wireless networks design in the era of deep learning: Model-based, AI-based, or both?

A Zappone, M Di Renzo… - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
This paper deals with the use of emerging deep learning techniques in future wireless
communication networks. It will be shown that the data-driven approaches should not …

A review of domain adaptation without target labels

WM Kouw, M Loog - IEEE transactions on pattern analysis and …, 2019 - ieeexplore.ieee.org
Domain adaptation has become a prominent problem setting in machine learning and
related fields. This review asks the question: How can a classifier learn from a source …

Multi-task learning using uncertainty to weigh losses for scene geometry and semantics

A Kendall, Y Gal, R Cipolla - Proceedings of the IEEE …, 2018 - openaccess.thecvf.com
Numerous deep learning applications benefit from multi-task learning with multiple
regression and classification objectives. In this paper we make the observation that the …

A novel group recommendation model with two-stage deep learning

Z Huang, Y Liu, C Zhan, C Lin, W Cai… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Group recommendation has recently drawn a lot of attention to the recommender system
community. Currently, several deep learning-based approaches are leveraged to learn …