[HTML][HTML] A comparison review of transfer learning and self-supervised learning: Definitions, applications, advantages and limitations

Z Zhao, L Alzubaidi, J Zhang, Y Duan, Y Gu - Expert Systems with …, 2023 - Elsevier
Deep learning has emerged as a powerful tool in various domains, revolutionising machine
learning research. However, one persistent challenge is the scarcity of labelled training …

Large-scale self-supervised speech representation learning for automatic speaker verification

Z Chen, S Chen, Y Wu, Y Qian, C Wang… - ICASSP 2022-2022 …, 2022 - ieeexplore.ieee.org
The speech representations learned from large-scale unlabeled data have shown better
generalizability than those from supervised learning and thus attract a lot of interest to be …

Pushing the limits of raw waveform speaker recognition

J Jung, YJ Kim, HS Heo, BJ Lee, Y Kwon… - arXiv preprint arXiv …, 2022 - arxiv.org
In recent years, speaker recognition systems based on raw waveform inputs have received
increasing attention. However, the performance of such systems are typically inferior to the …

Self-supervised speaker recognition with loss-gated learning

R Tao, KA Lee, RK Das… - ICASSP 2022-2022 …, 2022 - ieeexplore.ieee.org
In self-supervised learning for speaker recognition, pseudo labels are useful as the
supervision signals. It is a known fact that a speaker recognition model doesn't always …

Self-supervised learning with cluster-aware-dino for high-performance robust speaker verification

B Han, Z Chen, Y Qian - IEEE/ACM Transactions on Audio …, 2023 - ieeexplore.ieee.org
The automatic speaker verification task has achieved great success using deep learning
approaches with a large-scale, manually annotated dataset. However, collecting a …

Utilizing self-supervised representations for MOS prediction

WC Tseng, C Huang, WT Kao, YY Lin, H Lee - arXiv preprint arXiv …, 2021 - arxiv.org
Speech quality assessment has been a critical issue in speech processing for decades.
Existing automatic evaluations usually require clean references or parallel ground truth data …

Self-supervised speaker verification using dynamic loss-gate and label correction

B Han, Z Chen, Y Qian - arXiv preprint arXiv:2208.01928, 2022 - arxiv.org
For self-supervised speaker verification, the quality of pseudo labels decides the upper
bound of the system due to the massive unreliable labels. In this work, we propose dynamic …

Self-supervised speaker verification with simple siamese network and self-supervised regularization

M Sang, H Li, F Liu, AO Arnold… - ICASSP 2022-2022 IEEE …, 2022 - ieeexplore.ieee.org
Training speaker-discriminative and robust speaker verification systems without speaker
labels is still challenging and worthwhile to explore. In this study, we propose an effective …

Injecting text in self-supervised speech pretraining

Z Chen, Y Zhang, A Rosenberg… - 2021 IEEE Automatic …, 2021 - ieeexplore.ieee.org
Self-supervised pretraining for Automated Speech Recognition (ASR) has shown varied
degrees of success. In this paper, we propose to jointly learn representations during …

C3-DINO: Joint contrastive and non-contrastive self-supervised learning for speaker verification

C Zhang, D Yu - IEEE Journal of Selected Topics in Signal …, 2022 - ieeexplore.ieee.org
Self-supervised learning (SSL) has drawn an increased attention in the field of speech
processing. Recent studies have demonstrated that contrastive learning is able to learn …