A review of deep learning techniques for speech processing

A Mehrish, N Majumder, R Bharadwaj, R Mihalcea… - Information …, 2023 - Elsevier
The field of speech processing has undergone a transformative shift with the advent of deep
learning. The use of multiple processing layers has enabled the creation of models capable …

Contrastive representation learning: A framework and review

PH Le-Khac, G Healy, AF Smeaton - Ieee Access, 2020 - ieeexplore.ieee.org
Contrastive Learning has recently received interest due to its success in self-supervised
representation learning in the computer vision domain. However, the origins of Contrastive …

Graphmae: Self-supervised masked graph autoencoders

Z Hou, X Liu, Y Cen, Y Dong, H Yang, C Wang… - Proceedings of the 28th …, 2022 - dl.acm.org
Self-supervised learning (SSL) has been extensively explored in recent years. Particularly,
generative SSL has seen emerging success in natural language processing and other …

Improving graph collaborative filtering with neighborhood-enriched contrastive learning

Z Lin, C Tian, Y Hou, WX Zhao - … of the ACM web conference 2022, 2022 - dl.acm.org
Recently, graph collaborative filtering methods have been proposed as an effective
recommendation approach, which can capture users' preference over items by modeling the …

[HTML][HTML] Spatially informed clustering, integration, and deconvolution of spatial transcriptomics with GraphST

Y Long, KS Ang, M Li, KLK Chong, R Sethi… - Nature …, 2023 - nature.com
Spatial transcriptomics technologies generate gene expression profiles with spatial context,
requiring spatially informed analysis tools for three key tasks, spatial clustering, multisample …

Graph self-supervised learning: A survey

Y Liu, M Jin, S Pan, C Zhou, Y Zheng… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Deep learning on graphs has attracted significant interests recently. However, most of the
works have focused on (semi-) supervised learning, resulting in shortcomings including …

Graph contrastive learning with augmentations

Y You, T Chen, Y Sui, T Chen… - Advances in neural …, 2020 - proceedings.neurips.cc
Generalizable, transferrable, and robust representation learning on graph-structured data
remains a challenge for current graph neural networks (GNNs). Unlike what has been …

Graph contrastive learning with adaptive augmentation

Y Zhu, Y Xu, F Yu, Q Liu, S Wu, L Wang - Proceedings of the web …, 2021 - dl.acm.org
Recently, contrastive learning (CL) has emerged as a successful method for unsupervised
graph representation learning. Most graph CL methods first perform stochastic augmentation …

Self-supervised learning of graph neural networks: A unified review

Y Xie, Z Xu, J Zhang, Z Wang… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Deep models trained in supervised mode have achieved remarkable success on a variety of
tasks. When labeled samples are limited, self-supervised learning (SSL) is emerging as a …

Self-supervised learning: Generative or contrastive

X Liu, F Zhang, Z Hou, L Mian, Z Wang… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Deep supervised learning has achieved great success in the last decade. However, its
defects of heavy dependence on manual labels and vulnerability to attacks have driven …