A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends

J Gui, T Chen, J Zhang, Q Cao, Z Sun… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Deep supervised learning algorithms typically require a large volume of labeled data to
achieve satisfactory performance. However, the process of collecting and labeling such data …

Unsupervised point cloud representation learning with deep neural networks: A survey

A Xiao, J Huang, D Guan, X Zhang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Point cloud data have been widely explored due to its superior accuracy and robustness
under various adverse situations. Meanwhile, deep neural networks (DNNs) have achieved …

Self-supervised visual feature learning with deep neural networks: A survey

L Jing, Y Tian - IEEE transactions on pattern analysis and …, 2020 - ieeexplore.ieee.org
Large-scale labeled data are generally required to train deep neural networks in order to
obtain better performance in visual feature learning from images or videos for computer …

Image-to-lidar self-supervised distillation for autonomous driving data

C Sautier, G Puy, S Gidaris, A Boulch… - Proceedings of the …, 2022 - openaccess.thecvf.com
Segmenting or detecting objects in sparse Lidar point clouds are two important tasks in
autonomous driving to allow a vehicle to act safely in its 3D environment. The best …

Beyond just vision: A review on self-supervised representation learning on multimodal and temporal data

S Deldari, H Xue, A Saeed, J He, DV Smith… - arXiv preprint arXiv …, 2022 - arxiv.org
Recently, Self-Supervised Representation Learning (SSRL) has attracted much attention in
the field of computer vision, speech, natural language processing (NLP), and recently, with …

Self-supervised multimodal learning: A survey

Y Zong, O Mac Aodha, T Hospedales - arXiv preprint arXiv:2304.01008, 2023 - arxiv.org
Multimodal learning, which aims to understand and analyze information from multiple
modalities, has achieved substantial progress in the supervised regime in recent years …

[HTML][HTML] Self-supervised learning for point cloud data: A survey

C Zeng, W Wang, A Nguyen, J Xiao, Y Yue - Expert Systems with …, 2024 - Elsevier
Abstract 3D point clouds are a crucial type of data collected by LiDAR sensors and widely
used in transportation applications due to its concise descriptions and accurate localization …

Self-supervised learning for pre-training 3d point clouds: A survey

B Fei, W Yang, L Liu, T Luo, R Zhang, Y Li… - arXiv preprint arXiv …, 2023 - arxiv.org
Point cloud data has been extensively studied due to its compact form and flexibility in
representing complex 3D structures. The ability of point cloud data to accurately capture and …

Pos-bert: Point cloud one-stage bert pre-training

K Fu, P Gao, SL Liu, L Qu, L Gao, M Wang - Expert Systems with …, 2024 - Elsevier
Recently, the pre-training paradigm combining Transformer and masked language modeling
in BERT has achieved tremendous success not only in NLP, but also in images and point …

A survey on self-supervised learning: Algorithms, applications, and future trends

J Gui, T Chen, J Zhang, Q Cao, Z Sun, H Luo… - arXiv preprint arXiv …, 2023 - arxiv.org
Deep supervised learning algorithms typically require a large volume of labeled data to
achieve satisfactory performance. However, the process of collecting and labeling such data …