Unsupervised point cloud representation learning with deep neural networks: A survey

A Xiao, J Huang, D Guan, X Zhang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Point cloud data have been widely explored due to its superior accuracy and robustness
under various adverse situations. Meanwhile, deep neural networks (DNNs) have achieved …

Image-to-lidar self-supervised distillation for autonomous driving data

C Sautier, G Puy, S Gidaris, A Boulch… - Proceedings of the …, 2022 - openaccess.thecvf.com
Segmenting or detecting objects in sparse Lidar point clouds are two important tasks in
autonomous driving to allow a vehicle to act safely in its 3D environment. The best …

Also: Automotive lidar self-supervision by occupancy estimation

A Boulch, C Sautier, B Michele… - Proceedings of the …, 2023 - openaccess.thecvf.com
We propose a new self-supervised method for pre-training the backbone of deep perception
models operating on point clouds. The core idea is to train the model on a pretext task which …

Swin3d: A pretrained transformer backbone for 3d indoor scene understanding

YQ Yang, YX Guo, JY Xiong, Y Liu, H Pan… - arXiv preprint arXiv …, 2023 - arxiv.org
The use of pretrained backbones with fine-tuning has been successful for 2D vision and
natural language processing tasks, showing advantages over task-specific networks. In this …

Implicit autoencoder for point-cloud self-supervised representation learning

S Yan, Z Yang, H Li, C Song, L Guan… - Proceedings of the …, 2023 - openaccess.thecvf.com
This paper advocates the use of implicit surface representation in autoencoder-based self-
supervised 3D representation learning. The most popular and accessible 3D representation …

Deep learning for 3D object recognition: A survey

AAM Muzahid, H Han, Y Zhang, D Li, Y Zhang… - Neurocomputing, 2024 - Elsevier
With the growing availability of extensive 3D datasets and the rapid progress in
computational power, deep learning (DL) has emerged as a highly promising approach for …

Shape self-correction for unsupervised point cloud understanding

Y Chen, J Liu, B Ni, H Wang, J Yang… - Proceedings of the …, 2021 - openaccess.thecvf.com
We develop a novel self-supervised learning method named Shape Self-Correction for point
cloud analysis. Our method is motivated by the principle that a good shape representation …

Pos-bert: Point cloud one-stage bert pre-training

K Fu, P Gao, SL Liu, L Qu, L Gao, M Wang - Expert Systems with …, 2024 - Elsevier
Recently, the pre-training paradigm combining Transformer and masked language modeling
in BERT has achieved tremendous success not only in NLP, but also in images and point …

Self-supervised point cloud representation learning via separating mixed shapes

C Sun, Z Zheng, X Wang, M Xu… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
The manual annotation for large-scale point clouds costs a lot of time and is usually
unavailable in harsh real-world scenarios. Inspired by the great success of the pre-training …

Hvdistill: Transferring knowledge from images to point clouds via unsupervised hybrid-view distillation

S Zhang, J Deng, L Bai, H Li, W Ouyang… - International Journal of …, 2024 - Springer
We present a hybrid-view-based knowledge distillation framework, termed HVDistill, to
guide the feature learning of a point cloud neural network with a pre-trained image network …