Mitigating memorization of noisy labels by clipping the model prediction

H Wei, H Zhuang, R Xie, L Feng… - International …, 2023 - proceedings.mlr.press
In the presence of noisy labels, designing robust loss functions is critical for securing the
generalization performance of deep neural networks. Cross Entropy (CE) loss has been …

Understanding and mitigating the label noise in pre-training on downstream tasks

H Chen, J Wang, A Shah, R Tao, H Wei, X Xie… - arXiv preprint arXiv …, 2023 - arxiv.org
Pre-training on large-scale datasets and then fine-tuning on downstream tasks have
become a standard practice in deep learning. However, pre-training data often contain label …

Learning with noisy foundation models

H Chen, J Wang, Z Wang, R Tao, H Wei, X Xie… - arXiv preprint arXiv …, 2024 - arxiv.org
Foundation models are usually pre-trained on large-scale datasets and then adapted to
downstream tasks through tuning. However, the large-scale pre-training datasets, often …

TBC-MI: Suppressing noise labels by maximizing cleaning samples for robust image classification

Y Li, Z Guo, L Wang, L Xu - Information Processing & Management, 2024 - Elsevier
In classification tasks with noisy labels, eliminating the interference of noisy label samples in
the dataset is the key to improving network performance. However, the distribution between …

Controller-Guided Partial Label Consistency Regularization with Unlabeled Data

QW Wang, B Zhao, M Zhu, T Li, Z Liu… - Proceedings of the AAAI …, 2024 - ojs.aaai.org
Partial label learning (PLL) learns from training examples each associated with multiple
candidate labels, among which only one is valid. In recent years, benefiting from the strong …

Slight Corruption in Pre-training Data Makes Better Diffusion Models

H Chen, Y Han, D Misra, X Li, K Hu, D Zou… - arXiv preprint arXiv …, 2024 - arxiv.org
Diffusion models (DMs) have shown remarkable capabilities in generating realistic high-
quality images, audios, and videos. They benefit significantly from extensive pre-training on …

Learning with Noisy Labels through Learnable Weighting and Centroid Similarity

FA Wani, MS Bucarelli, F Silvestri - 2024 International Joint …, 2024 - ieeexplore.ieee.org
We introduce a novel method for training machine learning models in the presence of noisy
labels, which are prevalent in domains such as medical diagnosis and autonomous driving …

A Two-Stage Noisy Label Learning Framework with Uniform Consistency Selection and Robust Training

Q Zhang, Q Chen - Available at SSRN 4835466 - papers.ssrn.com
Deep neural networks suffer from overfitting when training samples contain inaccurate
annotations (noisy labels), leading to suboptimal performance. In addressing this challenge …