On mixup regularization

L Carratino, M Cissé, R Jenatton, JP Vert - Journal of Machine Learning …, 2022 - jmlr.org
… can be interpreted as an empiricial risk minimization on modified data with random
perturbations. In Section 4 we analyze the regularization effect of Mixup through a quadratic Taylor …

Mixup as locally linear out-of-manifold regularization

H Guo, Y Mao, R Zhang - Proceedings of the AAAI conference on …, 2019 - ojs.aaai.org
… that MixUp is also a data-dependent regularization scheme in the sense that the imposed
constraints on the … Next we will argue that MixUp may be viewed as another data-dependent …

How does mixup help with robustness and generalization?

L Zhang, Z Deng, K Kawaguchi, A Ghorbani… - arXiv preprint arXiv …, 2020 - arxiv.org
… In this section, we first introduce a lemma that characterizes the regularization effect of
Mixup. Based on this lemma, we then derive our main theoretical results on adversarial …

Dual mixup regularized learning for adversarial domain adaptation

Y Wu, D Inkpen, A El-Roby - Computer Vision–ECCV 2020: 16th European …, 2020 - Springer
… First, we apply category mixup regularization on source and target domains. Specifically,
for unlabeled target data, pseudo-labels are introduced. Since there are obviously false labels …

Using mixup as a regularizer can surprisingly improve accuracy & out-of-distribution robustness

F Pinto, H Yang, SN Lim, P Torr… - Advances in Neural …, 2022 - proceedings.neurips.cc
… In fact, we observe that Mixup otherwise yields much degraded performance on detecting
out-of-distribution samples possibly, as we show empirically, due to its tendency to learn …

C-mixup: Improving generalization in regression

H Yao, Y Wang, L Zhang, JY Zou… - Advances in neural …, 2022 - proceedings.neurips.cc
… The first line of research directly imposes regularization on meta-learning algorithms [21,
30, 63, 79]. The second line of approaches introduces task augmentation to produce more …

Understanding mixup training methods

D Liang, F Yang, T Zhang, P Yang - IEEE access, 2018 - ieeexplore.ieee.org
… that mixup-HV and mixup-HC use more data augmentation than mixup-C and mixup-H, because
the regularization of … Based on the conclusion that the input information of the mixup has …

Fair mixup: Fairness via interpolation

CY Chuang, Y Mroueh - arXiv preprint arXiv:2103.06503, 2021 - arxiv.org
regularizing the models on paths of interpolated samples between the groups. We use mixup,
… We analyze fair mixup and empirically show that it ensures a better generalization for both …

Remix: rebalanced mixup

HP Chou, SC Chang, JY Pan, W Wei… - Computer Vision–ECCV …, 2020 - Springer
… In order to come up with a solution that is convenient to incorporate for large-scale datasets,
we focus on regularization techniques which normally introduce little extra costs. Despite the …

Noisy feature mixup

SH Lim, NB Erichson, F Utrera, W Xu… - arXiv preprint arXiv …, 2021 - arxiv.org
regularization, showing that NFM amplifies the regularizing … , amplifying the regularizing
effects of manifold mixup and noise … In Subsection 4.3, we focus on demonstrating how NFM can …