Unlabeled data improves adversarial robustness

Y Carmon, A Raghunathan, L Schmidt… - Advances in neural …, 2019 - proceedings.neurips.cc
We demonstrate, theoretically and empirically, that adversarial robustness can significantly
benefit from semisupervised learning. Theoretically, we revisit the simple Gaussian model of …

The pitfalls of simplicity bias in neural networks

H Shah, K Tamuly, A Raghunathan… - Advances in …, 2020 - proceedings.neurips.cc
Several works have proposed Simplicity Bias (SB)---the tendency of standard training
procedures such as Stochastic Gradient Descent (SGD) to find simple models---to justify why …

Adversarial examples from computational constraints

S Bubeck, YT Lee, E Price… - … on Machine Learning, 2019 - proceedings.mlr.press
Why are classifiers in high dimension vulnerable to “adversarial” perturbations? We show
that it is likely not due to information theoretic limitations, but rather it could be due to …

How benign is benign overfitting?

A Sanyal, PK Dokania, V Kanade, PHS Torr - arXiv preprint arXiv …, 2020 - arxiv.org
We investigate two causes for adversarial vulnerability in deep neural networks: bad data
and (poorly) trained models. When trained with SGD, deep neural networks essentially …

Adversarial learning guarantees for linear hypotheses and neural networks

P Awasthi, N Frank, M Mohri - International Conference on …, 2020 - proceedings.mlr.press
Adversarial or test time robustness measures the susceptibility of a classifier to perturbations
to the test input. While there has been a flurry of recent work on designing defenses against …

On the existence of the adversarial bayes classifier

P Awasthi, N Frank, M Mohri - Advances in Neural …, 2021 - proceedings.neurips.cc
Adversarial robustness is a critical property in a variety of modern machine learning
applications. While it has been the subject of several recent theoretical studies, many …

On the hardness of robust classification

P Gourdeau, V Kanade, M Kwiatkowska… - Journal of Machine …, 2021 - jmlr.org
It is becoming increasingly important to understand the vulnerability of machine learning
models to adversarial attacks. In this paper we study the feasibility of adversarially robust …

The complexity of adversarially robust proper learning of halfspaces with agnostic noise

I Diakonikolas, DM Kane… - Advances in Neural …, 2020 - proceedings.neurips.cc
We study the computational complexity of adversarially robust proper learning of halfspaces
in the distribution-independent agnostic PAC model, with a focus on $ L_p $ perturbations …

Improving adversarial robustness via unlabeled out-of-domain data

Z Deng, L Zhang, A Ghorbani… - … Conference on Artificial …, 2021 - proceedings.mlr.press
Data augmentation by incorporating cheap unlabeled data from multiple domains is a
powerful way to improve prediction especially when there is limited labeled data. In this …

Robust and private learning of halfspaces

B Ghazi, R Kumar, P Manurangsi… - International …, 2021 - proceedings.mlr.press
In this work, we study the trade-off between differential privacy and adversarial robustness
under $ L_2 $-perturbations in the context of learning halfspaces. We prove nearly tight …