A primer on zeroth-order optimization in signal processing and machine learning: Principals, recent advances, and applications
Zeroth-order (ZO) optimization is a subset of gradient-free optimization that emerges in many
signal processing and machine learning (ML) applications. It is used for solving optimization …
signal processing and machine learning (ML) applications. It is used for solving optimization …
Artificial intelligence security: Threats and countermeasures
In recent years, with rapid technological advancement in both computing hardware and
algorithm, Artificial Intelligence (AI) has demonstrated significant advantage over human …
algorithm, Artificial Intelligence (AI) has demonstrated significant advantage over human …
Robustbench: a standardized adversarial robustness benchmark
As a research community, we are still lacking a systematic understanding of the progress on
adversarial robustness which often makes it hard to identify the most promising ideas in …
adversarial robustness which often makes it hard to identify the most promising ideas in …
Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks
The field of defense strategies against adversarial attacks has significantly grown over the
last years, but progress is hampered as the evaluation of adversarial defenses is often …
last years, but progress is hampered as the evaluation of adversarial defenses is often …
Adversarial weight perturbation helps robust generalization
The study on improving the robustness of deep neural networks against adversarial
examples grows rapidly in recent years. Among them, adversarial training is the most …
examples grows rapidly in recent years. Among them, adversarial training is the most …
Anti-adversarially manipulated attributions for weakly and semi-supervised semantic segmentation
Weakly supervised semantic segmentation produces a pixel-level localization from class
labels; but a classifier trained on such labels is likely to restrict its focus to a small …
labels; but a classifier trained on such labels is likely to restrict its focus to a small …
Uncovering the limits of adversarial training against norm-bounded adversarial examples
Adversarial training and its variants have become de facto standards for learning robust
deep neural networks. In this paper, we explore the landscape around adversarial training in …
deep neural networks. In this paper, we explore the landscape around adversarial training in …
Understanding and improving fast adversarial training
M Andriushchenko… - Advances in Neural …, 2020 - proceedings.neurips.cc
A recent line of work focused on making adversarial training computationally efficient for
deep learning models. In particular, Wong et al.(2020) showed that $\ell_\infty $-adversarial …
deep learning models. In particular, Wong et al.(2020) showed that $\ell_\infty $-adversarial …
Sharpness-aware training for free
Modern deep neural networks (DNNs) have achieved state-of-the-art performances but are
typically over-parameterized. The over-parameterization may result in undesirably large …
typically over-parameterized. The over-parameterization may result in undesirably large …
When does contrastive learning preserve adversarial robustness from pretraining to finetuning?
Contrastive learning (CL) can learn generalizable feature representations and achieve state-
of-the-art performance of downstream tasks by finetuning a linear classifier on top of it …
of-the-art performance of downstream tasks by finetuning a linear classifier on top of it …