Rethinking lipschitz neural networks and certified robustness: A boolean function perspective

B Zhang, D Jiang, D He… - Advances in neural …, 2022 - proceedings.neurips.cc
Designing neural networks with bounded Lipschitz constant is a promising way to obtain
certifiably robust classifiers against adversarial examples. However, the relevant progress …

Three Decades of Activations: A Comprehensive Survey of 400 Activation Functions for Neural Networks

V Kunc, J Kléma - arXiv preprint arXiv:2402.09092, 2024 - arxiv.org
Neural networks have proven to be a highly effective tool for solving complex problems in
many areas of life. Recently, their importance and practical usability have further been …

Learning weakly convex regularizers for convergent image-reconstruction algorithms

A Goujon, S Neumayer, M Unser - SIAM Journal on Imaging Sciences, 2024 - SIAM
We propose to learn non-convex regularizers with a prescribed upper bound on their weak-
convexity modulus. Such regularizers give rise to variational denoisers that minimize a …

A neural-network-based convex regularizer for inverse problems

A Goujon, S Neumayer, P Bohra… - IEEE Transactions …, 2023 - ieeexplore.ieee.org
The emergence of deep-learning-based methods to solve image-reconstruction problems
has enabled a significant increase in quality. Unfortunately, these new methods often lack …

Improving Lipschitz-constrained neural networks by learning activation functions

S Ducotterd, A Goujon, P Bohra, D Perdios… - Journal of Machine …, 2024 - jmlr.org
Lipschitz-constrained neural networks have several advantages over unconstrained ones
and can be applied to a variety of problems, making them a topic of attention in the deep …

[HTML][HTML] On the number of regions of piecewise linear neural networks

A Goujon, A Etemadi, M Unser - Journal of Computational and Applied …, 2024 - Elsevier
Many feedforward neural networks (NNs) generate continuous and piecewise-linear
(CPWL) mappings. Specifically, they partition the input domain into regions on which the …

[PDF][PDF] A neural-network-based convex regularizer for image reconstruction

A Goujon, S Neumayer, P Bohra… - arXiv preprint arXiv …, 2022 - researchgate.net
The emergence of deep-learning-based methods for solving inverse problems has enabled
a significant increase in reconstruction quality. Unfortunately, these new methods often lack …

Provably convergent plug-and-play quasi-Newton methods

HY Tan, S Mukherjee, J Tang, CB Schönlieb - SIAM Journal on Imaging …, 2024 - SIAM
Plug-and-Play (PnP) methods are a class of efficient iterative methods that aim to combine
data fidelity terms and deep denoisers using classical optimization algorithms, such as ISTA …

ABBA neural networks: Coping with positivity, expressivity, and robustness

A Neacşu, JC Pesquet, V Vasilescu… - SIAM Journal on …, 2024 - SIAM
We introduce ABBA networks, a novel class of (almost) nonnegative neural networks, which
are shown to possess a series of appealing properties. In particular, we demonstrate that …

Compact: Approximating complex activation functions for secure computation

M Islam, SS Arora, R Chatterjee, P Rindal… - arXiv preprint arXiv …, 2023 - arxiv.org
Secure multi-party computation (MPC) techniques can be used to provide data privacy when
users query deep neural network (DNN) models hosted on a public cloud. State-of-the-art …