Differentially private natural language models: Recent advances and future directions
Recent developments in deep learning have led to great success in various natural
language processing (NLP) tasks. However, these applications may involve data that …
language processing (NLP) tasks. However, these applications may involve data that …
DP-mix: mixup-based data augmentation for differentially private learning
Data augmentation techniques, such as simple image transformations and combinations,
are highly effective at improving the generalization of computer vision models, especially …
are highly effective at improving the generalization of computer vision models, especially …
Formal Privacy Proof of Data Encoding: The Possibility and Impossibility of Learnable Encryption
We initiate a formal study on the concept of learnable obfuscation and aim to answer the
following question: is there a type of data encoding that maintains the" learnability" of …
following question: is there a type of data encoding that maintains the" learnability" of …
Differentially private non-convex learning for multi-layer neural networks
This paper focuses on the problem of Differentially Private Stochastic Optimization for (multi-
layer) fully connected neural networks with a single output node. In the first part, we examine …
layer) fully connected neural networks with a single output node. In the first part, we examine …
Geometry of Sensitivity: Twice Sampling and Hybrid Clipping in Differential Privacy with Optimal Gaussian Noise and Application to Deep Learning
We study the fundamental problem of the construction of optimal randomization in
Differential Privacy (DP). Depending on the clipping strategy or additional properties of the …
Differential Privacy (DP). Depending on the clipping strategy or additional properties of the …
Gradient sparsification for efficient wireless federated learning with differential privacy
Federated learning (FL) enables distributed clients to collaboratively train a machine
learning model without sharing raw data with each other. However, it suffers from the …
learning model without sharing raw data with each other. However, it suffers from the …
Inference and Interference: The Role of Clipping, Pruning and Loss Landscapes in Differentially Private Stochastic Gradient Descent
Differentially private stochastic gradient descent (DP-SGD) is known to have poorer training
and test performance on large neural networks, compared to ordinary stochastic gradient …
and test performance on large neural networks, compared to ordinary stochastic gradient …
Delving into Differentially Private Transformer
Deep learning with differential privacy (DP) has garnered significant attention over the past
years, leading to the development of numerous methods aimed at enhancing model …
years, leading to the development of numerous methods aimed at enhancing model …
Private and Communication-Efficient Federated Learning based on Differentially Private Sketches
M Zhang, Z Xie, L Yin - arXiv preprint arXiv:2410.05733, 2024 - arxiv.org
Federated learning (FL) faces two primary challenges: the risk of privacy leakage due to
parameter sharing and communication inefficiencies. To address these challenges, we …
parameter sharing and communication inefficiencies. To address these challenges, we …