Machine learning with confidential computing: A systematization of knowledge

F Mo, Z Tarkhani, H Haddadi - ACM computing surveys, 2024 - dl.acm.org
Privacy and security challenges in Machine Learning (ML) have become increasingly
severe, along with ML's pervasive development and the recent demonstration of large attack …

Securing AI Inference in the Cloud: Is CPU-GPU Confidential Computing Ready?

A Mohan, M Ye, H Franke, M Srivatsa… - 2024 IEEE 17th …, 2024 - ieeexplore.ieee.org
Many applications have been offloaded onto cloud environments to achieve higher agility,
access to more powerful computational resources, and obtain better infrastructure …

Obsidian: Cooperative state-space exploration for performant inference on secure ml accelerators

S Banerjee, S Wei, P Ramrakhyani, M Tiwari - arXiv preprint arXiv …, 2024 - arxiv.org
Trusted execution environments (TEEs) for machine learning accelerators are indispensable
in secure and efficient ML inference. Optimizing workloads through state-space exploration …

Empowering data centers for next generation trusted computing

A Dhar, S Sridhara, S Shinde, S Capkun… - arXiv preprint arXiv …, 2022 - arxiv.org
Modern data centers have grown beyond CPU nodes to provide domain-specific
accelerators such as GPUs and FPGAs to their customers. From a security standpoint, cloud …

sNPU: Trusted Execution Environments on Integrated NPUs

E Feng, D Feng, D Du, Y Xia… - 2024 ACM/IEEE 51st …, 2024 - ieeexplore.ieee.org
Trusted execution environment (TEE) promises strong security guarantee with hardware
extensions for security-sensitive tasks. Due to its numerous benefits, TEE has gained …

ExclaveFL: Providing Transparency to Federated Learning using Exclaves

J Guo, K Vaswani, A Paverd, P Pietzuch - arXiv preprint arXiv:2412.10537, 2024 - arxiv.org
In federated learning (FL), data providers jointly train a model without disclosing their
training data. Despite its privacy benefits, a malicious data provider can simply deviate from …

Ascend-CC: Confidential Computing on Heterogeneous NPU for Emerging Generative AI Workloads

A Dhar, C Thorens, LM Lazier, L Cavigelli - arXiv preprint arXiv …, 2024 - arxiv.org
Cloud workloads have dominated generative AI based on large language models (LLM).
Specialized hardware accelerators, such as GPUs, NPUs, and TPUs, play a key role in AI …

Security and Privacy in Machine Learning

N Chandran - International Conference on Information Systems …, 2023 - Springer
Abstract Machine learning technologies have the potential to transform and revolutionize
various industries, such as drug discovery by finding new molecules, medical diagnosis by …

AccShield: a New Trusted Execution Environment with Machine-Learning Accelerators

W Ren, W Kozlowski, S Koteshwara… - 2023 60th ACM/IEEE …, 2023 - ieeexplore.ieee.org
Machine learning accelerators such as the Tensor Processing Unit (TPU) are already being
deployed in the hybrid cloud, and we foresee such accelerators proliferating in the future. In …

Reducing Memory Requirements for the IPU using Butterfly Factorizations

SK Shekofteh, C Alles, H Fröning - Proceedings of the SC'23 Workshops …, 2023 - dl.acm.org
High Performance Computing (HPC) benefits from different improvements during last
decades, specially in terms of hardware platforms to provide more processing power while …