Large language models are zero-shot fuzzers: Fuzzing deep-learning libraries via large language models

Y Deng, CS Xia, H Peng, C Yang, L Zhang - Proceedings of the 32nd …, 2023 - dl.acm.org
Deep Learning (DL) systems have received exponential growth in popularity and have
become ubiquitous in our everyday life. Such systems are built on top of popular DL …

Large language models are edge-case fuzzers: Testing deep learning libraries via fuzzgpt

Y Deng, CS Xia, C Yang, SD Zhang, S Yang… - arXiv preprint arXiv …, 2023 - arxiv.org
Deep Learning (DL) library bugs affect downstream DL applications, emphasizing the need
for reliable systems. Generating valid input programs for fuzzing DL libraries is challenging …

Characterizing signal propagation to close the performance gap in unnormalized resnets

A Brock, S De, SL Smith - arXiv preprint arXiv:2101.08692, 2021 - arxiv.org
Batch Normalization is a key component in almost all state-of-the-art image classifiers, but it
also introduces practical challenges: it breaks the independence between training examples …

Fuzzing deep-learning libraries via automated relational api inference

Y Deng, C Yang, A Wei, L Zhang - Proceedings of the 30th ACM Joint …, 2022 - dl.acm.org
Deep Learning (DL) has gained wide attention in recent years. Meanwhile, bugs in DL
systems can lead to serious consequences, and may even threaten human lives. As a result …

Large language models are edge-case generators: Crafting unusual programs for fuzzing deep learning libraries

Y Deng, CS Xia, C Yang, SD Zhang, S Yang… - Proceedings of the 46th …, 2024 - dl.acm.org
Bugs in Deep Learning (DL) libraries may affect almost all downstream DL applications, and
it is crucial to ensure the quality of such systems. It is challenging to generate valid input …

Audee: Automated testing for deep learning frameworks

Q Guo, X Xie, Y Li, X Zhang, Y Liu, X Li… - Proceedings of the 35th …, 2020 - dl.acm.org
Deep learning (DL) has been applied widely, and the quality of DL system becomes crucial,
especially for safety-critical applications. Existing work mainly focuses on the quality …

Security for Machine Learning-based Software Systems: A Survey of Threats, Practices, and Challenges

H Chen, MA Babar - ACM Computing Surveys, 2024 - dl.acm.org
The rapid development of Machine Learning (ML) has demonstrated superior performance
in many areas, such as computer vision and video and speech recognition. It has now been …

Differential Testing of Cross Deep Learning Framework {APIs}: Revealing Inconsistencies and Vulnerabilities

Z Deng, G Meng, K Chen, T Liu, L Xiang… - 32nd USENIX Security …, 2023 - usenix.org
With the increasing adoption of deep learning (DL) in various applications, developers often
reuse models by, for example, performing model conversion among frameworks to raise …

Coverage-guided tensor compiler fuzzing with joint ir-pass mutation

J Liu, Y Wei, S Yang, Y Deng, L Zhang - Proceedings of the ACM on …, 2022 - dl.acm.org
In the past decade, Deep Learning (DL) systems have been widely deployed in various
application domains to facilitate our daily life, eg, natural language processing, healthcare …

Machine translation testing via pathological invariance

S Gupta, P He, C Meister, Z Su - Proceedings of the 28th ACM Joint …, 2020 - dl.acm.org
Machine translation software has become heavily integrated into our daily lives due to the
recent improvement in the performance of deep neural networks. However, machine …