Benchmarking Deep Learning Fuzzers

NS Harzevili, HV Pham, S Wang - arXiv preprint arXiv:2310.06912, 2023 - arxiv.org
In this work, we set out to conduct the first ground-truth empirical evaluation of state-of-the-
art DL fuzzers. Specifically, we first manually created an extensive DL bug benchmark …

Deep learning framework fuzzing based on model mutation

X Shen, J Zhang, X Wang, H Yu… - 2021 IEEE Sixth …, 2021 - ieeexplore.ieee.org
Deep learning (DL) frameworks are widely used for neural network model training and
prediction in a lot of areas such as computer vision, natural language processing, medical …

DeepDiffer: Find Deep Learning Compiler Bugs via Priority-guided Differential Fuzzing

K Lin, X Song, Y Zeng, S Guo - 2023 IEEE 23rd International …, 2023 - ieeexplore.ieee.org
Recently, Deep learning (DL) compilers have been widely developed to optimize the
deployment of DL models. These DL compilers transform DL models into high-level …

Crafting unusual programs for fuzzing deep learning libraries

S Yang - 2023 - ideals.illinois.edu
Deep Learning (DL) applications play a vital role in modern society. Bugs in DL libraries can
significantly impact a wide range of downstream DL applications, making it crucial to …

When Fuzzing Meets LLMs: Challenges and Opportunities

Y Jiang, J Liang, F Ma, Y Chen, C Zhou, Y Shen… - arXiv preprint arXiv …, 2024 - arxiv.org
Fuzzing, a widely-used technique for bug detection, has seen advancements through Large
Language Models (LLMs). Despite their potential, LLMs face specific challenges in fuzzing …

Fuzzing automatic differentiation in deep-learning libraries

C Yang, Y Deng, J Yao, Y Tu, H Li… - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Deep learning (DL) has attracted wide attention and has been widely deployed in recent
years. As a result, more and more research efforts have been dedicated to testing DL …

Large language models are edge-case generators: Crafting unusual programs for fuzzing deep learning libraries

Y Deng, CS Xia, C Yang, SD Zhang, S Yang… - Proceedings of the 46th …, 2024 - dl.acm.org
Bugs in Deep Learning (DL) libraries may affect almost all downstream DL applications, and
it is crucial to ensure the quality of such systems. It is challenging to generate valid input …

Magma: A ground-truth fuzzing benchmark

A Hazimeh, A Herrera, M Payer - Abstract Proceedings of the 2021 ACM …, 2021 - dl.acm.org
High scalability and low running costs have made fuzz testing the de facto standard for
discovering software bugs. Fuzzing techniques are constantly being improved in a race to …

Large language models are edge-case fuzzers: Testing deep learning libraries via fuzzgpt

Y Deng, CS Xia, C Yang, SD Zhang, S Yang… - arXiv preprint arXiv …, 2023 - arxiv.org
Deep Learning (DL) library bugs affect downstream DL applications, emphasizing the need
for reliable systems. Generating valid input programs for fuzzing DL libraries is challenging …

MoCo: Fuzzing Deep Learning Libraries via Assembling Code

P Ji, Y Feng, D Wu, L Yan, P Chen, J Liu… - arXiv preprint arXiv …, 2024 - arxiv.org
The rapidly developing deep learning (DL) techniques have been applied in software
systems with various application scenarios. However, they could also pose new safety …