Free lunch for testing: Fuzzing deep-learning libraries from open source

A Wei, Y Deng, C Yang, L Zhang - Proceedings of the 44th International …, 2022 - dl.acm.org
Deep learning (DL) systems can make our life much easier, and thus are gaining more and
more attention from both academia and industry. Meanwhile, bugs in DL systems can be …

Bug characterization in machine learning-based systems

MM Morovati, A Nikanjam, F Tambon, F Khomh… - Empirical Software …, 2024 - Springer
The rapid growth of applying Machine Learning (ML) in different domains, especially in
safety-critical areas, increases the need for reliable ML components, ie, a software …

Biasasker: Measuring the bias in conversational ai system

Y Wan, W Wang, P He, J Gu, H Bai… - Proceedings of the 31st …, 2023 - dl.acm.org
Powered by advanced Artificial Intelligence (AI) techniques, conversational AI systems, such
as ChatGPT, and digital assistants like Siri, have been widely deployed in daily life …

Repairing dnn architecture: Are we there yet?

J Kim, N Humbatova, G Jahangirova… - … IEEE Conference on …, 2023 - ieeexplore.ieee.org
As Deep Neural Networks (DNNs) are rapidly being adopted within large software systems,
software developers are increasingly required to design, train, and deploy such models into …

Thirdeye: Attention maps for safe autonomous driving systems

A Stocco, PJ Nunes, M d'Amorim… - Proceedings of the 37th …, 2022 - dl.acm.org
Automated online recognition of unexpected conditions is an indispensable component of
autonomous vehicles to ensure safety even in unknown and uncertain situations. In this …

Efficient and effective feature space exploration for testing deep learning systems

T Zohdinasab, V Riccio, A Gambi… - ACM Transactions on …, 2023 - dl.acm.org
Assessing the quality of Deep Learning (DL) systems is crucial, as they are increasingly
adopted in safety-critical domains. Researchers have proposed several input generation …

Deepfd: Automated fault diagnosis and localization for deep learning programs

J Cao, M Li, X Chen, M Wen, Y Tian, B Wu… - Proceedings of the 44th …, 2022 - dl.acm.org
As Deep Learning (DL) systems are widely deployed for mission-critical applications,
debugging such systems becomes essential. Most existing works identify and repair …

Mttm: Metamorphic testing for textual content moderation software

W Wang, J Huang, W Wu, J Zhang… - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
The exponential growth of social media platforms such as Twitter and Facebook has
revolutionized textual communication and textual content publication in human society …

GraphPrior: Mutation-based test input prioritization for graph neural networks

X Dang, Y Li, M Papadakis, J Klein… - ACM Transactions on …, 2023 - dl.acm.org
Graph Neural Networks (GNNs) have achieved promising performance in a variety of
practical applications. Similar to traditional DNNs, GNNs could exhibit incorrect behavior that …

Deepmetis: Augmenting a deep learning test set to increase its mutation score

V Riccio, N Humbatova, G Jahangirova… - 2021 36th IEEE/ACM …, 2021 - ieeexplore.ieee.org
Deep Learning (DL) components are routinely integrated into software systems that need to
perform complex tasks such as image or natural language processing. The adequacy of the …