A software engineering perspective on engineering machine learning systems: State of the art and challenges

G Giray - Journal of Systems and Software, 2021 - Elsevier
Context: Advancements in machine learning (ML) lead to a shift from the traditional view of
software development, where algorithms are hard-coded by humans, to ML systems …

Semi-supervised log-based anomaly detection via probabilistic label estimation

L Yang, J Chen, Z Wang, W Wang… - 2021 IEEE/ACM …, 2021 - ieeexplore.ieee.org
With the growth of software systems, logs have become an important data to aid system
maintenance. Log-based anomaly detection is one of the most important methods for such …

Deep learning library testing via effective model generation

Z Wang, M Yan, J Chen, S Liu, D Zhang - … of the 28th ACM Joint Meeting …, 2020 - dl.acm.org
Deep learning (DL) techniques are rapidly developed and have been widely adopted in
practice. However, similar to traditional software systems, DL systems also contain bugs …

A comprehensive study of deep learning compiler bugs

Q Shen, H Ma, J Chen, Y Tian, SC Cheung… - Proceedings of the 29th …, 2021 - dl.acm.org
There are increasing uses of deep learning (DL) compilers to generate optimized code,
boosting the runtime performance of DL models on specific hardware. Like their traditional …

Free lunch for testing: Fuzzing deep-learning libraries from open source

A Wei, Y Deng, C Yang, L Zhang - Proceedings of the 44th International …, 2022 - dl.acm.org
Deep learning (DL) systems can make our life much easier, and thus are gaining more and
more attention from both academia and industry. Meanwhile, bugs in DL systems can be …

Prioritizing test inputs for deep neural networks via mutation analysis

Z Wang, H You, J Chen, Y Zhang… - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
Deep Neural Network (DNN) testing is one of the most widely-used ways to guarantee the
quality of DNNs. However, labeling test inputs to check the correctness of DNN prediction is …

An empirical study on data distribution-aware test selection for deep learning enhancement

Q Hu, Y Guo, M Cordy, X Xie, L Ma… - ACM Transactions on …, 2022 - dl.acm.org
Similar to traditional software that is constantly under evolution, deep neural networks need
to evolve upon the rapid growth of test data for continuous enhancement (eg, adapting to …

Identifying bad software changes via multimodal anomaly detection for online service systems

N Zhao, J Chen, Z Yu, H Wang, J Li, B Qiu… - Proceedings of the 29th …, 2021 - dl.acm.org
In large-scale online service systems, software changes are inevitable and frequent. Due to
importing new code or configurations, changes are likely to incur incidents and destroy user …

Toward understanding deep learning framework bugs

J Chen, Y Liang, Q Shen, J Jiang, S Li - ACM Transactions on Software …, 2023 - dl.acm.org
DL frameworks are the basis of constructing all DL programs and models, and thus their
bugs could lead to the unexpected behaviors of any DL program or model relying on them …

Natural test generation for precise testing of question answering software

Q Shen, J Chen, JM Zhang, H Wang, S Liu… - Proceedings of the 37th …, 2022 - dl.acm.org
Question answering (QA) software uses information retrieval and natural language
processing techniques to automatically answer questions posed by humans in a natural …