Software testing with large language models: Survey, landscape, and vision

J Wang, Y Huang, C Chen, Z Liu… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Pre-trained large language models (LLMs) have recently emerged as a breakthrough
technology in natural language processing and artificial intelligence, with the ability to …

Generative ai for self-adaptive systems: State of the art and research roadmap

J Li, M Zhang, N Li, D Weyns, Z Jin, K Tei - ACM Transactions on …, 2024 - dl.acm.org
Self-adaptive systems (SASs) are designed to handle changes and uncertainties through a
feedback loop with four core functionalities: monitoring, analyzing, planning, and execution …

Automatically inspecting thousands of static bug warnings with large language model: How far are we?

C Wen, Y Cai, B Zhang, J Su, Z Xu, D Liu… - ACM Transactions on …, 2024 - dl.acm.org
Static analysis tools for capturing bugs and vulnerabilities in software programs are widely
employed in practice, as they have the unique advantages of high coverage and …

Variable discovery with large language models for metamorphic testing of scientific software

C Tsigkanos, P Rani, S Müller, T Kehrer - International Conference on …, 2023 - Springer
When testing scientific software, it is often challenging or even impossible to craft a test
oracle for checking whether the program under test produces the expected output when …

LLMS for intelligent software testing: a comparative study

M Boukhlif, N Kharmoum, M Hanine - Proceedings of the 7th …, 2024 - dl.acm.org
The need for effective and timely testing processes has become critical in the constantly
changing field of software development. Large Language Models (LLMs) have …

Exploring the Integration of Large Language Models in Industrial Test Maintenance Processes

L Lemner, L Wahlgren, G Gay, N Mohammadiha… - arXiv preprint arXiv …, 2024 - arxiv.org
Much of the cost and effort required during the software testing process is invested in
performing test maintenance-the addition, removal, or modification of test cases to keep the …

The Current Challenges of Software Engineering in the Era of Large Language Models

C Gao, X Hu, S Gao, X Xia, Z Jin - ACM Transactions on Software …, 2024 - dl.acm.org
With the advent of large language models (LLMs) in the artificial intelligence (AI) area, the
field of software engineering (SE) has also witnessed a paradigm shift. These models, by …

Testing constraint checking implementations via principled metamorphic transformations

M Gao, H Wang, C Xu - 2024 IEEE International Conference on …, 2024 - ieeexplore.ieee.org
Constraint checking techniques are being widely used for ensuring the consistency of
software artifacts during their development and evolution (eg, detecting inconsistency in an …

CFStra: Enhancing Configurable Program Analysis Through LLM-Driven Strategy Selection Based on Code Features

J Su, L Deng, C Wen, S Qin, C Tian - International Symposium on …, 2024 - Springer
Abstract Configurable Program Analysis (CPA) allows users to customize program analysis
based on their preferences. However, current program verification tools like Cpachecker …

Tasks People Prompt: A Taxonomy of LLM Downstream Tasks in Software Verification and Falsification Approaches

VA Braberman, F Bonomo-Braberman… - arXiv preprint arXiv …, 2024 - arxiv.org
Prompting has become one of the main approaches to leverage emergent capabilities of
Large Language Models [Brown et al. NeurIPS 2020, Wei et al. TMLR 2022, Wei et al …