Software testing with large language models: Survey, landscape, and vision

J Wang, Y Huang, C Chen, Z Liu… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Pre-trained large language models (LLMs) have recently emerged as a breakthrough
technology in natural language processing and artificial intelligence, with the ability to …

[HTML][HTML] A/B testing: A systematic literature review

F Quin, D Weyns, M Galster, CC Silva - Journal of Systems and Software, 2024 - Elsevier
A/B testing, also referred to as online controlled experimentation or continuous
experimentation, is a form of hypothesis testing where two variants of a piece of software are …

Generative ai for self-adaptive systems: State of the art and research roadmap

J Li, M Zhang, N Li, D Weyns, Z Jin, K Tei - ACM Transactions on …, 2024 - dl.acm.org
Self-adaptive systems (SASs) are designed to handle changes and uncertainties through a
feedback loop with four core functionalities: monitoring, analyzing, planning, and execution …

MR-Adopt: Automatic Deduction of Input Transformation Function for Metamorphic Testing

C Xu, S Chen, J Wu, SC Cheung, V Terragni… - Proceedings of the 39th …, 2024 - dl.acm.org
While a recent study reveals that many developer-written test cases can encode a reusable
Metamorphic Relation (MR), over 70% of them directly hard-code the source input and …

Exploring the Potential of Large Language Models in Self-adaptive Systems

J Li, M Zhang, N Li, D Weyns, Z Jin, K Tei - Proceedings of the 19th …, 2024 - dl.acm.org
Large Language Models (LLMs), with their abilities in knowledge acquisition and reasoning,
can potentially enhance the various aspects of Self-adaptive Systems (SAS). Yet, the …

LLMS for intelligent software testing: a comparative study

M Boukhlif, N Kharmoum, M Hanine - Proceedings of the 7th …, 2024 - dl.acm.org
The need for effective and timely testing processes has become critical in the constantly
changing field of software development. Large Language Models (LLMs) have …

Contract-driven design of scientific data analysis workflows

AD Vu, JA Sparka, N De Mecquenem… - 2023 IEEE 19th …, 2023 - ieeexplore.ieee.org
Software systems enabling large-scale data analysis workflows (DAWs) are a key
technology for many scientific disciplines, as they allow extracting new insights from …

S3LLM: Large-Scale Scientific Software Understanding with LLMs Using Source, Metadata, and Document

K Shaik, D Wang, W Zheng, Q Cao, H Fan… - International Conference …, 2024 - Springer
The understanding of large-scale scientific software is a significant challenge due to its
diverse codebase, extensive code length, and target computing architectures. The …

Using Category Partition to Detect Metamorphic Relations

S Pedram, Y Labiche - Proceedings of the 9th ACM International …, 2024 - dl.acm.org
The Category Partition (CP) functional testing method has proven to be useful in various
contexts. It begins by identifying parameters and environment conditions on the basis of the …

Can Large Language Model Aid in Generating Properties for UPPAAL Timed Automata? A Case Study

HW Wu, SJ Lee - 2024 IEEE 48th Annual Computers, Software …, 2024 - ieeexplore.ieee.org
Real-time systems play an important role in nu-merous industries, including automobiles,
telecommunications, medical systems, among others. When designing these systems, we …