Software testing with large language models: Survey, landscape, and vision

J Wang, Y Huang, C Chen, Z Liu… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Pre-trained large language models (LLMs) have recently emerged as a breakthrough
technology in natural language processing and artificial intelligence, with the ability to …

Code generation using machine learning: A systematic review

E Dehaerne, B Dey, S Halder, S De Gendt… - Ieee …, 2022 - ieeexplore.ieee.org
Recently, machine learning (ML) methods have been used to create powerful language
models for a broad range of natural language processing tasks. An important subset of this …

Automated program repair in the era of large pre-trained language models

CS Xia, Y Wei, L Zhang - 2023 IEEE/ACM 45th International …, 2023 - ieeexplore.ieee.org
Automated Program Repair (APR) aims to help developers automatically patch software
bugs. However, current state-of-the-art traditional and learning-based APR techniques face …

Codamosa: Escaping coverage plateaus in test generation with pre-trained large language models

C Lemieux, JP Inala, SK Lahiri… - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Search-based software testing (SBST) generates high-coverage test cases for programs
under test with a combination of test case generation and mutation. SBST's performance …

An empirical evaluation of using large language models for automated unit test generation

M Schäfer, S Nadi, A Eghbali… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Unit tests play a key role in ensuring the correctness of software. However, manually
creating unit tests is a laborious task, motivating the need for automation. Large Language …

Retrieval-based prompt selection for code-related few-shot learning

N Nashid, M Sintaha, A Mesbah - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Large language models trained on massive code corpora can generalize to new tasks
without the need for task-specific fine-tuning. In few-shot learning, these models take as …

No more manual tests? evaluating and improving chatgpt for unit test generation

Z Yuan, Y Lou, M Liu, S Ding, K Wang, Y Chen… - arXiv preprint arXiv …, 2023 - arxiv.org
Unit testing is essential in detecting bugs in functionally-discrete program units. Manually
writing high-quality unit tests is time-consuming and laborious. Although traditional …

Studying the usage of text-to-text transfer transformer to support code-related tasks

A Mastropaolo, S Scalabrino, N Cooper… - 2021 IEEE/ACM …, 2021 - ieeexplore.ieee.org
Deep learning (DL) techniques are gaining more and more attention in the software
engineering community. They have been used to support several code-related tasks, such …

On the robustness of code generation techniques: An empirical study on github copilot

A Mastropaolo, L Pascarella… - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Software engineering research has always being concerned with the improvement of code
completion approaches, which suggest the next tokens a developer will likely type while …

Using pre-trained models to boost code review automation

R Tufano, S Masiero, A Mastropaolo… - Proceedings of the 44th …, 2022 - dl.acm.org
Code review is a practice widely adopted in open source and industrial projects. Given the
non-negligible cost of such a process, researchers started investigating the possibility of …