Natural language generation and understanding of big code for AI-assisted programming: A review

MF Wong, S Guo, CN Hang, SW Ho, CW Tan - Entropy, 2023 - mdpi.com
This paper provides a comprehensive review of the literature concerning the utilization of
Natural Language Processing (NLP) techniques, with a particular focus on transformer …

A critical review of large language model on software engineering: An example from chatgpt and automated program repair

Q Zhang, T Zhang, J Zhai, C Fang, B Yu, W Sun… - arXiv preprint arXiv …, 2023 - arxiv.org
Large Language Models (LLMs) have been gaining increasing attention and demonstrated
promising performance across a variety of Software Engineering (SE) tasks, such as …

An analysis of the automatic bug fixing performance of chatgpt

D Sobania, M Briesch, C Hanna… - 2023 IEEE/ACM …, 2023 - ieeexplore.ieee.org
To support software developers in finding and fixing software bugs, several automated
program repair techniques have been introduced. Given a test suite, standard methods …

Impact of code language models on automated program repair

N Jiang, K Liu, T Lutellier, L Tan - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Automated program repair (APR) aims to help developers improve software reliability by
generating patches for buggy programs. Although many code language models (CLM) are …

Automated repair of programs from large language models

Z Fan, X Gao, M Mirchev… - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Large language models such as Codex, have shown the capability to produce code for
many programming tasks. However, the success rate of existing models is low, especially for …

Cure: Code-aware neural machine translation for automatic program repair

N Jiang, T Lutellier, L Tan - 2021 IEEE/ACM 43rd International …, 2021 - ieeexplore.ieee.org
Automatic program repair (APR) is crucial to improve software reliability. Recently, neural
machine translation (NMT) techniques have been used to automatically fix software bugs …

Coconut: combining context-aware neural translation models using ensemble for program repair

T Lutellier, HV Pham, L Pang, Y Li, M Wei… - Proceedings of the 29th …, 2020 - dl.acm.org
Automated generate-and-validate (GV) program repair techniques (APR) typically rely on
hard-coded rules, thus only fixing bugs following specific fix patterns. These rules require a …

Can OpenAI's codex fix bugs? an evaluation on QuixBugs

JA Prenner, H Babii, R Robbes - … of the Third International Workshop on …, 2022 - dl.acm.org
OpenAI's Codex, a GPT-3 like model trained on a large code corpus, has made headlines in
and outside of academia. Given a short user-provided description, it is capable of …

Neural program repair with execution-based backpropagation

H Ye, M Martinez, M Monperrus - … of the 44th international conference on …, 2022 - dl.acm.org
Neural machine translation (NMT) architectures have achieved promising results for
automatic program repair. Yet, they have the limitation of generating low-quality patches (eg …

A survey of learning-based automated program repair

Q Zhang, C Fang, Y Ma, W Sun, Z Chen - ACM Transactions on Software …, 2023 - dl.acm.org
Automated program repair (APR) aims to fix software bugs automatically and plays a crucial
role in software development and maintenance. With the recent advances in deep learning …