This paper provides a comprehensive review of the literature concerning the utilization of
Natural Language Processing (NLP) techniques, with a particular focus on transformer …

Recent advances in Large Language Models (LLM) have made automatic code generation
possible for real-world programming tasks in general-purpose programming languages …

Large pre-trained code generation models, such as OpenAI Codex, can generate syntax-
and function-correct code, making the coding of programmers more productive and our …

Deep learning has become the dominant approach in addressing various tasks in Natural
Language Processing (NLP). Although text inputs are typically represented as a sequence …

Although large language models (LLMs) have demonstrated impressive ability in code
generation, they are still struggling to address the complicated intent provided by humans. It …

Large pre-trained code generation models, such as OpenAI Codex, can generate syntax-
and function-correct code, making the coding of programmers more productive. In this paper …

Automated Program Repair (APR) helps improve the efficiency of software development and
maintenance. Recent APR techniques use deep learning, particularly the encoder-decoder …

The recent advancements in Artificial Intelligence, particularly in large language models and
generative models, are reshaping the field of software engineering by enabling innovative …

The introduction of GitHub's new code generation tool, GitHub Copilot, seems to be the first
well-established instance of an AI pair-programmer. GitHub Copilot has access to a large …

Code intelligence leverages machine learning techniques to extract knowledge from
extensive code corpora, with the aim of developing intelligent tools to improve the quality …