The utilization of programming language (PL) models, pre-trained on large-scale code corpora, as a means of automating software engineering processes has demonstrated …
We present PanGu-Coder, a pretrained decoder-only language model adopting the PanGu- Alpha architecture for text-to-code generation, ie the synthesis of programming language …
Automatically generating compilable programs with (or without) natural language descriptions has always been a touchstone problem for computational linguistics and …
Program synthesis is the task of automatically generating a program consistent with a specification. Recent years have seen proposal of a number of neural approaches for …
Program synthesis has been long studied with recent approaches focused on directly using the power of Large Language Models (LLMs) to generate code. Programming benchmarks …
J Liu, Y Zhu, K Xiao, Q Fu, X Han, W Yang… - arXiv preprint arXiv …, 2023 - arxiv.org
The goal of program synthesis, or code generation, is to generate executable code based on given descriptions. Recently, there has been an increasing number of studies employing …
The potential for pre-trained large language models (LLMs) to use natural language feedback at inference time has been an exciting recent development. We build upon this …
Existing large language model-based code generation pipelines typically use beam search or sampling algorithms during the decoding process. Although the programs they generate …
X Chen, D Song, Y Tian - Advances in Neural Information …, 2021 - proceedings.neurips.cc
Program synthesis from input-output (IO) examples has been a long-standing challenge. While recent works demonstrated limited success on domain-specific languages (DSL), it …