Class-Level Code Generation from Natural Language Using Iterative, Tool-Enhanced Reasoning over Repository

A Deshpande, A Agarwal, S Shet, A Iyer… - arXiv preprint arXiv …, 2024 - arxiv.org
LLMs have demonstrated significant potential in code generation tasks, achieving promising
results at the function or statement level in various benchmarks. However, the complexities …

Codeagent: Enhancing code generation with tool-integrated agent systems for real-world repo-level coding challenges

K Zhang, J Li, G Li, X Shi, Z Jin - arXiv preprint arXiv:2401.07339, 2024 - arxiv.org
Large Language Models (LLMs) have shown promise in automated code generation but
typically excel only in simpler tasks such as generating standalone code units. Real-world …

Enhancing Repository-Level Code Generation with Integrated Contextual Information

Z Pan, X Hu, X Xia, X Yang - arXiv preprint arXiv:2406.03283, 2024 - arxiv.org
Large language models (LLMs) have demonstrated remarkable capabilities in code
generation tasks. However, repository-level code generation presents unique challenges …

ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code

X Tang, Y Liu, Z Cai, Y Shao, J Lu, Y Zhang… - arXiv e …, 2023 - ui.adsabs.harvard.edu
Abstract Despite Large Language Models (LLMs) like GPT-4 achieving impressive results in
function-level code generation, they struggle with repository-scale code understanding (eg …

A Review of Repository Level Prompting for LLMs

D Schonholtz - arXiv preprint arXiv:2312.10101, 2023 - arxiv.org
As coding challenges become more complex, recent advancements in Large Language
Models (LLMs) have led to notable successes, such as achieving a 94.6\% solve rate on the …

Repoagent: An llm-powered open-source framework for repository-level code documentation generation

Q Luo, Y Ye, S Liang, Z Zhang, Y Qin, Y Lu… - arXiv preprint arXiv …, 2024 - arxiv.org
Generative models have demonstrated considerable potential in software engineering,
particularly in tasks such as code generation and debugging. However, their utilization in the …

Context-aware code generation framework for code repositories: Local, global, and third-party library awareness

D Liao, S Pan, Q Huang, X Ren, Z Xing, H Jin… - arXiv preprint arXiv …, 2023 - arxiv.org
Code generation tools are essential to help developers in the software development
process. Existing tools often disconnect with the working context, ie, the code repository …

Teaching Code LLMs to Use Autocompletion Tools in Repository-Level Code Generation

C Wang, J Zhang, Y Feng, T Li, W Sun, Y Liu… - arXiv preprint arXiv …, 2024 - arxiv.org
Recent code large language models (LLMs) have shown promising performance in
generating standalone functions but face limitations in repository-level code generation due …

CodeRAG-Bench: Can Retrieval Augment Code Generation?

ZZ Wang, A Asai, XV Yu, FF Xu, Y Xie, G Neubig… - arXiv preprint arXiv …, 2024 - arxiv.org
While language models (LMs) have proven remarkably adept at generating code, many
programs are challenging for LMs to generate using their parametric knowledge alone …

Towards more realistic evaluation of LLM-based code generation: an experimental study and beyond

D Zheng, Y Wang, E Shi, R Zhang, Y Ma… - arXiv preprint arXiv …, 2024 - arxiv.org
To evaluate the code generation capabilities of Large Language Models (LLMs) in complex
real-world software development scenarios, many evaluation approaches have been …