Is ChatGPT the ultimate programming assistant--how far is it?

H Tian, W Lu, TO Li, X Tang, SC Cheung… - arXiv preprint arXiv …, 2023 - arxiv.org
Recently, the ChatGPT LLM has received great attention: it can be used as a bot for
discussing source code, prompting it to suggest changes, provide descriptions or even …

Octopack: Instruction tuning code large language models

N Muennighoff, Q Liu, A Zebaze, Q Zheng… - arXiv preprint arXiv …, 2023 - arxiv.org
Finetuning large language models (LLMs) on instructions leads to vast performance
improvements on natural language tasks. We apply instruction tuning using code …

Few-shot training LLMs for project-specific code-summarization

T Ahmed, P Devanbu - Proceedings of the 37th IEEE/ACM International …, 2022 - dl.acm.org
Very large language models (LLMs), such as GPT-3 and Codex have achieved state-of-the-
art performance on several natural-language tasks, and show great promise also for code. A …

Recommending root-cause and mitigation steps for cloud incidents using large language models

T Ahmed, S Ghosh, C Bansal… - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Incident management for cloud services is a complex process involving several steps and
has a huge impact on both service health and developer productivity. On-call engineers …

Pitfalls in language models for code intelligence: A taxonomy and survey

X She, Y Liu, Y Zhao, Y He, L Li… - arXiv preprint arXiv …, 2023 - arxiv.org
Modern language models (LMs) have been successfully employed in source code
generation and understanding, leading to a significant increase in research focused on …

Towards efficient fine-tuning of pre-trained code models: An experimental study and beyond

E Shi, Y Wang, H Zhang, L Du, S Han… - Proceedings of the …, 2023 - dl.acm.org
Recently, fine-tuning pre-trained code models such as CodeBERT on downstream tasks has
achieved great success in many software testing and analysis tasks. While effective and …

Automatic code summarization via chatgpt: How far are we?

W Sun, C Fang, Y You, Y Miao, Y Liu, Y Li… - arXiv preprint arXiv …, 2023 - arxiv.org
To support software developers in understanding and maintaining programs, various
automatic code summarization techniques have been proposed to generate a concise …

Binary code summarization: Benchmarking chatgpt/gpt-4 and other large language models

X Jin, J Larson, W Yang, Z Lin - arXiv preprint arXiv:2312.09601, 2023 - arxiv.org
Binary code summarization, while invaluable for understanding code semantics, is
challenging due to its labor-intensive nature. This study delves into the potential of large …

Extending source code pre-trained language models to summarise decompiled binaries

A Al-Kaswan, T Ahmed, M Izadi… - … on Software Analysis …, 2023 - ieeexplore.ieee.org
Binary reverse engineering is used to understand and analyse programs for which the
source code is unavailable. Decompilers can help, transforming opaque binaries into a …

What makes good in-context demonstrations for code intelligence tasks with llms?

S Gao, XC Wen, C Gao, W Wang… - 2023 38th IEEE/ACM …, 2023 - ieeexplore.ieee.org
Pre-trained models of source code have gained widespread popularity in many code
intelligence tasks. Recently, with the scaling of the model and corpus size, large language …