[HTML][HTML] A survey of GPT-3 family large language models including ChatGPT and GPT-4
KS Kalyan - Natural Language Processing Journal, 2024 - Elsevier
Large language models (LLMs) are a special class of pretrained language models (PLMs)
obtained by scaling model size, pretraining corpus and computation. LLMs, because of their …
obtained by scaling model size, pretraining corpus and computation. LLMs, because of their …
Towards an understanding of large language models in software engineering tasks
Abstract Large Language Models (LLMs) have drawn widespread attention and research
due to their astounding performance in text generation and reasoning tasks. Derivative …
due to their astounding performance in text generation and reasoning tasks. Derivative …
“What it wants me to say”: Bridging the abstraction gap between end-user programmers and code-generating large language models
Code-generating large language models map natural language to code. However, only a
small portion of the infinite space of naturalistic utterances is effective at guiding code …
small portion of the infinite space of naturalistic utterances is effective at guiding code …
From google gemini to openai q*(q-star): A survey of reshaping the generative artificial intelligence (ai) research landscape
This comprehensive survey explored the evolving landscape of generative Artificial
Intelligence (AI), with a specific focus on the transformative impacts of Mixture of Experts …
Intelligence (AI), with a specific focus on the transformative impacts of Mixture of Experts …
[PDF][PDF] Unifying the perspectives of nlp and software engineering: A survey on language models for code
Z Zhang, C Chen, B Liu, C Liao, Z Gong… - arXiv preprint arXiv …, 2023 - simg.baai.ac.cn
In this work we systematically review the recent advancements in code processing with
language models, covering 50+ models, 30+ evaluation tasks, 170+ datasets, and 700 …
language models, covering 50+ models, 30+ evaluation tasks, 170+ datasets, and 700 …
What makes good in-context demonstrations for code intelligence tasks with llms?
Pre-trained models of source code have gained widespread popularity in many code
intelligence tasks. Recently, with the scaling of the model and corpus size, large language …
intelligence tasks. Recently, with the scaling of the model and corpus size, large language …
Do code summarization models process too much information? function signature may be all that is needed
With the fast development of large software projects, automatic code summarization
techniques, which summarize the main functionalities of a piece of code using natural …
techniques, which summarize the main functionalities of a piece of code using natural …
Multilingual code co-evolution using large language models
Many software projects implement APIs and algorithms in multiple programming languages.
Maintaining such projects is tiresome, as developers have to ensure that any change (eg, a …
Maintaining such projects is tiresome, as developers have to ensure that any change (eg, a …
From commit message generation to history-aware commit message completion
Commit messages are crucial to software development, allowing developers to track
changes and collaborate effectively. Despite their utility, most commit messages lack …
changes and collaborate effectively. Despite their utility, most commit messages lack …
Prompt engineering or fine tuning: An empirical assessment of large language models in automated software engineering tasks
In this paper, we investigate the effectiveness of state-of-the-art LLM, ie, GPT-4, with three
different prompting engineering techniques (ie, basic prompting, in-context learning, and …
different prompting engineering techniques (ie, basic prompting, in-context learning, and …