[HTML][HTML] A survey of GPT-3 family large language models including ChatGPT and GPT-4

KS Kalyan - Natural Language Processing Journal, 2024 - Elsevier
Large language models (LLMs) are a special class of pretrained language models (PLMs)
obtained by scaling model size, pretraining corpus and computation. LLMs, because of their …

Towards an understanding of large language models in software engineering tasks

Z Zheng, K Ning, Q Zhong, J Chen, W Chen… - Empirical Software …, 2025 - Springer
Abstract Large Language Models (LLMs) have drawn widespread attention and research
due to their astounding performance in text generation and reasoning tasks. Derivative …

Din-sql: Decomposed in-context learning of text-to-sql with self-correction

M Pourreza, D Rafiei - Advances in Neural Information …, 2024 - proceedings.neurips.cc
There is currently a significant gap between the performance of fine-tuned models and
prompting approaches using Large Language Models (LLMs) on the challenging task of text …

Llms for knowledge graph construction and reasoning: Recent capabilities and future opportunities

Y Zhu, X Wang, J Chen, S Qiao, Y Ou, Y Yao, S Deng… - World Wide Web, 2024 - Springer
This paper presents an exhaustive quantitative and qualitative evaluation of Large
Language Models (LLMs) for Knowledge Graph (KG) construction and reasoning. We …

Large language models for software engineering: Survey and open problems

A Fan, B Gokkaya, M Harman… - 2023 IEEE/ACM …, 2023 - ieeexplore.ieee.org
This paper provides a survey of the emerging area of Large Language Models (LLMs) for
Software Engineering (SE). It also sets out open research challenges for the application of …

Text-to-sql empowered by large language models: A benchmark evaluation

D Gao, H Wang, Y Li, X Sun, Y Qian, B Ding… - arXiv preprint arXiv …, 2023 - arxiv.org
Large language models (LLMs) have emerged as a new paradigm for Text-to-SQL task.
However, the absence of a systematical benchmark inhibits the development of designing …

Unbiased watermark for large language models

Z Hu, L Chen, X Wu, Y Wu, H Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
The recent advancements in large language models (LLMs) have sparked a growing
apprehension regarding the potential misuse. One approach to mitigating this risk is to …

SQL-PaLM: Improved Large Language Model Adaptation for Text-to-SQL (extended)

R Sun, SÖ Arik, A Muzio, L Miculicich… - arXiv preprint arXiv …, 2023 - arxiv.org
Text-to-SQL, the process of translating natural language into Structured Query Language
(SQL), represents a transformative application of large language models (LLMs), potentially …

C3: Zero-shot text-to-sql with chatgpt

X Dong, C Zhang, Y Ge, Y Mao, Y Gao, J Lin… - arXiv preprint arXiv …, 2023 - arxiv.org
This paper proposes a ChatGPT-based zero-shot Text-to-SQL method, dubbed C3, which
achieves 82.3\% in terms of execution accuracy on the holdout test set of Spider and …

Enhancing text-to-SQL capabilities of large language models: A study on prompt design strategies

L Nan, Y Zhao, W Zou, N Ri, J Tae… - Findings of the …, 2023 - aclanthology.org
In-context learning (ICL) has emerged as a new approach to various natural language
processing tasks, utilizing large language models (LLMs) to make predictions based on …