Promptintern: Saving inference costs by internalizing recurrent prompt during large language model fine-tuning

J Zou, M Zhou, T Li, S Han, D Zhang - arXiv preprint arXiv:2407.02211, 2024 - arxiv.org
Recent advances in fine-tuning large language models (LLMs) have greatly enhanced their
usage in domain-specific tasks. Despite the success, fine-tuning continues to rely on …

An empirical study of validating synthetic data for formula generation

U Singh, J Cambronero, S Gulwani, A Kanade… - arXiv preprint arXiv …, 2024 - arxiv.org
Large language models (LLMs) can be leveraged to help with writing formulas in
spreadsheets, but resources on these formulas are scarce, impacting both the base …

Automated Data Visualization from Natural Language via Large Language Models: An Exploratory Study

Y Wu, Y Wan, H Zhang, Y Sui, W Wei, W Zhao… - Proceedings of the …, 2024 - dl.acm.org
The Natural Language to Visualization (NL2Vis) task aims to transform natural-language
descriptions into visual representations for a grounded table, enabling users to gain insights …

Auto-Formula: Recommend Formulas in Spreadsheets using Contrastive Learning for Table Representations

S Chen, Y He, W Cui, J Fan, S Ge, H Zhang… - Proceedings of the …, 2024 - dl.acm.org
Spreadsheets are widely recognized as the most popular end-user programming tools,
which blend the power of formula-based computation, with an intuitive table-based interface …

Table-LLM-Specialist: Language Model Specialists for Tables using Iterative Generator-Validator Fine-tuning

J Xing, Y He, M Zhou, H Dong, S Han, D Zhang… - arXiv preprint arXiv …, 2024 - arxiv.org
In this work, we propose Table-LLM-Specialist, or Table-Specialist for short, as a new self-
trained fine-tuning paradigm specifically designed for table tasks. Our insight is that for each …

GUI-WORLD: A Dataset for GUI-oriented Multimodal LLM-based Agents

D Chen, Y Huang, S Wu, J Tang, L Chen, Y Bai… - arXiv preprint arXiv …, 2024 - arxiv.org
Recently, Multimodal Large Language Models (MLLMs) have been used as agents to
control keyboard and mouse inputs by directly perceiving the Graphical User Interface (GUI) …