A survey on stability of learning with limited labelled data and its sensitivity to the effects of randomness

B Pecher, I Srba, M Bielikova - ACM Computing Surveys, 2024 - dl.acm.org
Learning with limited labelled data, such as prompting, in-context learning, fine-tuning, meta-
learning, or few-shot learning, aims to effectively train a model using only a small amount of …

Teach better or show smarter? on instructions and exemplars in automatic prompt optimization

X Wan, R Sun, H Nakhost, SO Arik - arXiv preprint arXiv:2406.15708, 2024 - arxiv.org
Large language models have demonstrated remarkable capabilities, but their performance
is heavily reliant on effective prompt engineering. Automatic prompt optimization (APO) …

Aviary: training language agents on challenging scientific tasks

S Narayanan, JD Braza, RR Griffiths… - arXiv preprint arXiv …, 2024 - arxiv.org
Solving complex real-world tasks requires cycles of actions and observations. This is
particularly true in science, where tasks require many cycles of analysis, tool use, and …

Data-Centric AI in the Age of Large Language Models

X Xu, Z Wu, R Qiao, A Verma, Y Shu, J Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
This position paper proposes a data-centric viewpoint of AI research, focusing on large
language models (LLMs). We start by making the key observation that data is instrumental in …

Position Paper: Data-Centric AI in the Age of Large Language Models

X Xu, Z Wu, R Qiao, A Verma, Y Shu… - Findings of the …, 2024 - aclanthology.org
This position paper proposes a data-centric viewpoint of AI research, focusing on large
language models (LLMs). We start by making a key observation that data is instrumental in …

Hyperband-based Bayesian Optimization for Black-box Prompt Selection

L Schneider, M Wistuba, A Klein, J Golebiowski… - arXiv preprint arXiv …, 2024 - arxiv.org
Optimal prompt selection is crucial for maximizing large language model (LLM) performance
on downstream tasks. As the most powerful models are proprietary and can only be invoked …

A Survey on Stability of Learning with Limited Labelled Data and its Sensitivity to the Effects of Randomness

B Pecher, I Srba, M Bielikova - arXiv preprint arXiv:2312.01082, 2023 - arxiv.org
Learning with limited labelled data, such as prompting, in-context learning, fine-tuning, meta-
learning or few-shot learning, aims to effectively train a model using only a small amount of …