Learning to execute actions or ask clarification questions

Z Shi, Y Feng, A Lipani - arXiv preprint arXiv:2204.08373, 2022 - arxiv.org
Collaborative tasks are ubiquitous activities where a form of communication is required in
order to reach a joint goal. Collaborative building is one of such tasks. We wish to develop …

Instruction clarification requests in multimodal collaborative dialogue games: Tasks, and an analysis of the CoDraw dataset

B Madureira, D Schlangen - arXiv preprint arXiv:2302.14406, 2023 - arxiv.org
In visual instruction-following dialogue games, players can engage in repair mechanisms in
face of an ambiguous or underspecified instruction that cannot be fully mapped to actions in …