We demonstrate that coreference resolution in procedural texts is significantly improved
when performing transformation-based entity linking prior to coreference relation …

Multimodal dialogue involving multiple participants presents complex computational
challenges, primarily due to the rich interplay of diverse communicative modalities including …

Actions are critical for interpreting dialogue: they provide context for demonstratives and
definite descriptions in discourse, and they continually update the common ground. This …

Abstract Models of natural language understanding often rely on question answering and
logical inference benchmark challenges to evaluate the performance of a system. While …

Semantic textual similarity (STS) is a fundamental NLP task that measures the semantic
similarity between a pair of sentences. In order to reduce the inherent ambiguity posed from …

Understanding inferences and answering questions from text requires more than merely
recovering surface arguments, adjuncts, or strings associated with the query terms. As …

This paper presents three studies on the design, use and effectiveness of multimodal online
baking blogs that present cookie recipes in two forms: illustrated step-by-step Instructions …

In this work we present an overview of our winning system for the R2VQ-Competence-based
Multimodal Question Answering task, with the final exact match score of 92.53%. The task is …

This paper presents the second place system for the R2VQ: competence-based multimodal
question answering shared task. The purpose of this task is to involve semantic&cooking …

This paper describes our system used in the SemEval-2022 Task 09: R2VQ-Competence-
based Multimodal Question Answering. We propose a knowledge-enhanced model for …