Multimodal research in vision and language: A review of current and emerging trends
Deep Learning and its applications have cascaded impactful research and development
with a diverse range of modalities present in the real-world data. More recently, this has …
with a diverse range of modalities present in the real-world data. More recently, this has …
A systematic literature review on multimodal machine learning: Applications, challenges, gaps and future directions
Multimodal machine learning (MML) is a tempting multidisciplinary research area where
heterogeneous data from multiple modalities and machine learning (ML) are combined to …
heterogeneous data from multiple modalities and machine learning (ML) are combined to …
Wit: Wikipedia-based image text dataset for multimodal multilingual machine learning
The milestone improvements brought about by deep representation learning and pre-
training techniques have led to large performance gains across downstream NLP, IR and …
training techniques have led to large performance gains across downstream NLP, IR and …
A novel graph-based multi-modal fusion encoder for neural machine translation
Multi-modal neural machine translation (NMT) aims to translate source sentences into a
target language paired with images. However, dominant multi-modal NMT models do not …
target language paired with images. However, dominant multi-modal NMT models do not …
Trends in integration of vision and language research: A survey of tasks, datasets, and methods
Abstract Interest in Artificial Intelligence (AI) and its applications has seen unprecedented
growth in the last few years. This success can be partly attributed to the advancements made …
growth in the last few years. This success can be partly attributed to the advancements made …
Uc2: Universal cross-lingual cross-modal vision-and-language pre-training
Vision-and-language pre-training has achieved impressive success in learning multimodal
representations between vision and language. To generalize this success to non-English …
representations between vision and language. To generalize this success to non-English …
Neural natural language generation: A survey on multilinguality, multimodality, controllability and learning
Developing artificial learning systems that can understand and generate natural language
has been one of the long-standing goals of artificial intelligence. Recent decades have …
has been one of the long-standing goals of artificial intelligence. Recent decades have …
Dynamic context-guided capsule network for multimodal machine translation
Multimodal machine translation (MMT), which mainly focuses on enhancing text-only
translation with visual features, has attracted considerable attention from both computer …
translation with visual features, has attracted considerable attention from both computer …
Grounding'grounding'in NLP
The NLP community has seen substantial recent interest in grounding to facilitate interaction
between language technologies and the world. However, as a community, we use the term …
between language technologies and the world. However, as a community, we use the term …
Multimodality information fusion for automated machine translation
Abstract Machine translation is a popular automation approach for translating texts between
different languages. Although traditionally it has a strong focus on natural language, images …
different languages. Although traditionally it has a strong focus on natural language, images …