A systematic literature review on multimodal machine learning: Applications, challenges, gaps and future directions

A Barua, MU Ahmed, S Begum - IEEE Access, 2023 - ieeexplore.ieee.org
Multimodal machine learning (MML) is a tempting multidisciplinary research area where
heterogeneous data from multiple modalities and machine learning (ML) are combined to …

Gaia: A fine-grained multimedia knowledge extraction system

M Li, A Zareian, Y Lin, X Pan, S Whitehead… - Proceedings of the …, 2020 - aclanthology.org
We present the first comprehensive, open source multimedia knowledge extraction system
that takes a massive stream of unstructured, heterogeneous multimedia data from various …

Resin: A dockerized schema-guided cross-document cross-lingual cross-media information extraction and event tracking system

H Wen, Y Lin, T Lai, X Pan, S Li, X Lin… - Proceedings of the …, 2021 - aclanthology.org
We present a new information extraction system that can automatically construct temporal
event graphs from a collection of news documents from multiple sources, multiple languages …

MIRRE approach: nonlinear and multimodal exploration of MIR aggregated search results

U Rashid, K Saleem, A Ahmed - Multimedia Tools and Applications, 2021 - Springer
Nowadays, web users frequently explore multimedia contents to satisfy their information
needs. The exploration approaches usually provide linear interaction mechanisms and do …

Content-based video retrieval using integration of curvelet transform and simple linear iterative clustering

RM Bommisetty, A Khare, M Khare… - International Journal of …, 2022 - World Scientific
Video is a rich information source containing both audio and visual information along with
motion information embedded in it. Applications such as e-learning, live TV, video on …

Semantic deep learning and adaptive clustering for handling multimodal multimedia information retrieval

S Sattari, A Yazici - Multimedia Tools and Applications, 2024 - Springer
Multimedia data encompasses various modalities, including audio, visual, and text,
necessitating the development of robust retrieval methods capable of harnessing these …

Efficient and effective multi-modal queries through heterogeneous network embedding

CT Duong, TT Nguyen, H Yin… - … on Knowledge and …, 2021 - ieeexplore.ieee.org
The heterogeneity of today's Web sources requires information retrieval (IR) systems to
handle multi-modal queries. Such queries define a user's information needs by different data …

Graph embeddings for one-pass processing of heterogeneous queries

CT Duong, H Yin, D Hoang, MH Nguyen… - 2020 IEEE 36th …, 2020 - ieeexplore.ieee.org
Effective information retrieval (IR) relies on the ability to comprehensively capture a user's
information needs. Traditional IR systems are limited to homogeneous queries that define …

Content based video retrieval using histogram of gradients and frame fusion

BR Mounika, A Khare - twelfth international conference on …, 2020 - spiedigitallibrary.org
In the present article, we present an algorithm of content based video retrieval using Frame
fusion and Histogram of Oriented Gradients (HOG). Representative frames of database …

Examining the effectiveness of compensatory adaptation from a consumer's perspective in evaluating products online

J Lim, JR Wollscheid, R Ayyagari - American Journal of Business, 2020 - emerald.com
Purpose Consumers often encounter issues of perceived ambiguity and performance risk
when attempting to evaluate experience goods being offered online. Sellers try to alleviate …