A systematic literature review on multimodal machine learning: Applications, challenges, gaps and future directions

A Barua, MU Ahmed, S Begum - IEEE Access, 2023 - ieeexplore.ieee.org
Multimodal machine learning (MML) is a tempting multidisciplinary research area where
heterogeneous data from multiple modalities and machine learning (ML) are combined to …

Tongue contour tracking and segmentation in lingual ultrasound for speech recognition: A review

K Al-Hammuri, F Gebali, I Thirumarai Chelvan… - Diagnostics, 2022 - mdpi.com
Lingual ultrasound imaging is essential in linguistic research and speech recognition. It has
been used widely in different applications as visual feedback to enhance language learning …

Unlocking the potential of two-point cells for energy-efficient and resilient training of deep nets

A Adeel, A Adetomi, K Ahmed… - … on Emerging Topics …, 2023 - ieeexplore.ieee.org
Context-sensitive two-point layer 5 pyramidal cells (L5PCs) were discovered as long ago as
1999. However, the potential of this discovery to provide useful neural computation has yet …

Tracing Human Stress From Physiological Signals Using UWB Radar

J Xu, T Xiao, P Lv, Z Chen, C Cai… - IEEE Internet of …, 2024 - ieeexplore.ieee.org
Stress tracing is an important research domain that supports many applications, such as
health care and stress management; and its closest related works are derived from stress …

Real-time mri video synthesis from time aligned phonemes with sequence-to-sequence networks

S Udupa, PK Ghosh - ICASSP 2023-2023 IEEE International …, 2023 - ieeexplore.ieee.org
Real-Time Magnetic resonance imaging (rtMRI) of the midsagittal plane of the mouth is of
interest for speech production research. In this work, we focus on estimating utterance level …

How the Brunswikian lens model illustrates the relationship between physiological and behavioral signals and psychological emotional and cognitive states

JK Burgoon, RX Wang, X Chen, TS Ge… - Frontiers in …, 2022 - frontiersin.org
Social relationships are constructed by and through the relational communication that
people exchange. Relational messages are implicit nonverbal and verbal messages that …

[PDF][PDF] Towards Speech Classification from Acoustic and Vocal Tract data in Real-time MRI

Y Yue, M Proctor, L Zhou, R Gupta… - Proceedings of …, 2024 - isca-archive.org
Real-time magnetic resonance image (rtMRI) data of the upper airway provides a rich
source of information about vocal tract shaping that can inform phonemic analysis and …

Multimodal Dementia Screening from Brain Magnetic Resonance Imaging and Conversational Speech

KM Lankenau, E Brauße, J Schill… - 2024 46th Annual …, 2024 - ieeexplore.ieee.org
Early detection of Alzheimer's dementia is crucial for effective symptomatic treatment.
Herein, we explore the opportunities of dementia screening based on automatically derived …

[PDF][PDF] Vision Transformer-based Context-Aware System for Lingual Ultrasound in Digital Health Ecosystem

K Al-hammuri - 2024 - dspace.library.uvic.ca
The complex nature of modern healthcare systems and the widespread distribution of
healthcare infrastructure made the interoperability within healthcare information system …

[PDF][PDF] Unlocking the potential of two-point cells for energy-efficient training of deep nets.

A Adeel, AAKAA Hussain, TAWA Phillips - CoRR, 2022 - academia.edu
Context-sensitive two-point layer 5 pyramidal cells (L5PC) were discovered as long ago as
1999. However, the potential of this discovery to provide useful neural computation has yet …