Foundations & trends in multimodal machine learning: Principles, challenges, and open questions

PP Liang, A Zadeh, LP Morency - ACM Computing Surveys, 2024 - dl.acm.org
Multimodal machine learning is a vibrant multi-disciplinary research field that aims to design
computer agents with intelligent capabilities such as understanding, reasoning, and learning …

Speech emotion recognition: Emotional models, databases, features, preprocessing methods, supporting modalities, and classifiers

MB Akçay, K Oğuz - Speech Communication, 2020 - Elsevier
Speech is the most natural way of expressing ourselves as humans. It is only natural then to
extend this communication medium to computer applications. We define speech emotion …

Deep learning for human affect recognition: Insights and new developments

PV Rouast, MTP Adam, R Chiong - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
Automatic human affect recognition is a key step towards more natural human-computer
interaction. Recent trends include recognition in the wild using a fusion of audiovisual and …

Emotion recognition from physiological signal analysis: A review

M Egger, M Ley, S Hanke - Electronic Notes in Theoretical Computer …, 2019 - Elsevier
Human computer interaction is increasingly utilized in smart home, industry 4.0 and
personal health. Communication between human and computer can benefit by a flawless …

Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges

R Gravina, P Alinia, H Ghasemzadeh, G Fortino - Information Fusion, 2017 - Elsevier
Abstract Body Sensor Networks (BSNs) have emerged as a revolutionary technology in
many application domains in health-care, fitness, smart cities, and many other compelling …

Facial emotion recognition using deep learning: review and insights

W Mellouk, W Handouzi - Procedia Computer Science, 2020 - Elsevier
Automatic emotion recognition based on facial expression is an interesting research field,
which has presented and applied in several areas such as safety, health and in human …

Survey on emotional body gesture recognition

F Noroozi, CA Corneanu, D Kamińska… - IEEE transactions on …, 2018 - ieeexplore.ieee.org
Automatic emotion recognition has become a trending research topic in the past decade.
While works based on facial expressions or speech abound, recognizing affect from body …

Artificial intelligence within the interplay between natural and artificial computation: Advances in data science, trends and applications

JM Górriz, J Ramírez, A Ortiz, FJ Martinez-Murcia… - Neurocomputing, 2020 - Elsevier
Artificial intelligence and all its supporting tools, eg machine and deep learning in
computational intelligence-based systems, are rebuilding our society (economy, education …

A review of human activity recognition methods

M Vrigkas, C Nikou, IA Kakadiaris - Frontiers in Robotics and AI, 2015 - frontiersin.org
Recognizing human activities from video sequences or still images is a challenging task due
to problems, such as background clutter, partial occlusion, changes in scale, viewpoint …

Sewa db: A rich database for audio-visual emotion and sentiment research in the wild

J Kossaifi, R Walecki, Y Panagakis… - IEEE transactions on …, 2019 - ieeexplore.ieee.org
Natural human-computer interaction and audio-visual human behaviour sensing systems,
which would achieve robust performance in-the-wild are more needed than ever as digital …