[HTML][HTML] Multimodal model with text and drug embeddings for adverse drug reaction classification

A Sakhovskiy, E Tutubalina - Journal of Biomedical Informatics, 2022 - Elsevier
In this paper, we focus on the classification of tweets as sources of potential signals for
adverse drug effects (ADEs) or drug reactions (ADRs). Following the intuition that text and …

Hsemotion team at the 6th abaw competition: Facial expressions, valence-arousal and emotion intensity prediction

AV Savchenko - arXiv preprint arXiv:2403.11590, 2024 - arxiv.org
This article presents our results for the sixth Affective Behavior Analysis in-the-wild (ABAW)
competition. To improve the trustworthiness of facial analysis, we study the possibility of …

Against opacity: Explainable ai and large language models for effective digital advertising

Q Yang, M Ongpin, S Nikolenko, A Huang… - Proceedings of the 31st …, 2023 - dl.acm.org
The opaqueness of modern digital advertising, exemplified by platforms such as Meta Ads,
raises concerns regarding their autonomous control over audience targeting, pricing …

Monovan: Visual attention for self-supervised monocular depth estimation

I Indyk, I Makarov - … on Mixed and Augmented Reality (ISMAR), 2023 - ieeexplore.ieee.org
Depth estimation is crucial in various computer vision applications, including autonomous
driving, robotics, and virtual and augmented reality. An accurate scene depth map is …

HSE-NN team at the 4th ABAW competition: multi-task emotion recognition and learning from synthetic images

AV Savchenko - arXiv preprint arXiv:2207.09508, 2022 - arxiv.org
In this paper, we present the results of the HSE-NN team in the 4th competition on Affective
Behavior Analysis in-the-wild (ABAW). The novel multi-task EfficientNet model is trained for …

Layerwise universal adversarial attack on NLP models

O Tsymboi, D Malaev, A Petrovskii… - Findings of the …, 2023 - aclanthology.org
In this work, we examine the vulnerability of language models to universal adversarial
triggers (UATs). We propose a new white-box approach to the construction of layerwise …

Sequential analysis in Fourier probabilistic neural networks

AV Savchenko, NS Belova - Expert Systems with Applications, 2022 - Elsevier
In this paper, the computational complexity of the probabilistic neural network for the
classification of high-dimensional data is improved. At first, the class probability densities are …

A video is worth 4096 tokens: Verbalize videos to understand them in zero shot

A Bhattacharya, YK Singla, B Krishnamurthy… - arXiv preprint arXiv …, 2023 - arxiv.org
Multimedia content, such as advertisements and story videos, exhibit a rich blend of
creativity and multiple modalities. They incorporate elements like text, visuals, audio, and …

SOMONITOR: Explainable marketing data processing and analysis with large language models

Q Yang, S Nikolenko, M Ongpin, I Gossoudarev… - arXiv preprint arXiv …, 2024 - arxiv.org
Online marketing faces formidable challenges in managing and interpreting immense
volumes of data necessary for competitor analysis, content research, and strategic branding …

Audio-visual continuous recognition of emotional state in a multi-user system based on personalized representation of facial expressions and voice

AV Savchenko, LV Savchenko - Pattern Recognition and Image Analysis, 2022 - Springer
This paper is devoted to tracking dynamics of psycho-emotional state based on analysis of
the user's facial video and voice. We propose a novel technology with personalized acoustic …