Knowledge-infused self attention transformers

K Roy, Y Zi, V Narayanan, M Gaur, A Sheth - arXiv preprint arXiv …, 2023 - arxiv.org
Transformer-based language models have achieved impressive success in various natural
language processing tasks due to their ability to capture complex dependencies and …

KSAT: Knowledge-infused Self Attention Transformer--Integrating Multiple Domain-Specific Contexts

K Roy, Y Zi, V Narayanan, M Gaur, A Sheth - arXiv preprint arXiv …, 2022 - arxiv.org
Domain-specific language understanding requires integrating multiple pieces of relevant
contextual information. For example, we see both suicide and depression-related behavior …

IERL: Interpretable Ensemble Representation Learning--Combining CrowdSourced Knowledge and Distributed Semantic Representations

Y Zi, K Roy, V Narayanan, M Gaur, A Sheth - arXiv preprint arXiv …, 2023 - arxiv.org
Large Language Models (LLMs) encode meanings of words in the form of distributed
semantics. Distributed semantics capture common statistical patterns among language …

Healthcare Assistance Challenges-Driven Neurosymbolic AI

K Roy - Biomedical Journal of Scientific &Technical …, 2024 - scholarcommons.sc.edu
Abstract Although Artificial Intelligence technology has proven effective in providing
healthcare assistance by analyzing health data, it still falls short in supporting decision …

Ontolog Summit 2024 Talk Report: Healthcare Assistance Challenges-Driven Neurosymbolic AI

K Roy - 2024 - scholarcommons.sc.edu
Abstract Although Artificial Intelligence technology has proven effective in providing
healthcare assistance by analyzing health data, it still falls short in supporting decision …

Knowledge-infused Reinforcement Learning

K Roy, M Gaur, Q Zhang, A Sheth - 2022 - scholarcommons.sc.edu
Virtual health agents (VHAs) have received considerable attention, but the early focus has
been on collecting data, helping patients follow generic health guidelines, and providing …

ACM web conference 2023

U Lokala, K Roy, U Jaimini, A Sheth - 2023 - scholarcommons.sc.edu
Improving the performance and explanations of ML algorithms is a priority for adoption by
humans in the real world. In critical domains such as healthcare, such technology has …