Wearable sensor-based human activity recognition with transformer model

I Dirgová Luptáková, M Kubovčík, J Pospíchal - Sensors, 2022 - mdpi.com
Computing devices that can recognize various human activities or movements can be used
to assist people in healthcare, sports, or human–robot interaction. Readily available data for …

Physics of language models: Part 1, context-free grammar

Z Allen-Zhu, Y Li - arXiv preprint arXiv:2305.13673, 2023 - arxiv.org
We design experiments to study $\textit {how} $ generative language models, like GPT, learn
context-free grammars (CFGs)--diverse language systems with a tree-like structure capturing …

Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks

S Jain, R Kirk, ES Lubana, RP Dick, H Tanaka… - arXiv preprint arXiv …, 2023 - arxiv.org
Fine-tuning large pre-trained models has become the de facto strategy for developing both
task-specific and general-purpose machine learning systems, including developing models …

Transformer-based deep reverse attention network for multi-sensory human activity recognition

R Pramanik, R Sikdar, R Sarkar - Engineering Applications of Artificial …, 2023 - Elsevier
In today's era, one of the important applications of Artificial Intelligence (AI) is Human Activity
Recognition (HAR). It has a wide range of applicability in health monitoring for patients with …

Hybrid machine learning and deep learning models for multi-step-ahead daily reference evapotranspiration forecasting in different climate regions across the …

M Valipour, H Khoshkam, SM Bateni, C Jun… - Agricultural Water …, 2023 - Elsevier
The daily reference evapotranspiration (ET o) must be accurately forecasted to improve real-
time irrigation scheduling and decision-making for water resources allocation. In this study …

HN-PPISP: a hybrid network based on MLP-Mixer for protein–protein interaction site prediction

Y Kang, Y Xu, X Wang, B Pu, X Yang… - Briefings in …, 2023 - academic.oup.com
Motivation Biological experimental approaches to protein–protein interaction (PPI) site
prediction are critical for understanding the mechanisms of biochemical processes but are …

Transformer-based maneuvering target tracking

G Zhao, Z Wang, Y Huang, H Zhang, X Ma - Sensors, 2022 - mdpi.com
When tracking maneuvering targets, recurrent neural networks (RNNs), especially long short-
term memory (LSTM) networks, are widely applied to sequentially capture the motion states …

Fault detection and diagnosis in AHU system using deep learning approach

Y Masdoua, M Boukhnifer, KH Adjallah… - Journal of the Franklin …, 2023 - Elsevier
Energy consumption in buildings increases with the failures of equipment involved in the
energy exchange, and control networks in buildings. One of the ways to remedy this issue is …

Everyone's preference changes differently: A weighted multi-interest model for retrieval

H Shi, Y Gu, Y Zhou, B Zhao, S Gao… - … on Machine Learning, 2023 - proceedings.mlr.press
User embeddings (vectorized representations of a user) are essential in recommendation
systems. Numerous approaches have been proposed to construct a representation for the …

LUNA: A Model-Based Universal Analysis Framework for Large Language Models

D Song, X Xie, J Song, D Zhu, Y Huang… - IEEE Transactions …, 2024 - ieeexplore.ieee.org
Over the past decade, Artificial Intelligence (AI) has had great success recently and is being
used in a wide range of academic and industrial fields. More recently, Large Language …