查看文章

Human activity recognition has a significant impact on people’s daily lives. The need to infer human activities is prominent in many human-centric applications, such as healthcare and individual assistance. In this article, we introduce a noninvasive human activity recognition system that utilizes footstep-induced vibration and sound in an outdoor environment with the aim of achieving improved performance over a single source of information. We employ 1-D convolutional neural networks (1-D CNNs) for automated feature extraction, fusion, and activity recognition on a nine-class classification problem. The proposed framework reports an average F1 score of 92%, which corresponds to a 5.74% improvement over the best-performing state-of-the-art. Confusion matrix-based analysis demonstrates that audio-seismic fusion not only reduces misclassifications, but also reduces the impact of background noise on model …