3D convolutional neural network with multi-model framework for action recognition

L Jing, Y Ye, X Yang, Y Tian - 2017 IEEE international …, 2017 - ieeexplore.ieee.org
2017 IEEE international conference on image processing (ICIP), 2017ieeexplore.ieee.org
In this paper, we propose an efficient and effective action recognition framework by
combining multiple feature models from dynamic image, optical flow and raw frame, with 3D
convolutional neural network (CNN). Dynamic image preserves the long-term temporal
information, while optical flow captures short-term temporal information, and raw frame
represents the appearance information. Experiments demonstrate that dynamic image
provides complementary information to raw frame feature and optical flow feature …
In this paper, we propose an efficient and effective action recognition framework by combining multiple feature models from dynamic image, optical flow and raw frame, with 3D convolutional neural network (CNN). Dynamic image preserves the long-term temporal information, while optical flow captures short-term temporal information, and raw frame represents the appearance information. Experiments demonstrate that dynamic image provides complementary information to raw frame feature and optical flow feature. Furthermore, with the approximate rank pooling, the computation of dynamic images is about 360 times faster than optical flow, and the dynamic image requires far less memory than optical flow and raw frame.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果