Hierarchical Recurrent Neural Network For Skeleton Based Action Recognition
2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)(2015)
摘要
Human actions can be represented by the trajectories of skeleton joints. Traditional methods generally model the spatial structure and temporal dynamics of human skeleton with hand-crafted features and recognize human actions by well-designed classifiers. In this paper, considering that recurrent neural network (RNN) can model the long-term contextual information of temporal sequences well, we propose an end-to-end hierarchical RNN for skeleton based action recognition. Instead of taking the whole skeleton as the input, we divide the human skeleton into five parts according to human physical structure, and then separately feed them to five subnets. As the number of layers increases, the representations extracted by the subnets are hierarchically fused to be the inputs of higher layers. The final representations of the skeleton sequences are fed into a single-layer perceptron, and the temporally accumulated output of the perceptron is the final decision. We compare with five other deep RNN architectures derived from our model to verify the effectiveness of the proposed network, and also compare with several other methods on three publicly available datasets. Experimental results demonstrate that our model achieves the state-of-the-art performance with high computational efficiency.
更多查看译文
关键词
hierarchical recurrent neural network,end-to-end hierarchical RNN,skeleton based action recognition,subnet representation extraction,single-layer perceptron,deep RNN architectures,temporal sequences
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络