التفاصيل البيبلوغرافية
| العنوان: |
Augmented Skeleton Based Contrastive Action Learning with Momentum LSTM for Unsupervised Action Recognition. |
| المؤلفون: |
Rao, Haocong1,2 (AUTHOR) hc.rao@siat.ac.cn, Xu, Shihao1,2 (AUTHOR) xushh16@lzu.edu.cn, Hu, Xiping1,2 (AUTHOR) huxp@lzu.edu.cn, Cheng, Jun1,2 (AUTHOR) jun.cheng@siat.ac.cn, Hu, Bin1 (AUTHOR) bh@lzu.edu.cn |
| المصدر: |
Information Sciences. Aug2021, Vol. 569, p90-109. 20p. |
| مصطلحات موضوعية: |
ACTIVE learning, SKELETON, MOVING average process, SUPERVISED learning, DEEP learning, HUMAN behavior, OBJECT recognition (Computer vision) |
| مستخلص: |
Action recognition via 3D skeleton data is an emerging important topic. Most existing methods rely on hand-crafted descriptors to recognize actions, or perform supervised action representation learning with massive labels. In this paper, we for the first time propose a contrastive action learning paradigm named AS-CAL that exploits different augmentations of unlabeled skeleton sequences to learn action representations in an unsupervised manner. Specifically, we first propose to contrast similarity between augmented instances of the input skeleton sequence, which are transformed with multiple novel augmentation strategies, to learn inherent action patterns (" pattern-invariance ") in different skeleton transformations. Second, to encourage learning the pattern-invariance with more consistent action representations, we propose a momentum LSTM, which is implemented as the momentum-based moving average of LSTM based query encoder, to encode long-term action dynamics of the key sequence. Third, we introduce a queue to store the encoded keys, which allows flexibly reusing proceeding keys to build a consistent dictionary to facilitate contrastive learning. Last, we propose a novel representation named Contrastive Action Encoding (CAE) to represent human's action effectively. Empirical evaluations show that our approach significantly outperforms hand-crafted methods by 10–50% Top-1 accuracy, and it can even achieve superior performance to many supervised learning methods (Our codes are available at https://github.com/Mikexu007/AS-CALTest). [ABSTRACT FROM AUTHOR] |
|
Copyright of Information Sciences is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| قاعدة البيانات: |
Business Source Index |
