Loading...

Sparsness embedding in bending of space and time; a case study on unsupervised 3D action recognition

Mohammadzade, H ; Sharif University of Technology | 2020

309 Viewed
  1. Type of Document: Article
  2. DOI: 10.1016/j.jvcir.2019.102691
  3. Publisher: Academic Press Inc , 2020
  4. Abstract:
  5. Human action recognition from skeletal data is one of the most popular topics in computer vision which has been widely studied in the literature, occasionally with some very promising results. However, being supervised, most of the existing methods suffer from two major drawbacks; (1) too much reliance on massive labeled data and (2) high sensitivity to outliers, which in turn hinder their applications in such real-world scenarios as recognizing long-term and complex movements. In this paper, we propose a novel unsupervised 3D action recognition method called Sparseness Embedding in which the spatiotemporal representation of action sequences is nonlinearly projected into an unwarped feature representation medium, where unlike the original curved space, one can easily apply the Euclidean metrics. Our strategy can simultaneously integrate the characteristics of nonlinearity, sparsity, and space curvature of sequences into a single objective function, leading to a more robust and highly compact representation of discriminative attributes without any need to label information. Moreover, we propose a joint learning strategy for dealing with the heterogeneity of the temporal and spatial characteristics of action sequences. A set of extensive experiments on six publicly available databases, including UTKinect, TST fall, UTD-MHAD, CMU, Berkeley MHAD, and NTU RGB+D demonstrates the superiority of our method compared with the state-of-the-art algorithms. © 2019 Elsevier Inc
  6. Keywords:
  7. Human computer interaction ; Sparseness embedding ; Time series analysis ; Unsupervised action recognition ; Embeddings ; Action recognition ; Compact representation ; Feature representation ; Human-action recognition ; Real-world scenario ; State-of-the-art algorithms ; Temporal and spatial
  8. Source: Journal of Visual Communication and Image Representation ; Volume 66 , January , 2020
  9. URL: https://www.sciencedirect.com/science/article/abs/pii/S1047320319303128