Loading...

A weighting scheme for mining key skeletal joints for human action recognition

Shabaninia, E ; Sharif University of Technology | 2019

534 Viewed
  1. Type of Document: Article
  2. DOI: 10.1007/s11042-019-7740-z
  3. Publisher: Springer New York LLC , 2019
  4. Abstract:
  5. A novel class-dependent joint weighting method is proposed to mine the key skeletal joints for human action recognition. Existing deep learning methods or those based on hand-crafted features may not adequately capture the relevant joints of different actions which are important to recognize the actions. In the proposed method, for each class of human actions, each joint is weighted according to its temporal variations and its inherent ability in extension or flexion. These weights can be used as a prior knowledge in skeletal joints-based methods. Here, a novel human action recognition algorithm is also proposed in order to use these weights in two different ways. First, for each frame of a skeletal sequence, the histogram of 3D joints is weighted according to the contribution of joints in the corresponding class of human action. Second, a weighted motion energy function is defined to dynamically divide the temporal pyramid of actions. Experimental results on three benchmark datasets show the efficiency of proposed weighting method, especially when occlusion occurs. © 2019, Springer Science+Business Media, LLC, part of Springer Nature
  6. Keywords:
  7. Class-dependent joint weight ; Deep learning ; Graphic methods ; Benchmark datasets ; Hierarchical extended histogram (HEH) ; Human activity recognition ; Human-action recognition ; Kinect ; Temporal variation ; Weighting methods ; Musculoskeletal system
  8. Source: Multimedia Tools and Applications ; Volume 78, Issue 22 , 2019 , Pages 31319-31345 ; 13807501 (ISSN)
  9. URL: https://link.springer.com/article/10.1007/s11042-019-7740-z