Loading...

A non-linear mapping representing human action recognition under missing modality problem in video data

Gharahdaghi, A ; Sharif University of Technology | 2021

319 Viewed
  1. Type of Document: Article
  2. DOI: 10.1016/j.measurement.2021.110123
  3. Publisher: Elsevier B.V , 2021
  4. Abstract:
  5. Human action recognition by using standard video files is a well-studied problem in the literature. In this study, we assume to have access to single modality standard data of some actions (training data). Based on this data, we aim at identifying the actions that are present in a target modality video data without any explicit source–target relationship information. In this case, the training and test phases of the recognition task are based on different imaging modalities. Our goal in this paper is to introduce a mapping (a nonlinear operator) on both modalities such that the outcome shares some common features. These common features were then used to recognize the actions in each domain. Simulation results on MSRDailyActivity3D, MSRActionPairs, UTKinect-Action3D, and SBU Kinect interaction datasets showed that the introduced method outperforms state-of-the art methods with a success rate margin of 15% on average. © 2021 Elsevier Ltd
  6. Keywords:
  7. Mapping ; Mathematical operators ; Common features ; Human-action recognition ; Missing modality ; Nonlinear mappings ; RGB-D data ; Test phasis ; Training data ; Training phasis ; Video data ; Video files ; Video recording
  8. Source: Measurement: Journal of the International Measurement Confederation ; Volume 186 , 2021 ; 02632241 (ISSN)
  9. URL: https://www.sciencedirect.com/science/article/abs/pii/S0263224121010411