Loading...

Path planning of modular robots on various terrains using Q-learning versus optimization algorithms

Haghzad Klidbary, S ; Sharif University of Technology | 2017

585 Viewed
  1. Type of Document: Article
  2. DOI: 10.1007/s11370-017-0217-x
  3. Publisher: Springer Verlag , 2017
  4. Abstract:
  5. Self-reconfigurable modular robots (SRMRs) have recently attracted considerable attention because of their numerous potential applications in the real world. In this paper, we draw a comprehensive comparison among five different algorithms in path planning of a novel SRMR system called ACMoD through an environment comprised of various terrains in a static condition. The contribution of this work is that the reconfiguration ability of ACMoD has been taken into account. This consideration, though raises new algorithmic challenges, equips the robot with new capability to pass difficult terrains rather than bypassing them, and consequently the robot can achieve better performance in terms of traversal time and energy consumption. In this work, four different optimization algorithms, including Adaptive Genetic Algorithm, Elitist Ant System, Dijkstra and Dynamic Weighting A*, along with a well-known reinforcement learning algorithm called Q-Learning, are proposed to solve this path planning problem. The outputs of these algorithms are the optimal path through the environment and the associated configuration on each segment of the path. The challenges involved in mapping the path planning problem to each algorithm are discussed in full details. Eventually, all algorithms are compared in terms of the quality of their solutions and convergence rate. © 2017, Springer-Verlag Berlin Heidelberg
  6. Keywords:
  7. Adaptive genetic algorithm (AGA) ; Dijkstra ; Dynamic weighting A* (DWA*) ; Elitist ant system (EAS) ; Q-Learning ; Robot path planning (RPP) ; Self-reconfigurable modular robots (SRMRs) ; Energy utilization ; Genetic algorithms ; Modular robots ; Motion planning ; Optimization ; Reinforcement learning ; Robot programming ; Robots ; Adaptive genetic algorithms ; Ant systems ; Robot path-planning ; Self-reconfigurable modular robots ; Learning algorithms
  8. Source: Intelligent Service Robotics ; Volume 10, Issue 2 , 2017 , Pages 121-136 ; 18612776 (ISSN)
  9. URL: https://link.springer.com/article/10.1007/s11370-017-0217-x