Loading...

A sampling method based on distributed learning automata for solving stochastic shortest path problem

Beigy, H ; Sharif University of Technology | 2021

313 Viewed
  1. Type of Document: Article
  2. DOI: 10.1016/j.knosys.2020.106638
  3. Publisher: Elsevier B.V , 2021
  4. Abstract:
  5. This paper studies an iterative stochastic algorithm for solving the stochastic shortest path problem. This algorithm, which uses a distributed learning automata, tries to find the shortest path by taking a sufficient number of samples from the edges of the graph. In this algorithm, which edges to be sampled are determined dynamically as the algorithm proceeds. At each iteration of this algorithm, a distributed learning automata used to determine which edges to be sampled. This sampling method, which uses distributed learning automata, reduces the number of samplings from those edges, which may not be along the shortest path, and resulting in a reduction in the number of the edges to be sampled. In this paper, we propose a new method for analysis of the algorithm. The method proposed in this paper, unlike the previous ones, which were based on the Martingale theory, is based on the sampling. The proof given in this paper, unlike the previous ones, which were for a specific input graph, is not restricted to the input graph and is general. We also show that as the number of samples taken from the edges increases, the probability of finding the shortest path also increases. Experimental results obtained from some benchmark stochastic graphs and some random graphs also confirm the theoretical results. © 2020 Elsevier B.V
  6. Keywords:
  7. Automata theory ; Graph algorithms ; Iterative methods ; Learning algorithms ; Learning systems ; Robots ; Stochastic systems ; Distributed learning automaton ; Martingale theory ; Number of samples ; Random graphs ; Sampling method ; Stochastic algorithms ; Stochastic graphs ; Stochastic Shortest Path Problem ; Graph theory
  8. Source: Knowledge-Based Systems ; Volume 212 , 2021 ; 09507051 (ISSN)
  9. URL: https://www.sciencedirect.com/science/article/pii/S095070512030767X?via%3Dihub