Loading...

A uniformization-based algorithm for continuous-time stochastic games model checking

Baghoolizadeh, S ; Sharif University of Technology | 2019

289 Viewed
  1. Type of Document: Article
  2. DOI: 10.1016/j.tcs.2018.10.009
  3. Publisher: Elsevier B.V , 2019
  4. Abstract:
  5. Continuous-time Stochastic Game (CTSG) can be seen as a proper model to analyze probabilistic, non-deterministic, and competitive behaviors as found in Stochastic Multi-Player Game (SMG). The difference is that in an SMG the system under design is analyzed in the discrete-time setting. In comparison, in a CTSG, the system transitions occur in the continuous-time setting with exponentially distributed delays. This paper focuses on the model checking of CTSGs and presents a uniformization-based algorithm, called TPA, to approximate the time-bounded reachability probabilities with an arbitrary error bound. We concentrate on CTSGs with bounded transition rates. To illustrate the strength points of our algorithm, we have implemented it in Java, developed some large examples, and compared our results with the ones from an existing algorithm which is based on discretization. In order to express properties specifying these types of probabilities in the continuous-time setting, we adjusted the existing temporal logic, PATL. Thus, properties like the following can be stated and checked over a CTSG: “A coalition of players has a strategy to guarantee to reach the target states within time bound t∈Q⩾0 with a probability equal to or greater than threshold P, regardless of the other players’ behaviors.” © 2018 Elsevier B.V
  6. Keywords:
  7. Continuous-time Markov game ; Continuous-time stochastic game ; Time-bounded reachability probability ; Continuous time systems ; Game theory ; Model checking ; Probability ; Stochastic systems ; Competitive behavior ; Distributed delays ; Markov games ; Multiplayer games ; Probabilistic model checking ; Stochastic game ; System transitions ; Time-bounded reachability ; Stochastic models
  8. Source: Theoretical Computer Science ; Volume 756 , 2019 , Pages 1-18 ; 03043975 (ISSN)
  9. URL: https://www.sciencedirect.com/science/article/abs/pii/S0304397518306145