Loading...

Improved K2 algorithm for Bayesian network structure learning

Behjati, S ; Sharif University of Technology | 2020

599 Viewed
  1. Type of Document: Article
  2. DOI: 10.1016/j.engappai.2020.103617
  3. Publisher: Elsevier Ltd , 2020
  4. Abstract:
  5. In this paper, we study the problem of learning the structure of Bayesian networks from data, which takes a dataset and outputs a directed acyclic graph. This problem is known to be NP-hard. Almost most of the existing algorithms for structure learning can be classified into three categories: constraint-based, score-based, and hybrid methods. The K2 algorithm, as a score-based algorithm, takes a random order of variables as input and its efficiency is strongly dependent on this ordering. Incorrect order of variables can lead to learning an incorrect structure. Therefore, the main challenge of this algorithm is strongly dependency of output quality on the initial order of variables. The main contribution of this paper is to derive a significant order of variables from the given dataset. Also, one of the significant challenges of structure learning is to find a practical structure learning approach to learn an optimal structure from complex and high-dimensional datasets in a reasonable time. We propose a new fast and straightforward algorithm for addressing this problem in a reasonable time. The proposed algorithm is based on an ordering by extracting strongly connected components of the graph built from data. We reduce the super-exponential search space of structures to the smaller space of nodes ordering. We evaluated the proposed algorithm using some standard benchmark datasets and compare the results with the results obtained from some state of the art algorithms. Finally, we show that the proposed algorithm is competitive with some algorithms for structure learning. © 2020 Elsevier Ltd
  6. Keywords:
  7. Bayesian network ; Constraint-based algorithm ; Score-based algorithms ; Structure learning ; Bayesian networks ; Directed graphs ; Graph algorithms ; Graph structures ; Structural optimization ; Bayesian network structure ; Benchmark datasets ; Constraint-based ; Directed acyclic graph (DAG) ; High dimensional datasets ; State-of-the-art algorithms ; Strongly connected component ; Structure-learning ; Learning algorithms
  8. Source: Engineering Applications of Artificial Intelligence ; Volume 91 , 2020
  9. URL: https://www.sciencedirect.com/science/article/abs/pii/S095219762030083X