Loading...

Stochastic ensemble pruning method via simulated quenching walking

Taghavi, Z. S ; Sharif University of Technology | 2019

545 Viewed
  1. Type of Document: Article
  2. DOI: 10.1007/s13042-018-00912-3
  3. Publisher: Springer Verlag , 2019
  4. Abstract:
  5. Inspired by an upward stochastic walking idea, a new ensemble pruning method called simulated quenching walking (SQWALKING) is developed in this paper. The rationale behind this method is to give values to stochastic movements as well as to accept unvalued solutions during the investigation of search spaces. SQWALKING incorporates simulated quenching and forward selection methods to choose the models through the ensemble using probabilistic steps. Two versions of SQWALKING are introduced based on two different evaluation measures; SQWALKINGA that is based on an accuracy measure and SQWALKINGH that is based on a human-like foresight measure. The main objective is to construct a proper architecture of ensemble pruning, which is independent of ensemble construction and combination phases. Extensive comparisons between the proposed method and competitors in terms of heterogeneous and homogeneous ensembles are performed using ten datasets. The comparisons on the heterogeneous ensemble show that SQWALKINGH and SQWALKINGA can lead respectively to 5.13% and 4.22% average accuracy improvement. One reason for these promising results is the pruning phase that takes additional time to find the best models compared to rivals. Finally, the proposed SQWALKINGs are also evaluated on a real-world dataset. © 2019, Springer-Verlag GmbH Germany, part of Springer Nature
  6. Keywords:
  7. Ensemble pruning method ; Forward selection method ; Genetic algorithm ; Simulated annealing algorithm ; Simulated quenching algorithm ; Genetic algorithms ; Quenching ; Simulated annealing ; Accuracy Improvement ; Ensemble construction ; Ensemble pruning ; Evaluation measures ; Forward selection ; Heterogeneous ensembles ; Simulated annealing algorithms ; Simulated Quenching ; Stochastic systems
  8. Source: International Journal of Machine Learning and Cybernetics ; Volume 10, Issue 7 , 2019 , Pages 1875-1892 ; 18688071 (ISSN)
  9. URL: https://link.springer.com/article/10.1007/s13042-018-00912-3