Loading...

Program state coverage: A test coverage metric based on executed program states

Etemadi Someoliayi, K ; Sharif University of Technology | 2019

257 Viewed
  1. Type of Document: Article
  2. DOI: 10.1109/SANER.2019.8667968
  3. Publisher: Institute of Electrical and Electronics Engineers Inc , 2019
  4. Abstract:
  5. In software testing, different metrics are proposed to predict and compare test suites effectiveness. In this regard, Mutation Score (MS) is one of most accurate metrics. However, calculating MS needs executing test suites many times and it is not commonly used in industry. On the other hand, Line Coverage (LC) is a widely used metric which is calculated by executing test suites only once, although it is not as accurate as MS in terms of predicting and comparing test suites effectiveness. In this paper, we propose a novel test coverage metric, called Program State Coverage (PSC), which improves the accuracy of LC. PSC works almost the same as LC and it can be calculated by executing test suites only once. However, it further considers the number of distinct program states in which each line is executed. Our experiments on 120 test suites from four packages of Apache Commons Math and Apache Commons Lang show that, compared to LC, PSC is more strongly correlated with normalized MS. As a result, we conclude that PSC is a promising test coverage metric. © 2019 IEEE
  6. Keywords:
  7. Line Coverage ; Mutation Score ; Program State Coverage ; Software Testing ; Test Suite Effectiveness ; Reengineering ; Testing ; Distinct programs ; Program state ; Test coverage
  8. Source: 26th IEEE International Conference on Software Analysis, Evolution, and Reengineering, SANER 2019, 24 February 2019 through 27 February 2019 ; 2019 , Pages 584-588 ; 9781728105918 (ISBN)
  9. URL: https://ieeexplore.ieee.org/document/8667968