A Theoretical and Empirical Study of Diversity-aware Mutation Adequacy Criterion

Cited 2 time in webofscience Cited 0 time in scopus
  • Hit : 105
  • Download : 0
Diversity has been widely studied in software testing as a guidance towards effective sampling of test inputs in the vast space of possible program behaviors. However, diversity has received relatively little attention in mutation testing. The traditional mutation adequacy criterion is a one-dimensional measure of the total number of killed mutants. We propose a novel, diversity-aware mutation adequacy criterion called distinguishing mutation adequacy criterion, which is fully satisfied when each of the considered mutants can be identified by the set of tests that kill it, thereby encouraging inclusion of more diverse range of tests. This paper presents the formal definition of the distinguishing mutation adequacy and its score. Subsequently, an empirical study investigates the relationship among distinguishing mutation score, fault detection capability, and test suite size. The results show that the distinguishing mutation adequacy criterion detects 1.33 times more unseen faults than the traditional mutation adequacy criterion, at the cost of a 1.56 times increase in test suite size, for adequate test suites that fully satisfies the criteria. The results show a better picture for inadequate test suites; on average, 8.63 times more unseen faults are detected at the cost of a 3.14 times increase in test suite size.
Publisher
IEEE COMPUTER SOC
Issue Date
2018-10
Language
English
Article Type
Article
Keywords

2ND-ORDER MUTATION; TESTS; GENERATION; OPERATORS; COVERAGE; MUTANTS; FAULTS

Citation

IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, v.44, no.10, pp.914 - 931

ISSN
0098-5589
DOI
10.1109/TSE.2017.2732347
URI
http://hdl.handle.net/10203/246717
Appears in Collection
CS-Journal Papers(저널논문)
Files in This Item
There are no files associated with this item.
This item is cited by other documents in WoS
⊙ Detail Information in WoSⓡ Click to see webofscience_button
⊙ Cited 2 items in WoS Click to see citing articles in records_button

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0