Stefan Fischer, Roberto Erick Lopez-Herrejon, Alexander Egyed,
"Towards a fault-detection benchmark for evaluating software product line testing approaches"
, in Hisham M. Haddad and Roger L. Wainwright and Richard Chbeir: Proceedings of the 33rd Annual ACM Symposium on Applied Computing, SAC 2018, Pau, France, April 09-13, 2018, ACM, Seite(n) 2034-2041, 2018
Towards a fault-detection benchmark for evaluating software product line testing approaches
Sprache des Titels:
Proceedings of the 33rd Annual ACM Symposium on Applied Computing, SAC 2018, Pau, France, April 09-13, 2018
Software Product Lines (SPLs) are families of related software systems distinguished by the set of features each one provides. The commonly large number of variants that can be derived from an SPL poses a unique set of challenges, because it is not feasible to test all the individual variants. Over the last few years many approaches for SPL testing have been devised. They usually select a set of variants to test based on some covering criterion. A problem when evaluating these testing approaches is properly comparing them to one another. Even though some benchmarks have been proposed, they focus on covering criteria and do not consider fault data in their analysis. Considering the dire lack of publicly available fault data, in this paper we present the first results of our ongoing project to introduce simulated faults into SPLs along with using evolutionary techniques for synthesizing unit test cases for SPL examples.