Assessing Oracle Quality with Checked Coverage
- ICST 2011
by
David Schuler, Andreas Zeller
ICST '11: Proceedings of the 4th International Conference on Software Testing, Verification and Validation, March 2011.
Abstract
A known problem of traditional coverage metrics is that they do not assess oracle quality - that is, whether the computation result is actually checked against expectations. In this paper, we introduce the concept of checked coverage - the dynamic slice of covered statements that actually influence an oracle. Our experiments on seven open-source projects show that checked coverage is a sure indicator for oracle quality - and even more sensitive than mutation testing, its much more demanding alternative.
BibTeX Entry
@inproceedings{schuler-icst-2011, title = "Assessing Oracle Quality with Checked Coverage", author = "David Schuler and Andreas Zeller", year = "2011", month = mar, booktitle = "ICST '11: Proceedings of the 4th International Conference on Software Testing, Verification and Validation", location = "Berlin, Germany", }