Assessing Oracle Quality with Checked Coverage
- ICST 2011
by
David Schuler, Andreas Zeller
ICST '11: Proceedings of the 4th International Conference on Software Testing, Verification and Validation, March 2011.
Abstract
A known problem of traditional coverage metrics is that they do not assess oracle quality - that is, whether the computation result is actually checked against expectations. In this paper, we introduce the concept of checked coverage - the dynamic slice of covered statements that actually influence an oracle. Our experiments on seven open-source projects show that checked coverage is a sure indicator for oracle quality - and even more sensitive than mutation testing, its much more demanding alternative.
BibTeX Entry
@inproceedings{schuler-icst-2011,
title = "Assessing Oracle Quality with Checked Coverage",
author = "David Schuler and Andreas Zeller",
year = "2011",
month = mar,
booktitle = "ICST '11: Proceedings of the 4th International Conference on Software Testing, Verification and
Validation",
location = "Berlin, Germany",
}