Assessing Oracle Quality with Checked Coverage - ICST 2011
by David Schuler, Andreas Zeller

ICST '11: Proceedings of the 4th International Conference on Software Testing, Verification and Validation, March 2011.

Download as PDF file.

Abstract

A known problem of traditional coverage metrics is that they do not assess oracle quality - that is, whether the computation result is actually checked against expectations. In this paper, we introduce the concept of checked coverage - the dynamic slice of covered statements that actually influence an oracle. Our experiments on seven open-source projects show that checked coverage is a sure indicator for oracle quality - and even more sensitive than mutation testing, its much more demanding alternative.

BibTeX Entry

@inproceedings{schuler-icst-2011,
    title = "Assessing Oracle Quality with Checked Coverage",
    author = "David Schuler and Andreas Zeller",
    year = "2011",
    month = mar,
    booktitle = "ICST '11: Proceedings of the 4th International Conference on Software Testing, Verification and
Validation",
    location = "Berlin, Germany",
}

Show all publications of the Software Engineering Chair.