Checked coverage: an indicator for oracle quality
by
David Schuler, Andreas Zeller
Software: Testing, Verification and Reliability, Pages 531-551, Volume 23, Number 7, November 2013.
Abstract
A known problem of traditional coverage metrics is that they do not assess oracle quality-that is, whether the computation result is actually checked against expectations. In this paper, we introduce the concept of checked coverage-the dynamic slice of covered statements that actually influence an oracle. Our experiments on seven open-source projects show that checked coverage is a sure indicator for oracle quality and even more sensitive than mutation testing.
Keywords
- test suite quality
- coverage metrics
- dynamic slicing
- mutation testing
BibTeX Entry
@article{schuler-stvr-2013,
title = "Checked coverage: an indicator for oracle quality",
author = "David Schuler and Andreas Zeller",
year = "2013",
month = nov,
journal = "Software: Testing, Verification and Reliability",
number = "7",
pages = "531--551",
volume = "23",
}