Entropy-based test generation for improved fault localization

Citation:
Campos JC, Abreu R, Fraser G, d'Amorim M.  2013.  Entropy-based test generation for improved fault localization. IEEE/ACM 28th International Conference on Automated Software Engineering - ASE). :257–267.

Date Presented:

November

Abstract:

Spectrum-based Bayesian reasoning can effectively rank candidate fault locations based on passing/failing test cases, but the diagnostic quality highly depends on the size and diversity of the underlying test suite. As test suites in practice often do not exhibit the necessary properties, we present a technique to extend existing test suites with new test cases that optimize the diagnostic quality. We apply probability theory concepts to guide test case generation using entropy, such that the amount of uncertainty in the diagnostic ranking is minimized. Our ENTBUG prototype extends the search-based test generation tool EVOSUITE to use entropy in the fitness function of its underlying genetic algorithm, and we applied it to seven real faults. Empirical results show that our approach reduces the entropy of the diagnostic ranking by 49% on average (compared to using the original test suite), leading to a 91% average reduction of diagnosis candidates needed to inspect to find the true faulty one.

Citation Key:

campos2013entropy

DOI:

10.1109/ASE.2013.6693085

PreviewAttachmentSize
campos-etal-ase2013.pdf482.48 KB