Verified Commit 9998409c authored byBrowse files
Add pairwise testing of configure options
Pairwise testing is a test case generation technique based on the observation that most faults are caused by interactions of at most two factors. When testing partition creating software those factors may be Type, Size, Format method, File system, and Compression. For BIND ./configure, we don't have such distinct factors. We could divide ./configure options to libraries (--with-zlib) and the rest. But this seems too artificial. Instead I scrape all custom BIND options introduced by AS_HELP_STRING, clean, shuffle and divide them by group of five. While treating each quintet as a distinct factor this model is processed by the PICT tool, which finds an effective test vector, which is then executed in parallel. The test vector is limited by previous artificial grouping by five options and thus does not provide complete test coverage of ./configure options, but when run via the 'pairwise:configure' job enough times, all combinations will be performed.
Showing with 65 additions and 0 deletions