Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • BIND BIND
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 590
    • Issues 590
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 97
    • Merge requests 97
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Container Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • ISC Open Source ProjectsISC Open Source Projects
  • BINDBIND
  • Merge requests
  • !1428

WIP: retry.sh: re-run only failed system tests

  • Review changes

  • Download
  • Email patches
  • Plain diff
Closed Evan Hunt requested to merge each-test-retry into master Jan 30, 2019
  • Overview 0
  • Commits 2
  • Pipelines 3
  • Changes 6

Add a method to allow certain system tests to be re-run, if they were marked as having failed in bin/tests/system/systests.output. This allows us to determine whether a test failure was transient or intermittent without having to run the entire system test job over again.

Ideally this should be run automatically from runall.sh or make test if there were any test failures in the initial test run, and it should provide an amended test summary that explicitly lists tests which failed but passed on retry, so that instability is clearly visible in test reports.

Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: each-test-retry