Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
BIND
BIND
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 628
    • Issues 628
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge Requests 112
    • Merge Requests 112
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Incidents
    • Environments
  • Packages & Registries
    • Packages & Registries
    • Container Registry
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • ISC Open Source Projects
  • BINDBIND
  • Merge Requests
  • !1428

Closed
Created Jan 30, 2019 by Evan Hunt@eachOwner
  • Report abuse
Report abuse

WIP: retry.sh: re-run only failed system tests

  • Overview 0
  • Commits 2
  • Pipelines 3
  • Changes 6

Add a method to allow certain system tests to be re-run, if they were marked as having failed in bin/tests/system/systests.output. This allows us to determine whether a test failure was transient or intermittent without having to run the entire system test job over again.

Ideally this should be run automatically from runall.sh or make test if there were any test failures in the initial test run, and it should provide an amended test summary that explicitly lists tests which failed but passed on retry, so that instability is clearly visible in test reports.

Assignee
Assign to
Reviewer
Request review from
None
Milestone
None
Assign milestone
Time tracking
Source branch: each-test-retry