kasp system test intermittent test failures for "rumoured.kasp" zone
Some checks recently added to the kasp
system test fail very often as
they do not tolerate certain events taking more than 1 second to happen:
I:kasp:check key timing metadata for key KEY1 id 49258 zone rumoured.kasp (110)
I:kasp:check key timing metadata for key KEY2 id 10506 zone rumoured.kasp (111)
I:kasp:check key timing metadata for key KEY3 id 25185 zone rumoured.kasp (112)
I:kasp:error: mismatch publish comment in ns3/Krumoured.kasp.+005+25185.key (expected 20200615091205)
I:kasp:error: mismatch publish in ns3/Krumoured.kasp.+005+25185.private (expected 20200615091205)
I:kasp:error: mismatch publish in ns3/Krumoured.kasp.+005+25185.state (expected 20200615091205)
I:kasp:error: mismatch active comment in ns3/Krumoured.kasp.+005+25185.key (expected 20200616091205)
I:kasp:error: mismatch active in ns3/Krumoured.kasp.+005+25185.private (expected 20200616091205)
I:kasp:error: mismatch active in ns3/Krumoured.kasp.+005+25185.state (expected 20200616091205)
I:kasp:error: mismatch retired comment in ns3/Krumoured.kasp.+005+25185.key (expected 20210616091205)
I:kasp:error: mismatch retired in ns3/Krumoured.kasp.+005+25185.private (expected 20210616091205)
I:kasp:error: mismatch retired in ns3/Krumoured.kasp.+005+25185.state (expected 20210616091205)
I:kasp:error: mismatch removed comment in ns3/Krumoured.kasp.+005+25185.key (expected 20210626101705)
I:kasp:error: mismatch removed in ns3/Krumoured.kasp.+005+25185.private (expected 20210626101705)
I:kasp:error: mismatch removed in ns3/Krumoured.kasp.+005+25185.state (expected 20210626101705)
I:kasp:failed
Meanwhile, in the artifacts:
$ cat bin/tests/system/kasp/ns3/Krumoured.kasp.+005+25185.key
; This is a zone-signing key, keyid 25185, for rumoured.kasp.
; Created: 20200615091204 (Mon Jun 15 09:12:04 2020)
; Publish: 20200615091204 (Mon Jun 15 09:12:04 2020)
; Activate: 20200616091204 (Tue Jun 16 09:12:04 2020)
; Inactive: 20210616091204 (Wed Jun 16 09:12:04 2021)
; Delete: 20210626101704 (Sat Jun 26 10:17:04 2021)
rumoured.kasp. 1234 IN DNSKEY 256 3 5 AwEAAbmPnkXcnAF0iTlpP57eQnoDD05ldTahTcUkOUVaeRqF1gSpYYU6 zp9mQrmYty57kLYe7EuG6xbPHIK2DT+7sAQxGM+J+oFLxFKkxCQE+Cm6 ubhaZZ5sbBpwQMy06iuZFJ3pNFT2Q1FzIz4zCjqbnupySShsC34SsvGT zgExa/73Jy9f7k8/8JT12mbcNYByamiSnvHzMTdyqGA/jiruRPRApgYG +Gh+nS0inf5r9pX/rzu54XrZ/n8CNYAYvp2wWgIO6uWJvDgj2oszgKn4 HUTsS/x6hu+CHiFeSOZPAyW2fXVRUTqARnDzLedyupO3WNgRVipBtE/X iwE=
Example instances of this failure mode taken from just one pipeline:
Edited by Matthijs Mekking