CI job timeout while system tests were running
The CI job 2471391 reached a CI job timeout while four system test were running.
It's like #3272 (closed) but the failed CI job did not happen in ASAN/TSAN environment but on OpenBSD and the shutdown
system pytest actually passed.
$ curl -sSL https://gitlab.isc.org/isc-projects/bind9/-/jobs/2471391/raw | grep '^[SR]:' | cut -d: -f2 | sort | uniq -c | awk '$1 != "2" { print }'
1 forward
1 geoip2
1 inline
1 kasp
The job started at 6:07, last system test time stamp is from 6:15:53:
$ curl -sSL https://gitlab.isc.org/isc-projects/bind9/-/jobs/2471391/raw | grep -P '^(S|E):.*:'
S:logfileconfig:2022-04-27T06:08:03+0000
S:keymgr:2022-04-27T06:08:03+0000
S:coverage:2022-04-27T06:08:03+0000
S:cookie:2022-04-27T06:08:03+0000
...
E:ixfr:2022-04-27T06:15:53+0000
S:forward:2022-04-27T06:15:53+0000
S:forward:2022-04-27T06:15:53+0000
T:forward:1:A
A:forward:System test forward
I:forward:PORTRANGE:8200 - 8299
I:forward:starting servers
S:geoip2:2022-04-27T06:15:45+0000
T:geoip2:1:A
A:geoip2:System test geoip2
I:geoip2:PORTRANGE:8300 - 8399
I:geoip2:starting servers
I:geoip2:checking that conf/good-options.conf is accepted (1)
I:geoip2:checking that conf/bad-areacode.conf is rejected (2)
I:geoip2:checking that conf/bad-dbname.conf is rejected (3)
I:geoip2:checking that conf/bad-netspeed.conf is rejected (4)
I:geoip2:checking that conf/bad-regiondb.conf is rejected (5)
I:geoip2:checking that conf/bad-threeletter.conf is rejected (6)
I:geoip2:checking Country database by code using IPv4 (7)
I:geoip2:checking Country database by code using IPv6 (8)
I:geoip2:reloading server
I:geoip2:ns2 server reload successful
I:geoip2:checking Country database with nested ACLs using IPv4 (9)
I:geoip2:checking Country database with nested ACLs using IPv6 (10)
I:geoip2:reloading server
I:geoip2:ns2 server reload successful
I:geoip2:checking Country database by name using IPv4 (11)
I:geoip2:checking Country database by name using IPv6 (12)
I:geoip2:reloading server
I:geoip2:ns2 server reload successful
I:geoip2:checking Country database by continent code using IPv4 (13)
S:inline:2022-04-27T06:15:29+0000
T:inline:1:A
A:inline:System test inline
I:inline:PORTRANGE:8600 - 8699
I:inline:starting servers
I:inline:checking that an unsupported algorithm is not used for signing (1)
I:inline:checking that rrsigs are replaced with ksk only (2)
I:inline:checking that the zone is signed on initial transfer (3)
I:inline:checking expired signatures are updated on load (4)
I:inline:checking removal of private type record via 'rndc signing -clear' (5)
I:inline:checking private type was properly signed (6)
I:inline:checking removal of remaining private type record via 'rndc signing -clear all' (7)
I:inline:checking negative private type response was properly signed (8)
I:inline:checking that the record is added on the hidden primary (9)
I:inline:checking that update has been transferred and has been signed (10)
I:inline:checking YYYYMMDDVV (2011072400) serial on hidden primary (11)
I:inline:checking YYYYMMDDVV (2011072400) serial in signed zone (12)
I:inline:checking that the zone is signed on initial transfer, noixfr (13)
I:inline:checking that the record is added on the hidden primary, noixfr (14)
I:inline:checking that update has been transferred and has been signed, noixfr (15)
I:inline:checking YYYYMMDDVV (2011072400) serial on hidden primary, noixfr (16)
I:inline:checking YYYYMMDDVV (2011072400) serial in signed zone, noixfr (17)
I:inline:checking that the primary zone signed on initial load (18)
I:inline:checking removal of private type record via 'rndc signing -clear' (primary) (19)
I:inline:checking private type was properly signed (primary) (20)
I:inline:checking removal of remaining private type record via 'rndc signing -clear' (primary) (21)
I:inline:check adding of record to unsigned primary (22)
I:inline:ns3 zone reload queued
I:inline:check adding record fails when SOA serial not changed (23)
I:inline:ns3 server reload successful
I:inline:check adding record works after updating SOA serial (24)
kasp
S:kasp:2022-04-27T06:15:07+0000
T:kasp:1:A
A:kasp:System test kasp
I:kasp:PORTRANGE:9000 - 9099
I:kasp:This test requires support for EDDSA cryptography
I:kasp:configure with --with-openssl, or --enable-native-pkcs11 --with-pkcs11
I:kasp:This test requires support for EDDSA cryptography
I:kasp:configure with --with-openssl, or --enable-native-pkcs11 --with-pkcs11
I:kasp:starting servers
I:kasp:check that 'dnssec-keygen -k' (configured policy) creates valid files (1)
I:kasp:check that 'dnssec-keygen -k' (default policy) creates valid files (2)
I:kasp:check key file ./Kkasp.+013+51983
I:kasp:check key timing metadata for key KEY1 id 51983 zone kasp (3)
I:kasp:check that 'dnssec-settime' by default does not edit key state file (4)
I:kasp:check that 'dnssec-settime -s' also sets publish time metadata and states in key state file (5)
I:kasp:check key file ./Kkasp.+013+51983
I:kasp:check key timing metadata for key KEY1 id 51983 zone kasp (6)
I:kasp:check that 'dnssec-settime -s' also unsets publish time metadata and states in key state file (7)
I:kasp:check key file ./Kkasp.+013+51983
I:kasp:check key timing metadata for key KEY1 id 51983 zone kasp (8)
I:kasp:check that 'dnssec-settime -s' also sets active time metadata and states in key state file (uppercase) (9)
I:kasp:check key file ./Kkasp.+013+51983
I:kasp:check key timing metadata for key KEY1 id 51983 zone kasp (10)
I:kasp:waiting for kasp signing changes to take effect (11)
I:kasp:check keys are created for zone default.kasp (12)
I:kasp:check number of keys for zone default.kasp in dir ns3 (12)
I:kasp:check key id 39605
I:kasp:KEY1 ID 39605
I:kasp:check rndc dnssec -status output for default.kasp (policy: default) (13)
I:kasp:check key timing metadata for key KEY1 id 39605 zone default.kasp (14)
I:kasp:check DNSKEY rrset is signed correctly for zone default.kasp (15)
I:kasp:check SOA rrset is signed correctly for zone default.kasp (16)
I:kasp:check CDS and CDNSKEY rrset are signed correctly for zone default.kasp (17)
I:kasp:check A a.default.kasp rrset is signed correctly for zone default.kasp (18)
I:kasp:dnssec-verify zone default.kasp (19)
I:kasp:modify unsigned zone file and check that new record is signed for zone default.kasp (20)
I:kasp:test that if private key files are inaccessible this doesn't trigger a rollover (20)
I:kasp:check keys are created for zone default.kasp (21)
I:kasp:check number of keys for zone default.kasp in dir ns3 (21)
I:kasp:check key id 39605
I:kasp:KEY1 ID 39605
I:kasp:check rndc dnssec -status output for default.kasp (policy: default) (22)
I:kasp:check key timing metadata for key KEY1 id 39605 zone default.kasp (23)
I:kasp:check DNSKEY rrset is signed correctly for zone default.kasp (24)
I:kasp:check SOA rrset is signed correctly for zone default.kasp (25)
I:kasp:check CDS and CDNSKEY rrset are signed correctly for zone default.kasp (26)
I:kasp:check A a.default.kasp rrset is signed correctly for zone default.kasp (27)
I:kasp:dnssec-verify zone default.kasp (28)
I:kasp:check keys are created for zone dynamic.kasp (29)
I:kasp:check number of keys for zone dynamic.kasp in dir ns3 (29)
I:kasp:check key id 56831
I:kasp:KEY1 ID 56831
I:kasp:check rndc dnssec -status output for dynamic.kasp (policy: default) (30)
I:kasp:check key timing metadata for key KEY1 id 56831 zone dynamic.kasp (31)
I:kasp:check DNSKEY rrset is signed correctly for zone dynamic.kasp (32)
I:kasp:check SOA rrset is signed correctly for zone dynamic.kasp (33)
I:kasp:check CDS and CDNSKEY rrset are signed correctly for zone dynamic.kasp (34)
I:kasp:check A a.dynamic.kasp rrset is signed correctly for zone dynamic.kasp (35)
I:kasp:dnssec-verify zone dynamic.kasp (36)
I:kasp:nsupdate zone and check that new record is signed for zone dynamic.kasp (37)
I:kasp:nsupdate zone and check that new record is signed for zone dynamic.kasp (38)
I:kasp:modify zone file and check that new record is signed for zone dynamic.kasp (39)
I:kasp:check keys are created for zone dynamic-inline-signing.kasp (40)
I:kasp:check number of keys for zone dynamic-inline-signing.kasp in dir ns3 (40)
I:kasp:check key id 32461
I:kasp:KEY1 ID 32461
I:kasp:check rndc dnssec -status output for dynamic-inline-signing.kasp (policy: default) (41)
I:kasp:check key timing metadata for key KEY1 id 32461 zone dynamic-inline-signing.kasp (42)
I:kasp:check DNSKEY rrset is signed correctly for zone dynamic-inline-signing.kasp (43)
I:kasp:check SOA rrset is signed correctly for zone dynamic-inline-signing.kasp (44)
I:kasp:check CDS and CDNSKEY rrset are signed correctly for zone dynamic-inline-signing.kasp (45)
I:kasp:check A a.dynamic-inline-signing.kasp rrset is signed correctly for zone dynamic-inline-signing.kasp (46)
I:kasp:dnssec-verify zone dynamic-inline-signing.kasp (47)
I:kasp:modify unsigned zone file and check that new record is signed for zone dynamic-inline-signing.kasp (48)
I:kasp:check keys are created for zone inline-signing.kasp (49)
I:kasp:check number of keys for zone inline-signing.kasp in dir ns3 (49)
I:kasp:check key id 44130
I:kasp:KEY1 ID 44130
I:kasp:check rndc dnssec -status output for inline-signing.kasp (policy: default) (50)
I:kasp:check key timing metadata for key KEY1 id 44130 zone inline-signing.kasp (51)
I:kasp:check DNSKEY rrset is signed correctly for zone inline-signing.kasp (52)
I:kasp:check SOA rrset is signed correctly for zone inline-signing.kasp (53)
I:kasp:check CDS and CDNSKEY rrset are signed correctly for zone inline-signing.kasp (54)
I:kasp:check A a.inline-signing.kasp rrset is signed correctly for zone inline-signing.kasp (55)
I:kasp:dnssec-verify zone inline-signing.kasp (56)
I:kasp:check keys are created for zone checkds-ksk.kasp (57)
I:kasp:check number of keys for zone checkds-ksk.kasp in dir ns3 (57)
I:kasp:check key id 57464
I:kasp:check key id 12023
I:kasp:KEY1 ID 57464
I:kasp:KEY2 ID 12023
I:kasp:check rndc dnssec -status output for checkds-ksk.kasp (policy: checkds-ksk) (58)
I:kasp:check DNSKEY rrset is signed correctly for zone checkds-ksk.kasp (59)
I:kasp:check SOA rrset is signed correctly for zone checkds-ksk.kasp (60)
I:kasp:check CDS and CDNSKEY rrset are signed correctly for zone checkds-ksk.kasp (61)
I:kasp:check A a.checkds-ksk.kasp rrset is signed correctly for zone checkds-ksk.kasp (62)
I:kasp:dnssec-verify zone checkds-ksk.kasp (63)
I:kasp:checkds publish correctly sets DSPublish for zone checkds-ksk.kasp (64)
I:kasp:calling rndc dnssec -checkds -when 20190102121314 published zone checkds-ksk.kasp in (65)
I:kasp:checkds withdraw correctly sets DSRemoved for zone checkds-ksk.kasp (66)
I:kasp:calling rndc dnssec -checkds -when 20200102121314 withdrawn zone checkds-ksk.kasp in (67)
I:kasp:check keys are created for zone checkds-doubleksk.kasp (68)
I:kasp:check number of keys for zone checkds-doubleksk.kasp in dir ns3 (68)
I:kasp:check key id 26947
I:kasp:check key id 27455
I:kasp:check key id 07792
I:kasp:KEY1 ID 26947
I:kasp:KEY2 ID 27455
I:kasp:KEY3 ID 7792
I:kasp:check rndc dnssec -status output for checkds-doubleksk.kasp (policy: checkds-doubleksk) (69)
I:kasp:check DNSKEY rrset is signed correctly for zone checkds-doubleksk.kasp (70)
I:kasp:check SOA rrset is signed correctly for zone checkds-doubleksk.kasp (71)
I:kasp:check CDS and CDNSKEY rrset are signed correctly for zone checkds-doubleksk.kasp (72)