The new "cipher-suites" system test fails in FIPS mode
!8576 (merged) was merged 3 days ago and here is a list of its failures in GitLab CI since:
- https://gitlab.isc.org/isc-projects/bind9/-/jobs/3938188
- https://gitlab.isc.org/isc-projects/bind9/-/jobs/3938189
- https://gitlab.isc.org/isc-projects/bind9/-/jobs/3939001
- https://gitlab.isc.org/isc-projects/bind9/-/jobs/3939002
- https://gitlab.isc.org/isc-projects/bind9/-/jobs/3939846
- https://gitlab.isc.org/isc-projects/bind9/-/jobs/3939847
- https://gitlab.isc.org/isc-projects/bind9/-/jobs/3939988
- https://gitlab.isc.org/isc-projects/bind9/-/jobs/3939989
These look like permanent failures; it is probably a rare case of a FIPS-only failure that was not caught before merging since we only run FIPS-mode jobs in scheduled pipelines rather than for every merge request.
Looks like there is a pattern to these failures - there seem to be different issues on different platforms:
-
on Oracle Linux 9 in FIPS mode, there is often a crash:
2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:Core was generated by `/builds/isc-projects/bind9/bin/named/.libs/lt-named -D cipher-suites_tmp__8wequ'. 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:Program terminated with signal SIGABRT, Aborted. 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#0 0x00007fde4caa158c in __pthread_kill_implementation () from /lib64/libc.so.6 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:[Current thread is 1 (Thread 0x7fde49fba600 (LWP 103424))] 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#0 0x00007fde4caa158c in __pthread_kill_implementation () from /lib64/libc.so.6 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#1 0x00007fde4ca54d06 in raise () from /lib64/libc.so.6 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#2 0x00007fde4ca287f3 in abort () from /lib64/libc.so.6 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#3 0x0000000000422b05 in assertion_failed (file=0x7fde4d8c26a1 "netmgr/tcp.c", line=918, type=isc_assertiontype_insist, cond=0x7fde4d8c2720 "csock->recv_cb != ((void *)0)") at main.c:234 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#4 0x00007fde4d88aace in isc_assertion_failed (file=file@entry=0x7fde4d8c26a1 "netmgr/tcp.c", line=line@entry=918, type=type@entry=isc_assertiontype_insist, cond=cond@entry=0x7fde4d8c2720 "csock->recv_cb != ((void *)0)") at assertions.c:48 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#5 0x00007fde4d8829e3 in accept_connection (csock=<optimized out>, csock@entry=0x7fde48c0b000) at netmgr/tcp.c:918 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#6 0x00007fde4d882c1d in tcp_connection_cb (server=<optimized out>, status=<optimized out>) at netmgr/tcp.c:558 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#7 0x00007fde4d481e77 in uv.server_io () from /lib64/libuv.so.1 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#8 0x00007fde4d49285e in uv.io_poll.part () from /lib64/libuv.so.1 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#9 0x00007fde4d47c5a8 in uv_run () from /lib64/libuv.so.1 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#10 0x00007fde4d89d896 in loop_thread (arg=arg@entry=0x7fde4bea6180) at loop.c:282 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#11 0x00007fde4d8af4b5 in thread_body (wrap=wrap@entry=0x1dc7350) at thread.c:85 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#12 0x00007fde4d8af4de in thread_run (wrap=0x1dc7350) at thread.c:100 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#13 0x00007fde4ca9f812 in start_thread () from /lib64/libc.so.6 2024-01-14 08:18:07 INFO:cipher-suites D:/builds/isc-projects/bind9/bin/tests/system/cipher-suites_tmp__8wequh4:#14 0x00007fde4ca3f450 in clone3 () from /lib64/libc.so.6
-
on Oracle Linux 8 in FIPS mode, there is often a test failure:
2024-01-13 00:16:03 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example" at "ns2" (1) 2024-01-13 00:16:04 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example" at "ns3" (2) 2024-01-13 00:16:04 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example" at "ns4" (3) 2024-01-13 00:16:04 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example-aes-128" at "ns2" (4) 2024-01-13 00:16:04 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example-aes-256" at "ns3" (5) 2024-01-13 00:16:04 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example-chacha-20" at "ns4" (6) 2024-01-13 00:16:13 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:failed 2024-01-13 00:16:13 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example-aes-256" at "ns2", failure expected (7) 2024-01-13 00:16:22 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example-chacha-20" at "ns2", failure expected (8) 2024-01-13 00:16:32 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example-aes-128" at "ns3", failure expected (9) 2024-01-13 00:16:41 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example-chacha-20" at "ns3", failure expected (10) 2024-01-13 00:16:51 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example-aes-128" at "ns4", failure expected (11) 2024-01-13 00:17:00 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example-aes-256" at "ns4", failure expected (12) 2024-01-13 00:17:09 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example" at "ns5", failure expected (13) 2024-01-13 00:17:19 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example-aes-128" at "ns5", failure expected (14) 2024-01-13 00:17:28 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example-aes-256" at "ns5", failure expected (15) 2024-01-13 00:17:38 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:testing zone transfer over TLS (XoT): - zone "example-chacha-20" at "ns5", failure expected (16) 2024-01-13 00:17:47 INFO:cipher-suites I:cipher-suites_tmp_5cchgkwp:exit status: 1
I would normally follow up on the original issue in cases like this, but it seems that at least the crash may be a pre-existing issue, so I thought that separating it out might be prudent.