Multiple tests fail
Summary
- Multiple tests fail during the build.
- Some failures (but not all) are linked to the fact that "PKCS#7 support in pyOpenSSL is deprecated. You should use the APIs ". These failures do not appear when using python3-openssl 21.0.0-1 instead of pyOpenSSL 22.1.0.
- Also, softhsm2-util is available despite some error messages in the log (do you modify PATH variable?) .
Environment
- Ubuntu 22.10 kinetic
- Python 3.10.8 (apt)
- pytest-7.2.0 (pip3)
- softhsm2 2.6.1-2ubuntu1 (apt)
- openssl 3.0.7-1 (apt)
- pyOpenSSL 22.1.0 (pip3) --> build 1
- python3-openssl 21.0.0-1 (apt) --> build 2
BIND version used
v9_19_6
Steps to reproduce
git checkout v9_19_6
export CFLAGS+=-Wno-error
export NOCONFIGURE=yes
autoreconf -f -i
./configure \
--build=x86_64-pc-linux-gnu \
--prefix=/usr --sysconfdir=/etc/bind --localstatedir=/ \
--datarootdir=/usr/share --docdir=/usr/share/doc --mandir=/usr/share/man \
--disable-querytrace \
--enable-auto-validation \
--enable-dnstap \
--enable-fixed-rrset \
--enable-full-report \
--enable-geoip \
--enable-largefile \
--enable-linux-caps \
--enable-shared=yes \
--with-cmocka=yes \
--with-gnu-ld=yes \
--with-gssapi=/usr/bin/krb5-config \
--with-jemalloc=detect \
--with-json-c=yes \
--with-libidn2 \
--with-libxml2=yes \
--with-lmdb=auto \
--with-maxminddb=yes \
--with-openssl=/usr/lib/x86_64-linux-gnu \
--with-tuning=large \
--with-zlib=yes
make all
make doc html pdf
pip3 install -I pytest
bin/tests/system/ifconfig.sh up
make check
- with latest pyOpenSSL, leads to:
...
PASS: names
FAIL: notify
PASS: nsec3
PASS: nslookup
PASS: padding
PASS: pending
PASS: redirect
PASS: rndc
PASS: rootkeysentinel
PASS: rpz
PASS: rrchecker
PASS: rrl
PASS: rrsetorder
PASS: rsabigexponent
PASS: runtime
PASS: sfcache
PASS: smartsign
PASS: sortlist
PASS: spf
PASS: staticstub
PASS: stub
PASS: synthfromdnssec
PASS: tkey
PASS: tools
PASS: transport-acl
PASS: tsig
PASS: tsiggss
PASS: ttl
PASS: unknown
PASS: verify
PASS: views
FAIL: wildcard
PASS: xferquota
PASS: zonechecks
PASS: nzd2nzf
PASS: fetchlimit
PASS: ixfr
PASS: nsupdate
PASS: resolver
PASS: statistics
PASS: upforwd
PASS: zero
FAIL: dnstap
FAIL: statschannel
PASS: xfer
PASS: reclimit
PASS: kasp
PASS: keymgr2kasp
FAIL: tcp
PASS: pipelined
FAIL: checkds
FAIL: dispatch
FAIL: rpzextra
FAIL: shutdown
FAIL: timeouts
PASS: qmin
FAIL: cookie
PASS: digdelv
PASS: dnssec
PASS: forward
PASS: chain
============================================================================
Testsuite summary for BIND 9.19.6
============================================================================
# TOTAL: 109
# PASS: 96
# SKIP: 2
# XFAIL: 0
# FAIL: 11
# XPASS: 0
# ERROR: 0
- with latest python3-openssl, leads to:
PASS: names
FAIL: notify
PASS: nsec3
PASS: nslookup
PASS: padding
PASS: pending
PASS: redirect
PASS: rndc
PASS: rootkeysentinel
PASS: rpz
PASS: rrchecker
PASS: rrl
PASS: rrsetorder
PASS: rsabigexponent
PASS: runtime
PASS: sfcache
PASS: smartsign
PASS: sortlist
PASS: spf
PASS: staticstub
PASS: stub
PASS: synthfromdnssec
PASS: tkey
PASS: tools
PASS: transport-acl
PASS: tsig
PASS: tsiggss
PASS: ttl
PASS: unknown
PASS: verify
PASS: views
PASS: wildcard
PASS: xferquota
PASS: zonechecks
PASS: nzd2nzf
PASS: fetchlimit
PASS: ixfr
PASS: nsupdate
PASS: resolver
PASS: statistics
PASS: upforwd
PASS: zero
PASS: dnstap
PASS: statschannel
PASS: xfer
PASS: reclimit
PASS: kasp
PASS: keymgr2kasp
PASS: tcp
PASS: pipelined
PASS: checkds
PASS: dispatch
PASS: rpzextra
PASS: shutdown
PASS: timeouts
PASS: qmin
FAIL: cookie
PASS: digdelv
PASS: dnssec
PASS: forward
PASS: chain
============================================================================
Testsuite summary for BIND 9.19.6
============================================================================
# TOTAL: 109
# PASS: 105
# SKIP: 2
# XFAIL: 0
# FAIL: 2
# XPASS: 0
# ERROR: 0
Relevant logs and/or screenshots
bin/tests/system/test-suite.log is attached as:
- test-suite-with-pyOpenSSL.log when pyOpenSSL 22.1.0 (pip3) is used
- test-suite-with-python3-openssl.log when python3-openssl 21.0.0-1 (apt) is used
The complete build logs are available on demand.