This MR aims to add support for running system tests with pytest. It targets versions 9.19 and 9.18. The intention is to keep the legacy way of running system tests available as long as 9.16 is supported.
It's currently WIP, but I got it to work locally for a subset of tests. For details about missing features and general overview, refer to commit messages and TODO notes in the code.
To run locally:
autoreconf -fiv && ./configure && make cd bin/tests/system/ sudo sh ifconfig.sh up pytest # to run all the tests sequentially pytest -k dns64 # to run a selected system test
Currently, I get
20 failed, 86 passed, 2 skipped system tests. As mentioned, this is WIP so they might not get executed correctly and some stuff isn't executed yet (e.g. existing pytests).