kea-dhcp4 hangs after kea-dhcp-ddns error
name: Bug report
about: Create a report to help us improve
Describe the bug We use 4 kea-dhcp4 services in our network. The kea services run in High Availability (HA) mode. 1 as primary, 1 as standby and 2 as backup nodes. As backend we use mariadb-server-10.3. The databases run in High Availability mode galera-3. The service is running and DHCP requests are processed. If there is an error with the dynamic DNS entries, the kea-dhcp4 service stops. In the process list the kea services are visible, but the dhcp4 service stops responding.
To Reproduce Steps to reproduce the behavior:
- services kea-dhcp-ddns, kea-dhcp4, kea-ctrl-agent.
- a client stops and releases its IP address, the kea-dhcp-ddns returns an error
- the server stops
Nov 3 13:39:14 bla0022 kea-dhcp-ddns: ERROR [kea-dhcp-ddns.d2-to-dns.140257951971200] DHCP_DDNS_FORWARD_REMOVE_ADDRS_REJECTED DNS Request ID 000101528812ABEE2C22399F0F3A3B7AFFF20D24A940285564B2E713F01ED1F46A2EA2: Server, 127.0.0.1 port:5300, rejected a DNS update request to remove the forward address mapping for FQDN, <SERVER-FQDN>., with an RCODE: 2
Nov 3 13:39:14 bla0022 kea-dhcp-ddns: ERROR [kea-dhcp-ddns.d2-to-dns.140257951971200] DHCP_DDNS_REMOVE_FAILED DHCP_DDNS Request ID 000101528812ABEE2C22399F0F3A3B7AFFF20D24A940285564B2E713F01ED1F46A2EA2: Transaction outcome: Status: Failed, Event: UPDATE_FAILED_EVT, Forward change: failed, Reverse change: failed, request: Type: 1 (CHG_REMOVE)#012Forward Change: yes#012Reverse Change: yes#012FQDN: [<SERVER-FQDN>.]#012IP Address: [10.189.16.71]#012DHCID: [000101528812ABEE2C22399F0F3A3B7AFFF20D24A940285564B2E713F01ED1F46A2EA2]#012Lease Expires On: 20211103123909#012Lease Length: 604800#012
Expected behavior The server catches the error and continues to run normally
Environment:
- Kea version: 1.8.2-isc0001520201206093433
- OS: Ubuntu 20.04.2 LTS x86_64
- offical isc deb package
- hooks libdhcp_lease_cmds.so libdhcp_stat_cmds.so libdhcp_ha.so
Additional Information
Nov 3 13:39:08 bla0022 kea-ctrl-agent: INFO [kea-ctrl-agent.ctrl-agent.140579089548864] CTRL_AGENT_COMMAND_FORWARDED command reservation-get-page successfully forwarded to the service dhcp4
Nov 3 13:39:14 bla0022 kea-ctrl-agent: INFO [kea-ctrl-agent.commands.140579089548864] COMMAND_RECEIVED Received command 'ha-heartbeat'
Nov 3 13:39:14 bla0022 kea-dhcp-ddns: ERROR [kea-dhcp-ddns.d2-to-dns.140257951971200] DHCP_DDNS_FORWARD_REMOVE_ADDRS_REJECTED DNS Request ID 000101528812ABEE2C22399F0F3A3B7AFFF20D24A940285564B2E713F01ED1F46A2EA2: Server, 127.0.0.1 port:5300, rejected a DNS update request to remove the forward address mapping for FQDN, <SERVER-FQDN>., with an RCODE: 2
Nov 3 13:39:14 bla0022 kea-dhcp-ddns: ERROR [kea-dhcp-ddns.d2-to-dns.140257951971200] DHCP_DDNS_REMOVE_FAILED DHCP_DDNS Request ID 000101528812ABEE2C22399F0F3A3B7AFFF20D24A940285564B2E713F01ED1F46A2EA2: Transaction outcome: Status: Failed, Event: UPDATE_FAILED_EVT, Forward change: failed, Reverse change: failed, request: Type: 1 (CHG_REMOVE)#012Forward Change: yes#012Reverse Change: yes#012FQDN: [<SERVER-FQDN>.]#012IP Address: [10.189.16.71]#012DHCID: [000101528812ABEE2C22399F0F3A3B7AFFF20D24A940285564B2E713F01ED1F46A2EA2]#012Lease Expires On: 20211103123909#012Lease Length: 604800#012
Nov 3 13:40:14 bla0022 kea-ctrl-agent: INFO [kea-ctrl-agent.commands.140579089548864] COMMAND_RECEIVED Received command 'version-get'
Nov 3 13:40:14 bla0022 kea-ctrl-agent: INFO [kea-ctrl-agent.commands.140579089548864] COMMAND_RECEIVED Received command 'ha-heartbeat'
Nov 3 13:41:14 bla0022 kea-ctrl-agent: INFO [kea-ctrl-agent.commands.140579089548864] COMMAND_RECEIVED Received command 'ha-heartbeat'
Contacting you