Increasing quantum for zone loading tasks has steep negative effect on performance
Currently, the loadtask has quantum of 2
which makes the whole world spin - it goes to netmgr, runs 2 events, schedules the task to be run again on netmgr, runs 2 events, ...
Bumping the number of quantum to higher number (UINT_MAX
or 2000
) has a severe effect on the zone loading - each event takes more and more time:
31-Mar-2022 16:10:16.447 zone dom108240.example/IN: loaded serial 2016010101
processed event 0x7f46583e57b0 in 769us
31-Mar-2022 16:10:16.447 zone dom108241.example/IN: loaded serial 2016010101
processed event 0x7f46583e5820 in 750us
31-Mar-2022 16:10:16.447 zone dom108242.example/IN: loaded serial 2016010101
processed event 0x7f46583e5890 in 761us
31-Mar-2022 16:10:16.447 zone dom108243.example/IN: loaded serial 2016010101
processed event 0x7f46583e5900 in 761us
31-Mar-2022 16:10:16.447 zone dom108244.example/IN: loaded serial 2016010101
processed event 0x7f46583e5970 in 777us
31-Mar-2022 16:10:16.451 zone dom108245.example/IN: loaded serial 2016010101
processed event 0x7f46583e59e0 in 829us
31-Mar-2022 16:10:16.451 zone dom108246.example/IN: loaded serial 2016010101
processed event 0x7f46583e5a50 in 748us
31-Mar-2022 16:10:16.451 zone dom108247.example/IN: loaded serial 2016010101
processed event 0x7f46583e5ac0 in 761us
31-Mar-2022 16:10:16.451 zone dom108248.example/IN: loaded serial 2016010101
processed event 0x7f46583e5b30 in 762us
31-Mar-2022 16:10:16.451 zone dom108249.example/IN: loaded serial 2016010101
processed event 0x7f46583e5ba0 in 759us
31-Mar-2022 16:10:16.455 zone dom108250.example/IN: loaded serial 2016010101
processed event 0x7f46583e5c10 in 766us
31-Mar-2022 16:10:16.455 zone dom108251.example/IN: loaded serial 2016010101
processed event 0x7f46583e5c80 in 752us
31-Mar-2022 16:10:16.455 zone dom108252.example/IN: loaded serial 2016010101
processed event 0x7f46583e5cf0 in 751us
31-Mar-2022 16:10:16.455 zone dom108253.example/IN: loaded serial 2016010101
processed event 0x7f46583e5d60 in 762us
31-Mar-2022 16:10:16.455 zone dom108254.example/IN: loaded serial 2016010101
processed event 0x7f46583e5dd0 in 760us
31-Mar-2022 16:10:16.459 zone dom108255.example/IN: loaded serial 2016010101
processed event 0x7f46583e5e40 in 802us
31-Mar-2022 16:10:16.459 zone dom108256.example/IN: loaded serial 2016010101
processed event 0x7f46583e5eb0 in 749us
31-Mar-2022 16:10:16.459 zone dom108257.example/IN: loaded serial 2016010101
processed event 0x7f46583e5f20 in 764us
31-Mar-2022 16:10:16.459 zone dom108258.example/IN: loaded serial 2016010101
processed event 0x7f46583e5f90 in 760us
31-Mar-2022 16:10:16.459 zone dom108259.example/IN: loaded serial 2016010101
processed event 0x7f46583e8000 in 762us
31-Mar-2022 16:10:16.463 zone dom108260.example/IN: loaded serial 2016010101
processed event 0x7f46583e8070 in 792us
31-Mar-2022 16:10:16.463 zone dom108261.example/IN: loaded serial 2016010101
processed event 0x7f46583e80e0 in 730us
31-Mar-2022 16:10:16.463 zone dom108262.example/IN: loaded serial 2016010101
processed event 0x7f46583e8150 in 762us
31-Mar-2022 16:10:16.463 zone dom108263.example/IN: loaded serial 2016010101
processed event 0x7f46583e81c0 in 762us
31-Mar-2022 16:10:16.463 zone dom108264.example/IN: loaded serial 2016010101
processed event 0x7f46583e8230 in 1016us
Reducing the quantum
to 1
(which is minimum results in):
31-Mar-2022 16:11:32.087 zone dom000030.example/IN: loaded serial 2016010101
processed event 0x7f69b349d9d0 in 55us
processed 1 events in 57us
31-Mar-2022 16:11:32.087 zone dom000031.example/IN: loaded serial 2016010101
processed event 0x7f69b349da40 in 55us
processed 1 events in 56us
31-Mar-2022 16:11:32.087 zone dom000032.example/IN: loaded serial 2016010101
processed event 0x7f69b349dab0 in 54us
processed 1 events in 56us
31-Mar-2022 16:11:32.087 zone dom000033.example/IN: loaded serial 2016010101
processed event 0x7f69b349db20 in 55us
processed 1 events in 56us
31-Mar-2022 16:11:32.087 zone dom000034.example/IN: loaded serial 2016010101
processed event 0x7f69b349db90 in 55us
processed 1 events in 56us
31-Mar-2022 16:11:32.087 zone dom000035.example/IN: loaded serial 2016010101
processed event 0x7f69b349dc00 in 55us
processed 1 events in 56us
What is interesting is that during the privileged task runs, other (non-privileged?) task starts leaking into the run:
31-Mar-2022 16:15:26.831 zone dom009279.example/IN: loaded serial 2016010101
processed event 0x7f189b657840 in 55us
processed 1 events in 57us
processed event 0x7f1743200770 in 1us
processed event 0x7f17432007e0 in 0us
processed event 0x7f1743200850 in 0us
processed event 0x7f17432008c0 in 0us
processed event 0x7f1743200930 in 0us
processed event 0x7f17432009a0 in 0us
processed event 0x7f1743200a10 in 0us
processed event 0x7f1743200a80 in 0us
processed event 0x7f1743200b60 in 0us
processed event 0x7f1743200bd0 in 0us
processed event 0x7f1743200c40 in 0us
processed event 0x7f1743200cb0 in 0us
processed event 0x7f1743200d20 in 0us
processed event 0x7f1743200d90 in 0us
processed event 0x7f1743200e00 in 0us
processed event 0x7f1743200e70 in 0us
processed event 0x7f1743200ee0 in 0us
processed event 0x7f1743200f50 in 0us
processed event 0x7f1743200fc0 in 0us
processed event 0x7f1743201030 in 0us
processed event 0x7f17432010a0 in 0us
processed event 0x7f1743201110 in 0us
processed event 0x7f1743201180 in 0us
processed event 0x7f17432011f0 in 0us
processed event 0x7f1743201260 in 0us
processed event 0x7f17432012d0 in 0us
processed event 0x7f1743201340 in 0us
processed event 0x7f17432013b0 in 0us
processed event 0x7f1743201420 in 0us
processed event 0x7f1743201490 in 0us
processed event 0x7f1743201500 in 0us
processed event 0x7f1743201570 in 0us
processed event 0x7f17432015e0 in 0us
processed event 0x7f1743201650 in 0us
processed event 0x7f17432016c0 in 0us
processed event 0x7f1743201730 in 0us
processed event 0x7f17432017a0 in 0us
processed event 0x7f1743201810 in 0us
processed event 0x7f1743201880 in 0us
processed event 0x7f17432018f0 in 0us
processed event 0x7f1743201960 in 0us
processed event 0x7f17432019d0 in 0us
processed event 0x7f1743201a40 in 0us
processed event 0x7f1743201ab0 in 0us
processed event 0x7f1743201b20 in 0us
processed event 0x7f1743201b90 in 0us
processed event 0x7f1743201c00 in 0us
processed event 0x7f1743201c70 in 0us
processed event 0x7f1743201ce0 in 0us
processed event 0x7f1743201d50 in 0us
processed event 0x7f1743201dc0 in 0us
processed event 0x7f1743201e30 in 0us
processed event 0x7f1743201ea0 in 0us
processed event 0x7f1743201f10 in 0us
processed event 0x7f1743201f80 in 0us
processed event 0x7f1743201ff0 in 0us
processed event 0x7f1743202060 in 0us
processed event 0x7f17432020d0 in 0us
processed event 0x7f1743202140 in 0us
processed event 0x7f17432021b0 in 0us
processed event 0x7f1743202220 in 0us
processed event 0x7f1743202290 in 0us
processed event 0x7f1743202300 in 0us
processed event 0x7f1743202370 in 0us
processed 64 events in 135us
31-Mar-2022 16:15:26.835 zone dom009280.example/IN: loaded serial 2016010101
processed event 0x7f189b6578b0 in 58us
processed 1 events in 59us
31-Mar-2022 16:15:26.835 zone dom009281.example/IN: loaded serial 2016010101
processed event 0x7f189b657920 in 87us
processed 1 events in 89us