Unbound python performance 1.9.4

Unbound
1

How is it possible to enable multiple python instances for get more performance?

I tried to add next:
module-config: “validator python python iterator”

python:
python-script: “/etc/unbound/dnsrabbit.py”
python-script: “/etc/unbound/dnsrabbit.py”

but after restart unbound, I got:
unbound-checkconf[15820]: [1572806018] unbound-checkconf[15820:0] fatal error: module conf ‘validator python python iterator’ is not known to work

I use our own custom python script for extend unbound functionality, but unfortunately after testing I found that unbound can process only 14k queries per second on ec2 amazon instance
c4.xlarge Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz

num-threads: 8

Version 1.9.4

Configure line: --build=x86_64-redhat-linux-gnu --host=x86_64-redhat-linux-gnu --program-prefix= --disable-dependency-tracking --prefix=/usr --exec-prefix=/usr --bindir=/usr/bin --sbindir=/usr/sbin --sysconfdir=/etc --datadir=/usr/share --includedir=/usr/include --libdir=/usr/lib64 --libexecdir=/usr/libexec --localstatedir=/var --sharedstatedir=/var/lib --mandir=/usr/share/man --infodir=/usr/share/info --with-pythonmodule --with-pyunbound PYTHON=/usr/bin/python2 --with-libevent --with-pthreads --with-ssl --disable-rpath --disable-static --with-conf-file=/etc/unbound/unbound.conf --with-pidfile=/var/run/unbound/unbound.pid --enable-sha2 --disable-gost --enable-ecdsa --with-rootkey-file=/var/lib/unbound/root.key
Linked libs: libevent 2.0.21-stable (it uses epoll), OpenSSL 1.0.2k-fips 26 Jan 2017
Linked modules: dns64 python respip validator iterator

2

Hi Eduard,

There are two issues here:

1. There is a bug in unbound-checkconf that does not treat multiple
Python instances as valid configuration
(https://github.com/NLnetLabs/unbound/issues/103).
If you want you could bypass that by editing your systems's service file
and commenting out the `unbound-checkconf` invocation.

2. The module configuration lists the modules that will be called *in
series* for a given query. The multiple Python instances will allow for
different logic to exist in two or more Python modules. It won't make
sense to run the same Python script (logic) in another Python instance,
and what you are trying to achieve (parallelization) is not possible
that way.

When the Python module is enabled, unbound's performance is hindered by
Python's performance (more so depending on the logic/cost of the custom
code).

Best regards,
-- George

3

Hi George,

Thank you for you answers.

Is it possible to do any performance tests for python module for unbound?
I would like to get something like that:
https://stackoverflow.com/questions/582336/how-can-you-profile-a-python-script

пн, 4 нояб. 2019 г. в 19:22, George Thessalonikefs via Unbound-users <unbound-users@nlnetlabs.nl>: