The solution was in the thread below. I think the default limiting factor was the pools. I have a lot of upnp devices in my home network (especially since jellyfin was started) and there was no pool for ipv4 port bindings. Unlimiting the pools the binding started to work as expected.
