It was me 
FTR: This is the post in which I describe the issue on my side:
Yes, it seems like this. But maybe by chance the serial ports had a different order on the bare metal system and/or the bindings started in a “better” order.
Back on the ESXi, the issue re-appeared instantly.