Another update: It turned out that it is nothing major - the exception during startup can simply be ignored.
If you are too much annoyed by it, it can be suppressed by adding this to your log4j2.xml file.
Tl;dr: No reason not to update to Milestone 2!