I had a chat with @J-N-K about that. instead o addons.json like written in the Smarthome/J readme, you need to use the addons-snapshot.json, which allows to install the openHAB4 version through 3rd party addon marketplace.
It is running here very well.
