You need to decide what it going to control the devices. OpenHAB or Alexa.
For those devices that alexa controls directly like those budget wifi plugs, there are bindings available in OH or python scripts most of the time so that OH control them
Then you integrate with alexa with:
