Need help to setup MQTT Binding on OH2

vzorglub · June 1, 2018, 7:25am

Please use the code fences. Thanks

Do the following, in order:

uninstall the mqtt broker
delere your mqtt.cfg from the conf/services folder
clear the cache
stop openhab (DON’T reboot)
reboot your mqtt broker and wait 2 minutes
reboot OH computer
install the mqtt binding
fill in the mqtt.cfg file with you broker details:

pid:org.openhab.mqtt
broker.url=tcp://192.XX.X.XX:1883
broker.clientId=openhab2
broker.user=username
broker.pwd=HomeHub

That’s all there should be. NOTHING else
make sure that pid:org.openhab.mqtt is the VERY FIRST LINE OF THE FILE

stop openhab
start openhab
show us the logs at start up

rajeev2301 · June 1, 2018, 8:10am

Thanks Vincent for extending your help! also Thanks @Dim your patience -( I am new to this environment )

@vzorglub
Before I goahead with your suggestion of reinstalling mqtt broker, please help me clarify few doubts

Why the order/sequence of line ( in mqtt.cfg file) is different in mqtt.cfg file and the output which is getting from openhab console. ( plz ref below)

/etc/openhab2/services/mqtt.cfg file 
service.pid=org.openhab.mqtt
<broker>.url=tcp://192.XX.XX.XX:1883
<broker>.clientId=openhab2
<broker>.user=username
<broker>.pwd=HomeHub

openhab > config:edit org.openhab.mqtt
openhab> config:property-list

   <broker>.clientId = openhab2
   <broker>.pwd = HomeHub
   <broker>.url = tcp://192.XXX.X.XX:1883
   <broker>.user = username
   service.pid = org.openhab.mqtt

also, plz ref below the openhab log file , it says - Error starting broker connection. is that the reason why you want me to reinstall mqtt broker? if yes , please let me know do i need to uninstall & install both mosquitto and mosquitto-clients or only mosquitto ?? (BTW i use this source to download mqtt package : http://repo.mosquitto.org/debian/mosquitto-stretch.list) ?

2018-06-01 00:18:42.709 [INFO ] [t.mqtt.internal.MqttBrokerConnection] - Starting MQTT broker connection '<broker>'
2018-06-01 00:18:43.010 [ERROR] [penhab.io.transport.mqtt.MqttService] - Error starting broker connection
org.eclipse.paho.client.mqttv3.MqttException: Unable to connect to server
        at org.eclipse.paho.client.mqttv3.internal.TCPNetworkModule.start(TCPNetworkModule.java:79) [223:org.openhab.i$
        at org.eclipse.paho.client.mqttv3.internal.ClientComms$ConnectBG.run(ClientComms.java:650) [223:org.openhab.io$
        at java.lang.Thread.run(Thread.java:745) [?:?]
Caused by: java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:?]
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:?]
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:?]
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:?]
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:?]
        at java.net.Socket.connect(Socket.java:589) ~[?:?]
        at org.eclipse.paho.client.mqttv3.internal.TCPNetworkModule.start(TCPNetworkModule.java:70) ~[?:?]

Sencondly , when I run

pi@raspberrypi:~ $ dpkg -l | grep openhab 

ii  openhab2                              2.3.0~RC2-1                          all          openhab2
ll          openhab2

it looks like there are two instances of openhab2. ( is my understanding correct??) if yes, do I need to uninstall openhab as well and do a fresh installation.??

Appreciate your help!

vzorglub · June 1, 2018, 8:19am

WAIT!!!

Remove the < and the > from the <broker> in your mqtt.conf
Change the first line to: pid:org.openhab.mqtt - NOT service.pid:org.openhab.mqtt
Show me your log

rajeev2301 · June 1, 2018, 8:40am

Here is the changed mqtt.cfg file

pid:org.openhab.mqtt
broker.url=tcp://192.XXX.X.XX:1883
broker.clientId=openhab2
broker.user=username
broker.pwd=HomeHub

/var/log/openhab2/openhab.log

2018-06-01 01:31:05.886 [INFO ] [t.mqtt.internal.MqttBrokerConnection] - Starting MQTT broker connection 'broker'
2018-06-01 01:31:06.175 [ERROR] [penhab.io.transport.mqtt.MqttService] - Error starting broker connection
org.eclipse.paho.client.mqttv3.MqttException: Unable to connect to server
        at org.eclipse.paho.client.mqttv3.internal.TCPNetworkModule.start(TCPNetworkModule.java:79) [225:org.openhab.io.transport.mqtt:1.12.0$
        at org.eclipse.paho.client.mqttv3.internal.ClientComms$ConnectBG.run(ClientComms.java:650) [225:org.openhab.io.transport.mqtt:1.12.0.$
        at java.lang.Thread.run(Thread.java:745) [?:?]
Caused by: java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:?]
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:?]
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:?]
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:?]
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:?]
        at java.net.Socket.connect(Socket.java:589) ~[?:?]
        at org.eclipse.paho.client.mqttv3.internal.TCPNetworkModule.start(TCPNetworkModule.java:70) ~[?:?]
        ... 2 more

/var/lib/openhab2/config/org/openhab/mqtt.config

broker.clientId="openhab2"
broker.pwd="HomeHub"
broker.url="tcp://192.XXX.X.XX:1883"
broker.user="username"
service.pid="org.openhab.mqtt

/var/log/mosquitto/mosquitto.log

1527339623: mosquitto version 1.5 starting
1527339623: Config loaded from /etc/mosquitto/mosquitto.conf.
1527339623: Opening ipv4 listen socket on port 1883.
1527339623: Opening ipv6 listen socket on port 1883.
1527339623: Opening ipv4 listen socket on port 1883.
1527339623: Error: Address already in use
```

vzorglub · June 1, 2018, 8:48am

Ok, so your broker is refusing the connection from openHAB
The main reason for that are incorrect usernames and password settings.

Show me your mosquitto.conf file
It should be located in /etc/mosquitto

Answers to your questions above:

It doesn’t matter. OH is pulling the info from your mqtt.cfg and parsing it in the /var/lib/openhab2/config/org/openhab/mqtt.config automatically. DO NOT TOUCH /var/lib/openhab2/config/org/openhab/mqtt.config. Your are a beginner, let OH handle these things for you.

Your understanding is incorrect. Your console output is showing the main process and the subprocess

rajeev2301 · June 1, 2018, 8:57am

/etc/mosquitto/mosquitto.conf

port 1883
persistence false
log_dest file /var/log/mosquitto/mosquitto.log
log_type information
connection_message true
log_timestamp true
allow_anonymous false
password_file /etc/mosquitto/pwfile

vzorglub · June 1, 2018, 9:03am

Let’s go back to basic.
Follow me exactly. Don’t try to improvise
I am not putting your security at risk because you are doing it all in your LAN
When it works, we will add the username and password back in use
Let’s go…

Change the allow_anonymous to true
and comment out the password_file line

mosquitto.conf

port 1883
persistence false
log_dest file /var/log/mosquitto/mosquitto.log
log_type information
connection_message true
log_timestamp true
allow_anonymous true
#password_file /etc/mosquitto/pwfile

Then change your OH mqtt.cfg to:

mqtt.cfg

pid:org.openhab.mqtt
broker.url=tcp://192.XXX.X.XX:1883
#broker.clientId=openhab2
#broker.user=username
#broker.pwd=HomeHub

Then stop and restart mosquitto
Then stop and restart openHAB
Show your OH start up log

rajeev2301 · June 1, 2018, 9:27am

Here you go!

I followed the following steps

pi@raspberrypi:~ $ sudo systemctl stop mosquitto.service
pi@raspberrypi:~ $ sudo /etc/init.d/mosquitto start
[ ok ] Starting mosquitto (via systemctl): mosquitto.service.
pi@raspberrypi:~ $ sudo systemctl stop openhab2.service
pi@raspberrypi:~ $ sudo systemctl start openhab2.service

OH startup logfile…

2018-06-01 02:13:06.721 [WARN ] [g.dispatch.internal.ConfigDispatcher] - The file /etc/openhab2/services/mqtt.cfg subsequen$
2018-06-01 02:13:06.734 [INFO ] [penhab.io.transport.mqtt.MqttService] - MQTT Service initialization completed.
2018-06-01 02:13:06.740 [INFO ] [t.mqtt.internal.MqttBrokerConnection] - Starting MQTT broker connection 'broker'
2018-06-01 02:13:06.777 [ERROR] [penhab.io.transport.mqtt.MqttService] - Error starting broker connection
org.eclipse.paho.client.mqttv3.MqttException: Unable to connect to server
        at org.eclipse.paho.client.mqttv3.internal.TCPNetworkModule.start(TCPNetworkModule.java:79) [225:org.openhab.io.tra$
        at org.eclipse.paho.client.mqttv3.internal.ClientComms$ConnectBG.run(ClientComms.java:650) [225:org.openhab.io.tran$
        at java.lang.Thread.run(Thread.java:745) [?:?]
Caused by: java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:?]
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:?]
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:?]
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:?]
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:?]
        at java.net.Socket.connect(Socket.java:589) ~[?:?]
        at org.eclipse.paho.client.mqttv3.internal.TCPNetworkModule.start(TCPNetworkModule.java:70) ~[?:?]
        ... 2 more
2018-06-01 02:18:18.090 [INFO ] [basic.internal.servlet.WebAppServlet] - Stopped Basic UI
2018-06-01 02:18:27.479 [INFO ] [penhab.io.transport.mqtt.MqttService] - Stopping broker connection '192.XXX.X.XX'
2018-06-01 02:18:27.482 [INFO ] [penhab.io.transport.mqtt.MqttService] - Stopping broker connection 'broker'
2018-06-01 02:18:28.293 [INFO ] [arthome.ui.paper.internal.PaperUIApp] - Stopped Paper UI
2018-06-01 02:18:28.328 [INFO ] [panel.internal.HABPanelDashboardTile] - Stopped HABPanel
2018-06-01 02:18:28.344 [INFO ] [er.internal.HomeBuilderDashboardTile] - Stopped Home Builder
2018-06-01 02:18:28.376 [INFO ] [.dashboard.internal.DashboardService] - Stopped Dashboard
2018-06-01 02:18:59.026 [WARN ] [g.dispatch.internal.ConfigDispatcher] - The file /etc/openhab2/services/mqtt.cfg subsequen$
2018-06-01 02:18:59.090 [INFO ] [er.internal.HomeBuilderDashboardTile] - Started Home Builder at /homebuilder
2018-06-01 02:18:59.963 [INFO ] [.dashboard.internal.DashboardService] - Started Dashboard at http://192.X.X.XX:8080
2018-06-01 02:18:59.967 [INFO ] [.dashboard.internal.DashboardService] - Started Dashboard at https://192.XXX.X.XX:8443

/etc/openhab2/services/mqtt.cfg

pid:org.openhab.mqtt
broker.url=tcp://192.XXX.X.XX:1883
#broker.clientId=openhab2
#broker.user=username
#broker.pwd=HomeHub

vzorglub · June 1, 2018, 10:05am

OK,
Now change the following line in your mqtt.cfg:

pid:org.openhab.mqtt
broker.url=tcp://127.0.0.1:1883
#broker.clientId=openhab2
#broker.user=username
#broker.pwd=HomeHub

vzorglub · June 1, 2018, 10:58am

Did that work?

rajeev2301 · June 1, 2018, 3:50pm

Good Morning Vincent !

No, it did not work. Here is the OH log…

2018-06-01 08:46:44.929 [WARN ] [g.dispatch.internal.ConfigDispatcher] - The file /etc/openhab2/services/mqtt.cfg subsequently defines the exclusive PID 'org.$
2018-06-01 08:46:44.942 [INFO ] [penhab.io.transport.mqtt.MqttService] - MQTT Service initialization completed.
2018-06-01 08:46:44.945 [INFO ] [t.mqtt.internal.MqttBrokerConnection] - Starting MQTT broker connection 'broker'
2018-06-01 08:46:44.980 [ERROR] [penhab.io.transport.mqtt.MqttService] - Error starting broker connection
org.eclipse.paho.client.mqttv3.MqttException: Unable to connect to server
        at org.eclipse.paho.client.mqttv3.internal.TCPNetworkModule.start(TCPNetworkModule.java:79) [225:org.openhab.io.transport.mqtt:1.12.0.RC2]
        at org.eclipse.paho.client.mqttv3.internal.ClientComms$ConnectBG.run(ClientComms.java:650) [225:org.openhab.io.transport.mqtt:1.12.0.RC2]
        at java.lang.Thread.run(Thread.java:745) [?:?]
Caused by: java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:?]
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:?]
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:?]
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:?]
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:?]
        at java.net.Socket.connect(Socket.java:589) ~[?:?]
        at org.eclipse.paho.client.mqttv3.internal.TCPNetworkModule.start(TCPNetworkModule.java:70) ~[?:?]
        ... 2 more

vzorglub · June 1, 2018, 3:51pm

reboot the pi

Dim · June 1, 2018, 3:56pm

it seems that mosquitto is not running (it doesn’t seem to be an auth issue)
it is strange but if you don’t put anything (port, listener, etc) in the config file for networking… it works (it uses the defaults)
(I saw this recently on my rPi3 after I upgraded mosquitto to v1.5)

try the following for mosquitto.conf:

persistence false
log_dest file /var/log/mosquitto/mosquitto.log
log_type information
connection_message true
log_timestamp true
allow_anonymous false
password_file /etc/mosquitto/pwfile

github.com/eclipse/mosquitto

Stopped working on Pi when running via systemctl

opened 12:56PM - 20 May 18 UTC

TotallyInformation

I've just updated my Pi which is running Rasbian Jesse. I guess I got v1.5 at th…at point. However, I now always get the following error when booting the Pi: ``` [Sun May 20 10:56:19 2018]: mosquitto version 1.5 starting [Sun May 20 10:56:19 2018]: Config loaded from /etc/mosquitto/mosquitto.conf. [Sun May 20 10:56:19 2018]: Opening ipv4 listen socket on port 1883. [Sun May 20 10:56:19 2018]: Opening ipv6 listen socket on port 1883. [Sun May 20 10:56:19 2018]: Opening websockets listen socket on port 9001. [Sun May 20 10:56:19 2018]: Opening ipv4 listen socket on port 1883. [Sun May 20 10:56:19 2018]: Error: Address already in use ``` As you can see, it appears to be trying to open twice. The result is that no connections are possible. I removed Mosquitto and reinstalled after manually deleting `/etc/mosquitto` and weirdly, I still get the same problem even though I now have no config file at all. When I run it manually from the command line, everything works as expected. Importantly, running without a config file means that I don't get websockets on port 9001 which is what I expect so I can't work out what is causing that configuration to still be active when running via systemctl. Confused!! Can anyone help? Thanks.

rajeev2301 · June 1, 2018, 4:03pm

@Vincent

I did reboot pi. Here is OH log

2018-06-01 08:57:55.755 [INFO ] [thome.model.lsp.internal.ModelServer] - Started Language Server Protocol (LSP) service on port 5007
2018-06-01 08:57:56.953 [INFO ] [el.core.internal.ModelRepositoryImpl] - Loading model 'MyHome.things'
2018-06-01 08:57:58.897 [INFO ] [basic.internal.servlet.WebAppServlet] - Started Basic UI at /basicui/app
2018-06-01 08:57:59.058 [INFO ] [arthome.ui.paper.internal.PaperUIApp] - Started Paper UI at /paperui
2018-06-01 08:57:59.136 [INFO ] [panel.internal.HABPanelDashboardTile] - Started HABPanel at /habpanel
2018-06-01 08:57:59.544 [INFO ] [penhab.io.transport.mqtt.MqttService] - MQTT Service initialization completed.
2018-06-01 08:57:59.551 [INFO ] [t.mqtt.internal.MqttBrokerConnection] - Starting MQTT broker connection 'broker'
2018-06-01 08:57:59.826 [ERROR] [penhab.io.transport.mqtt.MqttService] - Error starting broker connection
org.eclipse.paho.client.mqttv3.MqttException: Unable to connect to server
        at org.eclipse.paho.client.mqttv3.internal.TCPNetworkModule.start(TCPNetworkModule.java:79) [225:org.openhab.io.transport.mqtt:1.12.0.RC2]
        at org.eclipse.paho.client.mqttv3.internal.ClientComms$ConnectBG.run(ClientComms.java:650) [225:org.openhab.io.transport.mqtt:1.12.0.RC2]
        at java.lang.Thread.run(Thread.java:745) [?:?]
Caused by: java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:?]
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:?]
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:?]
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:?]
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:?]
        at java.net.Socket.connect(Socket.java:589) ~[?:?]
        at org.eclipse.paho.client.mqttv3.internal.TCPNetworkModule.start(TCPNetworkModule.java:70) ~[?:?]

Dim · June 1, 2018, 4:03pm

fix your mosquitto

vzorglub · June 1, 2018, 4:09pm

uninstall and purge mosquitto

sudo apt-get purge mosquitto
sudo reboot

Then follow:

STEP BY STEP
Don’t skip one thinking that you know better. You don’t

rajeev2301 · June 1, 2018, 4:11pm

Sure !

Let me uninstall and purge mosquitto.

Dim · June 1, 2018, 4:12pm

if you don’t fix your mosquitto.conf… you will spend all week here
comment out all networking options from the file and check if mosquitto is running
then, OH2 will connect (your mqtt.cfg is finally correct)

rajeev2301 · June 1, 2018, 4:16pm

sure !

Just another input for your guys while I am trying to install Mosquitto again… I had MQTT.fx runnning on another PC and till yesterday it was connecting properly with MQTT broker… In fact I was able to publish and subscribe messages…

Dim · June 1, 2018, 4:19pm

now… MQTT.fx cannot connect to the broker… correct?