OH2.2 Displaying Grafana Graphs

KevinI · December 27, 2017, 9:55am

Hi all,

Seems my issue has re-started where grafana graphs stop showing in either the browser or IOS app and I get the following errors in the openhab log, I know grafana is working fine as I can view the logs direct.
This issue only started after upgrading to OH2.2, ive tried just restart OH when the error occurs but that doesnt help,this all worked fine in OH2.1

2017-12-27 09:43:36.561 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:43:39.147 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:43:39.734 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:43:39.750 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:06.919 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:06.925 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:06.927 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:06.967 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:06.970 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:06.975 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:07.080 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:07.080 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:07.088 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:09.583 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:13.541 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:13.816 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:13.816 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:13.818 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:13.879 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:13.881 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:13.881 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:21.932 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:21.931 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:22.586 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:28.956 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:28.981 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:28.984 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:44.099 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:44.123 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:44.123 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:44.381 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:44.381 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:44.383 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:44.426 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:44.429 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:44:44.431 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:45:07.418 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-27 09:45:07.424 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout

Configuration in sitemap

		Frame  {
				Image item=System_Temperature_CPU
				url="http://192.168.1.176:3000/render/dashboard-solo/db/openhab-system?refresh=5m&orgId=1&panelId=6&from=now-1d&to=now&width=1000&height=320&tz=UTC%2B00%3A00"
				refresh=60000
				Image item=System_Temperature_CPU
				url="http://192.168.1.176:3000/render/dashboard-solo/db/openhab-system?refresh=5m&orgId=1&panelId=6&from=now-31d&to=now&width=1000&height=320&tz=UTC%2B00%3A00"
				refresh=60000
				Image item=System_Temperature_CPU
				url="http://192.168.1.176:3000/render/dashboard-solo/db/openhab-system?refresh=5m&orgId=1&panelId=6&from=now-183d&to=now&width=1000&height=320&tz=UTC%2B00%3A00"
				refresh=60000
				}

OH2.2 and grafana run on separate Pi 3 to keep the load and logging away from the main OH platform.

OH2.2

# openhab-cli info
Version:     2.2.0 (Build)

User:        openhab (Active Process 11942)
User Groups: openhab tty dialout video

Directories: Folder Name      | Path                        | User:Group
             -----------      | ----                        | ----------
             OPENHAB_HOME     | /usr/share/openhab2         | openhab:openhab
             OPENHAB_RUNTIME  | /usr/share/openhab2/runtime | openhab:openhab
             OPENHAB_USERDATA | /var/lib/openhab2           | openhab:openhab
             OPENHAB_CONF     | /etc/openhab2               | openhab:openhab
             OPENHAB_LOGDIR   | /var/log/openhab2           | root:root
             OPENHAB_BACKUPS  | /var/lib/openhab2/backups   | root:root

URLs:        http://192.168.1.142:8080
             https://192.168.1.142:8443

# lsb_release -a
No LSB modules are available.
Distributor ID:	Raspbian
Description:	Raspbian GNU/Linux 8.0 (jessie)
Release:	8.0
Codename:	jessie

Cheers

Kevin

rlkoshak · December 27, 2017, 8:19pm

I’m going to guess you upgraded Grafana when you upgraded OH.

I bet the problem is on the Grafana side, not the openHAB side. If you put that URL into a browser, do you get the chart or does the request time out? If it times out you will know for sure that the problem is Grafana, not openHAB.

KevinI · December 27, 2017, 11:22pm

Hi Rich,

Grafana is on a separate Pi3 so thats not been touched when I did the OH2.2 upgrade, I can access the graphs fine via the direct URL and wget works fine from the Pi3 running OH2.2 and it only takes about 3-4 seconds to return a chart.

So the issue has to be OH2.2 related, Ive also noticed it seems to be a bit more resource hungry CPU and memory and I’m having to reboot the Pi3 sometimes as restarting OH doesn’t seem to fix the issue.

It was all pretty much stable prior to moving to 2.2 and I could go back to a previous image I have however I’d rather stick with 2.2 and resolve this somehow but ultimately I need a stable environment.

Regards

Kevin

rlkoshak · December 27, 2017, 11:31pm

Maybe whatever is making the HTTP call isn’t waiting long enough. I’ve no other ideas.

KevinI · December 28, 2017, 8:53am

Thanks Rich,

I will just keep digging around as I’d rather not go back the way.

Kevin

KevinI · December 28, 2017, 10:36pm

Hi,

Looking for any idea on how I can find more info on the following and previously posted errors?
Any logging option I can enable to get more details?

2017-12-28 22:31:30.471 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-28 22:31:43.937 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-28 22:31:44.266 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-28 22:31:45.490 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-28 22:31:56.293 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-28 22:31:58.953 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-28 22:31:59.272 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout

Kevin

J-N-K · December 28, 2017, 10:57pm

There is not much logging available. The timeout is set to 15s, so probably the root cause is not a real timeout but something else.

KevinI · December 29, 2017, 7:26am

Hi,

Thanks for the update but not sure where this leaves me.

I have no idea how to debug this issue if I cant get more details I can see I have a few options open but not sure I’m keen on any of them.

Revert back to OH2.1 as that was working fine
Disable all graphs in sitemap, that should stop both the web and especially the IOS app from showing null graphs, the IOS app also tends to throw a “ERROR - The Request timed out” error after a while and then is unresponsive until I close/restart the app.
Try and display the graphs another way, took ages to get figure out how to get them to show in a browser and via the IOS app and Image/URL seems to be the only way it works in both - for me.
Try and debug this issue, really no idea where to start with that.

Ultimately stability is my goal as the misses will not be pleased if the home automation starts to be flakey as she doesnt see why we cant just use light switches like the good old days

Kevin

KevinI · December 30, 2017, 1:29pm

Hi,

Ok so Ive made a subtle change to my setup and Ive got the graphs displaying again, for now.

Some time ago I configured a MESH network between the OH Pi3 and the Grafana Pi3 over the on-board wireless networks, it was meant as a PoC to see if i could create a private network for fail over should the main router go down, or a power outage as both Pi’s have battery backup, anyhow I never managed to take it very far but the network remains active.

I have changed the graphs to point to the Grafana host via the MESH network IP and the graphs are showing fine at the moment, time will tell if it lasts, this was done without restarting OH2.2 and just updating the sitemap.

I have noticed the following errors had appeared in the openhab log prior to me making this change which are against the old Grafana IP address, I can also see 66 “ESTABLISHED” connections still exist via the old IP.

2017-12-30 13:02:53.245 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content: java.util.concurrent.RejectedExecutionException: Max requests per destination 1024 exceeded for HttpDestination[http://192.168.1.176:3000]@189f7b,queue=1024,pool=DuplexConnectionPool[c=64/64,a=64,i=0]
2017-12-30 13:02:53.308 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content: java.util.concurrent.RejectedExecutionException: Max requests per destination 1024 exceeded for HttpDestination[http://192.168.1.176:3000]@189f7b,queue=1024,pool=DuplexConnectionPool[c=64/64,a=64,i=0]
2017-12-30 13:02:53.368 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content: java.util.concurrent.RejectedExecutionException: Max requests per destination 1024 exceeded for HttpDestination[http://192.168.1.176:3000]@189f7b,queue=1024,pool=DuplexConnectionPool[c=64/64,a=64,i=0]
2017-12-30 13:02:53.426 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content: java.util.concurrent.RejectedExecutionException: Max requests per destination 1024 exceeded for HttpDestination[http://192.168.1.176:3000]@189f7b,queue=1024,pool=DuplexConnectionPool[c=64/64,a=64,i=0]
2017-12-30 13:02:53.484 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content: java.util.concurrent.RejectedExecutionException: Max requests per destination 1024 exceeded for HttpDestination[http://192.168.1.176:3000]@189f7b,queue=1024,pool=DuplexConnectionPool[c=64/64,a=64,i=0]
2017-12-30 13:02:53.542 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content: java.util.concurrent.RejectedExecutionException: Max requests per destination 1024 exceeded for HttpDestination[http://192.168.1.176:3000]@189f7b,queue=1024,pool=DuplexConnectionPool[c=64/64,a=64,i=0]

Connections showing over old IP address of Grafana server

tcp6   57930      0 192.168.1.142:58336     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57806     192.168.1.176:3000      ESTABLISHED
tcp6   55914      0 192.168.1.142:45364     192.168.1.176:3000      ESTABLISHED
tcp6   57231      0 192.168.1.142:41288     192.168.1.176:3000      ESTABLISHED
tcp6   24308      0 192.168.1.142:58300     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57842     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57798     192.168.1.176:3000      ESTABLISHED
tcp6   34583      0 192.168.1.142:41290     192.168.1.176:3000      ESTABLISHED
tcp6   35463      0 192.168.1.142:58770     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57816     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:45406     192.168.1.176:3000      ESTABLISHED
tcp6   55945      0 192.168.1.142:45446     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57796     192.168.1.176:3000      ESTABLISHED
tcp6   36848      0 192.168.1.142:48912     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57810     192.168.1.176:3000      ESTABLISHED
tcp6   57396      0 192.168.1.142:45420     192.168.1.176:3000      ESTABLISHED
tcp6   54615      0 192.168.1.142:41296     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:58368     192.168.1.176:3000      ESTABLISHED
tcp6   33969      0 192.168.1.142:58366     192.168.1.176:3000      ESTABLISHED
tcp6   53568      0 192.168.1.142:58352     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57790     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:52002     192.168.1.176:8086      ESTABLISHED
tcp6   24310      0 192.168.1.142:58276     192.168.1.176:3000      ESTABLISHED
tcp6   53451      0 192.168.1.142:58364     192.168.1.176:3000      ESTABLISHED
tcp6   39191      0 192.168.1.142:59806     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:58318     192.168.1.176:3000      ESTABLISHED
tcp6   30532      0 192.168.1.142:57848     192.168.1.176:3000      ESTABLISHED
tcp6   24308      0 192.168.1.142:58282     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57838     192.168.1.176:3000      ESTABLISHED
tcp6   53543      0 192.168.1.142:58332     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57832     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57802     192.168.1.176:3000      ESTABLISHED
tcp6   34507      0 192.168.1.142:45434     192.168.1.176:3000      ESTABLISHED
tcp6   41137      0 192.168.1.142:58354     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57788     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57794     192.168.1.176:3000      ESTABLISHED
tcp6   55942      0 192.168.1.142:45390     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57844     192.168.1.176:3000      ESTABLISHED
tcp6   57441      0 192.168.1.142:41298     192.168.1.176:3000      ESTABLISHED
tcp6   33360      0 192.168.1.142:45478     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57812     192.168.1.176:3000      ESTABLISHED
tcp6   54316      0 192.168.1.142:45408     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57834     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57786     192.168.1.176:3000      ESTABLISHED
tcp6   49207      0 192.168.1.142:57850     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:52530     192.168.1.176:8086      ESTABLISHED
tcp6   56021      0 192.168.1.142:45392     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57828     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:45378     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:58358     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:58330     192.168.1.176:3000      ESTABLISHED
tcp6   57362      0 192.168.1.142:45394     192.168.1.176:3000      ESTABLISHED
tcp6   36794      0 192.168.1.142:58360     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57830     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:58302     192.168.1.176:3000      ESTABLISHED
tcp6   29124      0 192.168.1.142:57846     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:58350     192.168.1.176:3000      ESTABLISHED
tcp6   44436      0 192.168.1.142:45464     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57840     192.168.1.176:3000      ESTABLISHED
tcp6   53315      0 192.168.1.142:58316     192.168.1.176:3000      ESTABLISHED
tcp6   34578      0 192.168.1.142:45450     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57804     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57814     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:58334     192.168.1.176:3000      ESTABLISHED
tcp6   57522      0 192.168.1.142:45366     192.168.1.176:3000      ESTABLISHED
tcp6       0      0 192.168.1.142:57792     192.168.1.176:3000      ESTABLISHED

Question should the connections not get closed if no graphs are being displayed via browser or IOS app?

Will see if the network change stays stable or goes the same way after some usage.

Kevin

KevinI · December 30, 2017, 1:39pm

Ok so it didnt last for long and the following occurred after a few minutes of viewing graphs via the browser and IOS app, the direct connection via the Grafana front end also threw errors so looks like the service is getting flooded by requests when I’m trying to view graphs.

2017-12-30 13:15:04.257 [INFO ] [el.core.internal.ModelRepositoryImpl] - Refreshing model 'MyHome.sitemap'
2017-12-30 13:15:04.379 [INFO ] [el.core.internal.ModelRepositoryImpl] - Refreshing model 'MyHome.sitemap'
2017-12-30 13:20:00.048 [INFO ] [smarthome.model.script.Temperature: ] - System Temp CPU 52.078
2017-12-30 13:20:00.089 [INFO ] [smarthome.model.script.Temperature: ] - System Fan 25
2017-12-30 13:20:00.120 [INFO ] [g.eclipse.smarthome.model.script.UPS] - Speed changed to 50 52.078
2017-12-30 13:20:00.147 [INFO ] [lipse.smarthome.io.net.exec.ExecUtil] - executed commandLine '/bin/bash /home/pi/bin/ups-fan speed 50'
2017-12-30 13:32:55.949 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:33:49.934 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:33:49.941 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:33:49.939 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:33:50.002 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:33:50.048 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:33:50.046 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:33:50.046 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:33:50.045 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:34:02.846 [ERROR] [org.influxdb.impl.BatchProcessor    ] - Batch could not be sent. Data will be lost
retrofit.RetrofitError: Connection reset
	at retrofit.RetrofitError.networkError(RetrofitError.java:27) ~[225:org.openhab.persistence.influxdb:1.11.0]
	at retrofit.RestAdapter$RestHandler.invokeRequest(RestAdapter.java:395) [225:org.openhab.persistence.influxdb:1.11.0]
	at retrofit.RestAdapter$RestHandler.invoke(RestAdapter.java:240) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.$Proxy155.writePoints(Unknown Source) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.InfluxDBImpl.write(InfluxDBImpl.java:151) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.BatchProcessor.write(BatchProcessor.java:171) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.BatchProcessor$1.run(BatchProcessor.java:144) [225:org.openhab.persistence.influxdb:1.11.0]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:?]
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:?]
	at java.lang.Thread.run(Thread.java:748) [?:?]
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:210) ~[?:?]
	at java.net.SocketInputStream.read(SocketInputStream.java:141) ~[?:?]
	at okio.Okio$2.read(Okio.java:137) ~[?:?]
	at okio.AsyncTimeout$2.read(AsyncTimeout.java:211) ~[?:?]
	at okio.RealBufferedSource.indexOf(RealBufferedSource.java:306) ~[?:?]
	at okio.RealBufferedSource.indexOf(RealBufferedSource.java:300) ~[?:?]
	at okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:196) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpConnection.readResponse(HttpConnection.java:191) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpTransport.readResponseHeaders(HttpTransport.java:80) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.readNetworkResponse(HttpEngine.java:917) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.access$300(HttpEngine.java:95) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine$NetworkInterceptorChain.proceed(HttpEngine.java:902) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.readResponse(HttpEngine.java:760) ~[?:?]
	at com.squareup.okhttp.Call.getResponse(Call.java:274) ~[?:?]
	at com.squareup.okhttp.Call$ApplicationInterceptorChain.proceed(Call.java:230) ~[?:?]
	at com.squareup.okhttp.Call.getResponseWithInterceptorChain(Call.java:201) ~[?:?]
	at com.squareup.okhttp.Call.execute(Call.java:81) ~[?:?]
	at retrofit.client.OkClient.execute(OkClient.java:53) ~[?:?]
	at retrofit.RestAdapter$RestHandler.invokeRequest(RestAdapter.java:326) ~[?:?]
	... 12 more
2017-12-30 13:34:03.185 [ERROR] [org.influxdb.impl.BatchProcessor    ] - Batch could not be sent. Data will be lost
retrofit.RetrofitError: Connection refused (Connection refused)
	at retrofit.RetrofitError.networkError(RetrofitError.java:27) ~[225:org.openhab.persistence.influxdb:1.11.0]
	at retrofit.RestAdapter$RestHandler.invokeRequest(RestAdapter.java:395) [225:org.openhab.persistence.influxdb:1.11.0]
	at retrofit.RestAdapter$RestHandler.invoke(RestAdapter.java:240) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.$Proxy155.writePoints(Unknown Source) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.InfluxDBImpl.write(InfluxDBImpl.java:151) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.BatchProcessor.write(BatchProcessor.java:171) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.BatchProcessor$1.run(BatchProcessor.java:144) [225:org.openhab.persistence.influxdb:1.11.0]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:?]
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:?]
	at java.lang.Thread.run(Thread.java:748) [?:?]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:?]
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:?]
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:?]
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:?]
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:?]
	at java.net.Socket.connect(Socket.java:589) ~[?:?]
	at com.squareup.okhttp.internal.Platform.connectSocket(Platform.java:100) ~[?:?]
	at com.squareup.okhttp.internal.http.SocketConnector.connectRawSocket(SocketConnector.java:160) ~[?:?]
	at com.squareup.okhttp.internal.http.SocketConnector.connectCleartext(SocketConnector.java:67) ~[?:?]
	at com.squareup.okhttp.Connection.connect(Connection.java:152) ~[?:?]
	at com.squareup.okhttp.Connection.connectAndSetOwner(Connection.java:185) ~[?:?]
	at com.squareup.okhttp.OkHttpClient$1.connectAndSetOwner(OkHttpClient.java:128) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.nextConnection(HttpEngine.java:341) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.connect(HttpEngine.java:330) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.sendRequest(HttpEngine.java:248) ~[?:?]
	at com.squareup.okhttp.Call.getResponse(Call.java:273) ~[?:?]
	at com.squareup.okhttp.Call$ApplicationInterceptorChain.proceed(Call.java:230) ~[?:?]
	at com.squareup.okhttp.Call.getResponseWithInterceptorChain(Call.java:201) ~[?:?]
	at com.squareup.okhttp.Call.execute(Call.java:81) ~[?:?]
	at retrofit.client.OkClient.execute(OkClient.java:53) ~[?:?]
	at retrofit.RestAdapter$RestHandler.invokeRequest(RestAdapter.java:326) ~[?:?]
	... 12 more
2017-12-30 13:34:05.104 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:34:05.129 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:34:05.128 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:34:06.135 [ERROR] [org.influxdb.impl.BatchProcessor    ] - Batch could not be sent. Data will be lost
retrofit.RetrofitError: Connection refused (Connection refused)
	at retrofit.RetrofitError.networkError(RetrofitError.java:27) ~[225:org.openhab.persistence.influxdb:1.11.0]
	at retrofit.RestAdapter$RestHandler.invokeRequest(RestAdapter.java:395) [225:org.openhab.persistence.influxdb:1.11.0]
	at retrofit.RestAdapter$RestHandler.invoke(RestAdapter.java:240) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.$Proxy155.writePoints(Unknown Source) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.InfluxDBImpl.write(InfluxDBImpl.java:151) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.BatchProcessor.write(BatchProcessor.java:171) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.BatchProcessor$1.run(BatchProcessor.java:144) [225:org.openhab.persistence.influxdb:1.11.0]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:?]
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:?]
	at java.lang.Thread.run(Thread.java:748) [?:?]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:?]
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:?]
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:?]
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:?]
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:?]
	at java.net.Socket.connect(Socket.java:589) ~[?:?]
	at com.squareup.okhttp.internal.Platform.connectSocket(Platform.java:100) ~[?:?]
	at com.squareup.okhttp.internal.http.SocketConnector.connectRawSocket(SocketConnector.java:160) ~[?:?]
	at com.squareup.okhttp.internal.http.SocketConnector.connectCleartext(SocketConnector.java:67) ~[?:?]
	at com.squareup.okhttp.Connection.connect(Connection.java:152) ~[?:?]
	at com.squareup.okhttp.Connection.connectAndSetOwner(Connection.java:185) ~[?:?]
	at com.squareup.okhttp.OkHttpClient$1.connectAndSetOwner(OkHttpClient.java:128) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.nextConnection(HttpEngine.java:341) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.connect(HttpEngine.java:330) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.sendRequest(HttpEngine.java:248) ~[?:?]
	at com.squareup.okhttp.Call.getResponse(Call.java:273) ~[?:?]
	at com.squareup.okhttp.Call$ApplicationInterceptorChain.proceed(Call.java:230) ~[?:?]
	at com.squareup.okhttp.Call.getResponseWithInterceptorChain(Call.java:201) ~[?:?]
	at com.squareup.okhttp.Call.execute(Call.java:81) ~[?:?]
	at retrofit.client.OkClient.execute(OkClient.java:53) ~[?:?]
	at retrofit.RestAdapter$RestHandler.invokeRequest(RestAdapter.java:326) ~[?:?]
	... 12 more
2017-12-30 13:34:09.333 [ERROR] [org.influxdb.impl.BatchProcessor    ] - Batch could not be sent. Data will be lost
retrofit.RetrofitError: Connection refused (Connection refused)
	at retrofit.RetrofitError.networkError(RetrofitError.java:27) ~[225:org.openhab.persistence.influxdb:1.11.0]
	at retrofit.RestAdapter$RestHandler.invokeRequest(RestAdapter.java:395) [225:org.openhab.persistence.influxdb:1.11.0]
	at retrofit.RestAdapter$RestHandler.invoke(RestAdapter.java:240) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.$Proxy155.writePoints(Unknown Source) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.InfluxDBImpl.write(InfluxDBImpl.java:151) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.BatchProcessor.write(BatchProcessor.java:171) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.BatchProcessor$1.run(BatchProcessor.java:144) [225:org.openhab.persistence.influxdb:1.11.0]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:?]
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:?]
	at java.lang.Thread.run(Thread.java:748) [?:?]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:?]
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:?]
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:?]
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:?]
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:?]
	at java.net.Socket.connect(Socket.java:589) ~[?:?]
	at com.squareup.okhttp.internal.Platform.connectSocket(Platform.java:100) ~[?:?]
	at com.squareup.okhttp.internal.http.SocketConnector.connectRawSocket(SocketConnector.java:160) ~[?:?]
	at com.squareup.okhttp.internal.http.SocketConnector.connectCleartext(SocketConnector.java:67) ~[?:?]
	at com.squareup.okhttp.Connection.connect(Connection.java:152) ~[?:?]
	at com.squareup.okhttp.Connection.connectAndSetOwner(Connection.java:185) ~[?:?]
	at com.squareup.okhttp.OkHttpClient$1.connectAndSetOwner(OkHttpClient.java:128) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.nextConnection(HttpEngine.java:341) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.connect(HttpEngine.java:330) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.sendRequest(HttpEngine.java:248) ~[?:?]
	at com.squareup.okhttp.Call.getResponse(Call.java:273) ~[?:?]
	at com.squareup.okhttp.Call$ApplicationInterceptorChain.proceed(Call.java:230) ~[?:?]
	at com.squareup.okhttp.Call.getResponseWithInterceptorChain(Call.java:201) ~[?:?]
	at com.squareup.okhttp.Call.execute(Call.java:81) ~[?:?]
	at retrofit.client.OkClient.execute(OkClient.java:53) ~[?:?]
	at retrofit.RestAdapter$RestHandler.invokeRequest(RestAdapter.java:326) ~[?:?]
	... 12 more
2017-12-30 13:34:11.058 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:34:11.060 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:34:11.058 [WARN ] [.internal.proxy.BlockingProxyServlet] - Proxy servlet failed to stream content due to a timeout
2017-12-30 13:34:12.334 [ERROR] [org.influxdb.impl.BatchProcessor    ] - Batch could not be sent. Data will be lost
retrofit.RetrofitError: Connection refused (Connection refused)
	at retrofit.RetrofitError.networkError(RetrofitError.java:27) ~[225:org.openhab.persistence.influxdb:1.11.0]
	at retrofit.RestAdapter$RestHandler.invokeRequest(RestAdapter.java:395) [225:org.openhab.persistence.influxdb:1.11.0]
	at retrofit.RestAdapter$RestHandler.invoke(RestAdapter.java:240) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.$Proxy155.writePoints(Unknown Source) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.InfluxDBImpl.write(InfluxDBImpl.java:151) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.BatchProcessor.write(BatchProcessor.java:171) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.BatchProcessor$1.run(BatchProcessor.java:144) [225:org.openhab.persistence.influxdb:1.11.0]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:?]
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:?]
	at java.lang.Thread.run(Thread.java:748) [?:?]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:?]
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:?]
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:?]
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:?]
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:?]
	at java.net.Socket.connect(Socket.java:589) ~[?:?]
	at com.squareup.okhttp.internal.Platform.connectSocket(Platform.java:100) ~[?:?]
	at com.squareup.okhttp.internal.http.SocketConnector.connectRawSocket(SocketConnector.java:160) ~[?:?]
	at com.squareup.okhttp.internal.http.SocketConnector.connectCleartext(SocketConnector.java:67) ~[?:?]
	at com.squareup.okhttp.Connection.connect(Connection.java:152) ~[?:?]
	at com.squareup.okhttp.Connection.connectAndSetOwner(Connection.java:185) ~[?:?]
	at com.squareup.okhttp.OkHttpClient$1.connectAndSetOwner(OkHttpClient.java:128) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.nextConnection(HttpEngine.java:341) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.connect(HttpEngine.java:330) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.sendRequest(HttpEngine.java:248) ~[?:?]
	at com.squareup.okhttp.Call.getResponse(Call.java:273) ~[?:?]
	at com.squareup.okhttp.Call$ApplicationInterceptorChain.proceed(Call.java:230) ~[?:?]
	at com.squareup.okhttp.Call.getResponseWithInterceptorChain(Call.java:201) ~[?:?]
	at com.squareup.okhttp.Call.execute(Call.java:81) ~[?:?]
	at retrofit.client.OkClient.execute(OkClient.java:53) ~[?:?]
	at retrofit.RestAdapter$RestHandler.invokeRequest(RestAdapter.java:326) ~[?:?]
	... 12 more
2017-12-30 13:34:12.596 [ERROR] [org.influxdb.impl.BatchProcessor    ] - Batch could not be sent. Data will be lost
retrofit.RetrofitError: Connection refused (Connection refused)
	at retrofit.RetrofitError.networkError(RetrofitError.java:27) ~[225:org.openhab.persistence.influxdb:1.11.0]
	at retrofit.RestAdapter$RestHandler.invokeRequest(RestAdapter.java:395) [225:org.openhab.persistence.influxdb:1.11.0]
	at retrofit.RestAdapter$RestHandler.invoke(RestAdapter.java:240) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.$Proxy155.writePoints(Unknown Source) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.InfluxDBImpl.write(InfluxDBImpl.java:151) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.BatchProcessor.write(BatchProcessor.java:171) [225:org.openhab.persistence.influxdb:1.11.0]
	at org.influxdb.impl.BatchProcessor$1.run(BatchProcessor.java:144) [225:org.openhab.persistence.influxdb:1.11.0]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:?]
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:?]
	at java.lang.Thread.run(Thread.java:748) [?:?]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:?]
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:?]
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:?]
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:?]
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:?]
	at java.net.Socket.connect(Socket.java:589) ~[?:?]
	at com.squareup.okhttp.internal.Platform.connectSocket(Platform.java:100) ~[?:?]
	at com.squareup.okhttp.internal.http.SocketConnector.connectRawSocket(SocketConnector.java:160) ~[?:?]
	at com.squareup.okhttp.internal.http.SocketConnector.connectCleartext(SocketConnector.java:67) ~[?:?]
	at com.squareup.okhttp.Connection.connect(Connection.java:152) ~[?:?]
	at com.squareup.okhttp.Connection.connectAndSetOwner(Connection.java:185) ~[?:?]
	at com.squareup.okhttp.OkHttpClient$1.connectAndSetOwner(OkHttpClient.java:128) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.nextConnection(HttpEngine.java:341) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.connect(HttpEngine.java:330) ~[?:?]
	at com.squareup.okhttp.internal.http.HttpEngine.sendRequest(HttpEngine.java:248) ~[?:?]
	at com.squareup.okhttp.Call.getResponse(Call.java:273) ~[?:?]
	at com.squareup.okhttp.Call$ApplicationInterceptorChain.proceed(Call.java:230) ~[?:?]
	at com.squareup.okhttp.Call.getResponseWithInterceptorChain(Call.java:201) ~[?:?]
	at com.squareup.okhttp.Call.execute(Call.java:81) ~[?:?]
	at retrofit.client.OkClient.execute(OkClient.java:53) ~[?:?]
	at retrofit.RestAdapter$RestHandler.invokeRequest(RestAdapter.java:326) ~[?:?]
	... 12 more

Back to the drawing board.

Kevin

Kees_M · February 14, 2018, 6:58am

Hi @KevinI,
Have you made any progress in finding what is causing this issue?

I have a very similar issue with grapes showing after a openhab2(.2) restart and stopping after 10 minutes or so with a blocking proxy timeout. Grafana still shows the graphs at that time.

I have one exception: one graph never shows in openhab, only in grafana. It logs the same blocking proxy timeout right after a restart.

I have enabled anonymous access in grafana.

Does anybody have any suggestions?

Kind regards,
K

Kees_M · February 14, 2018, 9:46am

When I increased logging for jetty (org.eclipse.jetty) to DEBUG I saw an error “Max connections 64/64 reached” from jetty.client.DuplexConnectionPool.

Is this an error (e.g. connections not being closed) or should I increase the max number of connections (and where do I do that)?

KevinI · February 14, 2018, 5:12pm

Hi @Kees_M

Sadly I have not had the time to investigate further so for now I’m using a work around which has never caused any issues and the connections to Granafa stay pretty consistent.

It seems to me that OH2 is less tolerant about timeouts while waiting for Grafana to return a graph and triggers more connections as a consequence which will hit that 64 max limit however for me 60 connections to the standalone Grafana/Influxdb Pi3 where enough to kill the pi network.

Something I need to go back to in the future as Id like to be back with the direct rendered graphs.

Regards

Kevin

Opsym · February 17, 2018, 9:33pm

Hi @KevinI

I have found something that improves things.
The maximum number of connections in debian was set to 128.

When I increase it to 1024 things seem to run better.

Enter

sysctl net.core.somaxconn=1024

or add
net.core.somaxconn=1024 to /etc/sysctl.conf
and enter sysctl -p

It has been running fine for more than an hour now (in the past grafana would not work well for more than 5 minutes).
Edit: after more than 12 hours it still runs fine.