Maybe a wild guess, but I currently believe that disable things does not solve the issue… in my case, the old 2.5.9 system is even more instable since I am disable every"thing" that I have already migraded to a new OH3 instance. I recommend deinstalling the binding itself after the things are disabled. But I have no idea if that will have an effect on your problem 
Actually yesterday I also thought about this idea, since I noticed in the log the enty “ModBus Manager starting” which I think means the binding is even active with all things disabled. I will follow this idea and uninstall the binding so I can see which effect it has.
Hello community,
I upgraded my OH2.5 with very few content to OH3 nearly on release day. After that I started playing around with blockly based rules and dsl rules. Soon the amount of rules was getting bigger and the system got more an more unstable. The java heap space errors occured nearly daily.
The logfile-entries based on the systeminfo binding showed a memory consumption on a quite stable level. The problems really seem to be related to the gui based rules. I moved all my rules to file based rules and from that moment on openhab doesnt seem to crash anymore.
Maybe the problems are also related to the mixture of openjdk8 and openjdk11. Both are still present because of the upgrade. I should give it a shot and try a fresh, clean install of plain OH3.
Cheers …
1 Like
I think it has nothing to do with the different jdk versions. I started with oh 3 (actually oh3.1 m1) on a fresh system with openhabian. But with the time the number of rules grows, actually 52 ui dsl rules. And from time to time I have Java heap space errors, but mostly when I am playing with the rules (e.g. play the rule to test something).
I use a Raspberry pi 3b+
Proxmox vm with 2cpu and 4gb memory, Ubuntu 20.04
Hi all,
I run into the same problem with fresh install OH3.0 on new Raspberry pi4 4go.
Got some heap space crash after upgrade to OH3.0.1 (note that I installed 3.0.0 not long enough to see this bug perhaps)
Hint : could it be related to Visual Studio Code ? I noticed that before definitively crash and loop 100% cpu my VSC link (LSP) to OH broke. (no code/error check…). Do you play with VSC also ? It is perhaps just a side effect of java memory leak at this moment …
No, I don’t use vsc…
Hello @morph166955,
Due to the forum restore, can you please describe again how to generate the dump file for the Java process? In case of a heap space error I will try to generate a file.
The last weekend, I hit the same issue. In the past I was lucky to catch the slow down before the heap space is OOM, but not this time,
2021-02-07 08:57:31.846 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=macOnline, getAction=GetSpecificHostEntry, dataType='boolean, parameter='3C:CD:36:A3:84:CA'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-07 08:57:35.266 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanAccessType, getAction=GetCommonLinkProperties, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-07 08:58:40.717 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=macOnline, getAction=GetSpecificHostEntry, dataType='boolean, parameter='06:CE:2A:53:EF:2D'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-07 08:59:39.634 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=macOnline, getAction=GetSpecificHostEntry, dataType='boolean, parameter='06:CE:2A:53:EF:2D'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-07 09:00:21.387 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=macOnline, getAction=GetSpecificHostEntry, dataType='boolean, parameter='B8:F1:2A:5D:A3:2D'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-07 09:00:31.695 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=macOnline, getAction=GetSpecificHostEntry, dataType='boolean, parameter='B8:F1:2A:5D:A3:2D'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-07 09:02:35.058 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=macOnline, getAction=GetSpecificHostEntry, dataType='boolean, parameter='DC:52:85:AC:C9:D2'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-07 09:02:55.752 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanConnectionStatus, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-07 09:03:19.894 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=macOnline, getAction=GetSpecificHostEntry, dataType='boolean, parameter='DC:52:85:AC:C9:D2'}: java.util.concurrent.ExecutionException: java.net.SocketTimeoutException: Connect Timeout
2021-02-07 09:03:44.006 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=macOnline, getAction=GetSpecificHostEntry, dataType='boolean, parameter='3C:CD:36:A3:84:CA'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-07 09:03:44.006 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=macOnline, getAction=GetSpecificHostEntry, dataType='boolean, parameter='3C:CD:36:A3:84:CA'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-07 09:04:04.678 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanMaxDownstreamRate, getAction=GetCommonLinkProperties, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-07 09:05:44.682 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanConnectionStatus, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-07 09:06:08.872 [WARN ] [p.internal.http.HttpResponseListener] - Requesting 'https://www.pegelonline.wsv.de/webservices/rest-api/v2/stations/WORMS/W/currentmeasurement.json' (method='GET', content='null') failed: Total timeout 3000 ms elapsed
2021-02-07 09:08:13.010 [WARN ] [e.jetty.util.thread.QueuedThreadPool] -
java.lang.OutOfMemoryError: Java heap space
2021-02-07 09:11:36.304 [WARN ] [mmon.WrappedScheduledExecutorService] - Scheduled runnable ended with an exception:
java.lang.OutOfMemoryError: Java heap space
2021-02-07 09:11:36.304 [WARN ] [mmon.WrappedScheduledExecutorService] - Scheduled runnable ended with an exception:
java.lang.OutOfMemoryError: Java heap space
2021-02-07 09:11:39.720 [WARN ] [mmon.WrappedScheduledExecutorService] - Scheduled runnable ended with an exception:
java.lang.OutOfMemoryError: Java heap space
2021-02-07 09:12:04.281 [ERROR] [e.automation.internal.RuleEngineImpl] - Failed to execute rule 'StundenVerbrauch': Fail to execute action: 2
2021-02-07 09:14:51.500 [WARN ] [mmon.WrappedScheduledExecutorService] - Scheduled runnable ended with an exception:
java.lang.OutOfMemoryError: Java heap space
2021-02-07 09:15:23.447 [WARN ] [e.jetty.util.thread.QueuedThreadPool] -
java.lang.OutOfMemoryError: Java heap space
So, the issue usually starts with the TR064 binding complaining about timeouts. And this the system gave up with the OOM condition.
One side effect I experienced this time was, that cron definitions for one DSL rule did not fire anymore. I needed to re-created those in the MainUI to get them running again. May caused by the required system reboot.
System: ZOTAC CI327, 8GB RAM, 4 core Celeron
Distributor ID: Debian
Description: Debian GNU/Linux 10 (buster)
Release: 10
Codename: busterTo do a thread dump:
ps -ef | grep java
find process ID (usually the first number you see after the username)
jstack -l (PID) > my-dump.txt
3 Likes
I would bet that the TR064 binding is probably very sensitive to the increase in CPU/RAM usage and is just “the first to go” on your system. We should see something hopefully in the thread dump. I’m hoping to see an excessive number of locked threads or something along those lines to indicate something is getting hung up.
Thank you! Are the devs informed about the here discussed problem with the java heap space?
Hi got the same today with tr64
2021-02-08 18:00:18.417 [INFO ] [064.internal.soap.SOAPValueConverter] - Postprocessor processTamListURL failed: Failed to get TAM list from URL https://192.168.178.1:49443/tamcalllist.lua?sid=170008edf54dc842&tamindex=0
2021-02-08 18:00:18.419 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=tamNewMessages, getAction=GetMessageList, dataType='string, parameter='0'}: failed to transform 'NewURL'
2021-02-08 18:00:21.333 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=callDeflectionEnable, getAction=GetDeflection, dataType='boolean, parameter='0'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:00:23.910 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=tamEnable, getAction=GetInfo, dataType='boolean, parameter='0'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:00:58.045 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanIpAddress, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:01:01.926 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanConnectionStatus, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:01:05.892 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanMaxDownstreamRate, getAction=GetCommonLinkProperties, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:01:08.399 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanTotalBytesReceived, getAction=GetTotalBytesReceived, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:01:13.383 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanMaxUpstreamRate, getAction=GetCommonLinkProperties, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:01:15.944 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanPhysicalLinkStatus, getAction=GetCommonLinkProperties, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:01:22.288 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanAccessType, getAction=GetCommonLinkProperties, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:01:24.968 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanTotalBytesSent, getAction=GetTotalBytesSent, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:01:34.122 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=missedCalls, getAction=GetCallList, dataType='string, parameter='5'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:01:41.765 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=uptime, getAction=GetInfo, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:01:50.492 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=tamNewMessages, getAction=GetMessageList, dataType='string, parameter='0'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:01:54.229 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=callDeflectionEnable, getAction=GetDeflection, dataType='boolean, parameter='0'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:01:57.958 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=tamEnable, getAction=GetInfo, dataType='boolean, parameter='0'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:02:04.478 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanIpAddress, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:02:09.699 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanConnectionStatus, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:02:35.004 [WARN ] [ab.core.internal.events.EventHandler] - Dispatching event to subscriber 'org.openhab.core.internal.items.ItemUpdater@b21a40' takes more than 5000ms.
2021-02-08 18:02:43.707 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanMaxDownstreamRate, getAction=GetCommonLinkProperties, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:02:47.641 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanTotalBytesReceived, getAction=GetTotalBytesReceived, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:02:51.360 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanMaxUpstreamRate, getAction=GetCommonLinkProperties, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:02:56.556 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanPhysicalLinkStatus, getAction=GetCommonLinkProperties, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:03:02.795 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanAccessType, getAction=GetCommonLinkProperties, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:03:06.590 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=missedCalls, getAction=GetCallList, dataType='string, parameter='5'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:03:11.597 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanTotalBytesSent, getAction=GetTotalBytesSent, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:03:14.127 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=uptime, getAction=GetInfo, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:03:16.655 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanIpAddress, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:03:19.175 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=tamNewMessages, getAction=GetMessageList, dataType='string, parameter='0'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:03:24.343 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanConnectionStatus, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:03:40.324 [WARN ] [ab.core.internal.events.EventHandler] - Dispatching event to subscriber 'org.openhab.core.internal.items.ItemUpdater@b21a40' takes more than 5000ms.
2021-02-08 18:03:41.591 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=callDeflectionEnable, getAction=GetDeflection, dataType='boolean, parameter='0'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:03:47.837 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=tamEnable, getAction=GetInfo, dataType='boolean, parameter='0'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:04:14.252 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanMaxDownstreamRate, getAction=GetCommonLinkProperties, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:04:16.741 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanTotalBytesReceived, getAction=GetTotalBytesReceived, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:04:19.311 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanMaxUpstreamRate, getAction=GetCommonLinkProperties, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:04:22.164 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanPhysicalLinkStatus, getAction=GetCommonLinkProperties, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:04:24.626 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanAccessType, getAction=GetCommonLinkProperties, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:04:36.134 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanIpAddress, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:04:38.664 [WARN ] [ab.core.internal.events.EventHandler] - Dispatching event to subscriber 'org.openhab.core.internal.items.ItemUpdater@b21a40' takes more than 5000ms.
2021-02-08 18:04:43.622 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanTotalBytesSent, getAction=GetTotalBytesSent, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:04:48.634 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanConnectionStatus, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:04:56.157 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=missedCalls, getAction=GetCallList, dataType='string, parameter='5'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:04:58.645 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=uptime, getAction=GetInfo, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:05:12.235 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=tamNewMessages, getAction=GetMessageList, dataType='string, parameter='0'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:05:23.616 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=callDeflectionEnable, getAction=GetDeflection, dataType='boolean, parameter='0'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:05:37.198 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=tamEnable, getAction=GetInfo, dataType='boolean, parameter='0'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:05:51.979 [WARN ] [ab.core.internal.events.EventHandler] - Dispatching event to subscriber 'org.openhab.core.internal.items.ItemUpdater@b21a40' takes more than 5000ms.
2021-02-08 18:05:56.905 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanMaxDownstreamRate, getAction=GetCommonLinkProperties, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:06:29.859 [WARN ] [p.internal.http.HttpResponseListener] - Requesting 'http://pihole.homezone.local:81/admin/api.php' (method='GET', content='null') failed: Total timeout 3000 ms elapsed
2021-02-08 18:06:36.494 [WARN ] [ab.core.internal.events.EventHandler] - Dispatching event to subscriber 'org.openhab.core.internal.items.ItemUpdater@b21a40' takes more than 5000ms.
2021-02-08 18:06:47.918 [WARN ] [ab.core.internal.events.EventHandler] - Dispatching event to subscriber 'org.openhab.core.internal.items.ItemUpdater@b21a40' takes more than 5000ms.
2021-02-08 18:09:05.290 [WARN ] [com.zaxxer.hikari.pool.HikariPool ] - 1m1s127ms365μs7ns - Thread starvation or clock leap detected (housekeeper delta=yank-default).
2021-02-08 18:09:54.031 [WARN ] [ab.core.internal.events.EventHandler] - Dispatching event to subscriber 'org.openhab.core.internal.items.ItemUpdater@b21a40' takes more than 5000ms.
2021-02-08 18:10:31.288 [WARN ] [ab.core.internal.events.EventHandler] - Dispatching event to subscriber 'org.openhab.core.internal.items.ItemUpdater@b21a40' takes more than 5000ms.
2021-02-08 18:10:36.347 [WARN ] [com.zaxxer.hikari.pool.HikariPool ] - 59s997ms811μs702ns - Thread starvation or clock leap detected (housekeeper delta=yank-default).
2021-02-08 18:10:38.797 [INFO ] [io.openhabcloud.internal.CloudClient] - Disconnected from the openHAB Cloud service (UUID = c82795cf-0cd5-4b2e-adc1-c7e5b5fb6f1a, base URL = http://localhost:30007)
2021-02-08 18:10:55.556 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanTotalBytesReceived, getAction=GetTotalBytesReceived, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:11:05.743 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanIpAddress, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:11:05.743 [WARN ] [ab.core.internal.events.EventHandler] - Dispatching event to subscriber 'org.openhab.core.internal.items.ItemUpdater@b21a40' takes more than 5000ms.
2021-02-08 18:11:13.314 [WARN ] [ab.core.internal.events.EventHandler] - Dispatching event to subscriber 'org.openhab.core.internal.items.ItemUpdater@b21a40' takes more than 5000ms.
2021-02-08 18:11:13.316 [WARN ] [com.zaxxer.hikari.pool.HikariPool ] - 1m2s913ms537μs376ns - Thread starvation or clock leap detected (housekeeper delta=yank-default).
2021-02-08 18:08:20.163 [WARN ] [mmon.WrappedScheduledExecutorService] - Scheduled runnable ended with an exception:
java.lang.OutOfMemoryError: Java heap space
2021-02-08 18:11:32.151 [WARN ] [ab.core.internal.events.EventHandler] - Dispatching event to subscriber 'org.openhab.core.internal.items.ItemUpdater@b21a40' takes more than 5000ms.
2021-02-08 18:14:09.410 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanConnectionStatus, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:14:17.127 [WARN ] [e.californium.scandium.DTLSConnector] - Shutdown DTLS connector on [0.0.0.0/0.0.0.0:41621] executor not terminated in time!
2021-02-08 18:14:27.442 [WARN ] [com.zaxxer.hikari.pool.HikariPool ] - 1m31s554ms408μs801ns - Thread starvation or clock leap detected (housekeeper delta=yank-default).
2021-02-08 18:14:49.031 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=missedCalls, getAction=GetCallList, dataType='string, parameter='5'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:15:13.022 [WARN ] [ab.core.internal.events.EventHandler] - Dispatching event to subscriber 'org.openhab.core.internal.items.ItemUpdater@b21a40' takes more than 5000ms.
2021-02-08 18:16:52.201 [WARN ] [mmon.WrappedScheduledExecutorService] - Scheduled runnable ended with an exception:
java.lang.OutOfMemoryError: Java heap space
2021-02-08 18:17:38.912 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanMaxUpstreamRate, getAction=GetCommonLinkProperties, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:17:46.202 [INFO ] [ternal.handler.TradfriGatewayHandler] - Bridge configuration updated. Updating paired things (if any).
2021-02-08 18:18:40.335 [WARN ] [e.californium.scandium.DTLSConnector] - Could not send record
java.net.SocketException: Protocol family unavailable
at java.net.PlainDatagramSocketImpl.send(Native Method) ~[?:?]
at java.net.DatagramSocket.send(DatagramSocket.java:695) ~[?:?]
at org.eclipse.californium.scandium.DTLSConnector.sendNextDatagramOverNetwork(DTLSConnector.java:2319) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendFlightOverNetwork(DTLSConnector.java:2305) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendFlight(DTLSConnector.java:2254) [bundleFile:?]
at org.eclipse.californium.scandium.dtls.Handshaker.sendFlight(Handshaker.java:1145) [bundleFile:?]
at org.eclipse.californium.scandium.dtls.ClientHandshaker.startHandshake(ClientHandshaker.java:665) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendMessage(DTLSConnector.java:2090) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.access$1600(DTLSConnector.java:214) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector$14.run(DTLSConnector.java:1992) [bundleFile:?]
at org.eclipse.californium.elements.util.SerialExecutor$1.run(SerialExecutor.java:276) [bundleFile:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
2021-02-08 18:19:25.667 [WARN ] [p.internal.http.HttpResponseListener] - Requesting 'http://pihole.homezone.local:81/admin/api.php' (method='GET', content='null') failed: Total timeout 3000 ms elapsed
2021-02-08 18:19:32.015 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanIpAddress, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:20:12.318 [WARN ] [e.californium.scandium.DTLSConnector] - Could not send record
java.net.SocketException: Protocol family unavailable
at java.net.PlainDatagramSocketImpl.send(Native Method) ~[?:?]
at java.net.DatagramSocket.send(DatagramSocket.java:695) ~[?:?]
at org.eclipse.californium.scandium.DTLSConnector.sendNextDatagramOverNetwork(DTLSConnector.java:2319) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendFlightOverNetwork(DTLSConnector.java:2305) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendFlight(DTLSConnector.java:2254) [bundleFile:?]
at org.eclipse.californium.scandium.dtls.Handshaker.sendFlight(Handshaker.java:1145) [bundleFile:?]
at org.eclipse.californium.scandium.dtls.ClientHandshaker.startHandshake(ClientHandshaker.java:665) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendMessage(DTLSConnector.java:2090) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.access$1600(DTLSConnector.java:214) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector$14.run(DTLSConnector.java:1992) [bundleFile:?]
at org.eclipse.californium.elements.util.SerialExecutor$1.run(SerialExecutor.java:276) [bundleFile:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
2021-02-08 18:20:59.796 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=uptime, getAction=GetInfo, dataType='ui4, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:21:22.254 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanConnectionStatus, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:21:37.160 [WARN ] [e.californium.scandium.DTLSConnector] - Could not send record
java.net.SocketException: Protocol family unavailable
at java.net.PlainDatagramSocketImpl.send(Native Method) ~[?:?]
at java.net.DatagramSocket.send(DatagramSocket.java:695) ~[?:?]
at org.eclipse.californium.scandium.DTLSConnector.sendNextDatagramOverNetwork(DTLSConnector.java:2319) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendFlightOverNetwork(DTLSConnector.java:2305) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendFlight(DTLSConnector.java:2254) [bundleFile:?]
at org.eclipse.californium.scandium.dtls.Handshaker.sendFlight(Handshaker.java:1145) [bundleFile:?]
at org.eclipse.californium.scandium.dtls.ClientHandshaker.startHandshake(ClientHandshaker.java:665) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendMessage(DTLSConnector.java:2090) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.access$1600(DTLSConnector.java:214) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector$14.run(DTLSConnector.java:1992) [bundleFile:?]
at org.eclipse.californium.elements.util.SerialExecutor$1.run(SerialExecutor.java:276) [bundleFile:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
2021-02-08 18:21:52.121 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanPhysicalLinkStatus, getAction=GetCommonLinkProperties, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:22:16.395 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=tamNewMessages, getAction=GetMessageList, dataType='string, parameter='0'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:22:53.987 [WARN ] [e.californium.scandium.DTLSConnector] - Could not send record
java.net.SocketException: Protocol family unavailable
at java.net.PlainDatagramSocketImpl.send(Native Method) ~[?:?]
at java.net.DatagramSocket.send(DatagramSocket.java:695) ~[?:?]
at org.eclipse.californium.scandium.DTLSConnector.sendNextDatagramOverNetwork(DTLSConnector.java:2319) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendFlightOverNetwork(DTLSConnector.java:2305) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendFlight(DTLSConnector.java:2254) [bundleFile:?]
at org.eclipse.californium.scandium.dtls.Handshaker.sendFlight(Handshaker.java:1145) [bundleFile:?]
at org.eclipse.californium.scandium.dtls.ClientHandshaker.startHandshake(ClientHandshaker.java:665) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendMessage(DTLSConnector.java:2090) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.access$1600(DTLSConnector.java:214) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector$14.run(DTLSConnector.java:1992) [bundleFile:?]
at org.eclipse.californium.elements.util.SerialExecutor$1.run(SerialExecutor.java:276) [bundleFile:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
2021-02-08 18:24:48.366 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanAccessType, getAction=GetCommonLinkProperties, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:25:47.009 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=callDeflectionEnable, getAction=GetDeflection, dataType='boolean, parameter='0'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:27:24.939 [INFO ] [ng.tr064.internal.soap.SOAPConnector] - Failed to get Tr064ChannelConfig{channelType=wanIpAddress, getAction=GetInfo, dataType='string, parameter='null'}: java.util.concurrent.TimeoutException: Total timeout 2000 ms elapsed
2021-02-08 18:27:23.737 [WARN ] [e.californium.scandium.DTLSConnector] - Could not send record
java.net.SocketException: Protocol family unavailable
at java.net.PlainDatagramSocketImpl.send(Native Method) ~[?:?]
at java.net.DatagramSocket.send(DatagramSocket.java:695) ~[?:?]
at org.eclipse.californium.scandium.DTLSConnector.sendNextDatagramOverNetwork(DTLSConnector.java:2319) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendFlightOverNetwork(DTLSConnector.java:2305) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendFlight(DTLSConnector.java:2254) [bundleFile:?]
at org.eclipse.californium.scandium.dtls.Handshaker.sendFlight(Handshaker.java:1145) [bundleFile:?]
at org.eclipse.californium.scandium.dtls.ClientHandshaker.startHandshake(ClientHandshaker.java:665) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.sendMessage(DTLSConnector.java:2090) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector.access$1600(DTLSConnector.java:214) [bundleFile:?]
at org.eclipse.californium.scandium.DTLSConnector$14.run(DTLSConnector.java:1992) [bundleFile:?]
at org.eclipse.californium.elements.util.SerialExecutor$1.run(SerialExecutor.java:276) [bundleFile:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
2021-02-08 18:29:58.483 [WARN ] [mmon.WrappedScheduledExecutorService] - Scheduled runnable ended with an exception:
java.lang.OutOfMemoryError: Java heap space
2021-02-08 18:29:05.310 [WARN ] [mmon.WrappedScheduledExecutorService] - Scheduled runnable ended with an exception:
java.lang.OutOfMemoryError: Java heap space
2021-02-08 18:30:11.916 [ERROR] [fornium.elements.util.SerialExecutor] - unexpected error occurred:
java.lang.OutOfMemoryError: Java heap space
2021-02-08 18:31:54.802 [WARN ] [com.zaxxer.hikari.pool.HikariPool ] - 2m6s773ms782μs775ns - Thread starvation or clock leap detected (housekeeper delta=yank-default).
2021-02-08 18:32:31.583 [WARN ] [p.internal.http.HttpResponseListener] - Requesting 'http://pihole.homezone.local:81/admin/api.php' (method='GET', content='null') failed: Total timeout 3000 ms elapsedDoes everyone have tr064 installed that is having this issue?
I went through the 3.0.1 release notes and as far as I can tell there were no changes to tr064 (or basically any binding) between 3.0 and 3.0.1. I’m still very intrigued that moving to 3.0.1 broke things for everyone as there wasn’t a whole lot done between the two.
Is anyone willing to go to 3.1M1 to see if the problem persists?
I’ve never heard of that binding before, so no. On the other hand, I’m not so sure any more if this is just ONE simple problem or if there’s more than one bug involved. My strong feeling is that the problem I (and others in this thread but maybe not all) am experiencing has with rules to do, right after upgrading to 3.0 I did a lot of fiddling around with my rules and I also had one test rule actually executing every fifth minute and I experienced crashes on a daily basis. But now I haven’t touched any rules in a while and also I have no rules executing that very often and my system has been running stable for over a week.
I have the tr064 binding installed and I am on 3.1m1. When I am playing with my rules the error occurs often, without modifying and playing on the rules the error could occur but not so often.
Did you modify the EXTRA_JAVA_OPTS as suggested from my side?
No, is this the recommended way? For me it seems that there is no solution yet…
How are you experience?
I wrote my experience above…I think Post #48 or so in this thread.