Syslog Errors (100 GB)

Setup, Configuration and Use Runtime
, ,
#1

My syslog (and deamon.log) is full (many, many GB of Data) with the following example:

Feb 11 11:22:48 openHAB karaf[555]: Exception in thread "OH-eventexecutor-615" java.lang.NullPointerException
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
Feb 11 11:22:48 openHAB karaf[555]: Exception in thread "OH-eventexecutor-616" #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.lang.Thread.run(Thread.java:834)
Feb 11 11:22:48 openHAB karaf[555]: java.lang.NullPointerException
Feb 11 11:22:48 openHAB karaf[555]: Exception in thread "OH-eventexecutor-617" #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.lang.Thread.run(Thread.java:834)
Feb 11 11:22:48 openHAB karaf[555]: java.lang.NullPointerException
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.lang.Thread.run(Thread.java:834)
Feb 11 11:22:48 openHAB karaf[555]: Exception in thread "OH-eventexecutor-618" java.lang.NullPointerException
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.lang.Thread.run(Thread.java:834)
Feb 11 11:22:48 openHAB karaf[555]: Exception in thread "OH-eventexecutor-619" java.lang.NullPointerException
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.lang.Thread.run(Thread.java:834)
Feb 11 11:22:48 openHAB karaf[555]: Exception in thread "OH-eventexecutor-620" java.lang.NullPointerException
Feb 11 11:22:48 openHAB karaf[555]: Exception in thread "OH-eventexecutor-621" #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
Feb 11 11:22:48 openHAB karaf[555]: Exception in thread "OH-eventexecutor-622" #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.lang.Thread.run(Thread.java:834)
Feb 11 11:22:48 openHAB karaf[555]: Exception in thread "OH-eventexecutor-626" java.lang.NullPointerException
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.lang.Thread.run(Thread.java:834)
Feb 11 11:22:48 openHAB karaf[555]: java.lang.NullPointerException
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.lang.Thread.run(Thread.java:834)
Feb 11 11:22:48 openHAB karaf[555]: Exception in thread "OH-eventexecutor-625" Exception in thread "OH-eventexecutor-624" Exception in thread "OH-eventexecutor-623" java.lang.NullPointerException
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
Feb 11 11:22:48 openHAB karaf[555]: #011at java.base/java.lang.Thread.run(Thread.java:834)

When I restart openHAB is OK, But after some hours it begins again.
And when this error is written in the syslog I’m not able to send commands over basicUI (and other UIs).

In the event.log and openhab.log I see nothing related to this problem.

How can I find the source of this error? I have no glue what it is.

  • Platform information:
    • Hardware: RaspberryPi 4
    • OS: Raspbian 5.10.11-v7l+
    • Java Runtime Environment: Zulu11.43+100-CA
    • openHAB version: 3.0.1

Thanks for your help.

"OH-eventexecutor-1" java.lang.NullPointerException
Logs flooded with Exception in thread EventAdminAsyncThread
#3

How to ask a good question / Help Us Help You - Tutorials & Examples - openHAB Community

#4

Thanks for your response. I try to do my best.

  1. Did you search?
    -> Yes. On the Forum and with Google. Since days I search a solution.
  2. So how do I search correctly?
    -> Yes, I try it.
  3. I found a similar topic but it’s already solved and I still have a problem. Should I post in it?
    -> Some. But nothing was releated.
  4. Did you read and search the docs ?
    -> Yes
  5. Choose a category
    -> Done
  6. Title
    -> Done
  7. Tags
    -> Done
  8. Describe your goal
    -> Is now inserted.
  9. Show effort
    -> I’ve written what I have done. I searched and searched, but find nothing.
  10. Describe your environment
    -> I added this part
  11. Describe what you changed and what’s happening now
    -> Some Information added
  12. Use proper formatting
    -> I hope it is good
  13. Attach examples
    -> I not know what I can atache
  14. Reread it
    -> done
  15. May I mention users in the post?
    -> I have no user to mention

I hope its now OK. Otherwise please tell me what is not OK and I try to fix it.

#5

Your description is too vague thus barely understandable. Noone wants to help if first thing he has to do is to ask all the details from you, you have to give them upfront.
Do you run openHABian ? If no, how did you install your box ?
How do you start OH ? When did the problem start first ? What did you try so far ?

It’s errors in syslog so it is not an openhab problem itself.
Java is crashing which is always a user’s own problem when he installed it himself.

#6

First I’m no expert, but find clues in the (somewhat obscure) error messages. It appears to me the thread OH-eventexecutor is trying to process a “null” value. Also looking at my system the OH-eventexecutor starts at 1, so it appears whatever is happening is in a loop. I’d check your rules and any other program (or binding) you wrote or run that processes OH events. Also there is a command in the console Shell:threads --list that might help.

That’s all I have.

Bob

#7

Thanks for your reply’s.

Do you run openHABian?

No, I use raspbian, because openHABian not work with a SSD-Disk

If no, how did you install your box ?

I install it with APT as is descriped at openHAB on Linux | openHAB

How do you start OH?

I start it with the system start: sudo systemctl enable openhab.service

When did the problem start first?

I’m not sure. My guess its with update to 3.0.1 from 3.0.0. But I’m not sure.

What did you try so far?

Check openhab and event log, but nothing is in there. I removed not used binding, Habbot and Voice.
I also try to find out what is happens when it starts (compare timestamp on syslog wit openhab and event log). And I compare that also with my rules, but find no related event.

It’s errors in syslog so it is not an openhab problem itself.
Java is crashing which is always a user’s own problem when he installed it himself.

Thanks for this hint. I update Zulu java to the latest version and maybe its with that OK. Until now it is OK, but sometimes openHAB runs some days until it happens.

Also there is a command in the console Shell:threads --list that might help

Thanks for this hint. I will check this when it happens again.

Syslog and daemon.log flood with Java-Error
#8

That’s not true.

You are possibly suffering from a lack of properly adapting java and OS parameters to OH which is right what openHABian will do for you.
Another major advantage of openHABian is that it provides a well-defined starting point.
In a nutshell, noone knows what you have installed on or done to your box so noone knows where to start debugging so noone or only very few are willing to do this for you.
It is a 1:1 thing and the next individual installation will be different with a different set of problems so there’s little point in spending efforts on this.
Your best choice is to move over.

#9

This is concerning. If you fix that, you might see clues. Might just be a case of looking in the right place.

#10

I’m seeing the same thing. Didn’t happen after the migration to 3 only in the latest sw version. I’m wondering if it can be the rules.

#11

I had the Zulu Azul JDK installed, replaced it for OpenJDK 11 and now the issue seeems to be gone.

#12

After update to the newest Version, it works by me without problems.
My current version is:

openjdk 11.0.10 2021-01-19 LTS
OpenJDK Runtime Environment Zulu11.45+27-CA (build 11.0.10+9-LTS)
OpenJDK Client VM Zulu11.45+27-CA (build 11.0.10+9-LTS, mixed mode)
#13

It not working with update java. After some weeks it happens again.

#14

It happes again. Here the result from Shell:threads --list:


Id      │ Name                                                                                          │ State         │ CPU time  │ Usr time
────────┼───────────────────────────────────────────────────────────────────────────────────────────────┼───────────────┼───────────┼──────────
1       │ main                                                                                          │ WAITING       │ 2820      │ 2510
2       │ Reference Handler                                                                             │ RUNNABLE      │ 13754     │ 9020
3       │ Finalizer                                                                                     │ WAITING       │ 18119     │ 15160
4       │ Signal Dispatcher                                                                             │ RUNNABLE      │ 0         │ 0
8       │ Common-Cleaner                                                                                │ TIMED_WAITING │ 1728      │ 1200
10      │ Active Thread: Equinox Container: 96ace3be-2a71-4f60-9e75-628f6ece24eb                        │ TIMED_WAITING │ 19809     │ 15190
12      │ Framework Event Dispatcher: org.eclipse.osgi.internal.framework.EquinoxEventPublisher@1cbe147 │ WAITING       │ 68        │ 50
13      │ Bundle File Closer                                                                            │ WAITING       │ 177       │ 110
14      │ Start Level: Equinox Container: 96ace3be-2a71-4f60-9e75-628f6ece24eb                          │ WAITING       │ 21538     │ 20490
15      │ Karaf Lock Monitor Thread                                                                     │ TIMED_WAITING │ 25258     │ 13190
16      │ Karaf Shutdown Socket Thread                                                                  │ RUNNABLE      │ 3         │ 0
27      │ Coordination Timer                                                                            │ WAITING       │ 0         │ 0
28      │ CM Configuration Updater                                                                      │ WAITING       │ 1573      │ 1440
29      │ CM Event Dispatcher                                                                           │ WAITING       │ 0         │ 0
30      │ fileinstall-/var/lib/openhab/etc                                                              │ TIMED_WAITING │ 30275     │ 26280
31      │ FileSystemWatchService                                                                        │ RUNNABLE      │ 1         │ 0
33      │ Log4j2-TF-5-Scheduled-1                                                                       │ TIMED_WAITING │ 3789      │ 2570
35      │ EventAdminAsyncThread #11                                                                     │ WAITING       │ 15223978  │ 11456810
36      │ EventAdminAsyncThread #12                                                                     │ WAITING       │ 15133070  │ 11400180
40      │ fileinstall-/usr/share/openhab/addons                                                         │ TIMED_WAITING │ 13161     │ 9600
41      │ FileSystemWatchService                                                                        │ RUNNABLE      │ 0         │ 0
42      │ encryption-1-thread-1                                                                         │ TIMED_WAITING │ 11481     │ 7340
43      │ FileSystemWatchService                                                                        │ RUNNABLE      │ 0         │ 0
44      │ SCR Component Actor                                                                           │ WAITING       │ 0         │ 0
52      │ Thread-14                                                                                     │ RUNNABLE      │ 11        │ 10
53      │ sshd-SshServer[1310344]-timer-thread-1                                                        │ TIMED_WAITING │ 15508     │ 12180
57      │ EMF Reference Cleaner                                                                         │ WAITING       │ 57        │ 50
59      │ ForkJoinPool.commonPool-worker-3                                                              │ WAITING       │ 475       │ 450
60      │ OH-OSGiEventManager                                                                           │ TIMED_WAITING │ 58818889  │ 49328450
62      │ OH-startlevel-1                                                                               │ TIMED_WAITING │ 11029     │ 10030
71      │ FileSystemWatchService                                                                        │ RUNNABLE      │ 1         │ 0
72      │ Dir Watcher                                                                                   │ WAITING       │ 0         │ 0
74      │ ServletEventDispatcher: 1                                                                     │ WAITING       │ 7         │ 0
75      │ ServletEventDispatcher: 2                                                                     │ WAITING       │ 6         │ 0
76      │ ServletEventDispatcher: 3                                                                     │ WAITING       │ 1         │ 0
79      │ Session-HouseKeeper-1ea3346                                                                   │ TIMED_WAITING │ 126       │ 100
80      │ qtp4532796-80-acceptor-0@946b3f-0.0.0.0:8443@7550ec{SSL,[ssl, http/1.1]}{0.0.0.0:8443}        │ RUNNABLE      │ 93        │ 70
83      │ qtp4532796-83-acceptor-0@d20d21-default@1a4f92e{HTTP/1.1,[http/1.1]}{0.0.0.0:8080}            │ RUNNABLE      │ 39        │ 20
93      │ OH-karaf-addons-1                                                                             │ TIMED_WAITING │ 1038      │ 980
94      │ com.google.inject.internal.util.$Finalizer                                                    │ WAITING       │ 0         │ 0
96      │ pool-9-thread-1                                                                               │ WAITING       │ 10        │ 10
97      │ Timer-1                                                                                       │ WAITING       │ 0         │ 0
100     │ OH-eventwatcher-1                                                                             │ TIMED_WAITING │ 31354349  │ 23751750
101     │ pool-5-thread-1                                                                               │ WAITING       │ 10346508  │ 6867040
102     │ Timer-2                                                                                       │ WAITING       │ 0         │ 0
103     │ OH-ruleengine-1                                                                               │ WAITING       │ 86        │ 80
104     │ Timer-3                                                                                       │ WAITING       │ 0         │ 0
105     │ Timer-4                                                                                       │ WAITING       │ 0         │ 0
106     │ Timer-5                                                                                       │ WAITING       │ 0         │ 0
107     │ SocketListener(sh-onflow-ch.local.)                                                           │ RUNNABLE      │ 506596    │ 475530
108     │ JmDNS(sh-onflow-ch.local.).Timer                                                              │ TIMED_WAITING │ 49716     │ 43440
109     │ JmDNS(sh-onflow-ch.local.).State.Timer                                                        │ TIMED_WAITING │ 259       │ 220
112     │ Timer-6                                                                                       │ WAITING       │ 405       │ 280
114     │ lsp-1                                                                                         │ RUNNABLE      │ 2         │ 0
115     │ Timer-8                                                                                       │ WAITING       │ 0         │ 0
116     │ Timer-9                                                                                       │ WAITING       │ 0         │ 0
119     │ Timer-10                                                                                      │ WAITING       │ 0         │ 0
120     │ Timer-11                                                                                      │ WAITING       │ 0         │ 0
121     │ ServletModel-17-121                                                                           │ RUNNABLE      │ 0         │ 0
122     │ ServletModel-17-122                                                                           │ RUNNABLE      │ 0         │ 0
123     │ ServletModel-17-123                                                                           │ TIMED_WAITING │ 163       │ 140
124     │ ServletModel-17-124                                                                           │ TIMED_WAITING │ 156       │ 80
125     │ ServletModel-17-125                                                                           │ TIMED_WAITING │ 166       │ 120
126     │ ServletModel-17-126                                                                           │ TIMED_WAITING │ 157       │ 50
127     │ ServletModel-17-127                                                                           │ TIMED_WAITING │ 156       │ 60
128     │ ServletModel-17-128                                                                           │ TIMED_WAITING │ 159       │ 110
129     │ upnp-main-1                                                                                   │ TIMED_WAITING │ 21328     │ 17050
130     │ upnp-main-2                                                                                   │ RUNNABLE      │ 5842      │ 5200
132     │ upnp-main-4                                                                                   │ RUNNABLE      │ 0         │ 0
135     │ jupnp-jetty-client-135                                                                        │ TIMED_WAITING │ 5858      │ 4510
136     │ jupnp-jetty-client-136                                                                        │ RUNNABLE      │ 5861      │ 4520
141     │ OH-httpClient-common-141                                                                      │ RUNNABLE      │ 264129    │ 193340
143     │ OH-httpClient-common-143                                                                      │ TIMED_WAITING │ 260963    │ 191340
144     │ OH-httpClient-common-144                                                                      │ RUNNABLE      │ 1         │ 0
145     │ OH-httpClient-common-145                                                                      │ RUNNABLE      │ 0         │ 0
146     │ OH-httpClient-common-146                                                                      │ TIMED_WAITING │ 269592    │ 197440
147     │ OH-httpClient-common-147                                                                      │ TIMED_WAITING │ 257259    │ 188950
148     │ OH-httpClient-common-148                                                                      │ TIMED_WAITING │ 276158    │ 203890
149     │ OH-httpClient-common-149                                                                      │ RUNNABLE      │ 273795    │ 201200
150     │ OH-httpClient-common-150                                                                      │ TIMED_WAITING │ 262796    │ 193520
151     │ OH-httpClient-common-151                                                                      │ TIMED_WAITING │ 276326    │ 202590
152     │ OH-usb-serial-discovery-linux-sysfs-1                                                         │ TIMED_WAITING │ 259471    │ 150570
158     │ OH-scriptwatcher-1                                                                            │ TIMED_WAITING │ 1230      │ 960
159     │ OH-rulesRefresher-1                                                                           │ WAITING       │ 1         │ 0
161     │ FileSystemWatchService                                                                        │ RUNNABLE      │ 0         │ 0
162     │ OH-thingHandler-1                                                                             │ TIMED_WAITING │ 1156551   │ 1087950
166     │ OH-thingHandler-2                                                                             │ TIMED_WAITING │ 1173575   │ 1104650
167     │ HttpClient@1c9926c-scheduler                                                                  │ TIMED_WAITING │ 77429     │ 62780
168     │ OH-thingHandler-3                                                                             │ TIMED_WAITING │ 1167700   │ 1098590
172     │ RxSchedulerPurge-1                                                                            │ TIMED_WAITING │ 26928     │ 22470
173     │ RxCachedWorkerPoolEvictor-1                                                                   │ TIMED_WAITING │ 287       │ 220
175     │ OH-thingHandler-4                                                                             │ TIMED_WAITING │ 1186064   │ 1116340
176     │ OH-thingHandler-5                                                                             │ WAITING       │ 1169801   │ 1100530
177     │ nioEventLoopGroup-2-1                                                                         │ RUNNABLE      │ 34863506  │ 20253790
179     │ RXTXPortMonitor(/dev/ttyUSB0)                                                                 │ TIMED_WAITING │ 97        │ 30
180     │ OH-binding-rfxcom:bridge:a9cfc67d79                                                           │ RUNNABLE      │ 306025    │ 197310
181     │ RxComputationThreadPool-1                                                                     │ WAITING       │ 11        │ 10
182     │ items-3                                                                                       │ TIMED_WAITING │ 10814057  │ 6240780
183     │ OH-rule-LocalDiskSpace-1                                                                      │ WAITING       │ 113383    │ 106910
184     │ pool-14-thread-1                                                                              │ TIMED_WAITING │ 339181    │ 275200
189     │ OH-rule-EGWohnzimmerLichtOFF-1                                                                │ WAITING       │ 2         │ 0
191     │ Thread-63                                                                                     │ TIMED_WAITING │ 22        │ 20
192     │ Thread-64                                                                                     │ TIMED_WAITING │ 25        │ 20
193     │ Thread-65                                                                                     │ TIMED_WAITING │ 24        │ 0
194     │ Thread-66                                                                                     │ TIMED_WAITING │ 28        │ 20
195     │ Thread-67                                                                                     │ TIMED_WAITING │ 27        │ 0
196     │ Thread-68                                                                                     │ TIMED_WAITING │ 29        │ 20
197     │ Thread-69                                                                                     │ TIMED_WAITING │ 25        │ 20
198     │ Thread-70                                                                                     │ TIMED_WAITING │ 24        │ 20
199     │ Thread-71                                                                                     │ TIMED_WAITING │ 29        │ 10
200     │ Thread-72                                                                                     │ TIMED_WAITING │ 21        │ 20
201     │ Thread-73                                                                                     │ TIMED_WAITING │ 20        │ 10
202     │ Thread-74                                                                                     │ TIMED_WAITING │ 26        │ 10
203     │ JmDNS pool-10-thread-1                                                                        │ WAITING       │ 41119     │ 40360
204     │ RxComputationThreadPool-2                                                                     │ WAITING       │ 28        │ 20
205     │ RxComputationThreadPool-3                                                                     │ RUNNABLE      │ 155465094 │ 147351820
206     │ RxComputationThreadPool-4                                                                     │ WAITING       │ 8         │ 0
207     │ :CoapEndpoint-UDP-0.0.0.0:5683#1                                                              │ TIMED_WAITING │ 2206719   │ 2149540
208     │ UDP-Receiver-0.0.0.0/0.0.0.0:5683[0]                                                          │ RUNNABLE      │ 126893    │ 95550
209     │ UDP-Sender-0.0.0.0/0.0.0.0:5683[0]                                                            │ WAITING       │ 0         │ 0
210     │ :CoapEndpoint-UDP-0.0.0.0:0#1                                                                 │ TIMED_WAITING │ 2167      │ 2040
211     │ UDP-Receiver-0.0.0.0/0.0.0.0:0[0]                                                             │ RUNNABLE      │ 21        │ 10
212     │ UDP-Sender-0.0.0.0/0.0.0.0:0[0]                                                               │ WAITING       │ 74        │ 60
215     │ OH-rule-EGBueroLichtOFF-1                                                                     │ WAITING       │ 4         │ 0
216     │ pool-1-thread-1                                                                               │ WAITING       │ 65        │ 60
258     │ OH-rule-HeizungBueroAUS-1                                                                     │ WAITING       │ 89        │ 80
259     │ OH-rule-HeizungBueroEIN-1                                                                     │ WAITING       │ 95        │ 80
326     │ OH-httpClient-common-326                                                                      │ TIMED_WAITING │ 251609    │ 184420
342     │ OH-httpClient-common-342                                                                      │ TIMED_WAITING │ 282055    │ 206940
450     │ OH-rule-EGBueroLichtON-1                                                                      │ WAITING       │ 2         │ 0
1960    │ Connector-Scheduler-7550ec                                                                    │ TIMED_WAITING │ 3802      │ 3360
2045    │ Connector-Scheduler-1a4f92e                                                                   │ WAITING       │ 8         │ 0
2514    │ OH-httpClient-common-2514                                                                     │ TIMED_WAITING │ 258439    │ 188970
6497    │ OH-rule-EGWohnzimmerLichtOn-1                                                                 │ WAITING       │ 3         │ 0
6825    │ OH-rule-OGGangButtonTopShort-1                                                                │ WAITING       │ 2576      │ 2520
7430    │ HttpClient@59f2b8-scheduler                                                                   │ WAITING       │ 726       │ 340
9806    │ OH-rule-EGKellerWasserpumpeOFF-1                                                              │ WAITING       │ 1         │ 0
14859   │ OH-rule-EGKellerWasserpumpeOn-1                                                               │ WAITING       │ 1         │ 0
15835   │ OH-rule-OGGangButtonBottomShort-1                                                             │ WAITING       │ 1493      │ 1490
15840   │ OH-rule-OGGangBottomTopLong-1                                                                 │ WAITING       │ 13        │ 10
18218   │ OH-rule-OGGangButtomBottomLong-1                                                              │ WAITING       │ 13        │ 10
27954   │ OH-httpClient-common-27954                                                                    │ TIMED_WAITING │ 112999    │ 82420
27955   │ OH-httpClient-common-27955                                                                    │ TIMED_WAITING │ 99239     │ 72470
27956   │ OH-httpClient-common-27956                                                                    │ TIMED_WAITING │ 110284    │ 80890
40983   │ OH-rule-KlingelLastUpdate-1                                                                   │ WAITING       │ 2719      │ 2660
42202   │ qtp4532796-42202                                                                              │ RUNNABLE      │ 1045      │ 1020
42891   │ jupnp-jetty-client-42891                                                                      │ RUNNABLE      │ 1392      │ 970
45492   │ jupnp-jetty-client-45492                                                                      │ TIMED_WAITING │ 54        │ 30
45494   │ jupnp-jetty-client-45494                                                                      │ TIMED_WAITING │ 53        │ 40
49729   │ OH-scheduler-16                                                                               │ TIMED_WAITING │ 24        │ 0
50193   │ qtp4532796-50193                                                                              │ TIMED_WAITING │ 426       │ 420
51738   │ qtp4532796-51738                                                                              │ RUNNABLE      │ 970       │ 900
3768302 │ qtp4532796-3768302                                                                            │ RUNNABLE      │ 31        │ 0
6616487 │ items-35242                                                                                   │ TIMED_WAITING │ 44        │ 10
6626375 │ OH-common-8928                                                                                │ TIMED_WAITING │ 49        │ 40
6727545 │ OH-discovery-7596                                                                             │ TIMED_WAITING │ 2         │ 0
6744015 │ qtp4532796-6744015                                                                            │ RUNNABLE      │ 1         │ 0
6744017 │ qtp4532796-6744017                                                                            │ TIMED_WAITING │ 16        │ 10
6744019 │ qtp4532796-6744019                                                                            │ TIMED_WAITING │ 179       │ 170
6744021 │ qtp4532796-6744021                                                                            │ TIMED_WAITING │ 38        │ 20
6744022 │ qtp4532796-6744022                                                                            │ TIMED_WAITING │ 36        │ 30
6744023 │ qtp4532796-6744023                                                                            │ TIMED_WAITING │ 99        │ 90
6744993 │ qtp4532796-6744993                                                                            │ TIMED_WAITING │ 22        │ 10
6757195 │ qtp4532796-6757195                                                                            │ TIMED_WAITING │ 3         │ 0
6827312 │ qtp4532796-6827312                                                                            │ TIMED_WAITING │ 0         │ 0
6827313 │ qtp4532796-6827313                                                                            │ TIMED_WAITING │ 0         │ 0
6832413 │ OH-discovery-7601                                                                             │ TIMED_WAITING │ 0         │ 0
6841789 │ OH-common-8942                                                                                │ TIMED_WAITING │ 12        │ 10
6874727 │ OH-common-8943                                                                                │ TIMED_WAITING │ 2         │ 0
6878189 │ OH-common-8944                                                                                │ TIMED_WAITING │ 6         │ 0
6891904 │ OH-discovery-7603                                                                             │ TIMED_WAITING │ 0         │ 0
6908218 │ OH-discovery-7604                                                                             │ TIMED_WAITING │ 0         │ 0
6911422 │ OH-discovery-7605                                                                             │ TIMED_WAITING │ 0         │ 0
6917465 │ OH-common-8945                                                                                │ TIMED_WAITING │ 0         │ 0
6926663 │ sshd-SshServer[1310344]-nio2-thread-1                                                         │ WAITING       │ 339       │ 300
6926827 │ Thread-421                                                                                    │ TIMED_WAITING │ 0         │ 0
6930193 │ sshd-SshServer[1310344]-nio2-thread-2                                                         │ WAITING       │ 724       │ 650
6930360 │ org.apache.karaf.shell.ssh.SshTerminal@1402f8e input pump thread                              │ WAITING       │ 1         │ 0
6930516 │ Karaf ssh console user openhab                                                                │ WAITING       │ 380       │ 370
6930543 │ pipe-Shell:threads --list                                                                     │ RUNNABLE      │ 146       │ 110
6930545 │ job controller 1                                                                              │ WAITING       │ 18        │ 10
6930584 │ pool-16-thread-3                                                                              │ TIMED_WAITING │ 32        │ 10
6930586 │ pool-16-thread-4                                                                              │ TIMED_WAITING │ 483       │ 440
6932206 │ OH-eventexecutor-6878823                                                                      │ RUNNABLE      │ 0         │ 0
6932207 │ OH-eventexecutor-6878824                                                                      │ RUNNABLE      │ 0         │ 0

I don’t know what I can do at next? Please help me?

OH3 - killing my system occasionally - LOGfile exploding to 100% root
#15

Have the same issue and as a workaround check syslog every 3 minutes by a cronjob. The script looks like this:

#!/bin/bash

exec >>/var/log/openhab/restart.log
exec 2>&1


tail -20 /var/log/syslog | grep -q LinkedBlockingQueue

[ $? -ne 0 ]  && exit 0

echo `date`: Restarting openhab
/usr/sbin/service openhab restart 
echo `date`: openhab restarted
tail -2 /var/log/openhab/restart.log | mailx -s 'Openhab restarted' your@address.here
exit 0

Crontab entry:

*/3 * * * * /root/bin/checkopenhab

There is a second thread for the same topic here:

The common part seems to be ARM architecture and azul java. I try switching to openjdk as @RhavoX suggested.

#16

To reiterate my statement above, why don’t you switch to openHABian ? It takes care of all these issues. Sure it’s no guarantee there’s no bugs but for sure it’s way more intelligent and less of a hassle to everybody to maintain a single setup rather than to debug everybody’s own specific setup.

#17

“Anything else ARM based such as ODroids, OrangePis and the like may work or not.”

My instance runs on a odroidhc1 …

#18

I’ve switched now to Openhabian with same Configuration. Now we will see it is this the problem or something inside Openhab.

#19

It happens again. Now with openhabian.
What can I do as next to find the problem?

#20

And it happens again. What can I do to find the problem or deliver more informations?

Attached the openhab.log with error.openhab.log (81.9 KB)

It looks like an error with influxDB. But openhab should not stop work when it happes?

I changed on /etc/influxdb/influxdb.conf the following values:

[data]
query-log-enabled = false

[http]
flux-log-enabled = false
log-enabled = false
suppress-write-log = true

Thats all what I modify on influx. Installation of Influx was over Openhabian.

#21

The error in the log mainly looks to me as if influxdb is not running at that moment or using a different port than 8086:

...
Caused by: java.net.ConnectException: Failed to connect to /127.0.0.1:8086
...
Caused by: java.net.ConnectException: Connection refused (Connection refused)
...

I don’t think this is related to the syslog errors problem.

At least it looks like it doesn’t happen that often when using plain openjdk instead of Zulu Java, so it might be related to some strange behaviour of the JRE itself. openHAB 3 runs for one week now for me without showing the problem again.