Syslog overwhelmed with Karaf NPE's

Hi

Over the last few days I have experienced a massive overload of log messages in syslog, like this:

May 18 00:41:40 openhabian karaf[11086]: Exception in thread "pool-6-thread-248785918" java.lang.NullPointerException
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.lang.Thread.run(Thread.java:829)
May 18 00:41:40 openhabian karaf[11086]: Exception in thread "pool-6-thread-248785919" java.lang.NullPointerException
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.lang.Thread.run(Thread.java:829)
May 18 00:41:40 openhabian karaf[11086]: Exception in thread "pool-6-thread-248785920" java.lang.NullPointerException
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
May 18 00:41:40 openhabian karaf[11086]: Exception in thread "pool-6-thread-248785921" #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.lang.Thread.run(Thread.java:829)
May 18 00:41:40 openhabian karaf[11086]: java.lang.NullPointerException
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
May 18 00:41:40 openhabian karaf[11086]: #011at java.base/java.lang.Thread.run(Thread.java:829)

Naturally the system died as it ran out of disk space. When I got it up, the syslog were at 73 GB and the daemon.log at 350 GB(!)

The problem started two days ago, and apparently it has been writing continuously to the logs.

Any idea what can cause this? Or more importantly, how can I help prevent it in the future…?

2 Likes