Configuration broken after log files filled disk

Hi,

I had a similar issue as posted about here : Syslog and daemon.log flood with Java-Error However on reboot, my configuration is broken.

My syslog and daemon.log filled up with many NPEs.
I was able to ssh in, stop syslog, stop openhab, delete the daemon.log which freed space.
I rebooted the system, and openhab came back up however the configuration seemed quite broken

  • my admin user wasn’t recognized - I was asked to create a new one
  • none of my things were visisble.
  • Items were there, but all the links to the item channels were broken.

Leaving the “log file filling up issue” aside, my main concern is why the configuration would be so totally broken after removing the log files and rebooting. Any thoughts on that issue?

Thanks everyone.

  • Platform information:
    • Hardware: Raspberry pi 4
    • OS: Raspbian5.10.63-v7l+
    • Java Runtime Environment: OpenJDK Runtime Environment Zulu11.52+13-CA (build 11.0.13+8-LTS)
    • openHAB version: openHAB 3.2.0 - Release Build

snippet of the log

Feb 12 07:06:03 openhab3 karaf[469]: Exception in thread "pool-6-thread-1" java.lang.NullPointerException
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:217)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.lang.Thread.run(Thread.java:829)
Feb 12 07:06:03 openhab3 karaf[469]: Exception in thread "pool-6-thread-2" java.lang.NullPointerException
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
Feb 12 07:06:03 openhab3 karaf[469]: Exception in thread "pool-6-thread-3" #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.lang.Thread.run(Thread.java:829)
Feb 12 07:06:03 openhab3 karaf[469]: java.lang.NullPointerException
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.lang.Thread.run(Thread.java:829)
Feb 12 07:06:03 openhab3 karaf[469]: Exception in thread "pool-6-thread-4" java.lang.NullPointerException
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.dequeue(LinkedBlockingQueue.java:214)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
Feb 12 07:06:03 openhab3 karaf[469]: #011at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)

The log files may have taken up all the free space on disk … Check for the content of the jsondb directory ( /var/lib/openhab/jsondb ). It might be that a new file was created but not enough space was available so that one or more of these files are broken.

Thanks @Wolfgang_S That is definitely the issue

/var/lib/openhab/jsondb/org.openhab.core.thing.Thing.json

is 0 bytes on disk.

Unfortunately, so are all the copies in the backup folder.

My SD card mirror backup saved the day here!
If you’re reading this and do not already have that feature setup - DO IT RIGHT NOW :slight_smile:

2 Likes