# openHab log and events stopped working / java.lang.NullPointerException

**URL:** <https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193>\
**Category:** Runtime\
**Tags:** openhab2, logging, eventloggingsetup\
**Created:** [December 14, 2020, 5:47pm UTC](https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193 "2020-12-14T17:47:16Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![Markus2020](https://community.openhab.org/user_avatar/community.openhab.org/markus2020/32/62081_2.png) [@Markus2020](https://community.openhab.org/u/Markus2020)\
**Post date:** [December 14, 2020, 5:47pm UTC](https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193/1 "2020-12-14T17:47:16Z")

</div>

- Platform information:
  - Hardware: Raspberry Pi 3b+ Processor: BCM2835; Linux 4.19.50-v7+ armv7l
  - OS: Raspbian GNU/Linux 10 (buster); Firmware #896
  - Java Runtime Environment: (build 11.0.8+10-post-Raspbian-1deb10u1); Version 11.0.8" 2020-07-14
  - openHAB version: 2.5.9 Release Build

Dear community,

My `/var/log/openhab2/openhab.log` and `/var/log/openhab2/events.log` suddenly stopped working on 02.12.2020 04:50:08am as you can see in my screenshot for the logs.

Several reboots of the Pi and restarts of openHab with cleaning the beforehand cache didn’t change the situation. The SD card don’t seem to be failing, everything else is just running fine.

Checking the log setup in the Karaf console showed me a “java.lang.NullPointerException” for every log command. For e.g.  
`
openhab> log:display
Error executing command: java.lang.NullPointerException
`

I am an absolute beginner, can someone help me with this?

Thanks and best regards,  
Markus

 ![image](https://community-openhab-org.s3.dualstack.eu-central-1.amazonaws.com/original/3X/4/8/48736873aaf4fe0abe7f3ff842e51bdc7532cff9.png)

---

<div class="post-metadata">

**Author:** ![Bruce\_Osborne](https://community.openhab.org/user_avatar/community.openhab.org/bruce_osborne/32/38531_2.png) [@Bruce\_Osborne](https://community.openhab.org/u/Bruce_Osborne)\
**Post date:** [December 14, 2020, 6:14pm UTC](https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193/2 "2020-12-14T18:14:05Z")

</div>

> [@Markus2020](#):
>
> The SD card don’t seem to be failing,

How do you know? Did you try with a different known good card?

---

<div class="post-metadata">

**Author:** ![Markus2020](https://community.openhab.org/user_avatar/community.openhab.org/markus2020/32/62081_2.png) [@Markus2020](https://community.openhab.org/u/Markus2020)\
**Post date:** [December 14, 2020, 7:56pm UTC](https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193/3 "2020-12-14T19:56:31Z")

</div>

Hi Bruce, good question. I can backup my current card with pi-clone in the next days to verify this in detail.

Currently I am not assuming that the card is failing because everything else is just running fine, I would expect way more strange behaviors instead of just stopping both logs.

Is there any way I can restart the logging from scratch without setting up openHab again from the beginning? For e.g. removing both the logfiles etc.?

---

<div class="post-metadata">

**Author:** ![Bruce\_Osborne](https://community.openhab.org/user_avatar/community.openhab.org/bruce_osborne/32/38531_2.png) [@Bruce\_Osborne](https://community.openhab.org/u/Bruce_Osborne)\
**Post date:** [December 14, 2020, 8:01pm UTC](https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193/4 "2020-12-14T20:01:14Z")

</div>

> [@Markus2020](#):
>
> stopping both logs.

Has the filesystem run out of space?

---

<div class="post-metadata">

**Author:** ![Markus2020](https://community.openhab.org/user_avatar/community.openhab.org/markus2020/32/62081_2.png) [@Markus2020](https://community.openhab.org/u/Markus2020)\
**Post date:** [December 14, 2020, 8:05pm UTC](https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193/5 "2020-12-14T20:05:25Z")

</div>

Filesystem in terms of space looks good to me I guess:

 ![image](https://community-openhab-org.s3.dualstack.eu-central-1.amazonaws.com/original/3X/9/4/9458500085f27c9cf0b8a87f09726b566e13a687.png)

---

<div class="post-metadata">

**Author:** ![Markus2020](https://community.openhab.org/user_avatar/community.openhab.org/markus2020/32/62081_2.png) [@Markus2020](https://community.openhab.org/u/Markus2020)\
**Post date:** [December 14, 2020, 9:17pm UTC](https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193/6 "2020-12-14T21:17:22Z")

</div>

I was able to investigate a but further, maybe someone can help with the debug logs? I used `openhab-cli start --debug` to find something, this came out after logging out:

```
openhab> logout
org.ops4j.pax.logging.pax-logging-api [log4j2] ERROR : Unable to write to stream /var/log/openhab2/openhab.log for appender LOGFILE Ignored FQCN: org.apache.logging.log4j.spi.AbstractLogger
org.apache.logging.log4j.core.appender.AppenderLoggingException: Error writing to RandomAccessFile /var/log/openhab2/openhab.log
        at org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager.writeToDestination(RollingRandomAccessFileManager.java:141)
        at org.apache.logging.log4j.core.appender.OutputStreamManager.flushBuffer(OutputStreamManager.java:293)
        at org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager.flush(RollingRandomAccessFileManager.java:160)
        at org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.directEncodeEvent(AbstractOutputStreamAppender.java:199)
        at org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.tryAppend(AbstractOutputStreamAppender.java:190)
        at org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.append(AbstractOutputStreamAppender.java:181)
        at org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender.append(RollingRandomAccessFileAppender.java:252)
        at org.apache.logging.log4j.core.config.AppenderControl.tryCallAppender(AppenderControl.java:156)
        at org.apache.logging.log4j.core.config.AppenderControl.callAppender0(AppenderControl.java:129)
        at org.apache.logging.log4j.core.config.AppenderControl.callAppenderPreventRecursion(AppenderControl.java:120)
        at org.apache.logging.log4j.core.config.AppenderControl.callAppender(AppenderControl.java:84)
        at org.apache.logging.log4j.core.config.LoggerConfig.callAppenders(LoggerConfig.java:543)
        at org.apache.logging.log4j.core.config.LoggerConfig.processLogEvent(LoggerConfig.java:502)
        at org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:485)
        at org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:412)
        at org.apache.logging.log4j.core.config.AwaitCompletionReliabilityStrategy.log(AwaitCompletionReliabilityStrategy.java:63)
        at org.apache.logging.log4j.core.Logger.logMessage(Logger.java:154)
        at org.ops4j.pax.logging.log4j2.internal.PaxLoggerImpl.doLog0(PaxLoggerImpl.java:354)
        at org.ops4j.pax.logging.log4j2.internal.PaxLoggerImpl.doLog(PaxLoggerImpl.java:337)
        at org.ops4j.pax.logging.log4j2.internal.PaxLoggerImpl.error(PaxLoggerImpl.java:163)
        at org.ops4j.pax.logging.internal.TrackingLogger.error(TrackingLogger.java:130)
        at org.ops4j.pax.logging.slf4j.Slf4jLogger.error(Slf4jLogger.java:1019)
        at org.apache.karaf.deployer.features.osgi.Activator$DeploymentFinishedListener.deploymentEvent(Activator.java:90)
        at org.apache.karaf.features.internal.service.FeaturesServiceImpl.callListeners(FeaturesServiceImpl.java:321)
        at org.apache.karaf.features.internal.service.Deployer.deploy(Deployer.java:1067)
        at org.apache.karaf.features.internal.service.FeaturesServiceImpl.doProvision(FeaturesServiceImpl.java:1062)
        at org.apache.karaf.features.internal.service.FeaturesServiceImpl.lambda$doProvisionInThread$13(FeaturesServiceImpl.java:998)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.io.IOException: No space left on device
        at java.base/java.io.RandomAccessFile.writeBytes(Native Method)
        at java.base/java.io.RandomAccessFile.write(RandomAccessFile.java:559)
        at org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager.writeToDestination(RollingRandomAccessFileManager.java:137)
        ... 30 more

```

Same as screenshot:

 ![image](https://community-openhab-org.s3.dualstack.eu-central-1.amazonaws.com/original/3X/d/f/df8d2b1ca6b6da77ba954fd5a424201f08cd62c0.png)

---

<div class="post-metadata">

**Author:** ![Bruce\_Osborne](https://community.openhab.org/user_avatar/community.openhab.org/bruce_osborne/32/38531_2.png) [@Bruce\_Osborne](https://community.openhab.org/u/Bruce_Osborne)\
**Post date:** [December 14, 2020, 9:21pm UTC](https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193/7 "2020-12-14T21:21:57Z")

</div>

> Unable to write to stream /var/log/openhab2/openhab.log  
> Either that path does not exist or there is a permissions issue.

---

<div class="post-metadata">

**Author:** ![Markus2020](https://community.openhab.org/user_avatar/community.openhab.org/markus2020/32/62081_2.png) [@Markus2020](https://community.openhab.org/u/Markus2020)\
**Post date:** [December 14, 2020, 10:00pm UTC](https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193/8 "2020-12-14T22:00:45Z")

</div>

Seems to be a combination of all your assumptions, means it might be an issue with space and permissions.

After further investigating I tried to reset the permission / ownership via the Karaf console. Turns out that there is no space left (why ever). My first thought was indeed a damaged SD card, but checking the filesystem with `df -h` showed me that there is no space left for logs:

 ![image](https://community-openhab-org.s3.dualstack.eu-central-1.amazonaws.com/original/3X/c/9/c947619335f220078c2dbeba4a3ab847324c2246.png)

Any hints how to solve this?

---

<div class="post-metadata">

**Author:** ![Bruce\_Osborne](https://community.openhab.org/user_avatar/community.openhab.org/bruce_osborne/32/38531_2.png) [@Bruce\_Osborne](https://community.openhab.org/u/Bruce_Osborne)\
**Post date:** [December 14, 2020, 10:31pm UTC](https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193/9 "2020-12-14T22:31:08Z")

</div>

It looks like you are running openHABian. I will defer to @mstormi on ho0w best to free up space. I suspect either old logs or something zram related.

---

<div class="post-metadata">

**Author:** ![Wolfgang\_S](https://community.openhab.org/user_avatar/community.openhab.org/wolfgang_s/32/52719_2.png) [@Wolfgang\_S](https://community.openhab.org/u/Wolfgang_S)\
**Post date:** [December 15, 2020, 6:48am UTC](https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193/10 "2020-12-15T06:48:54Z")

</div>

Check the content of /var/log.  
Are there any files that are rotated / old / gzipped ?  
What are the biggest files ?

---

<div class="post-metadata">

**Author:** ![Markus2020](https://community.openhab.org/user_avatar/community.openhab.org/markus2020/32/62081_2.png) [@Markus2020](https://community.openhab.org/u/Markus2020)\
**Post date:** [December 15, 2020, 9:23am UTC](https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193/11 "2020-12-15T09:23:21Z")

</div>

I dont know what I did but the logging started again, I strongly assume something is wrong with the zram1 setting.

After I rebootet the Pi, suddenly 17mb became available again, so the openhab log and events have at least for now enough space to run:

```
Filesystem Size Used Avail Use% Mounted on
/dev/zram1 469M 418M 17M 97% /opt/zram/zram1

```

In the red marked zram1 folder from my screenshot above are many old gzipped files, how can I remove them properly and how can I setup zram logrotate to prevent this issue for the future?

The /var/log/ folder also have a lot of gzipped files

Edit: I’m afraid the logging will stop soon, the zram1 folder will run out of space in the next hour. Those are the most heavy files. Any idea how to avoid the growing of the logfiles?

 ![image](https://community-openhab-org.s3.dualstack.eu-central-1.amazonaws.com/original/3X/7/7/772bf55207e141fbccff4bbfbf3a468e9004647e.png)

---

<div class="post-metadata">

**Author:** ![Wolfgang\_S](https://community.openhab.org/user_avatar/community.openhab.org/wolfgang_s/32/52719_2.png) [@Wolfgang\_S](https://community.openhab.org/u/Wolfgang_S)\
**Post date:** [December 15, 2020, 6:27pm UTC](https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193/12 "2020-12-15T18:27:56Z")

</div>

> [@Markus2020](#):
>
> Any idea how to avoid the growing of the logfiles?

a) check the log files and identify the root cause for logged items; depending on the root cause it might be necessary to take corrective actions  
b) reduce the log level from ‘verbose’ to ‘less verbose’; here it’s required to know more about what do you see in the related log files and the log level; depending on that the log level can be reduced

---

<div class="post-metadata">

**Author:** ![Markus2020](https://community.openhab.org/user_avatar/community.openhab.org/markus2020/32/62081_2.png) [@Markus2020](https://community.openhab.org/u/Markus2020)\
**Post date:** [December 15, 2020, 7:26pm UTC](https://community.openhab.org/t/openhab-log-and-events-stopped-working-java-lang-nullpointerexception/110193/13 "2020-12-15T19:26:45Z")

</div>

I finally got it running again. As I mentioned before, I don’t know why suddenly 17mb were available again after a restart so the logging was able to run again.

I checked the large daemon.log and syslog and saw that my influxdb was creating several records per second in the affected logfiles. I disabled the unnecessary logging from the influxdb config and cleared the logfiles with the following commands (not pretty, I know):

```
[11:19:02] root@RasPiHome:/home/pi# > /opt/zram/zram1/upper/syslog
[11:19:13] root@RasPiHome:/home/pi# > /opt/zram/zram1/upper/daemon.log
[11:19:38] root@RasPiHome:/home/pi# > /opt/zram/zram1/upper/kern.log

```

From now on the logging was reduced heavily and the space increased up to 400mb. Now everything should be fine with logrotate and not too large logfiles, even if in the last 8 hours a few mb of logs were written.

Thanks to everyone who pushed me into the right direction! It was a perfect start for me in the openHAB community.
