OH3 - Network gone - no way to recover

Setup, Configuration and Use Beginners
,
1 
Platform information:
Hardware: RPi 4 8 GB and 32 GB micro SD + zwave: Aeotec Z-Stick Gen5 (ZW090) - USB
OH 3.0.1

Yesterday, my system kind of crashed at 7:19 pm:

events.log:

2021-04-11 19:18:51.764 [INFO ] [openhab.event.ItemCommandEvent      ] - Item 'Heat_HzMode' received command night
2021-04-11 19:18:51.766 [INFO ] [penhab.event.ItemStatePredictedEvent] - Item 'Heat_HzMode' predicted to become night
2021-04-11 19:18:51.782 [INFO ] [openhab.event.ItemStateChangedEvent ] - Item 'Heat_HzMode' changed from day to night
2021-04-11 19:18:51.813 [INFO ] [openhab.event.ItemStateChangedEvent ] - Item 'Heat_HzMode_Sw' changed from ON to OFF
2021-04-11 19:18:56.648 [INFO ] [openhab.event.ItemStateChangedEvent ] - Item 'Abus_Mot' changed from 2021-04-11T19:17:23.000+0200 to 2021-04-11T19:18:37.000+0200
2021-04-11 19:18:56.659 [INFO ] [hab.event.GroupItemStateChangedEvent] - Item 'G_Motion' changed from 2021-04-11T19:17:23.000+0200 to 2021-04-11T19:18:37.000+0200 through Abus_Mot
2021-04-11 19:19:00.621 [INFO ] [openhab.event.ItemStateChangedEvent ] - Item 'ActTime' changed from 11.04./19:18 to 11.04./19:19
^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^$

This matches to the openhab.log - last entry - nothing else obvious:

2021-04-11 19:18:56.646 [INFO ] [enhab.core.model.script.+++ SECURITY] - Abus time stamp updated to: 11.04./19:18

The next morning (today) alarm clock worked as usual switching on the hot water (Buderus KM200) and Espresso machine (via zwave plug)

The symptoms:
ssh: I try to connect, put in the right password - session closed unexpectedly.
wrong password: ssh was asking to try again.
MainUI working normally:
logs using IP-adress:9001 - internal server error
Habpanel: server not available.
Alexa: controlling zwave switched by voice working ok (not always though)
Dash buttons work normally (pcap)
Rule cron: working ok: alarm clock and coffee machine (also zwave)
network ping device to router (item:switch) was OFF

I disconnected the network cable triggering a rule to restart networking after 15 min
→ did not help.
reboot of router for new DHCP connection
→ did not help

So how to trouble shoot this?

2
  • did you try to reboot the system ?
  • what does the system log ( /var/log/syslog ) show ?
  • what about: sudo journalctl ?
3

You mentioned a network cable, but is the wifi also configured? I experienced quite a few terrible network crashes due to the rpi4 wifi powermanagement mode. check dmesg for wifi driver errors.

there is a driver fix in the official debian rasperry repositry, but this didn’t fix it for me until I disabled power management.

4

Thank you, @Wolfgang_S
I will dig into this and might (will) post additional questions :slight_smile:

@Daniel_O
Hmmm. I think I deactivated wifi completely, but will check again.
Thanks for the hint.

5

How old is this SD card? Have there been any power outages?

If you can’t connect over the network you’ll have to plug it into a monitor and keyboard to access the terminal. From there you can look in the syslog and elsewhere for errors which might reveal a path to correcting the problem. But in all likelihood you’ll need to rebuild the system from backups.

6

Thanks Rich,
it’s not that old (around 2 months).

My Raspberry is running headless in a storage room, but I guess the next time I should connect a display and keyboard (it’s not that easy though).

@Wolfgang I was not able to do a regular reboot but switched the power for reboot.

@Daniel_O:
I am not sure, but your wifi guess looks promising.
(I removed the influxdb entries from the log for better transparency)
One point caught my eye: wifi is detected (although obviously disabled) and the entire system / network seems to restart right before I ran into the issues.
Does this make sense?

Apr 11 19:14:28 homer dhcpcd[683]: wlan0: new hardware address: 86:fe:ac:47:be:95
Apr 11 19:14:28 homer NetworkManager[381]: <info>  [1618161268.4106] device (wlan0): set-hw-addr: set MAC address to 86:FE:AC:47:BE:95 (scanning)
Apr 11 19:14:28 homer kernel: [870037.151705] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save enabled
Apr 11 19:14:28 homer NetworkManager[381]: <info>  [1618161268.4287] device (wlan0): supplicant interface state: inactive -> disabled
Apr 11 19:14:28 homer NetworkManager[381]: <info>  [1618161268.4294] device (wlan0): supplicant interface state: disabled -> inactive
Apr 11 19:14:28 homer wpa_supplicant[375]: wlan0: Reject scan trigger since one is already pending
Apr 11 19:15:01 homer CRON[16986]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Apr 11 19:17:01 homer CRON[17137]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Apr 11 19:17:28 homer systemd[1]: Stopping Network Time Synchronization...
Apr 11 19:17:28 homer systemd[1]: systemd-timesyncd.service: Succeeded.
Apr 11 19:17:28 homer systemd[1]: Stopped Network Time Synchronization.
Apr 11 19:17:28 homer systemd[1]: Starting Network Time Synchronization...
Apr 11 19:17:28 homer systemd[1]: Started Network Time Synchronization.
Apr 11 19:17:28 homer systemd-timesyncd[17181]: Synchronized to time server for the first time 194.36.144.87:123 (0.debian.pool.ntp.org).
Apr 11 19:18:33 homer fake-hwclock[118]: Sun 11 Apr 17:17:02 UTC 2021
Apr 11 19:18:33 homer systemd-fsck[133]: e2fsck 1.44.5 (15-Dec-2018)
Apr 11 19:18:33 homer systemd-fsck[133]: rootfs: clean, 83378/1911168 files, 2715069/7748608 blocks
Apr 11 19:18:33 homer systemd[1]: Started File System Check on Root Device.
Apr 11 19:18:33 homer systemd[1]: Starting Remount Root and Kernel File Systems...
Apr 11 19:18:33 homer systemd[1]: Started Set the console keyboard layout.
Apr 11 19:18:33 homer systemd[1]: Started udev Coldplug all Devices.
Apr 11 19:18:33 homer systemd[1]: Started Remount Root and Kernel File Systems.
Apr 11 19:18:33 homer systemd[1]: Condition check resulted in Rebuild Hardware Database being skipped.
Apr 11 19:18:33 homer systemd[1]: Starting Create System Users...
Apr 11 19:18:33 homer systemd[1]: Starting Flush Journal to Persistent Storage...
Apr 11 19:18:33 homer systemd[1]: Starting Load/Save Random Seed...
Apr 11 19:18:33 homer systemd[1]: Starting Helper to synchronize boot up for ifupdown...
Apr 11 19:18:33 homer systemd[1]: Started Create System Users.
Apr 11 19:18:33 homer systemd[1]: Started Load/Save Random Seed.
Apr 11 19:18:33 homer systemd[1]: Started Helper to synchronize boot up for ifupdown.
Apr 11 19:18:33 homer systemd[1]: Starting Create Static Device Nodes in /dev...
Apr 11 19:18:33 homer systemd-tmpfiles[154]: [/usr/lib/tmpfiles.d/vsftpd.conf:1] Line references path below legacy directory /var/run/, updating /var/run/vsftpd/empty → /run/vsftpd/empty; please update the tmpfiles.d/ drop-in file accordingly.
Apr 11 19:18:33 homer systemd[1]: Started Create Static Device Nodes in /dev.
Apr 11 19:18:33 homer systemd[1]: Starting udev Kernel Device Manager...
Apr 11 19:18:33 homer systemd[1]: Reached target Local File Systems (Pre).
Apr 11 19:18:33 homer systemd[1]: Started udev Kernel Device Manager.
Apr 11 19:18:33 homer systemd[1]: Started Flush Journal to Persistent Storage.
Apr 11 19:18:33 homer systemd-udevd[174]: Using default interface naming scheme 'v240'.
Apr 11 19:18:33 homer systemd[1]: Found device /dev/serial1.
Apr 11 19:18:33 homer mtp-probe: checking bus 2, device 2: "/sys/devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb2/2-2"
Apr 11 19:18:33 homer mtp-probe: bus: 2, device: 2 was not an MTP device
Apr 11 19:18:33 homer mtp-probe: checking bus 1, device 3: "/sys/devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3"
Apr 11 19:18:33 homer mtp-probe: bus: 1, device: 3 was not an MTP device
Apr 11 19:18:33 homer systemd-udevd[166]: Using default interface naming scheme 'v240'.
Apr 11 19:18:33 homer systemd[1]: Found device TS32GMSA370 boot.
Apr 11 19:18:33 homer systemd[1]: Condition check resulted in Rebuild Hardware Database being skipped.
Apr 11 19:18:33 homer systemd[1]: Condition check resulted in Huge Pages File System being skipped.
Apr 11 19:18:33 homer systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped.
Apr 11 19:18:33 homer systemd[1]: Condition check resulted in FUSE Control File System being skipped.
Apr 11 19:18:33 homer systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.
Apr 11 19:18:33 homer systemd[1]: Starting File System Check on /dev/disk/by-partuuid/cc1986ed-01...
Apr 11 19:18:33 homer systemd[1]: Starting Load/Save RF Kill Switch Status...
Apr 11 19:18:33 homer systemd[1]: Started Load/Save RF Kill Switch Status.
Apr 11 19:18:33 homer systemd-fsck[279]: fsck.fat 4.1 (2017-01-24)
Apr 11 19:18:33 homer systemd-fsck[279]: 0x41: Dirty bit is set. Fs was not properly unmounted and some data may be corrupt.
Apr 11 19:18:33 homer systemd-fsck[279]:  Automatically removing dirty bit.
Apr 11 19:18:33 homer systemd-fsck[279]: Performing changes.
Apr 11 19:18:33 homer systemd-fsck[279]: /dev/sda1: 270 files, 97615/516190 clusters
Apr 11 19:18:33 homer systemd[1]: Started File System Check on /dev/disk/by-partuuid/cc1986ed-01.
Apr 11 19:18:33 homer systemd[1]: Mounting /boot...
Apr 11 19:18:33 homer systemd[1]: Mounted /boot.
Apr 11 19:18:33 homer systemd[1]: Reached target Local File Systems.
Apr 11 19:18:33 homer systemd[1]: Starting Raise network interfaces...
Apr 11 19:18:33 homer systemd[1]: Starting Preprocess NFS configuration...
Apr 11 19:18:33 homer systemd[1]: Starting Create Volatile Files and Directories...
Apr 11 19:18:33 homer systemd[1]: Starting Set console font and keymap...
Apr 11 19:18:33 homer systemd[1]: Condition check resulted in Commit a transient machine-id on disk being skipped.
Apr 11 19:18:33 homer systemd[1]: nfs-config.service: Succeeded.
Apr 11 19:18:33 homer systemd[1]: Started Preprocess NFS configuration.
Apr 11 19:18:33 homer systemd[1]: Condition check resulted in RPC security service for NFS client and server being skipped.
Apr 11 19:18:33 homer systemd[1]: Condition check resulted in RPC security service for NFS server being skipped.
Apr 11 19:18:33 homer systemd[1]: Reached target NFS client services.
Apr 11 19:18:33 homer systemd[1]: Reached target Remote File Systems (Pre).
Apr 11 19:18:33 homer systemd[1]: Started Set console font and keymap.
Apr 11 19:18:33 homer systemd-tmpfiles[287]: [/usr/lib/tmpfiles.d/vsftpd.conf:1] Line references path below legacy directory /var/run/, updating /var/run/vsftpd/empty → /run/vsftpd/empty; please update the tmpfiles.d/ drop-in file accordingly.
Apr 11 19:18:33 homer systemd[1]: Started Create Volatile Files and Directories.
Apr 11 19:18:33 homer systemd[1]: Starting Network Time Synchronization...
Apr 11 19:18:33 homer systemd[1]: Starting Update UTMP about System Boot/Shutdown...
Apr 11 19:18:33 homer systemd[1]: Started Update UTMP about System Boot/Shutdown.
Apr 11 19:18:33 homer systemd[1]: Started Raise network interfaces.
Apr 11 19:18:33 homer systemd-timesyncd[303]: System clock time unset or jumped backwards, restoring from recorded timestamp: Sun 2021-04-11 19:18:32 CEST
Apr 11 19:18:33 homer systemd[1]: Started Network Time Synchronization.
Apr 11 19:18:33 homer systemd[1]: Reached target System Time Synchronized.
Apr 11 19:18:33 homer systemd[1]: Reached target System Initialization.
Apr 11 19:18:33 homer systemd[1]: Listening on Avahi mDNS/DNS-SD Stack Activation Socket.
Apr 11 19:18:33 homer systemd[1]: Started Daily generation of FireMotD stats.
Apr 11 19:18:33 homer systemd[1]: Started Daily apt download activities.
Apr 11 19:18:33 homer systemd[1]: Started Daily apt upgrade and clean activities.
Apr 11 19:18:33 homer systemd[1]: Listening on PC/SC Smart Card Daemon Activation Socket.
Apr 11 19:18:33 homer systemd[1]: Listening on D-Bus System Message Bus Socket.
Apr 11 19:18:33 homer systemd[1]: Reached target Sockets.
Apr 11 19:18:33 homer systemd[1]: Reached target Basic System.
Apr 11 19:18:33 homer systemd[1]: Condition check resulted in Copy user wpa_supplicant.conf being skipped.
Apr 11 19:18:33 homer systemd[1]: Condition check resulted in getty on tty2-tty6 if dbus and logind are not available being skipped.
Apr 11 19:18:33 homer systemd[1]: Starting Login Service...
Apr 11 19:18:33 homer systemd[1]: Starting Modem Manager...
Apr 11 19:18:33 homer systemd[1]: Starting iptables rules for OpenVPN...
Apr 11 19:18:33 homer systemd[1]: Starting Check for Raspberry Pi EEPROM updates...
Apr 11 19:18:33 homer systemd[1]: Started D-Bus System Message Bus.
Apr 11 19:18:33 homer systemd[1]: Starting WPA supplicant...
Apr 11 19:18:33 homer systemd[1]: Started Daily man-db regeneration.
Apr 11 19:18:33 homer systemd[1]: Starting Resets System Activity Data Collector...
Apr 11 19:18:33 homer systemd[1]: Starting dhcpcd on all interfaces...
Apr 11 19:18:33 homer systemd[1]: Started Daily Cleanup of Temporary Directories.
Apr 11 19:18:33 homer systemd[1]: Starting Avahi mDNS/DNS-SD Stack...
Apr 11 19:18:33 homer kernel: [    0.000000] Booting Linux on physical CPU 0x0
Apr 11 19:18:33 homer kernel: [    0.000000] Linux version 5.10.17-v7l+ (dom@buildbot) (arm-linux-gnueabihf-gcc-8 (Ubuntu/Linaro 8.4.0-3ubuntu1) 8.4.0, GNU ld (GNU Binutils for Ubuntu) 2.34) #1403 SMP Mon Feb 22 11:33:35 GMT 2021
Apr 11 19:18:33 homer systemd[1]: Started Daily rotation of log files.
Apr 11 19:18:33 homer kernel: [    0.000000] CPU: ARMv7 Processor [410fd083] revision 3 (ARMv7), cr=30c5383d
Apr 11 19:18:33 homer kernel: [    0.000000] CPU: div instructions available: patching division code
Apr 11 19:18:33 homer kernel: [    0.000000] CPU: PIPT / VIPT nonaliasing data cache, PIPT instruction cache
Apr 11 19:18:33 homer kernel: [    0.000000] OF: fdt: Machine model: Raspberry Pi 4 Model B Rev 1.4
Apr 11 19:18:33 homer kernel: [    0.000000] Memory policy: Data cache writealloc
Apr 11 19:18:33 homer systemd[1]: Reached target Timers.
Apr 11 19:18:33 homer kernel: [    0.000000] Reserved memory: created CMA memory pool at 0x000000001ec00000, size 256 MiB
Apr 11 19:18:33 homer kernel: [    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
Apr 11 19:18:33 homer kernel: [    0.000000] Zone ranges:
Apr 11 19:18:33 homer kernel: [    0.000000]   DMA      [mem 0x0000000000000000-0x000000002fffffff]
Apr 11 19:18:33 homer kernel: [    0.000000]   Normal   empty
Apr 11 19:18:33 homer kernel: [    0.000000]   HighMem  [mem 0x0000000030000000-0x00000001ffffffff]
Apr 11 19:18:33 homer kernel: [    0.000000] Movable zone start for each node
Apr 11 19:18:33 homer kernel: [    0.000000] Early memory node ranges
Apr 11 19:18:33 homer kernel: [    0.000000]   node   0: [mem 0x0000000000000000-0x000000003e5fffff]
Apr 11 19:18:33 homer systemd[1]: Starting Restore /etc/resolv.conf if the system crashed before the ppp link was shut down...
Apr 11 19:18:33 homer kernel: [    0.000000]   node   0: [mem 0x0000000040000000-0x00000000fbffffff]
Apr 11 19:18:33 homer kernel: [    0.000000]   node   0: [mem 0x0000000100000000-0x00000001ffffffff]
Apr 11 19:18:33 homer kernel: [    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x00000001ffffffff]
Apr 11 19:18:33 homer kernel: [    0.000000] On node 0 totalpages: 2074112
Apr 11 19:18:33 homer kernel: [    0.000000]   DMA zone: 2304 pages used for memmap
Apr 11 19:18:33 homer systemd[1]: Starting dphys-swapfile - set up, mount/unmount, and delete a swap file...
Apr 11 19:18:33 homer kernel: [    0.000000]   DMA zone: 0 pages reserved
Apr 11 19:18:33 homer kernel: [    0.000000]   DMA zone: 196608 pages, LIFO batch:63
Apr 11 19:18:33 homer kernel: [    0.000000]   HighMem zone: 1877504 pages, LIFO batch:63
Apr 11 19:18:33 homer kernel: [    0.000000] percpu: Embedded 20 pages/cpu s50700 r8192 d23028 u81920
Apr 11 19:18:33 homer systemd[1]: Starting System Logging Service...
Apr 11 19:18:33 homer kernel: [    0.000000] pcpu-alloc: s50700 r8192 d23028 u81920 alloc=20*4096
Apr 11 19:18:33 homer kernel: [    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 
Apr 11 19:18:33 homer kernel: [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 2071808
Apr 11 19:18:33 homer systemd[1]: Condition check resulted in Turn on SSH if /boot/ssh is present being skipped.
7

@NCO - Odd problem here!

Have you checked dmesg as well for potential problems/errors?

8

What should I look for?
I get currently many of these at the end of dmesg:

brcmf_cfg80211_set_power_mgmt: power save enabled

and this looks suspicious:

vc_sm_cma_vchi_init: failed to open VCHI service (-1)
[    5.065826] [vc_sm_connected_init]: failed to initialize shared memory service

I don’t have information of dmesg from the time I had the issues

9

I just recognized that wifi was still enabled an I deactivated it by

dtoverlay=disable-wifi

in /boot/config.txt

If one of you have some other comments about the logs above, please let me know :slight_smile:

10

As I said in my post before - you’lle see driver messages in dmesg output. brcmf is wifi by the way, and power management is exactly what is causing issues with certain RPI4s.

Maybe this is your issue, since you disabled wifi completely now, we’ll see :slight_smile:

11

I guess so :slight_smile:
I’ll keep an eye on it and will post the outcome here.

Thanks for your help!

12

Unfortunately it happend again:

2021-04-24 07:37:05.452 [INFO ] [penhab.core.model.script.+++ DEBUG: ] - IRRIGATION TIMER CHECK - LOW RAIN / MOISTURE
2021-04-24 07:37:05.457 [INFO ] [hab.core.model.script.+++ IRRIGATION] - Irrigation timer updated to: 0
2021-04-24 07:37:31.183 [INFO ] [penhab.core.model.script.+++ WEATHER] - Condition W_OWM_Cond changed to: Ein paar Wolken
^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@

syslog shows obviously a reboot (?)

Apr 24 07:35:01 homer CRON[4116]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Apr 24 07:35:09 homer influxd[650]: [httpd] 127.0.0.1 - openhab [24/Apr/2021:07:35:09 +0200] "POST /write?db=openhab_db&rp=autogen&precision=n&consistency=one HTTP/1.1" 204 0 "-" "okhttp/3.14.4" d57e1684-a4be-11eb-9de2-000000000000 5274
Apr 24 07:35:21 homer influxd[650]: [httpd] 127.0.0.1 - openhab [24/Apr/2021:07:35:21 +0200] "POST /write?db=openhab_db&rp=autogen&precision=n&consistency=one HTTP/1.1" 204 0 "-" "okhttp/3.14.4" dc3e0992-a4be-11eb-9de3-000000000000 4973
Apr 24 07:36:09 homer influxd[650]: [httpd] 127.0.0.1 - openhab [24/Apr/2021:07:36:09 +0200] "POST /write?db=openhab_db&rp=autogen&precision=n&consistency=one HTTP/1.1" 204 0 "-" "okhttp/3.14.4" f9464c55-a4be-11eb-9de4-000000000000 6452
Apr 24 07:37:01 homer influxd[650]: [httpd] 127.0.0.1 - openhab [24/Apr/2021:07:37:01 +0200] "POST /write?db=openhab_db&rp=autogen&precision=n&consistency=one HTTP/1.1" 204 0 "-" "okhttp/3.14.4" 17db6fd1-a4bf-11eb-9de5-000000000000 7407
Apr 24 07:37:01 homer influxd[650]: [httpd] 127.0.0.1 - openhab [24/Apr/2021:07:37:01 +0200] "POST /write?db=openhab_db&rp=autogen&precision=n&consistency=one HTTP/1.1" 204 0 "-" "okhttp/3.14.4" 17ec4dc3-a4bf-11eb-9de6-000000000000 3910
Apr 24 07:37:09 homer influxd[650]: [httpd] 127.0.0.1 - openhab [24/Apr/2021:07:37:09 +0200] "POST /write?db=openhab_db&rp=autogen&precision=n&consistency=one HTTP/1.1" 204 0 "-" "okhttp/3.14.4" 1d0fb4d3-a4bf-11eb-9de7-000000000000 3345
Apr 24 07:37:17 homer influxd[650]: [httpd] 127.0.0.1 - openhab [24/Apr/2021:07:37:17 +0200] "POST /write?db=openhab_db&rp=autogen&precision=n&consistency=one HTTP/1.1" 204 0 "-" "okhttp/3.14.4" 21e66596-a4bf-11eb-9de8-000000000000 3815
Apr 24 07:37:18 homer influxd[650]: [httpd] 127.0.0.1 - openhab [24/Apr/2021:07:37:18 +0200] "POST /write?db=openhab_db&rp=autogen&precision=n&consistency=one HTTP/1.1" 204 0 "-" "okhttp/3.14.4" 21f72bab-a4bf-11eb-9de9-000000000000 7972
Apr 24 07:37:31 homer influxd[650]: [httpd] 127.0.0.1 - openhab [24/Apr/2021:07:37:31 +0200] "POST /write?db=openhab_db&rp=autogen&precision=n&consistency=one HTTP/1.1" 204 0 "-" "okhttp/3.14.4" 29d296a6-a4bf-11eb-9dea-000000000000 35322
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          Apr 24 07:38:07 homer kernel: [    0.000000] Booting Linux on physical CPU 0x0
Apr 24 07:38:07 homer kernel: [    0.000000] Linux version 5.10.17-v7l+ (dom@buildbot) (arm-linux-gnueabihf-gcc-8 (Ubuntu/Linaro 8.4.0-3ubuntu1) 8.4.0, GNU ld (GNU Binutils for Ubuntu) 2.34) #1403 SMP Mon Feb 22 11:33:35 GMT 2021
Apr 24 07:38:07 homer kernel: [    0.000000] CPU: ARMv7 Processor [410fd083] revision 3 (ARMv7), cr=30c5383d
Apr 24 07:38:07 homer kernel: [    0.000000] CPU: div instructions available: patching division code
Apr 24 07:38:07 homer kernel: [    0.000000] CPU: PIPT / VIPT nonaliasing data cache, PIPT instruction cache
Apr 24 07:38:07 homer kernel: [    0.000000] OF: fdt: Machine model: Raspberry Pi 4 Model B Rev 1.4
Apr 24 07:38:07 homer kernel: [    0.000000] Memory policy: Data cache writealloc
Apr 24 07:38:07 homer kernel: [    0.000000] Reserved memory: created CMA memory pool at 0x000000001ec00000, size 256 MiB
Apr 24 07:38:07 homer kernel: [    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
Apr 24 07:38:07 homer kernel: [    0.000000] Zone ranges:
Apr 24 07:38:07 homer kernel: [    0.000000]   DMA      [mem 0x0000000000000000-0x000000002fffffff]
Apr 24 07:38:07 homer kernel: [    0.000000]   Normal   empty
Apr 24 07:38:07 homer kernel: [    0.000000]   HighMem  [mem 0x0000000030000000-0x00000001ffffffff]
Apr 24 07:38:07 homer kernel: [    0.000000] Movable zone start for each node
Apr 24 07:38:07 homer kernel: [    0.000000] Early memory node ranges
Apr 24 07:38:07 homer kernel: [    0.000000]   node   0: [mem 0x0000000000000000-0x000000003e5fffff]
Apr 24 07:38:07 homer kernel: [    0.000000]   node   0: [mem 0x0000000040000000-0x00000000fbffffff]
Apr 24 07:38:07 homer kernel: [    0.000000]   node   0: [mem 0x0000000100000000-0x00000001ffffffff]
Apr 24 07:38:07 homer kernel: [    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x00000001ffffffff]
Apr 24 07:38:07 homer kernel: [    0.000000] On node 0 totalpages: 2074112
Apr 24 07:38:07 homer kernel: [    0.000000]   DMA zone: 2304 pages used for memmap
Apr 24 07:38:07 homer kernel: [    0.000000]   DMA zone: 0 pages reserved
Apr 24 07:38:07 homer kernel: [    0.000000]   DMA zone: 196608 pages, LIFO batch:63
Apr 24 07:38:07 homer kernel: [    0.000000]   HighMem zone: 1877504 pages, LIFO batch:63
Apr 24 07:38:07 homer kernel: [    0.000000] percpu: Embedded 20 pages/cpu s50700 r8192 d23028 u81920
Apr 24 07:38:07 homer kernel: [    0.000000] pcpu-alloc: s50700 r8192 d23028 u81920 alloc=20*4096
Apr 24 07:38:07 homer kernel: [    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3

Could this indicate, that influxdb has some problems while writing to the DB?

EDIT:
I just remembered, that I installed a separate 3.1. JAR for influxDB.
Maybe I should update this one?

EDIT II:
I just removed the 3.1 and use the off-the-shelf version coming with 3.0.2 stable

13

One again it happend and I hope to get some help here again :slight_smile:

reading through some other forums I checked the following:

sudo nano /var/log/kern.log

and found this stuff:
A reboot at night? Why?
Does this ring a bell?
OH (kind of) crashed at 2021-05-24 00:08:45.328 according to openhab.log

May 23 19:41:00 homer kernel: [954218.155718] usb 2-2: reset SuperSpeed Gen 1 USB device number 2 using xhci_hcd
May 23 19:41:00 homer kernel: [954218.189975] scsi host0: uas_eh_device_reset_handler success
May 24 00:07:31 homer kernel: [    0.000000] Booting Linux on physical CPU 0x0
May 24 00:07:31 homer kernel: [    0.000000] Linux version 5.10.17-v7l+ (dom@buildbot) (arm-linux-gnueabihf-gcc-8 (Ubuntu/Linaro 8.4.0-3ubuntu1) 8.4.0, GNU ld (GNU Binutils for Ubuntu) 2.34) #1414 SMP Fri Apr 30 13:20:47 BST 2021
May 24 00:07:31 homer kernel: [    0.000000] CPU: ARMv7 Processor [410fd083] revision 3 (ARMv7), cr=30c5383d
May 24 00:07:31 homer kernel: [    0.000000] CPU: div instructions available: patching division code
May 24 00:07:31 homer kernel: [    0.000000] CPU: PIPT / VIPT nonaliasing data cache, PIPT instruction cache
May 24 00:07:31 homer kernel: [    0.000000] OF: fdt: Machine model: Raspberry Pi 4 Model B Rev 1.4
May 24 00:07:31 homer kernel: [    0.000000] Memory policy: Data cache writealloc
May 24 00:07:31 homer kernel: [    0.000000] Reserved memory: created CMA memory pool at 0x000000001ec00000, size 256 MiB
May 24 00:07:31 homer kernel: [    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
May 24 00:07:31 homer kernel: [    0.000000] Zone ranges:
May 24 00:07:31 homer kernel: [    0.000000]   DMA      [mem 0x0000000000000000-0x000000002fffffff]
May 24 00:07:31 homer kernel: [    0.000000]   Normal   empty
May 24 00:07:31 homer kernel: [    0.000000]   HighMem  [mem 0x0000000030000000-0x00000001ffffffff]
May 24 00:07:31 homer kernel: [    0.000000] Movable zone start for each node
May 24 00:07:31 homer kernel: [    0.000000] Early memory node ranges
May 24 00:07:31 homer kernel: [    0.000000]   node   0: [mem 0x0000000000000000-0x000000003e5fffff]
May 24 00:07:31 homer kernel: [    0.000000]   node   0: [mem 0x0000000040000000-0x00000000fbffffff]
May 24 00:07:31 homer kernel: [    0.000000]   node   0: [mem 0x0000000100000000-0x00000001ffffffff]
May 24 00:07:31 homer kernel: [    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x00000001ffffffff]
May 24 00:07:31 homer kernel: [    0.000000] On node 0 totalpages: 2074112
May 24 00:07:31 homer kernel: [    0.000000]   DMA zone: 2304 pages used for memmap
May 24 00:07:31 homer kernel: [    0.000000]   DMA zone: 0 pages reserved
May 24 00:07:31 homer kernel: [    0.000000]   DMA zone: 196608 pages, LIFO batch:63
May 24 00:07:31 homer kernel: [    0.000000]   HighMem zone: 1877504 pages, LIFO batch:63
May 24 00:07:31 homer kernel: [    0.000000] percpu: Embedded 20 pages/cpu s50700 r8192 d23028 u81920
May 24 00:07:31 homer kernel: [    0.000000] pcpu-alloc: s50700 r8192 d23028 u81920 alloc=20*4096
May 24 00:07:31 homer kernel: [    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3
May 24 00:07:31 homer kernel: [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 2071808
May 24 00:07:31 homer kernel: [    0.000000] Kernel command line: coherent_pool=1M 8250.nr_uarts=0 snd_bcm2835.enable_compat_alsa=0 snd_bcm2835.enable_hdmi=1  smsc95xx.macaddr=DC:A6:32:C5:D7:FD vc_mem.mem_base=0x3f000000 vc_mem.mem_size=0x3f600000  console=tty$
May 24 00:07:31 homer kernel: [    0.000000] Kernel parameter elevator= does not have any effect anymore.
May 24 00:07:31 homer kernel: [    0.000000] Please use sysfs to set IO scheduler for individual devices.
May 24 00:07:31 homer kernel: [    0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes, linear)
May 24 00:07:31 homer kernel: [    0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes, linear)
May 24 00:07:31 homer kernel: [    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
May 24 00:07:31 homer kernel: [    0.000000] software IO TLB: mapped [mem 0x0000000014c00000-0x0000000018c00000] (64MB)
May 24 00:07:31 homer kernel: [    0.000000] Memory: 7850668K/8296448K available (10240K kernel code, 1358K rwdata, 3160K rodata, 2048K init, 890K bss, 183636K reserved, 262144K cma-reserved, 7510016K highmem)
May 24 00:07:31 homer kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
May 24 00:07:31 homer kernel: [    0.000000] ftrace: allocating 33942 entries in 67 pages
May 24 00:07:31 homer kernel: [    0.000000] ftrace: allocated 67 pages with 3 groups
May 24 00:07:31 homer kernel: [    0.000000] rcu: Hierarchical RCU implementation.
May 24 00:07:31 homer kernel: [    0.000000]    Rude variant of Tasks RCU enabled.
May 24 00:07:31 homer kernel: [    0.000000]    Tracing variant of Tasks RCU enabled.
May 24 00:07:31 homer kernel: [    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
May 24 00:07:31 homer kernel: [    0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
May 24 00:07:31 homer kernel: [    0.000000] GIC: Using split EOI/Deactivate mode
May 24 00:07:31 homer kernel: [    0.000000] random: get_random_bytes called from start_kernel+0x3c8/0x59c with crng_init=0
May 24 00:07:31 homer kernel: [    0.000008] sched_clock: 32 bits at 1000kHz, resolution 1000ns, wraps every 2147483647500ns
May 24 00:07:31 homer kernel: [    0.000034] clocksource: timer: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275 ns
May 24 00:07:31 homer kernel: [    0.000099] bcm2835: system timer (irq = 25)
May 24 00:07:31 homer kernel: [    0.000751] arch_timer: cp15 timer(s) running at 54.00MHz (phys).
May 24 00:07:31 homer kernel: [    0.000772] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0xc743ce346, max_idle_ns: 440795203123 ns
May 24 00:07:31 homer kernel: [    0.000794] sched_clock: 56 bits at 54MHz, resolution 18ns, wraps every 4398046511102ns
May 24 00:07:31 homer kernel: [    0.000812] Switching to timer-based delay loop, resolution 18ns
May 24 00:07:31 homer kernel: [    0.001066] Console: colour dummy device 80x30
May 24 00:07:31 homer kernel: [    0.001821] printk: console [tty1] enabled
May 24 00:07:31 homer kernel: [    0.001886] Calibrating delay loop (skipped), value calculated using timer frequency.. 108.00 BogoMIPS (lpj=540000)
May 24 00:07:31 homer kernel: [    0.001940] pid_max: default: 32768 minimum: 301
May 24 00:07:31 homer kernel: [    0.002121] LSM: Security Framework initializing
May 24 00:07:31 homer kernel: [    0.002321] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
May 24 00:07:31 homer kernel: [    0.002366] Mountpoint-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
May 24 00:07:31 homer kernel: [    0.003939] Disabling memory control group subsystem
May 24 00:07:31 homer kernel: [    0.004076] CPU: Testing write buffer coherency: ok
May 24 00:07:31 homer kernel: [    0.004548] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
May 24 00:07:31 homer kernel: [    0.005770] Setting up static identity map for 0x200000 - 0x20003c
May 24 00:07:31 homer kernel: [    0.005986] rcu: Hierarchical SRCU implementation.
May 24 00:07:31 homer kernel: [    0.006927] smp: Bringing up secondary CPUs ...
May 24 00:07:31 homer kernel: [    0.008154] CPU1: thread -1, cpu 1, socket 0, mpidr 80000001
May 24 00:07:31 homer kernel: [    0.009516] CPU2: thread -1, cpu 2, socket 0, mpidr 80000002
May 24 00:07:31 homer kernel: [    0.010825] CPU3: thread -1, cpu 3, socket 0, mpidr 80000003
May 24 00:07:31 homer kernel: [    0.010985] smp: Brought up 1 node, 4 CPUs
May 24 00:07:31 homer kernel: [    0.011031] SMP: Total of 4 processors activated (432.00 BogoMIPS).
May 24 00:07:31 homer kernel: [    0.011061] CPU: All CPU(s) started in HYP mode.
May 24 00:07:31 homer kernel: [    0.011087] CPU: Virtualization extensions available.
May 24 00:07:31 homer kernel: [    0.011937] devtmpfs: initialized
May 24 00:07:31 homer kernel: [    0.025786] VFP support v0.3: implementor 41 architecture 3 part 40 variant 8 rev 0
May 24 00:07:31 homer kernel: [    0.026043] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
May 24 00:07:31 homer kernel: [    0.026096] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
May 24 00:07:31 homer kernel: [    0.033144] pinctrl core: initialized pinctrl subsystem
May 24 00:07:31 homer kernel: [    0.034236] NET: Registered protocol family 16
May 24 00:07:31 homer kernel: [    0.038227] DMA: preallocated 1024 KiB pool for atomic coherent allocations
May 24 00:07:31 homer kernel: [    0.039007] audit: initializing netlink subsys (disabled)
May 24 00:07:31 homer kernel: [    0.039291] audit: type=2000 audit(0.030:1): state=initialized audit_enabled=0 res=1
May 24 00:07:31 homer kernel: [    0.039847] thermal_sys: Registered thermal governor 'step_wise'
May 24 00:07:31 homer kernel: [    0.040528] hw-breakpoint: found 5 (+1 reserved) breakpoint and 4 watchpoint registers.
May 24 00:07:31 homer kernel: [    0.040582] hw-breakpoint: maximum watchpoint size is 8 bytes.
May 24 00:07:31 homer kernel: [    0.041017] Serial: AMBA PL011 UART driver
May 24 00:07:31 homer kernel: [    0.071884] bcm2835-mbox fe00b880.mailbox: mailbox enabled
May 24 00:07:31 homer kernel: [    0.090906] raspberrypi-firmware soc:firmware: Attached to firmware from 2021-04-30T13:46:08, variant start_cd
May 24 00:07:31 homer kernel: [    0.100920] raspberrypi-firmware soc:firmware: Firmware hash is d7f29d96450abfc77cd6cf011af1faf1e03e5e56
May 24 00:07:31 homer kernel: [    0.145773] bcm2835-dma fe007000.dma: DMA legacy API manager, dmachans=0x1
May 24 00:07:31 homer kernel: [    0.149878] vgaarb: loaded
May 24 00:07:31 homer kernel: [    0.150349] SCSI subsystem initialized
May 24 00:07:31 homer kernel: [    0.150592] usbcore: registered new interface driver usbfs
May 24 00:07:31 homer kernel: [    0.150679] usbcore: registered new interface driver hub
May 24 00:07:31 homer kernel: [    0.150768] usbcore: registered new device driver usb
May 24 00:07:31 homer kernel: [    0.151444] usb_phy_generic phy: supply vcc not found, using dummy regulator
May 24 00:07:31 homer kernel: [    0.153343] clocksource: Switched to clocksource arch_sys_counter
May 24 00:07:31 homer kernel: [    1.154156] VFS: Disk quotas dquot_6.6.0
May 24 00:07:31 homer kernel: [    1.154293] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
May 24 00:07:31 homer kernel: [    1.154493] FS-Cache: Loaded
May 24 00:07:31 homer kernel: [    1.154702] CacheFiles: Loaded
May 24 00:07:31 homer kernel: [    1.165120] NET: Registered protocol family 2
May 24 00:07:31 homer kernel: [    1.166017] tcp_listen_portaddr_hash hash table entries: 512 (order: 0, 6144 bytes, linear)
May 24 00:07:31 homer kernel: [    1.166180] TCP established hash table entries: 8192 (order: 3, 32768 bytes, linear)
May 24 00:07:31 homer kernel: [    1.166261] TCP bind hash table entries: 8192 (order: 4, 65536 bytes, linear)
May 24 00:07:31 homer kernel: [    1.166348] TCP: Hash tables configured (established 8192 bind 8192)
May 24 00:07:31 homer kernel: [    1.166519] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
May 24 00:07:31 homer kernel: [    1.166574] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
May 24 00:07:31 homer kernel: [    1.166856] NET: Registered protocol family 1
May 24 00:07:31 homer kernel: [    1.167589] RPC: Registered named UNIX socket transport module.
May 24 00:07:31 homer kernel: [    1.167622] RPC: Registered udp transport module.
May 24 00:07:31 homer kernel: [    1.167650] RPC: Registered tcp transport module.
May 24 00:07:31 homer kernel: [    1.167679] RPC: Registered tcp NFSv4.1 backchannel transport module.
May 24 00:07:31 homer kernel: [    1.167716] PCI: CLS 0 bytes, default 64
May 24 00:07:31 homer kernel: [    1.170555] Initialise system trusted keyrings
May 24 00:07:31 homer kernel: [    1.170825] workingset: timestamp_bits=14 max_order=21 bucket_order=7
May 24 00:07:31 homer kernel: [    1.179482] zbud: loaded
May 24 00:07:31 homer kernel: [    1.181411] FS-Cache: Netfs 'nfs' registered for caching
May 24 00:07:31 homer kernel: [    1.182177] NFS: Registering the id_resolver key type
May 24 00:07:31 homer kernel: [    1.182237] Key type id_resolver registered
May 24 00:07:31 homer kernel: [    1.182265] Key type id_legacy registered
May 24 00:07:31 homer kernel: [    1.182433] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
May 24 00:07:31 homer kernel: [    1.183543] Key type asymmetric registered
May 24 00:07:31 homer kernel: [    1.183576] Asymmetric key parser 'x509' registered
May 24 00:07:31 homer kernel: [    1.183783] bounce: pool size: 64 pages
May 24 00:07:31 homer kernel: [    1.183840] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249)
May 24 00:07:31 homer kernel: [    1.184075] io scheduler mq-deadline registered
May 24 00:07:31 homer kernel: [    1.184107] io scheduler kyber registered
May 24 00:07:31 homer kernel: [    1.188554] brcm-pcie fd500000.pcie: host bridge /scb/pcie@7d500000 ranges:
May 24 00:07:31 homer kernel: [    1.188606] brcm-pcie fd500000.pcie:   No bus range found for /scb/pcie@7d500000, using [bus 00-ff]
May 24 00:07:31 homer kernel: [    1.188709] brcm-pcie fd500000.pcie:      MEM 0x0600000000..0x063fffffff -> 0x00c0000000
May 24 00:07:31 homer kernel: [    1.188819] brcm-pcie fd500000.pcie:   IB MEM 0x0000000000..0x00bfffffff -> 0x0400000000
May 24 00:07:31 homer kernel: [    1.245448] brcm-pcie fd500000.pcie: link up, 5.0 GT/s PCIe x1 (SSC)
May 24 00:07:31 homer kernel: [    1.245829] brcm-pcie fd500000.pcie: PCI host bridge to bus 0000:00
May 24 00:07:31 homer kernel: [    1.245866] pci_bus 0000:00: root bus resource [bus 00-ff]
May 24 00:07:31 homer kernel: [    1.245901] pci_bus 0000:00: root bus resource [mem 0x600000000-0x63fffffff] (bus address [0xc0000000-0xffffffff])
May 24 00:07:31 homer kernel: [    1.246011] pci 0000:00:00.0: [14e4:2711] type 01 class 0x060400
May 24 00:07:31 homer kernel: [    1.246270] pci 0000:00:00.0: PME# supported from D0 D3hot
May 24 00:07:31 homer kernel: [    1.249770] PCI: bus0: Fast back to back transfers disabled
May 24 00:07:31 homer kernel: [    1.250043] pci 0000:01:00.0: [1106:3483] type 00 class 0x0c0330
May 24 00:07:31 homer kernel: [    1.250132] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x00000fff 64bit]
May 24 00:07:31 homer kernel: [    1.250410] pci 0000:01:00.0: PME# supported from D0 D3hot
May 24 00:07:31 homer kernel: [    1.253818] PCI: bus1: Fast back to back transfers disabled
May 24 00:07:31 homer kernel: [    1.253930] pci 0000:00:00.0: BAR 8: assigned [mem 0x600000000-0x6000fffff]
May 24 00:07:31 homer kernel: [    1.253971] pci 0000:01:00.0: BAR 0: assigned [mem 0x600000000-0x600000fff 64bit]
May 24 00:07:31 homer kernel: [    1.254033] pci 0000:00:00.0: PCI bridge to [bus 01]
May 24 00:07:31 homer kernel: [    1.254072] pci 0000:00:00.0:   bridge window [mem 0x600000000-0x6000fffff]
May 24 00:07:31 homer kernel: [    1.254493] pcieport 0000:00:00.0: enabling device (0140 -> 0142)
May 24 00:07:31 homer kernel: [    1.254749] pcieport 0000:00:00.0: PME: Signaling with IRQ 62
May 24 00:07:31 homer kernel: [    1.263067] iproc-rng200 fe104000.rng: hwrng registered
May 24 00:07:31 homer kernel: [    1.263424] vc-mem: phys_addr:0x00000000 mem_base=0x3f000000 mem_size:0x3f600000(1014 MiB)
May 24 00:07:31 homer kernel: [    1.264301] gpiomem-bcm2835 fe200000.gpiomem: Initialised: Registers at 0xfe200000
May 24 00:07:31 homer kernel: [    1.276651] brd: module loaded
May 24 00:07:31 homer kernel: [    1.289008] loop: module loaded
May 24 00:07:31 homer kernel: [    1.290663] Loading iSCSI transport class v2.0-870.
May 24 00:07:31 homer kernel: [    1.293104] libphy: Fixed MDIO Bus: probed
May 24 00:07:31 homer kernel: [    1.294893] bcmgenet fd580000.ethernet: GENET 5.0 EPHY: 0x0000
May 24 00:07:31 homer kernel: [    1.313410] libphy: bcmgenet MII bus: probed
May 24 00:07:31 homer kernel: [    1.403519] unimac-mdio unimac-mdio.-19: Broadcom UniMAC MDIO bus
May 24 00:07:31 homer kernel: [    1.404672] usbcore: registered new interface driver r8152
May 24 00:07:31 homer kernel: [    1.404758] usbcore: registered new interface driver lan78xx
May 24 00:07:31 homer kernel: [    1.404851] usbcore: registered new interface driver smsc95xx
May 24 00:07:31 homer kernel: [    1.452413] xhci_hcd 0000:01:00.0: xHCI Host Controller
May 24 00:07:31 homer kernel: [    1.452466] xhci_hcd 0000:01:00.0: new USB bus registered, assigned bus number 1
May 24 00:07:31 homer kernel: [    1.455711] xhci_hcd 0000:01:00.0: hcc params 0x002841eb hci version 0x100 quirks 0x0000030000000890
May 24 00:07:31 homer kernel: [    1.457029] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
May 24 00:07:31 homer kernel: [    1.457070] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
May 24 00:07:31 homer kernel: [    1.457107] usb usb1: Product: xHCI Host Controller
May 24 00:07:31 homer kernel: [    1.457137] usb usb1: Manufacturer: Linux 5.10.17-v7l+ xhci-hcd
May 24 00:07:31 homer kernel: [    1.457168] usb usb1: SerialNumber: 0000:01:00.0
May 24 00:07:31 homer kernel: [    1.457922] hub 1-0:1.0: USB hub found
May 24 00:07:31 homer kernel: [    1.458035] hub 1-0:1.0: 1 port detected
May 24 00:07:31 homer kernel: [    1.458745] xhci_hcd 0000:01:00.0: xHCI Host Controller
May 24 00:07:31 homer kernel: [    1.458788] xhci_hcd 0000:01:00.0: new USB bus registered, assigned bus number 2
May 24 00:07:31 homer kernel: [    1.458833] xhci_hcd 0000:01:00.0: Host supports USB 3.0 SuperSpeed
May 24 00:07:31 homer kernel: [    1.459312] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
May 24 00:07:31 homer kernel: [    1.459351] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
May 24 00:07:31 homer kernel: [    1.459387] usb usb2: Product: xHCI Host Controller
May 24 00:07:31 homer kernel: [    1.459416] usb usb2: Manufacturer: Linux 5.10.17-v7l+ xhci-hcd
May 24 00:07:31 homer kernel: [    1.459447] usb usb2: SerialNumber: 0000:01:00.0
May 24 00:07:31 homer kernel: [    1.460175] hub 2-0:1.0: USB hub found
May 24 00:07:31 homer kernel: [    1.460263] hub 2-0:1.0: 4 ports detected
May 24 00:07:31 homer kernel: [    1.461926] dwc_otg: version 3.00a 10-AUG-2012 (platform bus)
May 24 00:07:31 homer kernel: [    1.462239] dwc_otg: FIQ enabled
May 24 00:07:31 homer kernel: [    1.462253] dwc_otg: NAK holdoff enabled
May 24 00:07:31 homer kernel: [    1.462268] dwc_otg: FIQ split-transaction FSM enabled
May 24 00:07:31 homer kernel: [    1.462286] Module dwc_common_port init
May 24 00:07:31 homer kernel: [    1.462737] usbcore: registered new interface driver uas
May 24 00:07:31 homer kernel: [    1.462865] usbcore: registered new interface driver usb-storage
May 24 00:07:31 homer kernel: [    1.463076] mousedev: PS/2 mouse device common for all mice
May 24 00:07:31 homer kernel: [    1.464770] bcm2835-wdt bcm2835-wdt: Broadcom BCM2835 watchdog timer
May 24 00:07:31 homer kernel: [    1.468264] sdhci: Secure Digital Host Controller Interface driver
May 24 00:07:31 homer kernel: [    1.468299] sdhci: Copyright(c) Pierre Ossman
May 24 00:07:31 homer kernel: [    1.468892] sdhci-pltfm: SDHCI platform and OF driver helper
May 24 00:07:31 homer kernel: [    1.472339] ledtrig-cpu: registered to indicate activity on CPUs
May 24 00:07:31 homer kernel: [    1.472699] hid: raw HID events driver (C) Jiri Kosina
May 24 00:07:31 homer kernel: [    1.472902] usbcore: registered new interface driver usbhid
May 24 00:07:31 homer kernel: [    1.472932] usbhid: USB HID core driver
May 24 00:07:31 homer kernel: [    1.478692] Initializing XFRM netlink socket
May 24 00:07:31 homer kernel: [    1.478755] NET: Registered protocol family 17
May 24 00:07:31 homer kernel: [    1.478875] Key type dns_resolver registered
May 24 00:07:31 homer kernel: [    1.479244] Registering SWP/SWPB emulation handler
May 24 00:07:31 homer kernel: [    1.479423] registered taskstats version 1
May 24 00:07:31 homer kernel: [    1.479462] Loading compiled-in X.509 certificates
May 24 00:07:31 homer kernel: [    1.480315] Key type ._fscrypt registered
May 24 00:07:31 homer kernel: [    1.480346] Key type .fscrypt registered
May 24 00:07:31 homer kernel: [    1.480374] Key type fscrypt-provisioning registered
May 24 00:07:31 homer kernel: [    1.491907] uart-pl011 fe201000.serial: there is not valid maps for state default
May 24 00:07:31 homer kernel: [    1.492237] uart-pl011 fe201000.serial: cts_event_workaround enabled
May 24 00:07:31 homer kernel: [    1.492329] fe201000.serial: ttyAMA0 at MMIO 0xfe201000 (irq = 36, base_baud = 0) is a PL011 rev2
May 24 00:07:31 homer kernel: [    1.499165] bcm2835-power bcm2835-power: Broadcom BCM2835 power domains driver
May 24 00:07:31 homer kernel: [    1.503766] of_cfs_init
May 24 00:07:31 homer kernel: [    1.504037] of_cfs_init: OK
May 24 00:07:31 homer kernel: [    1.536058] mmc0: SDHCI controller on fe340000.emmc2 [fe340000.emmc2] using ADMA
May 24 00:07:31 homer kernel: [    1.536897] Waiting for root device PARTUUID=cc1986ed-02...
May 24 00:07:31 homer kernel: [    1.823384] usb 1-1: new high-speed USB device number 2 using xhci_hcd
May 24 00:07:31 homer kernel: [    2.006067] usb 1-1: New USB device found, idVendor=2109, idProduct=3431, bcdDevice= 4.21
May 24 00:07:31 homer kernel: [    2.006108] usb 1-1: New USB device strings: Mfr=0, Product=1, SerialNumber=0
May 24 00:07:31 homer kernel: [    2.006142] usb 1-1: Product: USB2.0 Hub
May 24 00:07:31 homer kernel: [    2.007916] hub 1-1:1.0: USB hub found
May 24 00:07:31 homer kernel: [    2.008236] hub 1-1:1.0: 4 ports detected
May 24 00:07:31 homer kernel: [    2.153829] usb 2-2: new SuperSpeed Gen 1 USB device number 2 using xhci_hcd
May 24 00:07:31 homer kernel: [    2.185060] usb 2-2: New USB device found, idVendor=174c, idProduct=0857, bcdDevice= 1.00
May 24 00:07:31 homer kernel: [    2.185100] usb 2-2: New USB device strings: Mfr=2, Product=3, SerialNumber=1
May 24 00:07:31 homer kernel: [    2.185133] usb 2-2: Product: X857
May 24 00:07:31 homer kernel: [    2.185162] usb 2-2: Manufacturer: SupTronics
May 24 00:07:31 homer kernel: [    2.185191] usb 2-2: SerialNumber: 20200700026A
May 24 00:07:31 homer kernel: [    2.208450] scsi host0: uas
May 24 00:07:31 homer kernel: [    2.209801] scsi 0:0:0:0: Direct-Access     TS32GMSA 370              0    PQ: 0 ANSI: 6
May 24 00:07:31 homer kernel: [    2.212059] sd 0:0:0:0: [sda] 62533296 512-byte logical blocks: (32.0 GB/29.8 GiB)
May 24 00:07:31 homer kernel: [    2.212275] sd 0:0:0:0: [sda] Write Protect is off
May 24 00:07:31 homer kernel: [    2.212310] sd 0:0:0:0: [sda] Mode Sense: 43 00 00 00
May 24 00:07:31 homer kernel: [    2.212670] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
May 24 00:07:31 homer kernel: [    2.213418] sd 0:0:0:0: [sda] Optimal transfer size 33553920 bytes
May 24 00:07:31 homer kernel: [    2.215299]  sda: sda1 sda2
May 24 00:07:31 homer kernel: [    2.218004] random: fast init done
May 24 00:07:31 homer kernel: [    2.218477] sd 0:0:0:0: [sda] Attached SCSI disk
May 24 00:07:31 homer kernel: [    2.238866] EXT4-fs (sda2): INFO: recovery required on readonly filesystem
May 24 00:07:31 homer kernel: [    2.238907] EXT4-fs (sda2): write access will be enabled during recovery
May 24 00:07:31 homer kernel: [    2.333414] usb 1-1.3: new full-speed USB device number 3 using xhci_hcd
May 24 00:07:31 homer kernel: [    2.474142] usb 1-1.3: New USB device found, idVendor=0658, idProduct=0200, bcdDevice= 0.00
May 24 00:07:31 homer kernel: [    2.474191] usb 1-1.3: New USB device strings: Mfr=0, Product=0, SerialNumber=1
May 24 00:07:31 homer kernel: [    2.474229] usb 1-1.3: SerialNumber: 12345678-9012-3456-7890-123456789012
May 24 00:07:31 homer kernel: [    2.607869] EXT4-fs (sda2): orphan cleanup on readonly fs
May 24 00:07:31 homer kernel: [    2.615738] EXT4-fs (sda2): 6 orphan inodes deleted
May 24 00:07:31 homer kernel: [    2.615774] EXT4-fs (sda2): recovery complete
May 24 00:07:31 homer kernel: [    2.630490] EXT4-fs (sda2): mounted filesystem with ordered data mode. Opts: (null)
May 24 00:07:31 homer kernel: [    2.630594] VFS: Mounted root (ext4 filesystem) readonly on device 8:2.
May 24 00:07:31 homer kernel: [    2.633915] devtmpfs: mounted
May 24 00:07:31 homer kernel: [    2.642729] Freeing unused kernel memory: 2048K
May 24 00:07:31 homer kernel: [    2.663679] Run /sbin/init as init process
May 24 00:07:31 homer kernel: [    2.663709]   with arguments:
May 24 00:07:31 homer kernel: [    2.663723]     /sbin/init
May 24 00:07:31 homer kernel: [    2.663737]   with environment:
May 24 00:07:31 homer kernel: [    2.663752]     HOME=/
May 24 00:07:31 homer kernel: [    2.663766]     TERM=linux
May 24 00:07:31 homer kernel: [    3.075865] NET: Registered protocol family 10
May 24 00:07:31 homer kernel: [    3.077303] Segment Routing with IPv6
May 24 00:07:31 homer kernel: [    3.884280] random: systemd: uninitialized urandom read (16 bytes read)
May 24 00:07:31 homer kernel: [    3.899232] random: systemd: uninitialized urandom read (16 bytes read)
May 24 00:07:31 homer kernel: [    3.903240] random: systemd: uninitialized urandom read (16 bytes read)
May 24 00:07:31 homer kernel: [    4.513461] EXT4-fs (sda2): re-mounted. Opts: (null)
May 24 00:07:31 homer kernel: [    5.388111] rpivid-mem feb00000.hevc-decoder: rpivid-hevcmem initialised: Registers at 0xfeb00000 length 0x00010000
May 24 00:07:31 homer kernel: [    5.390557] rpivid-mem feb10000.rpivid-local-intc: rpivid-intcmem initialised: Registers at 0xfeb10000 length 0x00001000
May 24 00:07:31 homer kernel: [    5.392077] rpivid-mem feb20000.h264-decoder: rpivid-h264mem initialised: Registers at 0xfeb20000 length 0x00010000
May 24 00:07:31 homer kernel: [    5.393851] rpivid-mem feb30000.vp9-decoder: rpivid-vp9mem initialised: Registers at 0xfeb30000 length 0x00010000
May 24 00:07:31 homer kernel: [    5.462142] vc_sm_cma: module is from the staging directory, the quality is unknown, you have been warned.
May 24 00:07:31 homer kernel: [    5.463067] snd_bcm2835: module is from the staging directory, the quality is unknown, you have been warned.
May 24 00:07:31 homer kernel: [    5.463626] mc: Linux media interface: v0.10
May 24 00:07:31 homer kernel: [    5.465769] bcm2835_vc_sm_cma_probe: Videocore shared memory driver
May 24 00:07:31 homer kernel: [    5.465796] [vc_sm_connected_init]: start
May 24 00:07:31 homer kernel: [    5.466504] vc_sm_cma_vchi_init: failed to open VCHI service (-1)
May 24 00:07:31 homer kernel: [    5.466525] [vc_sm_connected_init]: failed to initialize shared memory service
May 24 00:07:31 homer kernel: [    5.486140] bcm2835_audio bcm2835_audio: card created with 8 channels
May 24 00:07:31 homer kernel: [    5.531512] videodev: Linux video capture interface: v2.00
May 24 00:07:31 homer kernel: [    5.547970] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, you have been warned.
May 24 00:07:31 homer kernel: [    5.548178] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, you have been warned.
May 24 00:07:31 homer kernel: [    5.563488] bcm2835_v4l2: module is from the staging directory, the quality is unknown, you have been warned.
May 24 00:07:31 homer kernel: [    5.566989] bcm2835_codec: module is from the staging directory, the quality is unknown, you have been warned.
May 24 00:07:31 homer kernel: [    5.586372] bcm2835_isp: module is from the staging directory, the quality is unknown, you have been warned.
May 24 00:07:31 homer kernel: [    5.592609] bcm2835_mmal_vchiq: Failed to open VCHI service connection (status=-1)
May 24 00:07:31 homer kernel: [    5.593857] bcm2835_mmal_vchiq: Failed to open VCHI service connection (status=-1)
May 24 00:07:31 homer kernel: [    5.606411] bcm2835_mmal_vchiq: Failed to open VCHI service connection (status=-1)
May 24 00:07:31 homer kernel: [    5.855054] [drm] Initialized v3d 1.0.0 20180419 for fec00000.v3d on minor 0
May 24 00:07:31 homer kernel: [    5.869837] cdc_acm 1-1.3:1.0: ttyACM0: USB ACM device
May 24 00:07:31 homer kernel: [    5.872512] usbcore: registered new interface driver cdc_acm
May 24 00:07:31 homer kernel: [    5.872530] cdc_acm: USB Abstract Control Model driver for USB modems and ISDN adapters
May 24 00:07:31 homer kernel: [    5.928642] sd 0:0:0:0: Attached scsi generic sg0 type 0
May 24 00:07:31 homer kernel: [    5.938946] [drm] No displays found. Consider forcing hotplug if HDMI is attached
May 24 00:07:31 homer kernel: [    5.939076] vc4-drm gpu: bound fe600000.firmwarekms (ops vc4_fkms_ops [vc4])
May 24 00:07:31 homer kernel: [    5.939494] [drm] Initialized vc4 0.0.0 20140616 for gpu on minor 1
May 24 00:07:31 homer kernel: [    8.317984] 8021q: 802.1Q VLAN Support v1.8
May 24 00:07:31 homer kernel: [    8.329742] uart-pl011 fe201000.serial: no DMA platform data
May 24 00:07:31 homer kernel: [    8.530373] cfg80211: Loading compiled-in X.509 certificates for regulatory database
May 24 00:07:31 homer kernel: [    8.573475] Adding 2097148k swap on /var/swap.  Priority:-2 extents:26 across:4308988k SSFS
May 24 00:07:31 homer kernel: [    8.640860] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
May 24 00:07:31 homer kernel: [    8.784552] bcmgenet fd580000.ethernet: configuring instance for external RGMII (RX delay)
May 24 00:07:31 homer kernel: [    8.785755] bcmgenet fd580000.ethernet eth0: Link is Down
May 24 00:07:34 homer kernel: [   11.610849] random: crng init done
May 24 00:07:34 homer kernel: [   11.610864] random: 7 urandom warning(s) missed due to ratelimiting
May 24 00:07:36 homer kernel: [   13.993644] bcmgenet fd580000.ethernet eth0: Link is Up - 1Gbps/Full - flow control rx/tx
May 24 00:07:36 homer kernel: [   13.993701] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
May 24 00:07:37 homer kernel: [   15.080864] Bluetooth: Core ver 2.22
May 24 00:07:37 homer kernel: [   15.080971] NET: Registered protocol family 31
May 24 00:07:37 homer kernel: [   15.080987] Bluetooth: HCI device and connection manager initialized
May 24 00:07:37 homer kernel: [   15.081017] Bluetooth: HCI socket layer initialized
May 24 00:07:37 homer kernel: [   15.081040] Bluetooth: L2CAP socket layer initialized
May 24 00:07:37 homer kernel: [   15.081074] Bluetooth: SCO socket layer initialized
May 24 00:07:37 homer kernel: [   15.088583] Bluetooth: HCI UART driver ver 2.3
May 24 00:07:37 homer kernel: [   15.088606] Bluetooth: HCI UART protocol H4 registered
May 24 00:07:37 homer kernel: [   15.088751] Bluetooth: HCI UART protocol Three-wire (H5) registered
May 24 00:07:37 homer kernel: [   15.089107] Bluetooth: HCI UART protocol Broadcom registered
May 24 00:07:38 homer kernel: [   15.414769] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
May 24 00:07:38 homer kernel: [   15.414788] Bluetooth: BNEP filters: protocol multicast
May 24 00:07:38 homer kernel: [   15.414817] Bluetooth: BNEP socket layer initialized
May 24 08:41:50 homer kernel: [   15.922948] ICMPv6: process `dhcpcd' is using deprecated sysctl (syscall) net.ipv6.neigh.eth0.retrans_time - use net.ipv6.neigh.eth0.retrans_time_ms instead
May 24 08:41:50 homer kernel: [   16.149012] tun: Universal TUN/TAP device driver, 1.6
May 24 08:42:06 homer kernel: [   31.832278] vcc-sd: disabling
May 24 08:43:09 homer kernel: [   94.535514] device eth0 entered promiscuous mode

The entries from 08:4x am come from a hard reset.

14

In other words you intentionally created a power-loss, that way you are at least on the highway for a SD card failure if not being there already.

15

I know, but there was no other way to recover (as far as I know).

In the meanwhile I have also changed to an SSD to reduce this risk.
Especially because I need to pull the cord every few weeks.
(I know that there are other options like ZRAM, but please let us keep this thread focussed :wink:

So, this thread actually aims on finding out the root cause and (if possible) to find an automated way to solve this issue whenever it happens (whithout a hard reset).

So any hint would be greatly appreciated.

16

My RPi3 has been doing the same for years.

The time of 00:07 in your log is the time the pi crashed, it doesn’t have a battery backup clock so when you pull the power to reboot, the logs will initially have the wrong time until it syncs with a time server. So it rebooted when you pulled the power not at 00:07.

I’m sure my problems started when I added a USB Z-Wave stick to the system and seemed to get more frequent the more things attached to USB (switching to SSD made it worse for me). At one point it would crash once a week. When mine crashes I can’t SSH in, all logs stop updating, but OH will run ok for a while except for anything that requires file access such as graphs or running scripts. It almost looks like the USB system crashes.

I have managed to get some stability, i.e. it can run without crashing for over a month by using a USB hub and spacing out the USB devices from each other and the pi. Perhaps in my case it was some sort of interference causing the problem.

17

So you mean it crashed around 19:41 on May 23rd and the reboot I see is the one I triggered with the power cord? And at 8:41 thr NTP sync was done?

That would mean, that it looks like USB could be the culprit as you experienced as well:

usb 2-2: reset SuperSpeed Gen 1 USB device number 2 using xhci_hcd
18

Just out of curiosity, is the status light on the RPi itself a solid red, or is it blinking or off? If it’s not a solid red that means it’s experiencing undervoltage which can cause kernel panics as well as unexplained reboots.

19

Do you have a good 2.5+A power supply ? If a RPi becomes short on power, it’ll subsequently power down parts of the system, starting with USB, and the network in a RPi3 is connected through USB chip, too. That’s why the first sign of power shortage often is network problems.
As Rich noted the red LED will turn off then.
And the more peripherals you need to power through USB the worse and less predictable.
For me, another reason not to use an SSD. If by that you hope to buy you reliability, it’s maybe of help to fight SD wearout but worsens things and adversely impacts reliability in several other dimensions.
You better spend the money on a UPS.
I have a $25 Waveshare UPS piggybacked on my RPi3. It just flawlessly survived a power outage of my home.

20

Thanks, guys!

I actuall don’t know (I did not pay attention the last time it happened).
I will do so next time.

However, I am using the official RPi4 power supply (3A).

That’s a good point.
I will use a powerbank to verify the power induced failure.

I might also think about using ZRAM instead jst to compare.
Is there any ETA when the openhabian beta for RPi4 with 8GB will be official?