Issues after migration from 3.4.4-2 to 4.0.1

betahydri · July 29, 2023, 11:05am

Hi,

maybe someone can give me some hints regarding 3 issues after I migrated to 4.0.1.

/var/log/openhab/events.log stays empty, so no logging e.g. in frontail webservice
Can’t select a channel based trigger via UI.
Warning about my rules, after migration

Info System:

1.) log4j2.xml:

frontail doesn’t show any events from items, so I double checked my log files and the log4j2.xml seetings. Could not find any problems there.
Only that the events.log files stay empty, I already rebooted, clean-cache, uninstalled and reinstalled ZRAM and Frontail. But no changes here.

<?xml version="1.0" encoding="UTF-8" standalone="no"?><Configuration monitorInterval="10">

	<Appenders>
		<!-- Console appender not used by default (see Root logger AppenderRefs) -->
		<Console name="STDOUT">
			<PatternLayout pattern="%d{HH:mm:ss.SSS} [%-5.5p] [%-36.36c] - %m%n"/>
		</Console>

		<!-- Rolling file appender -->
		<RollingFile fileName="${sys:openhab.logdir}/openhab.log" filePattern="${sys:openhab.logdir}/openhab.log.%i.gz" name="LOGFILE">
			<PatternLayout pattern="%d{yyyy-MM-dd HH:mm:ss.SSS} [%-5.5p] [%-36.36c] - %m%n"/>
			<Policies>
				<OnStartupTriggeringPolicy/>
				<SizeBasedTriggeringPolicy size="16 MB"/>
			</Policies>
			<DefaultRolloverStrategy max="7"/>
		</RollingFile>

		<!-- Event log appender -->
		<RollingRandomAccessFile fileName="${sys:openhab.logdir}/events.log" filePattern="${sys:openhab.logdir}/events.log.%i.gz" name="EVENT">
			<PatternLayout pattern="%d{yyyy-MM-dd HH:mm:ss.SSS} [%-5.5p] [%-36.36c] - %m%n"/>
			<Policies>
				<OnStartupTriggeringPolicy/>
				<SizeBasedTriggeringPolicy size="16 MB"/>
			</Policies>
			<DefaultRolloverStrategy max="7"/>
		</RollingRandomAccessFile>

		<!-- Audit file appender -->
		<RollingRandomAccessFile fileName="${sys:openhab.logdir}/audit.log" filePattern="${sys:openhab.logdir}/audit.log.%i.gz" name="AUDIT">
			<PatternLayout pattern="%d{yyyy-MM-dd HH:mm:ss.SSS} [%-5.5p] [%-36.36c] - %m%n"/>
			<Policies>
				<OnStartupTriggeringPolicy/>
				<SizeBasedTriggeringPolicy size="8 MB"/>
			</Policies>
			<DefaultRolloverStrategy max="7"/>
		</RollingRandomAccessFile>

		<!-- OSGi appender -->
		<PaxOsgi filter="*" name="OSGI"/>
	</Appenders>

	<Loggers>
		<!-- Root logger configuration -->
		<Root level="WARN">
			<AppenderRef ref="LOGFILE"/>
			<AppenderRef ref="OSGI"/>
		</Root>

		<!-- Karaf Shell logger -->
		<Logger level="OFF" name="org.apache.karaf.shell.support">
			<AppenderRef ref="STDOUT"/>
		</Logger>

		<!-- Security audit logger -->
		<Logger additivity="false" level="INFO" name="org.apache.karaf.jaas.modules.audit">
			<AppenderRef ref="AUDIT"/>
		</Logger>

		<!-- openHAB specific logger configuration -->

		<Logger level="INFO" name="org.openhab"/>

		<Logger level="DEBUG" name="openhab.event.ItemStateEvent"/>
		<Logger level="DEBUG" name="openhab.event.ItemStateUpdatedEvent"/>
		<Logger level="ERROR" name="openhab.event.GroupStateUpdatedEvent"/>
		<Logger level="ERROR" name="openhab.event.ItemAddedEvent"/>
		<Logger level="ERROR" name="openhab.event.ItemRemovedEvent"/>
		<Logger level="ERROR" name="openhab.event.ItemChannelLinkAddedEvent"/>
		<Logger level="ERROR" name="openhab.event.ItemChannelLinkRemovedEvent"/>
		<Logger level="ERROR" name="openhab.event.ChannelDescriptionChangedEvent"/>
		<Logger level="ERROR" name="openhab.event.ThingStatusInfoEvent"/>
		<Logger level="ERROR" name="openhab.event.ThingAddedEvent"/>
		<Logger level="ERROR" name="openhab.event.ThingUpdatedEvent"/>
		<Logger level="ERROR" name="openhab.event.ThingRemovedEvent"/>
		<Logger level="ERROR" name="openhab.event.InboxUpdatedEvent"/>
		<Logger level="ERROR" name="openhab.event.RuleStatusInfoEvent"/>
		<Logger level="ERROR" name="openhab.event.RuleAddedEvent"/>
		<Logger level="ERROR" name="openhab.event.RuleRemovedEvent"/>
		<Logger level="ERROR" name="openhab.event.StartlevelEvent"/>
		<Logger level="ERROR" name="openhab.event.AddonEvent"/>

		<Logger additivity="false" level="INFO" name="openhab.event">
			<AppenderRef ref="EVENT"/>
			<AppenderRef ref="OSGI"/>
		</Logger>

		<Logger level="ERROR" name="javax.jmdns"/>
		<Logger level="ERROR" name="org.jupnp"/>

		<!-- This suppresses all Maven download issues from the log when doing feature installations -->
		<!-- as we are logging errors ourselves in a nicer way anyhow. -->
		<Logger level="ERROR" name="org.ops4j.pax.url.mvn.internal.AetherBasedResolver"/>

		<!-- Filters known issues of pax-web (issue link to be added here). -->
		<!-- Can be removed once the issues are resolved in an upcoming version. -->
		<Logger level="OFF" name="org.ops4j.pax.web.pax-web-runtime"/>

		<!-- Filters known issues of lsp4j, see -->
		<!-- https://github.com/eclipse/smarthome/issues/4639 -->
		<!-- https://github.com/eclipse/smarthome/issues/4629 -->
		<!-- https://github.com/eclipse/smarthome/issues/4643 -->
		<!-- Can be removed once the issues are resolved in an upcoming version. -->
		<Logger level="OFF" name="org.eclipse.lsp4j"/>

		<!-- Filters warnings for events that could not be delivered to a disconnected client. -->
		<Logger level="ERROR" name="org.apache.cxf.jaxrs.sse.SseEventSinkImpl"/>

		<!-- Filters warnings from broken connections during startup -->
		<!-- https://github.com/openhab/openhab-core/issues/2998 -->
		<Logger level="ERROR" name="org.apache.cxf.phase.PhaseInterceptorChain"/>

		<!-- Filters known issues of KarServiceImpl, see -->
		<!-- https://github.com/openhab/openhab-distro/issues/519#issuecomment-351944506 -->
		<!-- Can be removed once the issues are resolved in an upcoming version. -->
		<Logger level="ERROR" name="org.apache.karaf.kar.internal.KarServiceImpl"/>

		<!-- Filters warnings about unavailable ciphers when JCE is not installed, see -->
		<!-- https://github.com/openhab/openhab-distro/issues/999 -->
		<Logger level="ERROR" name="org.apache.karaf.shell.ssh.SshUtils"/>

		<!-- Filters known issues of javax.mail, see -->
		<!-- https://github.com/openhab/openhab-addons/issues/5530 -->
		<Logger level="ERROR" name="javax.mail"/>

		<!-- Filters disconnection warnings of the ChromeCast Java API, see -->
		<!-- https://github.com/openhab/openhab-addons/issues/3770 -->
		<Logger level="ERROR" name="su.litvak.chromecast.api.v2.Channel"/>

		<!-- Added by Karaf to prevent debug logging loops, see -->
		<!-- https://issues.apache.org/jira/browse/KARAF-5559 -->
		<Logger level="WARN" name="org.apache.sshd"/>
	</Loggers>

</Configuration>

Log levels:

Log files:

2.) No Channel:

noticed that my items based on events from channel triggers didn’t changed, e.g. Astro Binding
therefore I tried to create a new rule based on the channel trigger, but the channel picker popup in the UI won’t show up when I click on channel.

nochannelselectable1551×1154 64.6 KB

3.) Errors in openhab.log file,

I installed 4.0.1 addons JS Scripting and JavaScript Scripting (Nashorn).
I changed all non former ECMA 2021 automation scripts from application/javascript mime type to application/javascript;version=ECMAScript-5.1.

Can this be ignored?

2023-07-29 11:39:07.950 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'gAlleBatterienStatus' needed for rule 'BatterieZuNiedrig' removed. Trigger '1' will no longer work.
2023-07-29 11:39:07.962 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'SonoffSNZB03MOTION1_Bewegung' needed for rule 'EingangsflurBewegung' removed. Trigger '1' will no longer work.
2023-07-29 11:39:07.964 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'gAlleBatterienStatus' needed for rule 'BatterieZuNiedrig' removed. Condition '2' will no longer work.
2023-07-29 11:39:07.990 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'modeBlindsTerrasseAuto' needed for rule 'openBlindsTerrasseWeekend' removed. Condition '3' will no longer work.
2023-07-29 11:39:07.992 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'modeBlindsTerrasseAuto' needed for rule 'closeBindsTerrasseWeekday' removed. Condition '3' will no longer work.
2023-07-29 11:39:07.993 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'modeBlindsTerrasseAuto' needed for rule 'openBlindsTerrasseWeekday' removed. Condition '3' will no longer work.
2023-07-29 11:39:07.996 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'modeBlindsTerrasseAuto' needed for rule 'closeBlindsTerrasseWeekend' removed. Condition '3' will no longer work.
2023-07-29 11:39:08.006 [WARN ] [le.handler.ItemCommandTriggerHandler] - Item 'LGOLEDTV_VolDummy' needed for rule 'VolumeUpDown' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.007 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'VariableActuator_Urlaub_Status' needed for rule 'Anwesenheitssimulation_Lampen' removed. Condition '5' will no longer work.
2023-07-29 11:39:08.011 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'VariableActuator_Urlaub_Status' needed for rule 'AVM_Urlaubsschaltung_Anwenden' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.012 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'VariableActuator_Urlaub_Status' needed for rule 'AVM_Urlaubsschaltung_Anwenden' removed. Condition '4' will no longer work.
2023-07-29 11:39:08.012 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'VariableActuator_Urlaub_Status' needed for rule 'AVM_Heizung_Autmatik_Vorlage' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.014 [WARN ] [le.handler.ItemCommandTriggerHandler] - Item 'VoiceCommand' needed for rule 'VoiceTest' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.059 [WARN ] [le.handler.ItemCommandTriggerHandler] - Item 'LGOLEDTV_ChannelDummy' needed for rule 'ChannelUpDown' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.082 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'HeizungWohnzimmer_SetTemp' needed for rule 'HeizungEGStatusWennTuerLangOffen' removed. Trigger '2' will no longer work.
2023-07-29 11:39:08.097 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'steckdosemobil2' needed for rule 'BeleuchtungAus' removed. Condition '3' will no longer work.
2023-07-29 11:39:08.107 [WARN ] [le.handler.ItemCommandTriggerHandler] - Item 'SchlafzimmerFernseher_ChUpDown' needed for rule 'SchalfzimmerTV_Channel_UpDown' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.113 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'isNight' needed for rule 'Anwesenheitssimulation_Lampen' removed. Condition '4' will no longer work.
2023-07-29 11:39:08.116 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'isNight' needed for rule 'MotionTest' removed. Condition '3' will no longer work.
2023-07-29 11:39:08.173 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'Windows10_Online' needed for rule 'HeizungKellerFlurimWinter' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.175 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'Windows10_Online' needed for rule 'HeizungBueroKellerflurImSommer' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.176 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'Windows10_Online' needed for rule 'HeizungBueroimWinter' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.177 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'Windows10_Online' needed for rule 'OfficeWindowsPC_PingStatus' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.200 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'Terrassen_Tur_TurFensterstatus' needed for rule 'HeizungAusWennEGTuerAuf' removed. Trigger '2' will no longer work.
2023-07-29 11:39:08.236 [WARN ] [le.handler.ItemCommandTriggerHandler] - Item 'Windows10_ONOFF' needed for rule 'Windows10_ONOFF' removed. Trigger '0' will no longer work.
2023-07-29 11:39:08.258 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'Person1Presence_Raw' needed for rule 'MotionTest' removed. Condition '4' will no longer work.
2023-07-29 11:39:08.271 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'IkeaSchalter1_Action' needed for rule 'IkeaSchalter1_Regel' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.271 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'IkeaSchalter1_Action' needed for rule 'IkeaSchalter1_Regel' removed. Condition '2' will no longer work.
2023-07-29 11:39:08.275 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'modeBlindsEsszimmerAuto' needed for rule 'closeBlindsEsszimmerWeekend' removed. Condition '3' will no longer work.
2023-07-29 11:39:08.277 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'modeBlindsEsszimmerAuto' needed for rule 'openBlindsEsszimmerWeekday' removed. Condition '3' will no longer work.
2023-07-29 11:39:08.281 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'modeBlindsEsszimmerAuto' needed for rule 'openBlindsEsszimmerWeekend' removed. Condition '3' will no longer work.
2023-07-29 11:39:08.285 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'modeBlindsEsszimmerAuto' needed for rule 'closeBlindsEsszimmerWeekday' removed. Condition '3' will no longer work.
2023-07-29 11:39:08.350 [WARN ] [le.handler.ItemCommandTriggerHandler] - Item 'SchlafzimmerFernseher_RCButton' needed for rule 'Schlafzimmer_Fernseher_RCButton' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.406 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'IKEABewegungmelder1_Bewegung' needed for rule 'MotionTest' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.408 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'fboxMacJan1' needed for rule 'HeizungBueroimWinter' removed. Trigger '4' will no longer work.
2023-07-29 11:39:08.410 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'fboxMacJan1' needed for rule 'FalconSteuerung' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.411 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'fboxMacJan1' needed for rule 'HeizungKellerFlurimWinter' removed. Trigger '4' will no longer work.
2023-07-29 11:39:08.413 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'fboxMacJan1' needed for rule 'HeizungBueroKellerflurImSommer' removed. Trigger '4' will no longer work.
2023-07-29 11:39:08.497 [WARN ] [ule.handler.GroupStateTriggerHandler] - Group 'gHeizungen' needed for rule 'AVM_Urlaubsschaltung_Anwenden' removed. Trigger '6' will no longer work.
2023-07-29 11:39:08.520 [WARN ] [ule.handler.GroupStateTriggerHandler] - Group 'Debounce' needed for rule 'DebounceNew' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.538 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'HeizungEsszimmer_SetTemp' needed for rule 'HeizungEGStatusWennTuerLangOffen' removed. Trigger '3' will no longer work.
2023-07-29 11:39:08.544 [WARN ] [le.handler.ItemStateConditionHandler] - Item 'PresenceOverride' needed for rule 'AVM_Heizung_Autmatik_Vorlage' removed. Condition '7' will no longer work.
2023-07-29 11:39:08.568 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'Gartentuer_Esszimmer_Tuerstatus' needed for rule 'HeizungAusWennEGTuerAuf' removed. Trigger '3' will no longer work.
2023-07-29 11:39:08.604 [WARN ] [le.handler.ItemCommandTriggerHandler] - Item 'LGOLEDTV_RCButton' needed for rule 'LGTV_RCButton' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.607 [WARN ] [le.handler.ItemCommandTriggerHandler] - Item 'SchlafzimmerFernseher_VolDummy' needed for rule 'SchlafzimmerTV_Volume_UpDown' removed. Trigger '1' will no longer work.
2023-07-29 11:39:08.609 [WARN ] [dule.handler.ItemStateTriggerHandler] - Item 'Buro_Deckenleuchte_Schalter' needed for rule 'Deckenlampe_Status' removed. Trigger '1' will no longer work.

timl · July 29, 2023, 11:18am

Hey @betahydri

I can confirm the channel problem. I also saw an “Uncaught (in promise) TypeError: e.channels is undefined” error in my firefox console, after select “Thing” in the trigger menu. Sounds like this is related to the broken Channel selection.

Regards,
Tim

rlkoshak · July 30, 2023, 6:08pm

Do you have items actually receiving updates?
This is a known problem and an issue had already been opened for it.
I’m guessing this is related to 1. None of your items already to exist. How are they defined?

betahydri · July 30, 2023, 7:34pm

Hi Rich again ;-),

I have done a new installation and restored my backup (with openhab-cli restore ) from the former migrated 3.4.4-2 → 4.0.1 backup.
Even with a new installation, no events and therefore my automation is broken completely.
You’re right, what I noticed is, that the org.openhab.core.items.Item.json file is missing in /var/lib/openhab/jsondb. All my items have been added since 3.0 only from the UI, so no more file based items, only 3 Things.

1. Do you have items actually receiving updates?

Well I can control my items, e.g. light goes on when I klick on my UI

Items are updating in the UI, e.g. when I switch a light on/off, must press refresh, but I see the change afterwards.

No new log entry in the events.log when I toggle a switch on/off

Further I noticed, at the beginning of the new openhab 4.0.1 installation I had event.log entries, but after rollover the new file is empty again. (see events.log file events.log (795.5 KB))

AND org.openhab.core.items.Item.json is missing, this wasn’t so with 3.4.4. After I rebooting openhab, I also see log entries saying restoring from backup?

see old jsondb folder from 3.4.4 installation:

Regarding point 2., yes, I found the issue in the github already documented as bug.

rlkoshak · July 30, 2023, 8:15pm

When ever the items JSONDB file ends up empty it means you have no Items. No Items no events. No events, not rules will trigger.

The “restore from backup” message happens when OH sees you don’t have an Items jsondb file, so it uses the latest one in the backup folder.

You don’t say how you are doing the upgrade nor how you are doing the restore. Generally, you cannot restore an older backup if files to a newer version of OH. If you want to attempt to do that, you must run the upgrade tool but also check the breaking changes log in the announcements as there may be some things you have to change manually.

Also be careful with zram. You must shutdown/reboot normally and not by yanking the plug or else you lose all the changes made since the last boot.

betahydri · July 30, 2023, 8:33pm

Oh sorry, I meant that after the reinstallation I restored the backup of the previous upgrade version. I.e. with openhab-cli restore from the previous 3.4.4 → 4.0.1 migration. I corrected that in my original post.

And I’m always doing: “sudo shutdown -r now” or “sudo reboot”

rlkoshak · July 30, 2023, 8:41pm

If you just restore an old config on a newer openHAB instance you skip all the upgrade steps too. There are lots of breaking changes that can occur that you never know about because the upgrade scripts that run after upgrading OH make changes to your config for you.

First verify that your items JSONDB file is even in the backup. That might be corrupted. If it’s there, make sure to run the upgrade tool prior to starting OH after restoring the backup. That might work.

java -jar $OPENHAB_RUNTIME/bin/upgradetool.jar --force

betahydri · August 1, 2023, 4:02pm

Thanks Rich, I switched for now back to 3.4.5 and everything is working again. But I’m rewriting my javascript 5.1 and DSL rules to javascript ECMA 2021. Then when everything is cleaned-up I will install java 17 and test if it will break something, see announcements.

But maybe you as coder can give me a hint regarding my post:
How to use DateTimeFormatter.ofPattern in ECMA 2021 openhab rules - Setup, Configuration and Use / Scripts & Rules - openHAB Community