Disconnected from the openHAB Cloud service

Apps & Services openHAB Cloud
62

@LordLiverpool there is no such bundle. I believe the bundle is called org.openhab.io.openhabcloud?

1 Like
63

Ahh, I was just going by the log. Iā€™ll try that one.

It disconnected again at 1:03. Again, it incorrectly reports that it reconnected 10 seconds later.

2022-10-30 01:03:23.591 [INFO ] [io.openhabcloud.internal.CloudClient] - Disconnected from the openHAB Cloud service (UUID = 27fe6435-e6fb-4d91-9d06-fa1aa97f2bcb, base URL = http://localhost:8080)
2022-10-30 01:03:33.978 [INFO ] [io.openhabcloud.internal.CloudClient] - Connected to the openHAB Cloud service (UUID = 27fe6435-e6fb-4d91-9d06-fa1aa97f2bcb, base URL = http://localhost:8080)

Iā€™ll see if I can activate debug logging.

64

Are the servers a bit more unstable the last weeks? Iā€™ve noticed the last month (estimate) that google will say that ā€˜openhab is unreachableā€™ (not often, one or two times a week). Usually after a few minutes it responds again. Before this happened rarelyā€¦

(edit: ah, seems I wasnā€™t looking at the last post ā€¦ so let me rephrase the above: also experience this :wink: )

65

My monitoring flagged 17 issues with the cloud connector starting after 19:30 EDT on 2022/10/28 and ending before 00:45 on 2022/10/29. During that time, I was able to login to myopenhab.org - it indicated that I was offline. Most of the issues were timeouts (timeout was five seconds) - my Internet monitor showed no issues from my end. There were some error 500 ā€œServer Error: openHAB is offline for url: https://myopenhab.org/rest/items/ā€¦ā€ issues, which I saw when I disabled the cloud connector at my end during testing.

I monitor every 15 minutes. Of the 20 samples, three succeeded without errors, two after a single error attempting to reach myopenhab.org, and eight after one restart of the cloud connector. In seven attempts, two restarts were attempted - there were four consecutive double restart attempts between 22:15 and 23:00. The issues disappeared sometime after 00:30 - there was nothing in my openhab logs between 00:30 and 00:45 that suggested anything changed at my end. Since then, no further issues have been detected.

66

I am not able to change the log level to DEBUG. From openhab-cli console:

openhab> log:get org.openhab.io.openhabcloud
INFO
openhab> log:set DEBUG  org.openhab.io.openhabcloud
Error executing command: Unable to set level for logger

I am running OpenHAB 3.3.0 upgraded from OpenHAB 3.2.0. It might be related to log:set doesn't work when manually edited log4j2.xml exists Ā· Issue #1217 Ā· openhab/openhab-distro Ā· GitHub (possibly fixed in OH 3.4.0-SNAPSHOT) or a permissions issues (have not had the time to dig further).

67

Yesterday and overnight I didnā€™t see any further problems, so the bundle restart hasnā€™t had a chance to be tested.

68

What I currently experience / what leaves me puzzled:

  • I experienced the same reported disconnects and reconnects from openHAB Cloud between October 8th and 10th and since October 22nd.
  • Even though the last entry showed ā€žreconnectā€œ
2022-10-31 12:43:42.240 [INFO ] [io.openhabcloud.internal.CloudClient] - Disconnected from the openHAB Cloud service (UUID = xxx, base URL = http://localhost:8080)
2022-10-31 12:44:09.197 [INFO ] [io.openhabcloud.internal.CloudClient] - Connected to the openHAB Cloud service (UUID = xxx, base URL = http://localhost:8080)

ā€¦ Alexa still does not work / myopenhab says that my server is offline

  • I normally also lean towards thisā€¦

ā€¦ but, since the connection appears to be down now for almost 9 hours, I suspect it wonā€™t come up again? I have not yet tried to reconnect the cloud connector, because Iā€˜d like to understand why my server does not reconnect? Assuming I would be away (not being able to do the reconnect myself), the server should manage to get online all by itself.

Any ideas?

69

Correct. Your server doesnā€™t know that itā€™s disconnected, so thereā€™s no need to reconnect. You can confirm this by going to myopenhab.org, which will show that your system is ā€œOfflineā€.

Also, correct. Per the various ongoing discussion threads, this is happening to a lot of people. Somethingā€™s wrong, but itā€™s not your system. So the maintainers are trying to fix it.

The short-term fix is to restart the cloud connector. The easiest way to do this is to save the settings via MainUI, which forces a disconnect/connect.

I know itā€™s frustrating. What I find strange is that some are more affected than others. Iā€™ve only experienced this once or twice in the past few weeks, and I donā€™t know why I would be luckier than anyone else.

3 Likes
70

Yes.

Though, funny twist: My server did just manage to go back online all by itself. So I can go to bed now with a smile. :slight_smile:

2 Likes
71

Apart from the openhab Server that is kind a ā€ždownā€œ I experianced the issue, that my logview is down as well. I cant resch ip:9001 any longier. Even a restart did not fixed the Problem. Is someone facing the same problem?

72

Thatā€™s probably not related to this discussion, but oddly enough a similar thing happened to me. At 1am this morning, the log froze and MainUI became inaccessible. However, my sitemap and rules still worked.

Iā€™m chalking it up to an old SD card that needs to be replaced.

73

Restarting the binding ā€œorg.openhab.io.openhabcloudā€ seems to work.

Iā€™m using Javascript/JSR223

RestartBinding("org.openhab.io.openhabcloud");

export//
function RestartBinding(sBindingID)
{
  var Exec = Java.type("org.openhab.core.model.script.actions.Exec");
  var Duration = Java.type("java.time.Duration");
  // @ts-ignore
  Exec.executeCommandLine(Duration.ofSeconds(6), "sudo", "/usr/bin/ssh", "-p", "8101", "-i", "/var/lib/openhab/.ssh/openhab.id_rsa", "openhab@localhost", "bundle:restart", sBindingID);
}

The way I detect that the cloud has disconnected is by creating an item Cloud_Heartbeat_TimeStamp, which I update by calling the cloud API from rules every 10 minutes. If it stops getting updated, it probably means the cloud connection is down.

4 Likes
74

Seeing the same here since at least a week or so. My girlfriend starts getting annoyed by Alexa saying the hub is not responding :).

75

Hello, for some time I have had the problem that the connection to myopenhab.org is interrupted once a week and I cannot access it from on the road. If I then edit the settings for the openhab cloud in Openhab, it works again for a week.
Since a few days I have to do this almost every day.
Does anyone have similar problems and an idea for a solution?
Good, I can still access it via my private VPN - but thatā€™s always just plan B.
Greetings, Ansgar

76

Iā€™ve had this issue a year ago. Reinstalling OpenHAB somehow fixed it. Just untill two weeks ago, when this started to be a problem again. XHR Polling Error in the Logs.

I just reinstalled OpenHAB again and voila ā€¦ it still goes offline periodically.

Can someone help me with this?

77

Right now https://home.myopenhab.org/ is giving me: 504 Gateway Time-out

78

Been having this regularly the past several days. Becoming annoying when the Mrs asks Google to turn the light off in the nursery for putting the little one down. Even a rule restarting it a couple times a day isnā€™t enoughā€¦

79

Maybe itā€™s not relevant but I just checked my OH 2.5 logs and I canā€™t see any disconnect for more than a monthā€¦ Wether in my local logs nor in in the myopenhab.org logs

80

Hi LordLiverpool
This sounds like something I need, I was trying to find a way to extract the online/offline status from myopenhab. My plan was to change the colour of some led striplights.
can you explain a bit more how you use the timestamp?

81

First I create a ā€œcloud heartbeatā€ item in my items file:

DateTime Cloud_Heartbeat_TimeStamp "Cloud access heartbeat date-time [%1$tY.%1$tm.%1$td %1$tH:%1$tM:%1$tS]" (gAllDates)

Then I have a function that I run every ten minutes that updates the item via the cloud, using the REST API. That way, if cloud access is interrupted, the ā€œheartbeatā€ stops. I donā€™t know how much detail you need. Iā€™ll post a couple of the relevant functions.

// Update this date-time item via the cloud. If the cloud is down, it will not get updated
ZombificationCheck.prototype.SendCloudHeartbeat = 
function SendCloudHeartbeat() 
{
  // logInfo("SendCloudHeartbeat");

  try
  {
    var headers = GetOpenHabCloudCallAuthorisationHeaders();
    // logInfo("Cloud heartbeat headers: " + headers);

    var dateNow = new Date();

    DoHttpPutRequest("https://myopenhab.org:443/rest/items/Cloud_Heartbeat_TimeStamp/state", "Set cloud heartbeat", "*/*", dateNow.toISOString(), headers);     
  }
  catch(exception)
  {
    logInfo("Exception caught in SendCloudHeartbeat. Message: " + exception);   
  }
}

export//
function GetOpenHabCloudCallAuthorisationHeaders()
{
  var headers = [];

  headers['Content-Type'] = '*/*';
  headers['accept'] = '*/*';
  headers['Authorization'] = 'Basic xxxxxxxxxxxxxxxxxxxxxxxxxxxxx'; // Cloud user and pw encoded
  headers['WWW-Authenticate'] = 'Basic';

  return headers;
}

What Iā€™m trying to do, and what may be working - but Iā€™m not sure because lately the cloud disconnections have stopped, is restart the relevant bundle when the cloud heartbeat stops for too long.


ZombificationCheck.prototype.CheckIfAutomateAndCloudOffline = 
function CheckIfAutomateAndCloudOffline() 
{
   // Try restarting cloud client if down for a short amount of time
  if (dgReboot.GetMinutesSinceReboot() > 10 && nCloudHeartbeatAge > this.CLOUD_MAX_HEARTBEAT_AGE && (nCloudHeartbeatAge < this.CLOUD_MIN_AGE_ALERT_THRESHOLD || nCloudHeartbeatAge > dgReboot.GetMinutesSinceReboot()))
  {
    SendPushNotification("Attempting to restart cloud binding because cloud down");
    RestartBundle("org.openhab.io.openhabcloud");
  }
}

export//
function RestartBundle(sBundleID)
{
  var Exec = Java.type("org.openhab.core.model.script.actions.Exec");
  var Duration = Java.type("java.time.Duration");
  // @ts-ignore
  Exec.executeCommandLine(Duration.ofSeconds(6), "sudo", "/usr/bin/ssh", "-p", "8101", "-i", "/var/lib/openhab/.ssh/openhab.id_rsa", "openhab@localhost", "bundle:restart", sBindingID);
}

Getting the bundle restart to work was a bit involved, I recall. I can dig into the details if you want - Iā€™d have to refresh my memory.

3 Likes