Sauvegarde de la db de zigbee2mqtt

AlexTrovato · Novembre 10, 2022, 6:45

SI tu es abonné à Gladys Plus, dès que @lmilcent validera que la sauvegarde de la config z2m fonctionne, tu pourras changer de machine sans crainte.

lmilcent · Novembre 10, 2022, 7:19

Oui je te conseille d’attendre que la migration soit gérée par Gladys Plus ça sera plus clé en main.

Et puis j’ai passé plusieurs heures car j’ai fait du hardening (renforcement de sécurité) sur mon serveur, ce qui a provoqué quelques erreurs.

pierre-gilles · Novembre 11, 2022, 5:07

@lmilcent Tu nous diras si ça marche du coup! Pas besoin de tester avec Gladys Plus d’ailleurs, tu peux juste copier la DB SQLite d’un système à l’autre et voir si ça marche.

Si jamais tu relance une autre instance en parallèle de ta prod, attention car côté Gladys Plus une seule instance peut-être connectée en même temps, la dernière connectée « gagne » par rapport à l’autre. Donc si jamais tu as 2 instances qui tourne à un moment, à la fin dès que tu n’en a qu’une, relance ton instance et elle prendra la main.

Tu nous feras un petit poste j’espère!! La config fait rêver!

guim31 · Novembre 11, 2022, 7:20

Merci pour vos réponses ! Je vais patienter encore un peu alors

lmilcent · Novembre 11, 2022, 2:02

Voici ce que je viens de faire pour tester.

Clone de ma DB actuelle Gladys
Edit à la main de la DB pour supprimer toutes les feature_state (pour réduire de 5Go à 40Mo la DB) et les t_variable de Gladys Plus et Telegram (pour éviter de faire tourner en double deux instances)
Accès à Z2M pour déclencher un backup
Les logs confirment le backup

2022-11-11T14:32:15+0100 <info> saveZ2mBackup.js:12 (Zigbee2mqttManager.saveZ2mBackup) Zigbee2mqtt: storing backup...
2022-11-11T14:32:16+0100 <info> saveZ2mBackup.js:24 (Zigbee2mqttManager.saveZ2mBackup) Zigbee2mqtt: backup stored

Déplacement de la DB sur mon Raspberry Pi (sur lequel j’ai remis mon adaptateur USB Zigbee), suppression de tous les anciens fichiers dans /var/lib/gladysassistant liés à mon ancienne installation.
Lancement de Gladys avec cette DB sur mon Raspberry Pi
Vérification que ça lance bien les conteneurs Z2M, MQTT et que mes équipement se rattachent au réseau

> gladys-server@ start:prod /src/server
> cross-env NODE_ENV=production node index.js

2022-11-11T14:56:21+0100 <info> job.purge.js:17 (Job.purge) Deleting all background jobs created before = Fri Nov 04 2022 14:56:21 GMT+0100 (Central European Standard Time)
Initialising OpenZWave 1.6.0 binary addon for Node.JS.
        OpenZWave Security API is ENABLED
        ZWave device db    : /usr/local/etc/openzwave
        User settings path : /src/server/services/zwave/node_modules/openzwave-shared/build/Release/../../
        Option Overrides : --Logging false --ConsoleOutput false --SaveConfiguration true
2022-11-11T14:56:24+0100 <info> service.startAll.js:30 () Service alexa was manually stopped, so it is ignored at startup
2022-11-11T14:56:24+0100 <info> service.startAll.js:30 () Service rtsp-camera was manually stopped, so it is ignored at startup
2022-11-11T14:56:24+0100 <info> service.startAll.js:30 () Service xiaomi was manually stopped, so it is ignored at startup
2022-11-11T14:56:24+0100 <info> service.startAll.js:30 () Service zwave was manually stopped, so it is ignored at startup
2022-11-11T14:56:24+0100 <info> service.startAll.js:30 () Service tasmota was manually stopped, so it is ignored at startup
2022-11-11T14:56:24+0100 <info> service.startAll.js:30 () Service bluetooth was manually stopped, so it is ignored at startup
2022-11-11T14:56:24+0100 <info> service.startAll.js:30 () Service ewelink was manually stopped, so it is ignored at startup
2022-11-11T14:56:24+0100 <info> service.startAll.js:30 () Service tp-link was manually stopped, so it is ignored at startup
2022-11-11T14:56:24+0100 <info> service.startAll.js:30 () Service google-actions was manually stopped, so it is ignored at startup
2022-11-11T14:56:24+0100 <info> service.startAll.js:30 () Service homekit was manually stopped, so it is ignored at startup
2022-11-11T14:56:24+0100 <info> service.startAll.js:30 () Service broadlink was manually stopped, so it is ignored at startup
2022-11-11T14:56:24+0100 <info> service.startAll.js:30 () Service philips-hue was manually stopped, so it is ignored at startup
2022-11-11T14:56:24+0100 <info> service.startAll.js:30 () Service example was manually stopped, so it is ignored at startup
2022-11-11T14:56:24+0100 <info> index.js:16 (Object.start) Starting MQTT service
2022-11-11T14:56:24+0100 <info> updateContainer.js:13 (MqttHandler.updateContainer) MQTT: checking for required changes...
2022-11-11T14:56:24+0100 <warn> connect.js:50 (MqttClient.<anonymous>) Error while connecting to MQTT - Error: connect ECONNREFUSED 127.0.0.1:1883
2022-11-11T14:56:24+0100 <info> index.js:20 (Object.start) Starting Open Weather service
2022-11-11T14:56:24+0100 <info> init.js:39 (Zigbee2mqttManager.init) Zigbee2mqtt USB dongle attached to /dev/ttyUSB0
2022-11-11T14:56:24+0100 <info> installMqttContainer.js:28 (Zigbee2mqttManager.installMqttContainer) MQTT broker is being installed as Docker container...
2022-11-11T14:56:24+0100 <info> installMqttContainer.js:29 (Zigbee2mqttManager.installMqttContainer) Pulling eclipse-mosquitto:2 image...
2022-11-11T14:56:30+0100 <info> installMqttContainer.js:33 (Zigbee2mqttManager.installMqttContainer) Preparing broker environment...
2022-11-11T14:56:30+0100 <info> installMqttContainer.js:40 (Zigbee2mqttManager.installMqttContainer) Creating container with data in "/var/lib/gladysassistant" on host...
2022-11-11T14:56:44+0100 <info> installMqttContainer.js:54 (Zigbee2mqttManager.installMqttContainer) MQTT broker is restarting...
2022-11-11T14:57:17+0100 <info> installMqttContainer.js:61 (Zigbee2mqttManager.installMqttContainer) Creating user/pass...
2022-11-11T14:57:17+0100 <info> installMqttContainer.js:70 (Zigbee2mqttManager.installMqttContainer) MQTT broker is restarting...
2022-11-11T14:57:25+0100 <info> installMqttContainer.js:74 (Zigbee2mqttManager.installMqttContainer) MQTT broker container successfully started and configured
2022-11-11T14:57:25+0100 <info> restoreZ2mBackup.js:26 (Zigbee2mqttManager.restoreZ2mBackup) Zigbee2mqtt: loading z2m backup...
2022-11-11T14:57:25+0100 <info> restoreZ2mBackup.js:29 (Zigbee2mqttManager.restoreZ2mBackup) Restoring zigbee2mqtt configuration...
2022-11-11T14:57:25+0100 <info> installZ2mContainer.js:34 (Zigbee2mqttManager.installZ2mContainer) Zigbee2mqtt is being installed as Docker container...
2022-11-11T14:57:25+0100 <info> installZ2mContainer.js:35 (Zigbee2mqttManager.installZ2mContainer) Pulling koenkk/zigbee2mqtt:latest image...
2022-11-11T14:57:26+0100 <info> installZ2mContainer.js:38 (Zigbee2mqttManager.installZ2mContainer) Configuration of Device /dev/ttyUSB0
2022-11-11T14:57:26+0100 <info> installZ2mContainer.js:43 (Zigbee2mqttManager.installZ2mContainer) Creation of container...
2022-11-11T14:57:27+0100 <info> installZ2mContainer.js:46 (Zigbee2mqttManager.installZ2mContainer) Zigbee2mqtt successfully installed and configured as Docker container
2022-11-11T14:57:27+0100 <info> installZ2mContainer.js:59 (Zigbee2mqttManager.installZ2mContainer) Preparing Zigbee2mqtt environment...
2022-11-11T14:57:27+0100 <info> installZ2mContainer.js:72 (Zigbee2mqttManager.installZ2mContainer) Zigbee2mqtt container is starting...
2022-11-11T14:57:33+0100 <info> installZ2mContainer.js:78 (Zigbee2mqttManager.installZ2mContainer) Zigbee2mqtt container successfully started
2022-11-11T14:57:33+0100 <info> connect.js:14 (Zigbee2mqttManager.connect) Connecting Gladys to mqtt://localhost:1884 MQTT broker...
2022-11-11T14:57:33+0100 <info> connect.js:24 (MqttClient.<anonymous>) Connected to MQTT container mqtt://localhost:1884
2022-11-11T14:57:33+0100 <info> subscribe.js:12 (Zigbee2mqttManager.subscribe) Subscribing to MQTT topic zigbee2mqtt/#
2022-11-11T14:57:33+0100 <info> index.js:13 (Object.start) Starting usb service
2022-11-11T14:57:33+0100 <info> index.js:19 (Object.start) Starting Telegram service
2022-11-11T14:57:33+0100 <info> service.start.js:40 (Service.start) Service telegram is not configured, so it was not started.
2022-11-11T14:57:33+0100 <info> index.js:88 (Object.start) Starting CalDAV service
2022-11-11T14:57:33+0100 <info> scene.dailyUpdate.js:58 () Sunrise today is at 7:55 today, in your timezone = Europe/Paris
2022-11-11T14:57:33+0100 <info> scene.dailyUpdate.js:59 () Sunset today is at 17:17 today, in your timezone = Europe/Paris
2022-11-11T14:57:33+0100 <info> scene.dailyUpdate.js:67 () Sunrise is scheduled, 7 hours ago.
2022-11-11T14:57:33+0100 <info> scene.dailyUpdate.js:81 () Sunset is scheduled, in 2 hours.
2022-11-11T14:57:34+0100 <info> device.calculateAggregate.js:38 (DeviceManager.calculateAggregate) Calculating aggregates device feature state for interval hourly
2022-11-11T14:57:34+0100 <info> index.js:63 (Server.<anonymous>) Server listening on port 8088
2022-11-11T14:57:45+0100 <warn> handleMqttMessage.js:106 () Zigbee2mqtt device CapteurMouvementEntree, feature illuminance_lux not configured in Gladys.
2022-11-11T14:57:45+0100 <warn> handleMqttMessage.js:106 () Zigbee2mqtt device capteurQualitéDeLair, feature formaldehyd not configured in Gladys.
2022-11-11T14:57:45+0100 <info> device.calculateAggregate.js:105 (ChildProcess.<anonymous>) device.calculateAggregate: Finishing processing for interval hourly
2022-11-11T14:57:46+0100 <info> device.calculateAggregate.js:38 (DeviceManager.calculateAggregate) Calculating aggregates device feature state for interval daily
2022-11-11T14:57:47+0100 <warn> handleMqttMessage.js:106 () Zigbee2mqtt device capteurQualitéDeLair, feature formaldehyd not configured in Gladys.
2022-11-11T14:57:50+0100 <warn> handleMqttMessage.js:106 () Zigbee2mqtt device capteurQualitéDeLair, feature formaldehyd not configured in Gladys.
2022-11-11T14:57:54+0100 <warn> handleMqttMessage.js:106 () Zigbee2mqtt device capteurQualitéDeLair, feature formaldehyd not configured in Gladys.
2022-11-11T14:57:55+0100 <warn> device.calculateAggregate.js:95 (Socket.<anonymous>) device.calculateAggregate stderr: Error
    at Database.<anonymous> (/src/server/node_modules/sequelize/lib/dialects/sqlite/query.js:179:27)
    at /src/server/node_modules/sequelize/lib/dialects/sqlite/query.js:177:50
    at new Promise (<anonymous>)
    at Query.run (/src/server/node_modules/sequelize/lib/dialects/sqlite/query.js:177:12)
    at /src/server/node_modules/sequelize/lib/sequelize.js:313:28
    at async SQLiteQueryInterface.bulkUpdate (/src/server/node_modules/sequelize/lib/dialects/abstract/query-interface.js:355:12)
    at async Function.update (/src/server/node_modules/sequelize/lib/model.js:1952:28)
    at async /src/server/lib/device/device.calculcateAggregateChildProcess.js:153:5 {
  name: 'SequelizeTimeoutError',
  parent: [Error: SQLITE_BUSY: database is locked] {
    errno: 5,
    code: 'SQLITE_BUSY',
    sql: 'UPDATE `t_device_feature` SET `last_daily_aggregate`=$1,`updated_at`=$2 WHERE `id` = $3'
  },
  original: [Error: SQLITE_BUSY: database is locked] {
    errno: 5,
    code: 'SQLITE_BUSY',
    sql: 'UPDATE `t_device_feature` SET `last_daily_aggregate`=$1,`updated_at`=$2 WHERE `id` = $3'
  },
  sql: 'UPDATE `t_device_feature` SET `last_daily_aggregate`=$1,`updated_at`=$2 WHERE `id` = $3',
  parameters: {}
}

2022-11-11T14:57:55+0100 <warn> device.calculateAggregate.js:101 (ChildProcess.<anonymous>) device.calculateAggregate: Exiting child process with code 1
2022-11-11T14:57:57+0100 <warn> handleMqttMessage.js:106 () Zigbee2mqtt device capteurQualitéDeLair, feature formaldehyd not configured in Gladys.
2022-11-11T14:58:00+0100 <info> scene.checkCalendarTriggers.js:24 (SceneManager.checkCalendarTriggers) Checking calendar triggers at Fri, 11 Nov 2022 13:58:00 GMT
2022-11-11T14:58:01+0100 <warn> handleMqttMessage.js:106 () Zigbee2mqtt device capteurQualitéDeLair, feature formaldehyd not configured in Gladys.
2022-11-11T14:58:04+0100 <warn> handleMqttMessage.js:106 () Zigbee2mqtt device capteurQualitéDeLair, feature formaldehyd not configured in Gladys.
2022-11-11T14:58:08+0100 <error> device.onHourlyDeviceAggregateEvent.js:27 (DeviceManager.onHourlyDeviceAggregateEvent) Error: Error
    at Database.<anonymous> (/src/server/node_modules/sequelize/lib/dialects/sqlite/query.js:179:27)
    at /src/server/node_modules/sequelize/lib/dialects/sqlite/query.js:177:50
    at new Promise (<anonymous>)
    at Query.run (/src/server/node_modules/sequelize/lib/dialects/sqlite/query.js:177:12)
    at /src/server/node_modules/sequelize/lib/sequelize.js:313:28
    at async SQLiteQueryInterface.bulkUpdate (/src/server/node_modules/sequelize/lib/dialects/abstract/query-interface.js:355:12)
    at async Function.update (/src/server/node_modules/sequelize/lib/model.js:1952:28)
    at async /src/server/lib/device/device.calculcateAggregateChildProcess.js:153:5 {
  name: 'SequelizeTimeoutError',
  parent: [Error: SQLITE_BUSY: database is locked] {
    errno: 5,
    code: 'SQLITE_BUSY',
    sql: 'UPDATE `t_device_feature` SET `last_daily_aggregate`=$1,`updated_at`=$2 WHERE `id` = $3'
  },
  original: [Error: SQLITE_BUSY: database is locked] {
    errno: 5,
    code: 'SQLITE_BUSY',
    sql: 'UPDATE `t_device_feature` SET `last_daily_aggregate`=$1,`updated_at`=$2 WHERE `id` = $3'
  },
  sql: 'UPDATE `t_device_feature` SET `last_daily_aggregate`=$1,`updated_at`=$2 WHERE `id` = $3',
  parameters: {}
}

    at ChildProcess.<anonymous> (/src/server/lib/device/device.calculateAggregate.js:102:23)
    at ChildProcess.emit (events.js:400:28)
    at maybeClose (internal/child_process.js:1088:16)
    at Process.ChildProcess._handle.onexit (internal/child_process.js:296:5)
2022-11-11T14:58:08+0100 <info> device.calculateAggregate.js:38 (DeviceManager.calculateAggregate) Calculating aggregates device feature state for interval monthly
2022-11-11T14:58:08+0100 <warn> handleMqttMessage.js:106 () Zigbee2mqtt device capteurQualitéDeLair, feature formaldehyd not configured in Gladys.
2022-11-11T14:58:11+0100 <warn> handleMqttMessage.js:106 () Zigbee2mqtt device capteurQualitéDeLair, feature formaldehyd not configured in Gladys.
2022-11-11T14:58:15+0100 <warn> handleMqttMessage.js:106 () Zigbee2mqtt device capteurQualitéDeLair, feature formaldehyd not configured in Gladys.
2022-11-11T14:58:18+0100 <warn> handleMqttMessage.js:106 () Zigbee2mqtt device capteurQualitéDeLair, feature formaldehyd not configured in Gladys.
2022-11-11T14:58:21+0100 <warn> handleMqttMessage.js:106 () Zigbee2mqtt device CapteurMouvementCuisine, feature illuminance_lux not configured in Gladys.
2022-11-11T14:58:21+0100 <info> device.calculateAggregate.js:105 (ChildProcess.<anonymous>) device.calculateAggregate: Finishing processing for interval monthly

Et …

ça fonctionne super bien !!

Mon interface Gladys me permet de contrôler mes interrupteurs muraux, ma lumière dans le salon s’allume ! ça confirme que le réseau Zigbee s’est à nouveau remis en place avec les mêmes paramètres.

Très très beau boulot !!

Comme tu peux le voir dans les logs, il y a une erreur de DB Lock, qui a été générée lors de mes deux tests de restauration. Mais c’est passager, possiblement sans lien, et surtout Gladys fonctionne bien.

AlexTrovato · Novembre 11, 2022, 2:21

Heureux d’entendre et de voir ça !!!

Pour le lock DB en erreur, je pense que suite à mes modif sur le scheduler commun, on ne devrait plus lancer l’agrégation des données au démarrage, mais laisser le scheduler passer à l’heure prévue.
@pierre-gilles qu’en penses-tu ?

pierre-gilles · Novembre 12, 2022, 4:19

Génial !!

Pourquoi pas retirer l’agrégation au démarrage. A la base moi je l’avais ajouté au démarrage pour que les utilisateurs n’aient pas à attendre l’heure suivante pour tester la feature quand tu mets à jour Gladys (quand on a lancé la feature), après maintenant c’est peut être inutile…

Après ça change pas grand chose, l’agrégation passait déjà à heure fixe je crois ^^

guim31 · Novembre 22, 2022, 6:41

Étant donné que je vais recevoir mon NUC dans la semaine, je me demandais où en était ce travail ?
En fait j’ai pas trop compris si ce travail que vous avez fait va permettre de faire une migration « en quelques clics »? Ou bien si l’idée est que z2m soit sauvegardé tout seul et qu’une restauration par le biais de Gladys Plus le restaure aussi ?

GBoulvin · Novembre 22, 2022, 7:24

C’est toujours en test…
J’espère avoir un peu de temps demain ou jeudi pour m’y pencher.
Si je ne me trompe, tout est sensé se retrouver dans la DB Gladys afin de partir via gladys+ aussi.

guim31 · Novembre 23, 2022, 4:28

D’acc merci pour les informations !

Je précise que même si je suis impatient (nouveau joujou) je ne me permettrait pas de râler quant au temps que demande ce travail !

GBoulvin · Novembre 23, 2022, 10:36

Testé et approuvé :

Installation fraîche
Configuration de base et ajout d’un switch ZigBee
Attente de la sauvegarde automatique de 23h
Arrêt des conteneurs
Suppression des sous-dossiers présents dans /Var/lib/gladysassistant et de tous les conteneurs
Redémarrage du conteneur Gladys
Et tout redevient comme avant, ZigBee est fonctionnel!
Les logs :
A 23h :

2022-11-23T23:00:00+0100 <info> backup.js:39 (Zigbee2mqttManager.backup) Zigbee2MQTT request for backup
2022-11-23T23:00:00+0100 <warn> handleMqttMessage.js:84 (Zigbee2mqttManager.handleMqttMessage) Zigbee2mqtt topic zigbee2mqtt/bridge/request/backup empty message.
2022-11-23T23:00:10+0100 <info> device.calculateAggregate.js:105 (ChildProcess.<anonymous>) device.calculateAggregate: Finishing processing for interval hourly
2022-11-23T23:00:10+0100 <info> device.calculateAggregate.js:38 (DeviceManager.calculateAggregate) Calculating aggregates device feature state for interval daily
2022-11-23T23:00:12+0100 <info> saveZ2mBackup.js:12 (Zigbee2mqttManager.saveZ2mBackup) Zigbee2mqtt: storing backup...
2022-11-23T23:00:13+0100 <info> saveZ2mBackup.js:24 (Zigbee2mqttManager.saveZ2mBackup) Zigbee2mqtt: backup stored

Après suppression et redémarrage

>gladys-server@ start:prod /src/server
> cross-env NODE_ENV=production node index.js

2022-11-23T23:17:31+0100 <info> job.purge.js:17 (Job.purge) Deleting all background jobs created before = Wed Nov 16 2022 23:17:31 GMT+0100 (Central European Standard Time)
Initialising OpenZWave 1.6.0 binary addon for Node.JS.
        OpenZWave Security API is ENABLED
        ZWave device db    : /usr/local/etc/openzwave
        User settings path : /src/server/services/zwave/node_modules/openzwave-shared/build/Release/../../
        Option Overrides : --Logging false --ConsoleOutput false --SaveConfiguration true
2022-11-23T23:17:43+0100 <info> index.js:14 (Object.start) starting Alexa service
2022-11-23T23:17:43+0100 <info> index.js:21 (Object.start) Starting example service
2022-11-23T23:17:44+0100 <info> index.js:20 (Object.start) Starting Open Weather service
2022-11-23T23:17:44+0100 <info> service.start.js:40 (Service.start) Service openweather is not configured, so it was not started.
2022-11-23T23:17:44+0100 <info> index.js:88 (Object.start) Starting CalDAV service
2022-11-23T23:17:44+0100 <info> index.js:16 (Object.start) starting Broadlink service
2022-11-23T23:17:44+0100 <info> index.js:18 (Object.start) Starting HomeKit service
2022-11-23T23:17:45+0100 <info> index.js:14 (Object.start) starting GoogleActions service
2022-11-23T23:17:46+0100 <info> init.js:39 (Zigbee2mqttManager.init) Zigbee2mqtt USB dongle attached to /dev/ttyUSB0
2022-11-23T23:17:46+0100 <info> installMqttContainer.js:28 (Zigbee2mqttManager.installMqttContainer) MQTT broker is being installed as Docker container...
2022-11-23T23:17:46+0100 <info> installMqttContainer.js:29 (Zigbee2mqttManager.installMqttContainer) Pulling eclipse-mosquitto:2 image...
2022-11-23T23:17:47+0100 <info> installMqttContainer.js:33 (Zigbee2mqttManager.installMqttContainer) Preparing broker environment...
2022-11-23T23:17:47+0100 <info> installMqttContainer.js:40 (Zigbee2mqttManager.installMqttContainer) Creating container with data in "/var/lib/gladysassistant" on host...
2022-11-23T23:17:49+0100 <info> installMqttContainer.js:54 (Zigbee2mqttManager.installMqttContainer) MQTT broker is restarting...
2022-11-23T23:17:55+0100 <info> installMqttContainer.js:61 (Zigbee2mqttManager.installMqttContainer) Creating user/pass...
2022-11-23T23:17:56+0100 <info> installMqttContainer.js:70 (Zigbee2mqttManager.installMqttContainer) MQTT broker is restarting...
2022-11-23T23:18:03+0100 <info> installMqttContainer.js:74 (Zigbee2mqttManager.installMqttContainer) MQTT broker container successfully started and configured
2022-11-23T23:18:03+0100 <info> restoreZ2mBackup.js:26 (Zigbee2mqttManager.restoreZ2mBackup) Zigbee2mqtt: loading z2m backup...
2022-11-23T23:18:03+0100 <info> restoreZ2mBackup.js:29 (Zigbee2mqttManager.restoreZ2mBackup) Restoring zigbee2mqtt configuration...
2022-11-23T23:18:03+0100 <info> installZ2mContainer.js:34 (Zigbee2mqttManager.installZ2mContainer) Zigbee2mqtt is being installed as Docker container...
2022-11-23T23:18:03+0100 <info> installZ2mContainer.js:35 (Zigbee2mqttManager.installZ2mContainer) Pulling koenkk/zigbee2mqtt:latest image...
2022-11-23T23:18:05+0100 <info> installZ2mContainer.js:38 (Zigbee2mqttManager.installZ2mContainer) Configuration of Device /dev/ttyUSB0
2022-11-23T23:18:05+0100 <info> installZ2mContainer.js:43 (Zigbee2mqttManager.installZ2mContainer) Creation of container...
2022-11-23T23:18:08+0100 <info> installZ2mContainer.js:46 (Zigbee2mqttManager.installZ2mContainer) Zigbee2mqtt successfully installed and configured as Docker container
2022-11-23T23:18:08+0100 <info> installZ2mContainer.js:59 (Zigbee2mqttManager.installZ2mContainer) Preparing Zigbee2mqtt environment...
2022-11-23T23:18:08+0100 <info> installZ2mContainer.js:72 (Zigbee2mqttManager.installZ2mContainer) Zigbee2mqtt container is starting...
2022-11-23T23:18:14+0100 <info> installZ2mContainer.js:78 (Zigbee2mqttManager.installZ2mContainer) Zigbee2mqtt container successfully started
2022-11-23T23:18:14+0100 <info> connect.js:14 (Zigbee2mqttManager.connect) Connecting Gladys to mqtt://localhost:1884 MQTT broker...
2022-11-23T23:18:15+0100 <info> connect.js:24 (MqttClient.<anonymous>) Connected to MQTT container mqtt://localhost:1884
2022-11-23T23:18:15+0100 <info> subscribe.js:12 (Zigbee2mqttManager.subscribe) Subscribing to MQTT topic zigbee2mqtt/#
2022-11-23T23:18:15+0100 <info> index.js:18 (Object.start) Starting TP-Link service
2022-11-23T23:18:15+0100 <info> index.js:17 (Object.start) Starting eWeLink service
2022-11-23T23:18:15+0100 <info> service.start.js:40 (Service.start) Service ewelink is not configured, so it was not started.
2022-11-23T23:18:16+0100 <info> index.js:15 (Object.start) Starting Bluetooth service
2022-11-23T23:18:18+0100 <error> index.js:20 (process.<anonymous>) uncaughtException catched: uncaughtException
2022-11-23T23:18:18+0100 <error> index.js:21 (process.<anonymous>) Error: ENODEV, No such device
    at Hci.init (/src/server/services/bluetooth/node_modules/@abandonware/noble/lib/hci-socket/hci.js:100:35)
    at NobleBindings.init (/src/server/services/bluetooth/node_modules/@abandonware/noble/lib/hci-socket/bindings.js:78:13)
    at /src/server/services/bluetooth/node_modules/@abandonware/noble/lib/noble.js:60:24
    at processTicksAndRejections (internal/process/task_queues.js:77:11) {
  errno: 19,
  code: 'ENODEV',
  syscall: 'bind'
}
2022-11-23T23:18:18+0100 <info> index.js:15 (Object.start) Starting Tasmota service
2022-11-23T23:18:18+0100 <info> index.js:16 (Object.start) Starting zwave service
2022-11-23T23:18:18+0100 <info> service.start.js:40 (Service.start) Service zwave is not configured, so it was not started.
2022-11-23T23:18:18+0100 <info> index.js:14 (Object.start) Starting Xiaomi service
2022-11-23T23:18:18+0100 <info> index.js:13 (Object.start) Starting usb service
2022-11-23T23:18:18+0100 <info> index.js:19 (Object.start) Starting Telegram service
2022-11-23T23:18:18+0100 <info> service.start.js:40 (Service.start) Service telegram is not configured, so it was not started.
2022-11-23T23:18:18+0100 <info> index.js:16 (Object.start) Starting RTSP service
2022-11-23T23:18:18+0100 <info> index.js:18 (Object.start) Starting Philips Hue service
2022-11-23T23:18:19+0100 <info> index.js:16 (Object.start) Starting MQTT service
2022-11-23T23:18:19+0100 <info> updateContainer.js:13 (MqttHandler.updateContainer) MQTT: checking for required changes...
2022-11-23T23:18:19+0100 <info> service.start.js:40 (Service.start) Service mqtt is not configured, so it was not started.
2022-11-23T23:18:19+0100 <info> scene.dailyUpdate.js:58 () Sunrise today is at 8:10 today, in your timezone = Europe/Paris
2022-11-23T23:18:19+0100 <info> scene.dailyUpdate.js:59 () Sunset today is at 16:50 today, in your timezone = Europe/Paris

Demain, je teste avec ma db de prod.
Good job !

pierre-gilles · Novembre 24, 2022, 2:37

Merci d’avoir testé @GBoulvin ! Super propre !

Il faut que je review le code maintenant, je vous tiens au courant dès que j’ai le temps.

VonOx · Novembre 24, 2022, 11:45

Alex a pu développer sur du matos réel donc j’ai pas trop de doute sur le fonctionnel

lmilcent · Novembre 24, 2022, 6:32

Et je l’ai confirmé aussi avec ma DB de prod sur raspberry pi !

pierre-gilles · Novembre 25, 2022, 7:23

J’ai fais une première review sur la PR « common scheduler » qui est un pré-requis avant le merge de la PR backup Zigbee2mqtt.

Comme l’autre PR intègre les changements de cette PR, c’est pas facile à lire donc j’attend qu’on ait déjà fini sur cette PR

pierre-gilles · Novembre 25, 2022, 7:54

J’ai mergé la première PR de la série de 3 PRs nécessaires pour cette feature:

github.com/GladysAssistant/Gladys

Z2m clean code

GladysAssistant:master ← atrovato:z2m-clean-code

opened 05:39AM - 01 Nov 22 UTC

atrovato

+744 -591

### Pull Request check-list To ensure your Pull Request can be accepted as fa…st as possible, make sure to review and check all of these items: - [x] If your changes affects code, did your write the tests? - [x] Are tests passing? (`npm test` on both front/server) - [x] Is the linter passing? (`npm run eslint` on both front/server) - [x] Did you run prettier? (`npm run prettier` on both front/server) - ~~[ ] If you are adding a new features/services, did you run integration comparator? (`npm run compare-translations` on front)~~ - [x] Did you test this pull request in real life? With real devices? If this development is a big feature or a new service, we recommend that you provide a Docker image to [the community](https://community.gladysassistant.com/) for testing before merging. - ~~[ ] If your changes modify the API (REST or Node.js), did you modify the API documentation? (Documentation is based on comments in code)~~ - ~~[ ] If you are adding a new features/services which needs explanation, did you modify the user documentation? See [the GitHub repo](https://github.com/GladysAssistant/v4-website) and the [website](https://gladysassistant.com).~~ - ~~[ ] Did you add fake requests data for the demo mode (`front/src/config/demo.js`) so that the demo website is working without a backend? (if needed) See [https://demo.gladysassistant.com](https://demo.gladysassistant.com).~~ NOTE: these things are not required to open a PR and can be done afterwards / while the PR is open. ### Description of change This PR prepares the "z2m backup" feature. The z2m code is a bit disorganized, so to add features in it, it looks difficult and risky. So I just ran a cleaning and organization phase. It cleans the current z2m service code to: - use "debug" logger instead of "log" - load and store variables in Gladys database in a unique method (instead of everywhere in methods) - clean tests when proxyquire is not required - implements afterEach when needed on tests - ... I tested it in real life, in both upgrading and new install modes. It looks good.

VonOx · Novembre 25, 2022, 8:54

@AlexTrovato est une machine

guim31 · Décembre 27, 2022, 9:21

Salut à tous,

Je reviens ici car comme je ne comprends pas le langage des développeurs (merger une PR etc…) je ne me rend pas compte d’où en est cette fonctionnalité de sauvegarde ?
Faut il faire des tests ? Faut-il des testeurs ?

spenceur · Décembre 28, 2022, 5:51

En « gros », la premiere pr sur 3 est sur la branche de productions.
Il faudra attendre les deux autres pour que la fonctionnalité soit 100% fonctionnelle.
Mais pour la premières tout est passé test compris.

guim31 · Décembre 28, 2022, 2:52

Ok merci @spenceur pour ce point d’étape !