Test Adapter ioBroker.backitup v3.1.x

[Thomas Braun]

@simatec sagte in Test Adapter ioBroker.backitup v2.7.x:

Ich baue mir mal ne Testumgebung auf

Ich hab ja den CIFS der FritzBox im Verdacht. Der ist irgendwie etwas 'komisch'.

[simatec]

@thomas-braun kurze erster Test...
Debian12 und iobroker (Node.js: v20.5.1 NPM: 9.8.0) mit beta Repo... Ein CIFS mount auf mein NAS (Eigenbau mit OMV) läuft ohne Probleme und das backup wird sauber gespeichert.

Werde heute Abend mal noch mein olle Fritte für das Testszenario in Betrieb nehmen...

[simatec]

Ab sofort steht die Version 2.8.1 auf Github und im latest zur Verfügung.

Changelog

2.8.1 (2023-09-12)

• (simatec) Fix roles
• (simatec) help-links added

2.8.0 (2023-09-11)

• (simatec) small Sentry fixes
• (simatec) Bugfix System-Message
• (simatec) Docu & Wiki updated
• (simatec) Translation updated
• (simatec) dependencies updated
• (simatec) Fix Webdav
• (simatec) WOL Address & Port added
• (simatec) Restore for Backitup Config added

[bob der 1.]

@simatec

Update rennt und die Fritzbox ist auch zufrieden,danke

[simatec]

@bob-der-1 sagte in Test Adapter ioBroker.backitup v2.8.x:

@simatec

Update rennt und die Fritzbox ist auch zufrieden,danke

CIFS oder FTP?

[bob der 1.]

@simatec
Ftp

[DPO99]

Hallo Zusammen,

habe auf die 2.8.1 aktualisiert und hatte nun zum ersten mal diesen Fehler. Ist dazu was bekannt? Konnte nichts im Netz finden.

https://github.com/simatec/ioBroker.backitup/issues/991

Spoiler

Describe the bug
Backitup was Not able to delete old files

To Reproduce
Steps to reproduce the behavior:
Start Automatic Backup

Expected behavior
Old Backups should be deleted
.
Screenshots & Logfiles
2023-09-21 23:00:45.031 - error: backitup.0 (156610) [iobroker/clean] Backup files not deleted from /opt/iobroker/backups because some errors.

Versions:
Adapter version: 2.8.1
JS-Controller version: 4.0.24
Node version: 18.18.0
Operating system: Bullsyeye

Additional context
Backup should saved in NAS, dont know why He wants to delete in opt/iobroker/backups

DPO99 created this issue in simatec/ioBroker.backitup

closed Error Files could Not be deleted #991

[Thomas Braun]

@dpo99

Da müsstest du mehr zum Setup erzählen. Und LogFiles, LogFiles, LogFiles...

[DPO99]

@thomas-braun Welche Daten zum Setup genau helfen denn für die Analyse? Ansonten würde ich den Adapter einmal auf Debug stellen, wenn er heute das nächste mal los rennt, da sollte dann ja einiges drin stehen.

Danke schonmal!

[simatec]

@dpo99 Bitte poste den kompletten Debuglog vom Backupprozess

[DPO99]

@simatec

Heute trag der Fehler natürlich nicht auf...werde das weiter beobachten und mal auf Debug stehen lassen.

2023-09-22 23:00:10.076 - debug: backitup.0 (258932) The local storage check was completed successfully. On the host "iobroker" are currently 24314 MB free space available!
2023-09-22 23:00:10.141 - debug: backitup.0 (258932) Backup has started ...
2023-09-22 23:00:20.144 - debug: backitup.0 (258932) [iobroker/mount] noserverino option: false
2023-09-22 23:00:20.144 - debug: backitup.0 (258932) [iobroker/mount] cifs-mount command: "sudo mount -t cifs -o username=iobroker,password=****,rw,uid=iobroker,gid=iobroker,file_mode=0777,dir_mode=0777,vers=3.0 //192.168.178.5/Backup_IoBroker/Backup /opt/iobroker/backups"
2023-09-22 23:00:20.480 - debug: backitup.0 (258932) [iobroker/mount] mount successfully completed
2023-09-22 23:00:20.482 - debug: backitup.0 (258932) [iobroker/mount] done
2023-09-22 23:00:23.453 - debug: backitup.0 (258932) [iobroker/iobroker] host.iobroker 2904 states saved
2023-09-22 23:00:25.946 - debug: backitup.0 (258932) [iobroker/iobroker] host.iobroker 3395 objects saved
2023-09-22 23:00:29.829 - debug: backitup.0 (258932) [iobroker/iobroker] Backup created: /opt/iobroker/backups/iobroker_2023_09_22-23_00_20_backupiobroker.tar.gz
2023-09-22 23:00:31.162 - debug: backitup.0 (258932) [iobroker/iobroker] done
2023-09-22 23:00:32.067 - debug: backitup.0 (258932) [iobroker/historyDB] compress from historyDB started ...
2023-09-22 23:00:36.909 - debug: backitup.0 (258932) [iobroker/historyDB] Backup created: /opt/iobroker/backups/historyDB_2023_09_22-23_00_32_backupiobroker.tar.gz
2023-09-22 23:00:36.912 - debug: backitup.0 (258932) [iobroker/historyDB] done
2023-09-22 23:00:37.833 - debug: backitup.0 (258932) [iobroker/javascripts] Created javascript_tmp directory: "/opt/iobroker/backups/tmpScripts"
2023-09-22 23:00:37.979 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: VAR_Wochenverbrauch
2023-09-22 23:00:37.980 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: VAR_Monatsverbrauch
2023-09-22 23:00:37.981 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: VAR_Tagesverbrauch
2023-09-22 23:00:37.981 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: Verbrauchsmessung_Shellys
2023-09-22 23:00:37.981 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: Schaltung_openDTU
2023-09-22 23:00:37.981 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: Notabschaltung___Alarm
2023-09-22 23:00:37.982 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: An-_Abschaltung_Solar
2023-09-22 23:00:37.982 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: VAR_Realtime_Untertägig
2023-09-22 23:00:37.983 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: Akku_Balancing
2023-09-22 23:00:37.984 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: Luftentfeuchter
2023-09-22 23:00:37.984 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: Raspberry_PI
2023-09-22 23:00:37.985 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: OpenDTU
2023-09-22 23:00:37.986 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: HM_WR_Keller
2023-09-22 23:00:37.987 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: HW_WR_Garage
2023-09-22 23:00:37.987 - debug: backitup.0 (258932) [iobroker/javascripts] found Script: Akkuladung_100
2023-09-22 23:00:38.091 - debug: backitup.0 (258932) [iobroker/javascripts] Try deleting the Javascript tmp directory: "/opt/iobroker/backups/tmpScripts"
2023-09-22 23:00:38.112 - debug: backitup.0 (258932) [iobroker/javascripts] Javascript tmp directory "/opt/iobroker/backups/tmpScripts" successfully deleted
2023-09-22 23:00:38.113 - debug: backitup.0 (258932) [iobroker/javascripts] Backup created: /opt/iobroker/backups/javascripts_2023_09_22-23_00_37_backupiobroker.tar.gz
2023-09-22 23:00:38.113 - debug: backitup.0 (258932) [iobroker/javascripts] done
2023-09-22 23:00:38.867 - debug: backitup.0 (258932) [iobroker/cifs] used copy path: /Backup_IoBroker/Backup
2023-09-22 23:00:38.867 - debug: backitup.0 (258932) [iobroker/cifs] done
2023-09-22 23:00:39.486 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/iobroker_2023_09_18-23_00_25_backupiobroker.tar.gz
2023-09-22 23:00:39.489 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/iobroker_2023_09_17-23_00_20_backupiobroker.tar.gz
2023-09-22 23:00:39.491 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/iobroker_2023_09_16-23_00_20_backupiobroker.tar.gz
2023-09-22 23:00:39.503 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/historyDB_2023_09_18-23_00_36_backupiobroker.tar.gz
2023-09-22 23:00:39.506 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/historyDB_2023_09_17-23_00_32_backupiobroker.tar.gz
2023-09-22 23:00:39.521 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/historyDB_2023_09_16-23_00_31_backupiobroker.tar.gz
2023-09-22 23:00:39.536 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/javascripts_2023_09_18-23_00_40_backupiobroker.tar.gz
2023-09-22 23:00:39.539 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/javascripts_2023_09_17-23_00_35_backupiobroker.tar.gz
2023-09-22 23:00:39.542 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/javascripts_2023_09_16-23_00_35_backupiobroker.tar.gz
2023-09-22 23:00:39.545 - debug: backitup.0 (258932) [iobroker/clean] done
2023-09-22 23:00:40.793 - debug: backitup.0 (258932) [iobroker/historyHTML] new history html values created
2023-09-22 23:00:40.866 - debug: backitup.0 (258932) [iobroker/historyHTML] done
2023-09-22 23:00:41.094 - debug: backitup.0 (258932) [iobroker/historyJSON] new history json values created
2023-09-22 23:00:41.095 - debug: backitup.0 (258932) [iobroker/historyJSON] done
2023-09-22 23:00:41.276 - debug: backitup.0 (258932) [iobroker/umount] mount activ, umount is started ...
2023-09-22 23:00:46.329 - debug: backitup.0 (258932) [iobroker/umount] umount successfully completed
2023-09-22 23:00:46.330 - debug: backitup.0 (258932) [iobroker/umount] done
2023-09-22 23:00:46.481 - debug: backitup.0 (258932) [iobroker] exec: done

[simatec]

@dpo99 der Log sieht gut aus…

[DPO99]

Update**

@simatec Fehler trat nun wieder auf. Anbei das log.

2023-09-29 23:00:10.051 - debug: backitup.0 (929) The local storage check was completed successfully. On the host "iobroker" are currently 24137 MB free space available!
2023-09-29 23:00:10.059 - debug: backitup.0 (929) Backup has started ...
2023-09-29 23:00:20.060 - debug: backitup.0 (929) [iobroker/mount] noserverino option: false
2023-09-29 23:00:20.061 - debug: backitup.0 (929) [iobroker/mount] cifs-mount command: "sudo mount -t cifs -o username=iobroker,password=****,rw,uid=iobroker,gid=iobroker,file_mode=0777,dir_mode=0777,vers=3.0 //192.168.178.5/Backup_IoBroker/Backup /opt/iobroker/backups"
2023-09-29 23:00:20.349 - debug: backitup.0 (929) [iobroker/mount] mount successfully completed
2023-09-29 23:00:20.351 - debug: backitup.0 (929) [iobroker/mount] done
2023-09-29 23:00:23.687 - debug: backitup.0 (929) [iobroker/iobroker] host.iobroker 3001 states saved
2023-09-29 23:00:25.923 - debug: backitup.0 (929) [iobroker/iobroker] host.iobroker 3512 objects saved
2023-09-29 23:00:29.810 - debug: backitup.0 (929) [iobroker/iobroker] Backup created: /opt/iobroker/backups/iobroker_2023_09_29-23_00_20_backupiobroker.tar.gz
2023-09-29 23:00:37.788 - debug: backitup.0 (929) [iobroker/iobroker] done
2023-09-29 23:00:38.692 - debug: backitup.0 (929) [iobroker/historyDB] compress from historyDB started ...
2023-09-29 23:00:41.848 - debug: backitup.0 (929) [iobroker/historyDB] Backup created: /opt/iobroker/backups/historyDB_2023_09_29-23_00_38_backupiobroker.tar.gz
2023-09-29 23:00:41.849 - debug: backitup.0 (929) [iobroker/historyDB] done
2023-09-29 23:00:42.805 - debug: backitup.0 (929) [iobroker/javascripts] Created javascript_tmp directory: "/opt/iobroker/backups/tmpScripts"
2023-09-29 23:00:43.022 - debug: backitup.0 (929) [iobroker/javascripts] found Script: VAR_Wochenverbrauch
2023-09-29 23:00:43.023 - debug: backitup.0 (929) [iobroker/javascripts] found Script: VAR_Monatsverbrauch
2023-09-29 23:00:43.023 - debug: backitup.0 (929) [iobroker/javascripts] found Script: VAR_Tagesverbrauch
2023-09-29 23:00:43.024 - debug: backitup.0 (929) [iobroker/javascripts] found Script: Verbrauchsmessung_Shellys
2023-09-29 23:00:43.024 - debug: backitup.0 (929) [iobroker/javascripts] found Script: Schaltung_openDTU
2023-09-29 23:00:43.024 - debug: backitup.0 (929) [iobroker/javascripts] found Script: Notabschaltung___Alarm
2023-09-29 23:00:43.025 - debug: backitup.0 (929) [iobroker/javascripts] found Script: An-_Abschaltung_Solar
2023-09-29 23:00:43.025 - debug: backitup.0 (929) [iobroker/javascripts] found Script: VAR_Realtime_Untertägig
2023-09-29 23:00:43.025 - debug: backitup.0 (929) [iobroker/javascripts] found Script: Akku_Balancing
2023-09-29 23:00:43.025 - debug: backitup.0 (929) [iobroker/javascripts] found Script: Luftentfeuchter
2023-09-29 23:00:43.026 - debug: backitup.0 (929) [iobroker/javascripts] found Script: Raspberry_PI
2023-09-29 23:00:43.026 - debug: backitup.0 (929) [iobroker/javascripts] found Script: OpenDTU
2023-09-29 23:00:43.026 - debug: backitup.0 (929) [iobroker/javascripts] found Script: HM_WR_Keller
2023-09-29 23:00:43.026 - debug: backitup.0 (929) [iobroker/javascripts] found Script: HW_WR_Garage
2023-09-29 23:00:43.027 - debug: backitup.0 (929) [iobroker/javascripts] found Script: Akkuladung_100
2023-09-29 23:00:43.027 - debug: backitup.0 (929) [iobroker/javascripts] found Script: VAR_Jahresverbrauch
2023-09-29 23:00:43.027 - debug: backitup.0 (929) [iobroker/javascripts] found Script: TEST
2023-09-29 23:00:43.027 - debug: backitup.0 (929) [iobroker/javascripts] found Script: Test_Hama
2023-09-29 23:00:43.324 - debug: backitup.0 (929) [iobroker/javascripts] Try deleting the Javascript tmp directory: "/opt/iobroker/backups/tmpScripts"
2023-09-29 23:00:43.430 - debug: backitup.0 (929) [iobroker/javascripts] Javascript tmp directory "/opt/iobroker/backups/tmpScripts" successfully deleted
2023-09-29 23:00:43.431 - debug: backitup.0 (929) [iobroker/javascripts] Backup created: /opt/iobroker/backups/javascripts_2023_09_29-23_00_42_backupiobroker.tar.gz
2023-09-29 23:00:43.431 - debug: backitup.0 (929) [iobroker/javascripts] done
2023-09-29 23:00:44.184 - debug: backitup.0 (929) [iobroker/cifs] used copy path: /Backup_IoBroker/Backup
2023-09-29 23:00:44.185 - debug: backitup.0 (929) [iobroker/cifs] done
2023-09-29 23:00:44.787 - error: backitup.0 (929) [iobroker/clean] Backup files not deleted from /opt/iobroker/backups because some errors.
2023-09-29 23:00:44.788 - debug: backitup.0 (929) [iobroker/clean] done
2023-09-29 23:00:46.003 - debug: backitup.0 (929) [iobroker/historyHTML] new history html values created
2023-09-29 23:00:46.069 - debug: backitup.0 (929) [iobroker/historyHTML] done
2023-09-29 23:00:46.307 - debug: backitup.0 (929) [iobroker/historyJSON] new history json values created
2023-09-29 23:00:46.308 - debug: backitup.0 (929) [iobroker/historyJSON] done
2023-09-29 23:00:46.487 - debug: backitup.0 (929) [iobroker/umount] mount activ, umount is started ...
2023-09-29 23:00:51.587 - debug: backitup.0 (929) [iobroker/umount] umount successfully completed
2023-09-29 23:00:51.589 - debug: backitup.0 (929) [iobroker/umount] done
2023-09-29 23:00:51.740 - debug: backitup.0 (929) [iobroker] exec: done

Die Backups sind auch noch auf dem Pi gespeichert:

iobroker@iobroker:/opt/iobroker/backups $ dir
historyDB_2023_09_24-23_00_31_backupiobroker.tar.gz  iobroker_2023_09_27-23_00_20_backupiobroker.tar.gz
historyDB_2023_09_25-23_00_31_backupiobroker.tar.gz  iobroker_2023_09_28-23_00_20_backupiobroker.tar.gz
historyDB_2023_09_26-23_00_36_backupiobroker.tar.gz  iobroker_2023_09_29-23_00_20_backupiobroker.tar.gz
historyDB_2023_09_27-23_00_32_backupiobroker.tar.gz  javascripts_2023_09_24-23_00_35_backupiobroker.tar.gz
historyDB_2023_09_28-23_00_33_backupiobroker.tar.gz  javascripts_2023_09_25-23_00_35_backupiobroker.tar.gz
historyDB_2023_09_29-23_00_38_backupiobroker.tar.gz  javascripts_2023_09_26-23_00_41_backupiobroker.tar.gz
iobroker_2023_09_24-23_00_20_backupiobroker.tar.gz   javascripts_2023_09_27-23_00_36_backupiobroker.tar.gz
iobroker_2023_09_25-23_00_20_backupiobroker.tar.gz   javascripts_2023_09_28-23_00_40_backupiobroker.tar.gz
iobroker_2023_09_26-23_00_25_backupiobroker.tar.gz   javascripts_2023_09_29-23_00_42_backupiobroker.tar.gz

Anbei einmal die Einstellungen:

Zum System:
Raspberry Pi 4 8GB
Node.js: v18.18.0
NPM: 9.8.1
js-controller: 4.0.24
backitup: v2.8.1

Mir ist dann noch was aufgefallen.
Er hat hier m.E. eine Version zu viel gelöscht. Ich hebe immer 5 auf, also hätte er doch am 23.09.2023 den 19.09.2023 noch gar nicht löschen dürfen oder?

2023-09-23 23:00:37.923 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/iobroker_2023_09_19-23_00_20_backupiobroker.tar.gz
2023-09-23 23:00:37.937 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/historyDB_2023_09_19-23_00_33_backupiobroker.tar.gz
2023-09-23 23:00:37.951 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/javascripts_2023_09_19-23_00_40_backupiobroker.tar.gz
2023-09-23 23:00:37.954 - debug: backitup.0 (258932) [iobroker/clean] done

Am 26.09.2023 z.B. hat er tatsächlich 5 Versionen stehen lassen und die 6. gelöscht (also anders als am 23.09.2023):

2023-09-26 23:00:42.869 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/iobroker_2023_09_21-23_54_53_backupiobroker.tar.gz
2023-09-26 23:00:42.884 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/historyDB_2023_09_21-23_55_04_backupiobroker.tar.gz
2023-09-26 23:00:42.898 - debug: backitup.0 (258932) [iobroker/clean] delete /opt/iobroker/backups/javascripts_2023_09_21-23_55_08_backupiobroker.tar.gz
2023-09-26 23:00:42.901 - debug: backitup.0 (258932) [iobroker/clean] done

[DPO99]

Gestern hatte er es dann auch geschafft, dass vom 29.09.2023 "stehen gelassene" Backup zu löschen. Und auch hier hat er m.E. korrekt 5 Stück stehen lassen:

2023-09-30 23:00:37.375 - debug: backitup.0 (929) [iobroker/clean] delete /opt/iobroker/backups/iobroker_2023_09_25-23_00_20_backupiobroker.tar.gz
2023-09-30 23:00:37.378 - debug: backitup.0 (929) [iobroker/clean] delete /opt/iobroker/backups/iobroker_2023_09_24-23_00_20_backupiobroker.tar.gz
2023-09-30 23:00:37.394 - debug: backitup.0 (929) [iobroker/clean] delete /opt/iobroker/backups/historyDB_2023_09_25-23_00_31_backupiobroker.tar.gz
2023-09-30 23:00:37.397 - debug: backitup.0 (929) [iobroker/clean] delete /opt/iobroker/backups/historyDB_2023_09_24-23_00_31_backupiobroker.tar.gz
2023-09-30 23:00:37.411 - debug: backitup.0 (929) [iobroker/clean] delete /opt/iobroker/backups/javascripts_2023_09_25-23_00_35_backupiobroker.tar.gz
2023-09-30 23:00:37.414 - debug: backitup.0 (929) [iobroker/clean] delete /opt/iobroker/backups/javascripts_2023_09_24-23_00_35_backupiobroker.tar.gz
2023-09-30 23:00:37.417 - debug: backitup.0 (929) [iobroker/clean] done

[simatec]

@dpo99 sagte in Test Adapter ioBroker.backitup v2.8.x:

Die Backups sind auch noch auf dem Pi gespeichert

Wenn du ein NAS nutzt, können die Backups nicht auf dem PI liegen

[DPO99]

@simatec

Diese Aussage deckt sich aber nicht mit dem Verhalten. Die Backups liegen auf dem PI und auf dem NAS. So gesehen "doppelt" könnte man sagen.

[DJMarc75]

@dpo99 Sind das manuell angestoßene Backups ?

[simatec]

@dpo99 Und genau dies kann bei einem CIFS Mount nicht sein... Der lokale Pfad muss leer sein.

[Thomas Braun]

@dpo99 sagte in Test Adapter ioBroker.backitup v2.8.x:

Die Backups liegen auf dem PI und auf dem NAS. So gesehen "doppelt" könnte man sagen.

Üblicherweise werden NAS per NFS oder CIFS in dem Mountpunkt /opt/iobroker/backups gemountet. Da kann es keine Dopplung geben, weil die Dateien physisch auf dem NAS liegen und nur logisch in /opt/iobroker/backups.
Dieser Ordner ist dann auch leer, wenn das NAS gerade nicht gemountet ist .

[DPO99]

@thomas-braun @simatec

Ah okay alles klar. Das wäre dann soweit logisch. Hab das NAS mal eben ausgemacht und in den lokalen Pfad geschaut. Sieht so aus, wie beschrieben:

iobroker@iobroker:/opt/iobroker/backups $ dir
2023_02_19-18_44_43_backupiobroker.tar.gz

Gibts zum ursprünglichen Problem und dem "stehen lassen" bzw. zu "früh" löschen von Backups auch eine Idee?

@DJMarc75 Wenn mein NAS aus ist, dann sehe ich nur das manuelle Backup. Von daher passt das zur Aussage von Thomas Braun und Simatec.