UNSOLVED Adapter Backitup kopiert nicht auf FTP

simatec

@TepMan sagte in Adapter Backitup kopiert nicht auf FTP:

Letzter Post für heute - versprochen. Offenbar unmounted der Adapter nicht mehr. Ich hatte ja per CIFS ein Backup erfolgreich auf das NAS bekommen. Dann habe ich auf NFS umgeschaltet, man sieht im Log, er sagt, er könne nicht mounten, weil er keine Credentials bekommt. Das Backup wird aber trotzdem erstellt und landet auf dem NAS, also ist der Mountpoint noch drin:
backitup.0	2020-05-09 23:32:02.878	debug	(15061) [iobroker/iobroker] done
backitup.0	2020-05-09 23:32:01.831	debug	(15061) [iobroker/iobroker] Backup created: /opt/iobroker/backups/iobroker_2020_05_09-23_31_57_backupiobroker.tar.gz
backitup.0	2020-05-09 23:31:59.908	debug	(15061) [iobroker/iobroker] host.raspi4 2154 objects saved
backitup.0	2020-05-09 23:31:59.888	debug	(15061) [iobroker/iobroker] host.raspi4 3180 states saved
backitup.0	2020-05-09 23:31:57.803	debug	(15061) [iobroker/mount] mount.nfs: access denied by server while mounting 192.168.178.20:/ioBroker/ioBrokerBackups
backitup.0	2020-05-09 23:31:57.802	debug	(15061) [iobroker/mount] [IGNORED] Error: Command failed: sudo mount 192.168.178.20:/ioBroker/ioBrokerBackups /opt/iobroker/backups
backitup.0	2020-05-09 23:31:57.801	debug	(15061) [iobroker/mount] [undefined mount.nfs: access denied by server while mounting 192.168.178.20:/ioBroker/ioBrokerBackups
backitup.0	2020-05-09 23:31:47.283	debug	(15061) Backup has started ...
backitup.0	2020-05-09 23:30:25.756	debug	(15061) detect last backup file: iobroker_2020_05_09-23_27_29_backupiobroker.tar.gz
backitup.0	2020-05-09 23:30:25.753	debug	(15061) detect backup file 4: iobroker_2020_05_09-23_27_29_backupiobroker.tar.gz
backitup.0	2020-05-09 23:30:25.752	debug	(15061) detect backup file 3: iobroker_2020_05_09-23_24_25_backupiobroker.tar.gz
backitup.0	2020-05-09 23:30:25.751	debug	(15061) detect backup file 2: iobroker_2020_05_09-23_12_17_backupiobroker.tar.gz
backitup.0	2020-05-09 23:30:25.750	debug	(15061) detect backup file 1: iobroker_2020_05_09-20_25_50_backupiobroker.tar.gz
backitup.0	2020-05-09 23:30:23.744	error	(15061) Error: Command failed: sudo mount 192.168.178.20:/ioBroker/ioBrokerBackups /opt/iobroker/backups mount.nfs: access denied by server while mounting 192.168.178.20:/ioBroker/ioBrokerBackups
backitup.0	2020-05-09 23:30:23.271	debug	(15061) [iobroker] 10 00 02 */1 * *
Per FTP geht es gerade auch, eben weil der Mountpoint noch drin hängt.

Ich hoffe du fast die Kritik so konstruktiv auf, wie sie gemeint ist. Das einhängen der Mountpoints auf /opt/iobroker/backups ist zwar eine elegante Lösung, aber extrem verwirrend, wenn man nicht weiß, wie der Adapter arbeitet. Ausserdem birgt es - wie bei mir geschehen - das Risiko, das, wenn Mountpoints nicht ausgehängt werden können es, es zu einem echt seltsamen Systemverhalten führt. Dieses kann man sich dann schwer erklären, wenn man nicht weiß, was da passiert ist.

Wäre es nicht eine Option, die Mountpoints woanders, z.B. unter mnt zu hängen und die Files dann einfach darüber zu kopieren?

Aus dem Grund überprüft backitup beim start des Adapters und auch vor jedem Backup, ob der mount noch vorhanden ist und führt einen umount aus.

Den mount punkt woanders zu setzen ist nicht Ziel, da bei Systemen mit sd garnicht erst auf diese geschrieben werden soll

simatec

@TepMan sagte in Adapter Backitup kopiert nicht auf FTP:

Per FTP geht es gerade auch, eben weil der Mountpoint noch drin hängt.

Das zeigt, dass deine lokalen Rechte für FTP nicht passen

TepMan

Ok, dann habe ich das Konzept jetzt glaube ich verstanden. Die remoten Verzeichnisse werden jeweils dauerhaft gemounted und es wird beim Backup überprüft, ob die da sind, richtig? Dann hatte ich die Probleme wahrscheinlich durch das dauernde hin- und herschalten.

Das mit den Rechten für FTP habe ich aber nicht verstanden. Ich kann per FTP-Client mit dem User ohne Probleme auf das FTP-Verzeichnis zugreifen und Datein lesen und schreiben, welche Rechte fehlen denn da noch oder sind nicht richtig. Also auf dem NAS sind definitiv die Rechte vorhanden.

Und bleibt noch das Problem, das der Backup-Prozess nicht richtig abgeschlossen wird. Kann das mit dem Rechte-Problem zusammenhängen? Kann man das noch irgendwie herausfinden? Ich kann auch gern eine Version mit mehr Debug-Ausgaben installieren, bräuchte nur eine Git-URL zum Installieren.

simatec

@TepMan
Erstmal wäre zu testen, warum der Backup Prozess nicht abgeschlossen wird
Dafür würde ich erstmal alles deaktivieren und nur noch ein lokales Backup erstellen.
NAS aus, FTP aus und auch alle anderen Hacken raus.
Hast du zigbee oder history, mysql oder irgendwas noch aktiv und nicht konfiguriert?
Ansonsten können wir gerne ein debug machen oder Remote ...

TepMan

Jooo, es war ein Haken bei Zigbee! Keine Ahnung warum ich den gesetzt hatte, und natürlich hatte ich den auch überhaupt nicht im Blick. Jetzt ist er weg und das Backup läuft - auch per FTP - sauber durch und alle Backup-Files landen wo sie hin sollen.

Hab das jetzt spaßehalber auch mal mit Redis probiert (obwohl ich auch kein Redis im Einsatz habe) und da reagiert der Adapter mit entsprechenden Fehlermeldungen, arbeitet aber den Backup-Auftrag ansonsten korrekt ab:

Gestartet...
[DEBUG] [iobroker] - host.raspi4 3181 states saved

[DEBUG] [iobroker] - host.raspi4 2154 objects saved

[DEBUG] [iobroker] - Backup created: /opt/iobroker/backups/iobroker_2020_05_11-17_12_21_backupiobroker.tar.gz

[DEBUG] [iobroker] - done
[ERROR] [redis] - [IGNORED] No source for compress!
[DEBUG] [ftp] - FTP connected.
[DEBUG] [ftp] - Send iobroker_2020_05_11-17_12_21_backupiobroker.tar.gz
[DEBUG] [ftp] - Send redis_2020_05_11-17_12_26_backupiobroker.tar.gz
[ERROR] [ftp] - File "/opt/iobroker/backups/redis_2020_05_11-17_12_26_backupiobroker.tar.gz" not found
[DEBUG] [ftp] - done
[ERROR] [clean] - Backup files not deleted from /opt/iobroker/backups because some errors.
[DEBUG] [clean] - done
[DEBUG] [history] - backitup.0.history.html
[DEBUG] [history] - backitup.0.history.json
[EXIT] 0

Ich gucke mir noch ein paar Tage an, ob die zeit gesteuerten, nächtlichen Backups durchlaufen, aber ich gehe davon aus, das es klappen wird. Vielleicht guckst du bei Zigbee noch mal hin, warum der Adapter da so komisch reagiert.

Ansonsten bleibt mir nur, mich für deine Geduld und Hilfe zu bedanken!

simatec

@TepMan
danke für den Hinweis ... zigbee schaue ich mir mal an ...

simatec

@TepMan

Könntest du mal testen, ob es jetzt mit gesetzten Häckchen bei zigbee trotzdem läuft und auch beendet wird?
Installation über Github:

https://github.com/simatec/ioBroker.backitup/tarball/dev

Den Link direkt in der Katze unter Adaptern einfügen.

Am besten auch mal die Debug Ausgaben hier posten

TepMan

@simatec Hi, sieht gut aus (außer das die Meldung etwas sprechender sein könnte, "undefined backup done" wird einem unbedarften Anwender nicht viel sagen ) :

Gestartet...
[DEBUG] [iobroker] start with {"type":"creator","time":"02:00","debugging":true,"everyXDays":"1","deleteBackupAfter":0,"ftp":{"enabled":true,"type":"storage","source":"local","host":"192.168.178.20","debugging":true,"deleteOldBackup":true,"ownDir":false,"dir":"/ioBrokerBackups","dirMinimal":"/backupDir/iobroker","user":"ioBroker","pass":"****","port":"21"},"dir":"/opt/iobroker","redis":{"enabled":false,"type":"creator","ftp":{"enabled":true,"type":"storage","source":"local","host":"192.168.178.20","debugging":true,"deleteOldBackup":true,"ownDir":false,"dir":"/ioBrokerBackups","dirMinimal":"/backupDir/iobroker","user":"ioBroker","pass":"****","port":"21"},"cifs":{"enabled":false,"mountType":"CIFS","type":"storage","source":"local","mount":"192.168.178.20","debugging":true,"fileDir":"/opt/iobroker/node_modules/iobroker.backitup","wakeOnLAN":false,"macAd":"20:DE:20:DE:20:DE","wolTime":"25","smb":"vers=1.0","sudo":true,"cifsDomain":"","deleteOldBackup":false,"ownDir":false,"dir":"ioBroker/ioBrokerBackups","dirMinimal":"sharename/backupDir","user":"ioBroker","pass":"****"},"dropbox":{"enabled":false,"type":"storage","source":"local","debugging":true,"deleteOldBackup":false,"accessToken":"****","ownDir":false,"dir":"/backupDir","dirMinimal":"/backupDir/iobroker"},"googledrive":{"enabled":false,"type":"storage","source":"local","debugging":true,"deleteOldBackup":false,"accessJson":"****","ownDir":false,"dir":"/backupDir","dirMinimal":"/backupDir/iobroker"},"path":"/var/lib/redis"},"historyDB":{"enabled":false,"type":"creator","ftp":{"enabled":true,"type":"storage","source":"local","host":"192.168.178.20","debugging":true,"deleteOldBackup":true,"ownDir":false,"dir":"/ioBrokerBackups","dirMinimal":"/backupDir/iobroker","user":"ioBroker","pass":"****","port":"21"},"cifs":{"enabled":false,"mountType":"CIFS","type":"storage","source":"local","mount":"192.168.178.20","debugging":true,"fileDir":"/opt/iobroker/node_modules/iobroker.backitup","wakeOnLAN":false,"macAd":"20:DE:20:DE:20:DE","wolTime":"25","smb":"vers=1.0","sudo":true,"cifsDomain":"","deleteOldBackup":false,"ownDir":false,"dir":"ioBroker/ioBrokerBackups","dirMinimal":"sharename/backupDir","user":"ioBroker","pass":"****"},"dropbox":{"enabled":false,"type":"storage","source":"local","debugging":true,"deleteOldBackup":false,"accessToken":"****","ownDir":false,"dir":"/backupDir","dirMinimal":"/backupDir/iobroker"},"googledrive":{"enabled":false,"type":"storage","source":"local","debugging":true,"deleteOldBackup":false,"accessJson":"****","ownDir":false,"dir":"/backupDir","dirMinimal":"/backupDir/iobroker"},"path":"media/usb/history"},"zigbee":{"enabled":true,"type":"creator","ftp":{"enabled":true,"type":"storage","source":"local","host":"192.168.178.20","debugging":true,"deleteOldBackup":true,"ownDir":false,"dir":"/ioBrokerBackups","dirMinimal":"/backupDir/iobroker","user":"ioBroker","pass":"****","port":"21"},"cifs":{"enabled":false,"mountType":"CIFS","type":"storage","source":"local","mount":"192.168.178.20","debugging":true,"fileDir":"/opt/iobroker/node_modules/iobroker.backitup","wakeOnLAN":false,"macAd":"20:DE:20:DE:20:DE","wolTime":"25","smb":"vers=1.0","sudo":true,"cifsDomain":"","deleteOldBackup":false,"ownDir":false,"dir":"ioBroker/ioBrokerBackups","dirMinimal":"sharename/backupDir","user":"ioBroker","pass":"****"},"dropbox":{"enabled":false,"type":"storage","source":"local","debugging":true,"deleteOldBackup":false,"accessToken":"****","ownDir":false,"dir":"/backupDir","dirMinimal":"/backupDir/iobroker"},"googledrive":{"enabled":false,"type":"storage","source":"local","debugging":true,"deleteOldBackup":false,"accessJson":"****","ownDir":false,"dir":"/backupDir","dirMinimal":"/backupDir/iobroker"},"path":"/opt/iobroker/iobroker-data"},"history":{"enabled":true,"type":"message","entriesNumber":"25","systemLang":"de"},"email":{"enabled":false,"notificationsType":"Telegram","type":"message","instance":"","NoticeType":"longEmailNotice","emailReceiver":"xxx@xxx.com","emailSender":"xxx@xxx.com","onlyError":false,"emailWaiting":0,"systemLang":"de"},"pushover":{"enabled":false,"notificationsType":"Telegram","type":"message","instance":"","SilentNotice":false,"NoticeType":"longPushoverNotice","deviceID":"","onlyError":false,"pushoverWaiting":0,"systemLang":"de"},"backupDir":"/opt/iobroker/backups"}
[DEBUG] [iobroker] - host.raspi4 3447 states saved

[DEBUG] [iobroker] - host.raspi4 2417 objects saved

[DEBUG] [iobroker] - Backup created: /opt/iobroker/backups/iobroker_2020_05_12-17_32_23_backupiobroker.tar.gz

[DEBUG] [iobroker] - done
[DEBUG] [zigbee] - undefined backup done
[DEBUG] [ftp] start with {"type":"storage","source":"local","host":"192.168.178.20","debugging":true,"deleteOldBackup":true,"ownDir":false,"dir":"/ioBrokerBackups","dirMinimal":"/backupDir/iobroker","user":"ioBroker","pass":"****","port":"21","deleteBackupAfter":0}
[DEBUG] [ftp] - FTP connected.
[DEBUG] [ftp] - Send iobroker_2020_05_12-17_32_23_backupiobroker.tar.gz
[DEBUG] [ftp] - done
[DEBUG] [clean] - done
[DEBUG] [history] - backitup.0.history.html
[EXIT] 0
[DEBUG] [history] - backitup.0.history.json
[EXIT] 0
[DEBUG] [history] start with {"type":"creator","time":"02:00","debugging":true,"everyXDays":"1","deleteBackupAfter":0,"ftp":{"enabled":true,"type":"storage","source":"local","host":"192.168.178.20","debugging":true,"deleteOldBackup":true,"ownDir":false,"dir":"/ioBrokerBackups","dirMinimal":"/backupDir/iobroker","user":"ioBroker","pass":"****","port":"21"},"dir":"/opt/iobroker","redis":{"enabled":false,"type":"creator","ftp":{"enabled":true,"type":"storage","source":"local","host":"192.168.178.20","debugging":true,"deleteOldBackup":true,"ownDir":false,"dir":"/ioBrokerBackups","dirMinimal":"/backupDir/iobroker","user":"ioBroker","pass":"****","port":"21"},"cifs":{"enabled":false,"mountType":"CIFS","type":"storage","source":"local","mount":"192.168.178.20","debugging":true,"fileDir":"/opt/iobroker/node_modules/iobroker.backitup","wakeOnLAN":false,"macAd":"20:DE:20:DE:20:DE","wolTime":"25","smb":"vers=1.0","sudo":true,"cifsDomain":"","deleteOldBackup":false,"ownDir":false,"dir":"ioBroker/ioBrokerBackups","dirMinimal":"sharename/backupDir","user":"ioBroker","pass":"****"},"dropbox":{"enabled":false,"type":"storage","source":"local","debugging":true,"deleteOldBackup":false,"accessToken":"****","ownDir":false,"dir":"/backupDir","dirMinimal":"/backupDir/iobroker"},"googledrive":{"enabled":false,"type":"storage","source":"local","debugging":true,"deleteOldBackup":false,"accessJson":"****","ownDir":false,"dir":"/backupDir","dirMinimal":"/backupDir/iobroker"},"path":"/var/lib/redis"},"historyDB":{"enabled":false,"type":"creator","ftp":{"enabled":true,"type":"storage","source":"local","host":"192.168.178.20","debugging":true,"deleteOldBackup":true,"ownDir":false,"dir":"/ioBrokerBackups","dirMinimal":"/backupDir/iobroker","user":"ioBroker","pass":"****","port":"21"},"cifs":{"enabled":false,"mountType":"CIFS","type":"storage","source":"local","mount":"192.168.178.20","debugging":true,"fileDir":"/opt/iobroker/node_modules/iobroker.backitup","wakeOnLAN":false,"macAd":"20:DE:20:DE:20:DE","wolTime":"25","smb":"vers=1.0","sudo":true,"cifsDomain":"","deleteOldBackup":false,"ownDir":false,"dir":"ioBroker/ioBrokerBackups","dirMinimal":"sharename/backupDir","user":"ioBroker","pass":"****"},"dropbox":{"enabled":false,"type":"storage","source":"local","debugging":true,"deleteOldBackup":false,"accessToken":"****","ownDir":false,"dir":"/backupDir","dirMinimal":"/backupDir/iobroker"},"googledrive":{"enabled":false,"type":"storage","source":"local","debugging":true,"deleteOldBackup":false,"accessJson":"****","ownDir":false,"dir":"/backupDir","dirMinimal":"/backupDir/iobroker"},"path":"media/usb/history"},"zigbee":{"enabled":true,"type":"creator","ftp":{"enabled":true,"type":"storage","source":"local","host":"192.168.178.20","debugging":true,"deleteOldBackup":true,"ownDir":false,"dir":"/ioBrokerBackups","dirMinimal":"/backupDir/iobroker","user":"ioBroker","pass":"****","port":"21"},"cifs":{"enabled":false,"mountType":"CIFS","type":"storage","source":"local","mount":"192.168.178.20","debugging":true,"fileDir":"/opt/iobroker/node_modules/iobroker.backitup","wakeOnLAN":false,"macAd":"20:DE:20:DE:20:DE","wolTime":"25","smb":"vers=1.0","sudo":true,"cifsDomain":"","deleteOldBackup":false,"ownDir":false,"dir":"ioBroker/ioBrokerBackups","dirMinimal":"sharename/backupDir","user":"ioBroker","pass":"****"},"dropbox":{"enabled":false,"type":"storage","source":"local","debugging":true,"deleteOldBackup":false,"accessToken":"****","ownDir":false,"dir":"/backupDir","dirMinimal":"/backupDir/iobroker"},"googledrive":{"enabled":false,"type":"storage","source":"local","debugging":true,"deleteOldBackup":false,"accessJson":"****","ownDir":false,"dir":"/backupDir","dirMinimal":"/backupDir/iobroker"},"path":"/opt/iobroker/iobroker-data"},"history":{"enabled":true,"type":"message","entriesNumber":"25","systemLang":"de","time":"12. Mai 2020 um 17:32 Uhr"},"email":{"enabled":false,"notificationsType":"Telegram","type":"message","instance":"","NoticeType":"longEmailNotice","emailReceiver":"xxx@xxx.com","emailSender":"xxx@xxx.com","onlyError":false,"emailWaiting":0,"systemLang":"de"},"pushover":{"enabled":false,"notificationsType":"Telegram","type":"message","instance":"","SilentNotice":false,"NoticeType":"longPushoverNotice","deviceID":"","onlyError":false,"pushoverWaiting":0,"systemLang":"de"},"backupDir":"/opt/iobroker/backups"}

simatec

@TepMan
Danke für die Info und fürs testen ... konnte das selber auf die schnelle nicht testen, da mir aktuell keine laufende zigbee Installation vorliegt.
Den Log mache ich noch schick

TepMan

@simatec gerne. Kann ich die Dev-Version installiert lassen oder hat die noch "known issues"?

simatec

@TepMan
Kannst du installiert lassen ... Ich werde aber da noch ein paar Kleinigkeiten anpassen bevor die 1.5.8 ins latest geht

simatec

@TepMan
Jetzt sollten die Log-Ausgaben sauber sein und auch verständlich ...

TepMan

@simatec sieht sehr gut aus:

Gestartet...
[DEBUG] [iobroker] - host.raspi4 3445 states saved

[DEBUG] [iobroker] - host.raspi4 2298 objects saved

[DEBUG] [iobroker] - Backup created: /opt/iobroker/backups/iobroker_2020_05_13-17_32_17_backupiobroker.tar.gz

[DEBUG] [iobroker] - done
[DEBUG] [zigbee] - no zigbee database found!!
[DEBUG] [zigbee] - done
[DEBUG] [clean] - done
[DEBUG] [history] - backitup.0.history.html
[EXIT] 0
[DEBUG] [history] - backitup.0.history.json
[EXIT] 0
[DEBUG] [ftp] - FTP connected.
[DEBUG] [ftp] - Send iobroker_2020_05_13-17_32_17_backupiobroker.tar.gz
[DEBUG] [ftp] - done
[EXIT] 0

NEWS

UNSOLVED Adapter Backitup kopiert nicht auf FTP

Support us

1.4k
Online

30.4k
Users

76.7k
Topics

1.2m
Posts

NEWS

UNSOLVED Adapter Backitup kopiert nicht auf FTP

Support us

1.4kOnline

30.4kUsers

76.7kTopics

1.2mPosts

1.4k
Online

30.4k
Users

76.7k
Topics

1.2m
Posts