ioBroker Docker - InfluxDB Error bei hoher Disk I/O

hennerich

Hallo Leute,

ich muss das Thema noch mal aufmachen, weil sich die Situation mit dem Reboot signifikant verbessert hat, trotzdem ab und an aus unerfindlichen Gründen das Log explodiert.

Hier hatte ich einen Ansatz gefunden, den ich gerne ausprobieren würde:
https://github.com/influxdata/influxdb/issues/8036#issuecomment-875697382

Mein Problem ist jetzt, dass ich die entsprechende Variable im Docker Container mitgeben muss, da sonst der Default Wert greift.
Das habe ich mal so versucht und zwar mit der Deklaration wie hier beschrieben:
https://docs.influxdata.com/influxdb/v2.0/reference/config-options/

docker run -d --name=influxdb \
  -p 8086:8086 \
  -v /volume1/docker/influxdb:/var/lib/influxdb \
  -v /volume1/docker/influxdb/data2:/var/lib/influxdb2 \
  -v /volume1/docker/influxdb/config:/etc/influxdb2 \
  -e INFLUXDB_DATA_WAL_FSYNC_DELAY=120 \
  -e INFLUXDB_COORDINATOR_WRITE_TIMEOUT=30 \
  influxdb:latest

und anschließend auf der InfluxDB Console mal die Server Config ausgelesen:

root@ff56b05fc467:/# influx server-config
{
        "assets-path": "",
        "bolt-path": "/var/lib/influxdb2/influxd.bolt",
        "e2e-testing": false,
        "engine-path": "/var/lib/influxdb2/engine",
        "feature-flags": null,
        "flux-log-enabled": false,
        "hardening-enabled": false,
        "http-bind-address": ":8086",
        "http-idle-timeout": 180000000000,
        "http-read-header-timeout": 10000000000,
        "http-read-timeout": 0,
        "http-write-timeout": 0,
        "influxql-max-select-buckets": 0,
        "influxql-max-select-point": 0,
        "influxql-max-select-series": 0,
        "instance-id": "",
        "log-level": "info",
        "metrics-disabled": false,
        "nats-max-payload-bytes": 0,
        "nats-port": 4222,
        "no-tasks": false,
        "pprof-disabled": false,
        "query-concurrency": 1024,
        "query-initial-memory-bytes": 0,
        "query-max-memory-bytes": 0,
        "query-memory-bytes": 0,
        "query-queue-size": 1024,
        "reporting-disabled": false,
        "secret-store": "bolt",
        "session-length": 60,
        "session-renew-disabled": false,
        "sqlite-path": "/var/lib/influxdb2/influxd.sqlite",
        "storage-cache-max-memory-size": 1073741824,
        "storage-cache-snapshot-memory-size": 26214400,
        "storage-cache-snapshot-write-cold-duration": "10m0s",
        "storage-compact-full-write-cold-duration": "4h0m0s",
        "storage-compact-throughput-burst": 50331648,
        "storage-max-concurrent-compactions": 0,
        "storage-max-index-log-file-size": 1048576,
        "storage-no-validate-field-size": false,
        "storage-retention-check-interval": "30m0s",
        "storage-series-file-max-concurrent-snapshot-compactions": 0,
        "storage-series-id-set-cache-size": 0,
        "storage-shard-precreator-advance-period": "30m0s",
        "storage-shard-precreator-check-interval": "10m0s",
        "storage-tsm-use-madv-willneed": false,
        "storage-validate-keys": false,
        "storage-wal-fsync-delay": "0s",
        "storage-wal-max-concurrent-writes": 0,
        "storage-wal-max-write-delay": 600000000000,
        "storage-write-timeout": 10000000000,
        "store": "disk",
        "testing-always-allow-setup": false,
        "tls-cert": "",
        "tls-key": "",
        "tls-min-version": "1.2",
        "tls-strict-ciphers": false,
        "tracing-type": "",
        "ui-disabled": false,
        "vault-addr": "",
        "vault-cacert": "",
        "vault-capath": "",
        "vault-client-cert": "",
        "vault-client-key": "",
        "vault-client-timeout": 0,
        "vault-max-retries": 0,
        "vault-skip-verify": false,
        "vault-tls-server-name": "",
        "vault-token": ""
}

Mein Problem ist jetzt, dass die Übergabe der Variablen scheinbar nicht greift, denn sonst müsste ja bei dem FSYNC nicht 0s stehen.

Dann hab ich irgendwo gelesen, dass mit Docker die Variable so übergeben werden muss:
INFLUXD_STORAGE_WAL_FSYNC_DELAY

Aber auch das funktioniert nicht.
Schaue ich denn auf der Container Konsole in die falschen Infos oder weiß jemand von euch, wie die richtige Variable heißt?

cbarzu created this issue in influxdata/influxdb

closed failed to store statistics: timeout 1.2.0 #8036

Marc Berg

@hennerich

Ich nehme an, du willst die Variable auf 120ms stellen, dann muss du das auch so angeben:

INFLUXD_STORAGE_WAL_FSYNC_DELAY=120ms

Marc Berg

@hennerich sagte in ioBroker Docker - InfluxDB Error bei hoher Disk I/O:

INFLUXDB_COORDINATOR_WRITE_TIMEOUT

Diese Umgebungsvariable gibt es übrigens in der V2.x nicht mehr.

Hast du zu den Zeitpunkten, zu denen die Timeouts auftreten, Einträge im InfluxDB-Log, also auf der Docker-Console? In Abhängigkeit davon, ob zu diesem Zeitpunkt gerade ein Index geschrieben wird oder eine "Compaction" läuft, könnten unterschiedliche Anpassungen Sinn ergeben.

hennerich

@marc-berg sagte in ioBroker Docker - InfluxDB Error bei hoher Disk I/O:

@hennerich

Ich nehme an, du willst die Variable auf 120ms stellen, dann muss du das auch so angeben:

INFLUXD_STORAGE_WAL_FSYNC_DELAY=120ms

Hey Marc,

besten Dank für deine schnelle Rückmeldung.
Also gibt es die Variable aus meiner ersten Codebox (INFLUXDB_DATA_WAL_FSYNC_DELAY) nicht mehr oder es ist die falsche, richtig?
Und den Container hatte ich beim zweiten Versuch schon so mit Angabe der Zeit gestartet. Das wird mir angezeigt:

Marc Berg

@hennerich sagte in ioBroker Docker - InfluxDB Error bei hoher Disk I/O:

Also gibt es die Variable aus meiner ersten Codebox (INFLUXDB_DATA_WAL_FSYNC_DELAY) nicht mehr oder es ist die falsche, richtig?

Die ist falsch. Die Variablen, die mit "INFLUXDB_" beginnen, sind meines Wissens nur für die 1.x gültig. Für die 2.x fangen alle mit "INFLUXD_" an

hennerich

@marc-berg sagte in ioBroker Docker - InfluxDB Error bei hoher Disk I/O:

Die ist falsch. Die Variablen, die mit "INFLUXDB_" beginnen, sind meines Wissens nur für die 1.x gültig. Für die 2.x fangen alle mit "INFLUXD_" an

Ok, ich hab jetzt die Variable noch mal neu gesetzt und die andere entfernt.
Beim Setzen der Variable hatte ich Anfangs nur 120 als Wert hinterlegt. Jetzt hab ich 120s genommen.
So sieht das jetzt aus:

Und wenn ich auf der Konsole nun die Konfiguration abrufe, steht in der Tat

"storage-wal-fsync-delay": "2m0s",

Eventuell lag es an der nicht angegebenen Einheit.

@marc-berg sagte in ioBroker Docker - InfluxDB Error bei hoher Disk I/O:

Hast du zu den Zeitpunkten, zu denen die Timeouts auftreten, Einträge im InfluxDB-Log, also auf der Docker-Console? In Abhängigkeit davon, ob zu diesem Zeitpunkt gerade ein Index geschrieben wird oder eine "Compaction" läuft, könnten unterschiedliche Anpassungen Sinn ergeben.

Da hatte ich noch nie nachgeschaut. Hab das OS Dashboard installiert und immer wenn das Problem auftritt, sieht das so aus:

Jetzt gerade ist es wieder da und das ioBroker Log überschlägt sich mit Meldungen:

influxdb.0
	2023-05-26 22:10:42.337	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=6
influxdb.0
	2023-05-26 22:10:42.337	warn	Error on writePoint("{"value":-664,"time":"2023-05-26T20:10:02.308Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.337	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.332	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=6
influxdb.0
	2023-05-26 22:10:42.332	warn	Error on writePoint("{"value":664,"time":"2023-05-26T20:10:02.310Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.332	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.326	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=5
influxdb.0
	2023-05-26 22:10:42.326	warn	Error on writePoint("{"value":597,"time":"2023-05-26T20:07:22.173Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.326	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.323	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=4
influxdb.0
	2023-05-26 22:10:42.323	warn	Error on writePoint("{"value":-600,"time":"2023-05-26T20:07:42.190Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.323	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.320	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=5
influxdb.0
	2023-05-26 22:10:42.320	warn	Error on writePoint("{"value":-597,"time":"2023-05-26T20:07:22.171Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.320	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.315	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=3
influxdb.0
	2023-05-26 22:10:42.315	warn	Error on writePoint("{"value":-643,"time":"2023-05-26T20:09:42.268Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.315	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.275	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=2
influxdb.0
	2023-05-26 22:10:42.275	warn	Error on writePoint("{"value":-697,"time":"2023-05-26T20:10:22.269Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.275	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.245	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=4
influxdb.0
	2023-05-26 22:10:42.245	warn	Error on writePoint("{"value":-601,"time":"2023-05-26T20:06:02.084Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.245	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.243	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=1
influxdb.0
	2023-05-26 22:10:42.243	warn	Error on writePoint("{"value":-672,"time":"2023-05-26T20:09:02.198Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.242	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.228	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=4
influxdb.0
	2023-05-26 22:10:42.228	warn	Error on writePoint("{"value":601,"time":"2023-05-26T20:06:02.086Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.227	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.222	info	Discard point that had error for modbus.1.holdingRegisters.40206_M_AC_Power, error-count=10
influxdb.0
	2023-05-26 22:10:42.222	warn	Error on writePoint("{"value":-664,"time":"2023-05-26T20:10:02.207Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.221	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.067	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=9
influxdb.0
	2023-05-26 22:10:42.067	warn	Error on writePoint("{"value":-689,"time":"2023-05-26T20:03:13.008Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.067	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.064	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=8
influxdb.0
	2023-05-26 22:10:42.064	warn	Error on writePoint("{"value":-640,"time":"2023-05-26T20:03:11.785Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.064	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.059	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=7
influxdb.0
	2023-05-26 22:10:42.059	warn	Error on writePoint("{"value":-641,"time":"2023-05-26T20:03:10.481Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.059	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.055	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=6
influxdb.0
	2023-05-26 22:10:42.055	warn	Error on writePoint("{"value":-614,"time":"2023-05-26T20:03:07.988Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.054	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.020	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=5
influxdb.0
	2023-05-26 22:10:42.020	warn	Error on writePoint("{"value":-641,"time":"2023-05-26T20:03:02.952Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.020	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:42.017	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=4
influxdb.0
	2023-05-26 22:10:42.017	warn	Error on writePoint("{"value":-621,"time":"2023-05-26T20:03:00.442Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:42.017	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.999	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=3
influxdb.0
	2023-05-26 22:10:41.999	warn	Error on writePoint("{"value":-621,"time":"2023-05-26T20:03:05.505Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.999	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.997	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=2
influxdb.0
	2023-05-26 22:10:41.996	warn	Error on writePoint("{"value":-622,"time":"2023-05-26T20:03:04.233Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.996	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.904	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=1
influxdb.0
	2023-05-26 22:10:41.904	warn	Error on writePoint("{"value":-600,"time":"2023-05-26T20:05:21.770Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.903	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.261	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=3
influxdb.0
	2023-05-26 22:10:41.261	warn	Error on writePoint("{"value":584,"time":"2023-05-26T20:06:20.871Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.261	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.259	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=2
influxdb.0
	2023-05-26 22:10:41.259	warn	Error on writePoint("{"value":680,"time":"2023-05-26T20:08:41.132Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.258	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.255	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=3
influxdb.0
	2023-05-26 22:10:41.255	warn	Error on writePoint("{"value":-647,"time":"2023-05-26T20:08:21.160Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.255	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.251	info	Add point that had error for javascript.0.Solar.Wechselrichter.PVImportierteEnergieAktuell to buffer again, error-count=1
influxdb.0
	2023-05-26 22:10:41.251	warn	Error on writePoint("{"value":2.968,"time":"2023-05-26T20:08:00.924Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.251	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.248	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=2
influxdb.0
	2023-05-26 22:10:41.248	warn	Error on writePoint("{"value":-611,"time":"2023-05-26T20:06:00.823Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.247	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.244	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=1
influxdb.0
	2023-05-26 22:10:41.244	warn	Error on writePoint("{"value":647,"time":"2023-05-26T20:08:21.162Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.243	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.240	info	Discard point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch, error-count=10
influxdb.0
	2023-05-26 22:10:41.240	warn	Error on writePoint("{"value":583,"time":"2023-05-26T20:07:20.890Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.240	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.235	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=1
influxdb.0
	2023-05-26 22:10:41.235	warn	Error on writePoint("{"value":-645,"time":"2023-05-26T20:09:41.131Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.235	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.234	info	Discard point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower, error-count=10
influxdb.0
	2023-05-26 22:10:41.233	warn	Error on writePoint("{"value":-584,"time":"2023-05-26T20:06:20.869Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.233	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.225	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=9
influxdb.0
	2023-05-26 22:10:41.225	warn	Error on writePoint("{"value":645,"time":"2023-05-26T20:09:41.137Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.225	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.194	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=9
influxdb.0
	2023-05-26 22:10:41.194	warn	Error on writePoint("{"value":-680,"time":"2023-05-26T20:08:41.130Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.194	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.180	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=8
influxdb.0
	2023-05-26 22:10:41.180	warn	Error on writePoint("{"value":595,"time":"2023-05-26T20:07:41.055Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.180	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.176	info	Discard point that had error for modbus.1.holdingRegisters.40206_M_AC_Power, error-count=10
influxdb.0
	2023-05-26 22:10:41.176	warn	Error on writePoint("{"value":-595,"time":"2023-05-26T20:07:40.953Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.176	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.174	info	Discard point that had error for javascript.0.Solar.Wechselrichter.PVImportierteEnergieAktuell, error-count=10
influxdb.0
	2023-05-26 22:10:41.174	warn	Error on writePoint("{"value":2.956,"time":"2023-05-26T20:06:40.870Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.173	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.131	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=7
influxdb.0
	2023-05-26 22:10:41.131	warn	Error on writePoint("{"value":699,"time":"2023-05-26T20:10:21.121Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.131	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.127	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=8
influxdb.0
	2023-05-26 22:10:41.127	warn	Error on writePoint("{"value":-699,"time":"2023-05-26T20:10:21.119Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.127	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.121	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=7
influxdb.0
	2023-05-26 22:10:41.121	warn	Error on writePoint("{"value":-667,"time":"2023-05-26T20:10:01.068Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.121	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.119	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=6
influxdb.0
	2023-05-26 22:10:41.119	warn	Error on writePoint("{"value":-583,"time":"2023-05-26T20:07:20.889Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.118	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.115	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=6
influxdb.0
	2023-05-26 22:10:41.115	warn	Error on writePoint("{"value":667,"time":"2023-05-26T20:10:01.077Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.114	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.074	info	Add point that had error for javascript.0.Solar.Wechselrichter.PVImportierteEnergieAktuell to buffer again, error-count=9
influxdb.0
	2023-05-26 22:10:41.074	warn	Error on writePoint("{"value":2.983,"time":"2023-05-26T20:09:21.029Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.074	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.069	info	Add point that had error for javascript.0.Solar.Wechselrichter.PVImportierteEnergieAktuell to buffer again, error-count=8
influxdb.0
	2023-05-26 22:10:41.069	warn	Error on writePoint("{"value":2.991,"time":"2023-05-26T20:10:01.047Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.069	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.056	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=9
influxdb.0
	2023-05-26 22:10:41.056	warn	Error on writePoint("{"value":-645,"time":"2023-05-26T20:09:41.030Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.055	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.027	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=8
influxdb.0
	2023-05-26 22:10:41.027	warn	Error on writePoint("{"value":-699,"time":"2023-05-26T20:10:21.018Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.027	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:41.010	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=7
influxdb.0
	2023-05-26 22:10:41.009	warn	Error on writePoint("{"value":-674,"time":"2023-05-26T20:09:20.968Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:41.009	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:40.983	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=6
influxdb.0
	2023-05-26 22:10:40.983	warn	Error on writePoint("{"value":-667,"time":"2023-05-26T20:10:00.967Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:40.982	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:40.879	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=5
influxdb.0
	2023-05-26 22:10:40.879	warn	Error on writePoint("{"value":894,"time":"2023-05-26T20:05:00.684Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:40.879	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:40.874	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=5
influxdb.0
	2023-05-26 22:10:40.874	warn	Error on writePoint("{"value":-611,"time":"2023-05-26T20:06:00.721Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:40.874	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:40.872	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=4
influxdb.0
	2023-05-26 22:10:40.872	warn	Error on writePoint("{"value":-591,"time":"2023-05-26T20:05:40.713Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:40.872	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:40.829	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=5
influxdb.0
	2023-05-26 22:10:40.829	warn	Error on writePoint("{"value":-894,"time":"2023-05-26T20:05:00.682Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:40.828	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:40.797	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=3
influxdb.0
	2023-05-26 22:10:40.797	warn	Error on writePoint("{"value":-894,"time":"2023-05-26T20:05:00.581Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:40.796	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:40.787	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=4
influxdb.0
	2023-05-26 22:10:40.787	warn	Error on writePoint("{"value":-918,"time":"2023-05-26T20:04:40.594Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:40.786	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:40.756	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=4
influxdb.0
	2023-05-26 22:10:40.756	warn	Error on writePoint("{"value":799,"time":"2023-05-26T20:04:00.572Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:40.756	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:40.094	info	Add point that had error for javascript.0.Solar.Sonnenstand.Elevation to buffer again, error-count=2
influxdb.0
	2023-05-26 22:10:40.094	warn	Error on writePoint("{"value":0,"time":"2023-05-26T20:10:00.008Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:40.094	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:40.049	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=3
influxdb.0
	2023-05-26 22:10:40.049	warn	Error on writePoint("{"value":672,"time":"2023-05-26T20:08:39.942Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:40.049	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:40.033	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=3
influxdb.0
	2023-05-26 22:10:40.033	warn	Error on writePoint("{"value":-672,"time":"2023-05-26T20:08:39.940Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:40.033	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.923	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=2
influxdb.0
	2023-05-26 22:10:39.923	warn	Error on writePoint("{"value":-690,"time":"2023-05-26T20:08:59.827Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.923	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.920	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=2
influxdb.0
	2023-05-26 22:10:39.920	warn	Error on writePoint("{"value":-672,"time":"2023-05-26T20:08:39.839Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.919	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.881	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=2
influxdb.0
	2023-05-26 22:10:39.881	warn	Error on writePoint("{"value":690,"time":"2023-05-26T20:08:59.828Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.880	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.878	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=1
influxdb.0
	2023-05-26 22:10:39.878	warn	Error on writePoint("{"value":-675,"time":"2023-05-26T20:09:59.856Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.877	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.875	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=1
influxdb.0
	2023-05-26 22:10:39.875	warn	Error on writePoint("{"value":675,"time":"2023-05-26T20:09:59.859Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.875	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.870	info	Discard point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower, error-count=10
influxdb.0
	2023-05-26 22:10:39.870	warn	Error on writePoint("{"value":-665,"time":"2023-05-26T20:09:39.828Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.870	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.866	info	Discard point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch, error-count=10
influxdb.0
	2023-05-26 22:10:39.866	warn	Error on writePoint("{"value":692,"time":"2023-05-26T20:10:19.850Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.866	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.863	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=9
influxdb.0
	2023-05-26 22:10:39.863	warn	Error on writePoint("{"value":665,"time":"2023-05-26T20:09:39.829Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.863	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.859	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=9
influxdb.0
	2023-05-26 22:10:39.859	warn	Error on writePoint("{"value":-692,"time":"2023-05-26T20:10:19.847Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.859	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.852	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=1
influxdb.0
	2023-05-26 22:10:39.852	warn	Error on writePoint("{"value":-636,"time":"2023-05-26T20:08:19.797Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.851	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.797	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=8
influxdb.0
	2023-05-26 22:10:39.797	warn	Error on writePoint("{"value":-586,"time":"2023-05-26T20:07:59.708Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.797	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.795	info	Discard point that had error for modbus.1.holdingRegisters.40206_M_AC_Power, error-count=10
influxdb.0
	2023-05-26 22:10:39.795	warn	Error on writePoint("{"value":-675,"time":"2023-05-26T20:09:59.755Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.794	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.792	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=9
influxdb.0
	2023-05-26 22:10:39.792	warn	Error on writePoint("{"value":-690,"time":"2023-05-26T20:08:59.726Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.792	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.775	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=8
influxdb.0
	2023-05-26 22:10:39.775	warn	Error on writePoint("{"value":573,"time":"2023-05-26T20:07:19.660Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.774	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.756	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=8
influxdb.0
	2023-05-26 22:10:39.756	warn	Error on writePoint("{"value":-692,"time":"2023-05-26T20:10:19.746Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.756	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.754	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=7
influxdb.0
	2023-05-26 22:10:39.754	warn	Error on writePoint("{"value":-682,"time":"2023-05-26T20:09:19.697Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.753	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.679	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=6
influxdb.0
	2023-05-26 22:10:39.678	warn	Error on writePoint("{"value":-586,"time":"2023-05-26T20:07:59.606Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.678	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.453	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=7
influxdb.0
	2023-05-26 22:10:39.453	warn	Error on writePoint("{"value":773,"time":"2023-05-26T20:03:59.242Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.453	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:39.427	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=7
influxdb.0
	2023-05-26 22:10:39.427	warn	Error on writePoint("{"value":-773,"time":"2023-05-26T20:03:59.240Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:39.426	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:38.887	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=6
influxdb.0
	2023-05-26 22:10:38.887	warn	Error on writePoint("{"value":600,"time":"2023-05-26T20:06:38.470Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:38.886	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:38.884	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=5
influxdb.0
	2023-05-26 22:10:38.884	warn	Error on writePoint("{"value":-583,"time":"2023-05-26T20:06:18.277Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:38.884	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:38.882	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=6
influxdb.0
	2023-05-26 22:10:38.882	warn	Error on writePoint("{"value":-600,"time":"2023-05-26T20:06:38.469Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:38.882	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:38.880	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=5
influxdb.0
	2023-05-26 22:10:38.879	warn	Error on writePoint("{"value":686,"time":"2023-05-26T20:08:38.710Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:38.879	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:38.877	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=5
influxdb.0
	2023-05-26 22:10:38.877	warn	Error on writePoint("{"value":-599,"time":"2023-05-26T20:07:58.498Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:38.877	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:38.872	info	Add point that had error for javascript.0.Solar.Wechselrichter.Hausverbrauch to buffer again, error-count=4
influxdb.0
	2023-05-26 22:10:38.872	warn	Error on writePoint("{"value":625,"time":"2023-05-26T20:05:38.352Z","from":"system.adapter.javascript.0","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:38.872	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:38.868	info	Add point that had error for modbus.1.holdingRegisters.40206_M_AC_Power to buffer again, error-count=4
influxdb.0
	2023-05-26 22:10:38.868	warn	Error on writePoint("{"value":-630,"time":"2023-05-26T20:08:18.556Z","from":"system.adapter.modbus.1","q":0,"ack":true}): HttpError: unexpected error writing points to database: timeout / "unexpected error writing points to database: timeout""
influxdb.0
	2023-05-26 22:10:38.866	warn	Point could not be written to database: iobdata
influxdb.0
	2023-05-26 22:10:38.849	info	Add point that had error for javascript.0.Solar.Wechselrichter.ACTotalRealPower to buffer again, error-count=4

Wo genau muss ich nachschauen und worauf soll ich achten?

Marc Berg

@hennerich sagte in ioBroker Docker - InfluxDB Error bei hoher Disk I/O:

Wo genau muss ich nachschauen und worauf soll ich achten?

Also bei mir (Docker+Portainer) kann ich auf die Container Logs schauen, da steht dann sowas drin:

ts=2023-05-26T20:26:23.033009Z lvl=info msg="Snapshot for path written" log_id=0i2HUNW0000 service=storage-engine engine=tsm1 op_name=tsm1_cache_snapshot path=/var/lib/influxdb2/engine/data/2b42fccaf44c370d/autogen/2747 duration=218.588ms

ts=2023-05-26T20:26:23.033067Z lvl=info msg="Cache snapshot (end)" log_id=0i2HUNW0000 service=storage-engine engine=tsm1 op_name=tsm1_cache_snapshot op_event=end op_elapsed=218.661ms

ts=2023-05-26T20:27:51.815523Z lvl=info msg="Retention policy deletion check (start)" log_id=0i2HUNW0000 service=retention op_name=retention_delete_check op_event=start

ts=2023-05-26T20:27:51.816432Z lvl=info msg="Retention policy deletion check (end)" log_id=0i2HUNW0000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.947ms

ts=2023-05-26T20:35:02.035245Z lvl=info msg="TSI log compaction (start)" log_id=0i2HUNW0000 service=storage-engine index=tsi tsi1_partition=1 op_name=tsi1_compact_log_file tsi1_log_file_id=3 op_event=start

ts=2023-05-26T20:35:02.051768Z lvl=info msg="Log file compacted" log_id=0i2HUNW0000 service=storage-engine index=tsi tsi1_partition=1 op_name=tsi1_compact_log_file tsi1_log_file_id=3 elapsed=16ms bytes=1833 kb_per_sec=108

ts=2023-05-26T20:35:02.052216Z lvl=info msg="TSI log compaction (end)" log_id=0i2HUNW0000 service=storage-engine index=tsi tsi1_partition=1 op_name=tsi1_compact_log_file tsi1_log_file_id=3 op_event=end op_elapsed=17.005ms

Keine Ahnung, wie das bei dir aussieht. Die Idee war, dass man in diese Logs schaut, wenn die Timeouts auftreten, um zu sehen, was die DB in dieser Zeit macht.

Die 120 Sekunden finde ich ziemlich lang. Im Extremfall können dann 2min Daten verloren gehen. In den Konfigurationsbeispielen, die man so findet ist ja eher von Millisekunden die Rede.

@hennerich sagte in ioBroker Docker - InfluxDB Error bei hoher Disk I/O:

Wo genau muss ich nachschauen und worauf soll ich achten?

Moin,

nur als Beispiel, da ich keine influxDB auf meiner Syno als Docker habe, aber wenn Du auf der Syno Standard-Docker ohne Portainer nutzt, dann sollten die Logs hier einsehbar sein.

Beispiel:

Du kannst auch mal im Ressourcenmonitor der Syno schauen, ob da etwas auffälliges zu sehen ist

VG
Bernd

hennerich

Hey, danke für eure Ideen.
Ich hab auch Portainer und kann in die Logs schauen.
Nur hab ich davon keine Ahnung. Sowas steht da drin:

ts=2023-05-27T10:00:50.482078Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:01:00.399919Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:01:03.580933Z lvl=info msg="Error exhausting result iterator" log_id=0i2QNuH0000 service=task-executor error="runtime error @25:8-25:71: check: failed to evaluate map function: 20:40-20:49: interpolated expression produced a null value" name=wide-to12

ts=2023-05-27T10:01:10.398528Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:01:16.183890Z lvl=error msg="Failed to finish run" log_id=0i2QNuH0000 service=task-executor taskID=0ab8955a404fa000 runID=0b432937d8689000 error=timeout

ts=2023-05-27T10:01:20.401253Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:01:30.422068Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:01:40.394011Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:01:50.449177Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:02:00.398830Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:02:02.966146Z lvl=info msg="Error exhausting result iterator" log_id=0i2QNuH0000 service=task-executor error="runtime error @25:8-25:71: check: failed to evaluate map function: 20:40-20:49: interpolated expression produced a null value" name=wide-to12

ts=2023-05-27T10:02:10.429115Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:02:16.016547Z lvl=error msg="Failed to finish run" log_id=0i2QNuH0000 service=task-executor taskID=0ab8955a404fa000 runID=0b43297270a89000 error=timeout

ts=2023-05-27T10:02:20.443523Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:02:30.408063Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:02:40.403524Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:02:50.394245Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:03:00.463353Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:03:03.611349Z lvl=info msg="Error exhausting result iterator" log_id=0i2QNuH0000 service=task-executor error="runtime error @25:8-25:71: check: failed to evaluate map function: 20:40-20:49: interpolated expression produced a null value" name=wide-to12

ts=2023-05-27T10:03:10.524662Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:03:16.126425Z lvl=error msg="Failed to finish run" log_id=0i2QNuH0000 service=task-executor taskID=0ab8955a404fa000 runID=0b4329ad08689000 error=timeout

ts=2023-05-27T10:03:20.424070Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:03:28.204102Z lvl=info msg="Retention policy deletion check (start)" log_id=0i2QNuH0000 service=retention op_name=retention_delete_check op_event=start

ts=2023-05-27T10:03:28.204975Z lvl=info msg="Retention policy deletion check (end)" log_id=0i2QNuH0000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.896ms

ts=2023-05-27T10:03:30.422651Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:03:40.401910Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:03:50.465587Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

ts=2023-05-27T10:04:00.415541Z lvl=error msg="Unable to write gathered points" log_id=0i2QNuH0000 service=scraper scraper-name="OSS Monitoring" error=timeout

Seit gestern ist das ioBroker Log auf knapp 1GB angewachsen. Ich restarte jetzt den Adapter und lösche das Log.
Dann schauen wir mal, ob die 120s etwas gebracht haben.

hennerich

Update: als ich den Adapter neu gestartet habe, sind die Meldungen direkt wieder aufgetreten.
Ich kann nur vermuten, dass das an den 120s gelegen hat, denn nachdem ich den Wert zurück auf 0s (default) gestellt hatte, waren die Fehler wieder weg.

@hennerich sagte in ioBroker Docker - InfluxDB Error bei hoher Disk I/O:

Update: als ich den Adapter neu gestartet habe, sind die Meldungen direkt wieder aufgetreten.
Ich kann nur vermuten, dass das an den 120s gelegen hat, denn nachdem ich den Wert zurück auf 0s (default) gestellt hatte, waren die Fehler wieder weg.

Moin,

wie @Marc-Berg schon gesagt hat, 120s sind zu viel, denn als Standard ist 0, und in den Beispielen sind es ms also wenn Du mit diesem Parameter spielen möchtest, dann eher im ms Bereich und nicht im sek. Bereich.

Erklärung des Parameters https://docs.influxdata.com/influxdb/v2.7/reference/config-options/#influxd-flag-47

storage-wal-fsync-delay

Duration a write will wait before fsyncing. A duration greater than 0 batches multiple fsync calls. This is useful for slower disks or when WAL write contention is present.

Vielleicht ist das der bessere Wert, den Du anpassen kannst, Standard sind 10 sek. da kannst Du ja mal in Fünfer Schritten, die Zeit anpassen, INFLUXD_STORAGE_WRITE_TIMEOUT

storage-write-timeout

Maximum amount of time the storage engine will process a write request before timing out.

VG
Bernd

hennerich

Danke Bernd, hab ich eingestellt.
Du sag mal, wo genau in der Influx Doku hast du den denn gefunden? Wenn ich nach dem Parameter in Google suche, finde ich nicht wirklich was.

[Edit]
Habs gefunden: https://docs.influxdata.com/influxdb/v2.7/reference/config-options/#storage-write-timeout

@hennerich sagte in ioBroker Docker - InfluxDB Error bei hoher Disk I/O:

Danke Bernd, hab ich eingestellt.
Du sag mal, wo genau in der Influx Doku hast du den denn gefunden? Wenn ich nach dem Parameter in Google suche, finde ich nicht wirklich was.

Moin,

ich stöber immer beim Hersteller selbst
Das ist die Einstiegsseite https://docs.influxdata.com/influxdb/v2.7/# und dann entweder in der Suche oben links.
Das ist die Seite mit den Optionen https://docs.influxdata.com/influxdb/v2.7/reference/config-options/#

VG
Bernd

hennerich

kleines Zwischenfazit: heute Nacht war alles gut, kein Anstieg zu verzeichnen
Mal schauen wie sich das die nächsten Tage verhält

hennerich

So, ich hatte zwar zwischendrin (irgendwann mal im Laufe des Tages) wieder einen Vorfall, aber bis jetzt scheint es Nachts nach der Sicherung immer zu funktionieren.

@hennerich sagte in ioBroker Docker - InfluxDB Error bei hoher Disk I/O:

So, ich hatte zwar zwischendrin (irgendwann mal im Laufe des Tages) wieder einen Vorfall,

Moin,

erst einmal schön, dass es bei Dir jetzt etwas ruhiger zugeht und alles so weit funktioniert.

Wenn es passieren solltest, Du mal schauen, was Du gerade gemacht hast, am/im System und/oder schauen, was da die DiskStation gerade gemacht hat, vielleicht lief da gerade ein aufwändiger Task.

VG
Bernd

RikDRS

@glasfaser said in ioBroker Docker - InfluxDB Error bei hoher Disk I/O:

Ich kenne deine Grundeinstellungen in der Influx Instanz nicht ,
du könntest versuchen die Schreibaktionen zu sammeln

sie werden dann zwischengespeichert und einmalig von Influx in der eingestellten Zeit versendet .

Nachteil , sollte etwas in der Zwischenspeicherung / Zeit passieren , sind die Daten weg .

Bedenke .. Hyper Backup braucht viel Leistung , habe daher die Zeiten ( mehere Regeln ) versetzt eingestellt

Danke für diesen Tipp. Ich bin in den letzten Wochen ebenfalls mit dem oben beschriebenen Problem konfrontiert worden.
Habe nun versuchsweise die Schreibaktionen zusammenfassen auf 5 gestellt. Der Fehler tritt nicht mehr auf. Nun habe ich es seit drei Tagen auf 2 eingestellt, ebenfalls keine Fehlermeldungen mehr bis jetzt.

RikDRS

zu früh gefreut, der Fehler / das Problem tritt bei mir wieder auf...

Marc Berg

@rikdrs sagte in ioBroker Docker - InfluxDB Error bei hoher Disk I/O:

zu früh gefreut, der Fehler / das Problem tritt bei mir wieder auf...

Das hätte mich auch gewundert, da die vermeintliche Lösung am Problem vorbei geht. Dies besteht aus meiner Sicht darin, dass die InfluxDB regelmäßig Aufräum ("Compactions")-Arbeiten durchführt. Diese sind durch eine sehr starke I/O-Last erkennbar. Wenn das Verhältnis (Menge der Daten / Leistungsfähigkeit der Hardware) zu schlecht wird, laufen diese Jobs extrem lang, in dieser Zeit sind Write-Errors zu beobachten.

Du könntest zum einen versuchen, die Anzahl der "Concurrent compactions" auf "1" zu setzen.

Wesentlich erfolgversprechender ist es aber, die Menge an Daten radikal zu reduzieren. Schau mal, wo die meisten herkommen:

from(bucket: "iobroker")
|> range(start: -10y)
|> filter(fn: (r) => r["_field"] == "value")
|> count()
|> group()
|> keep(columns: ["_measurement", "_value"])
|> sort(columns: ["_value"], desc: true)
|> rename(columns: {_value: "Anzahl"})

NEWS

ioBroker Docker - InfluxDB Error bei hoher Disk I/O

closed failed to store statistics: timeout 1.2.0 #8036

Support us

1.7k
Online

30.4k
Users

76.7k
Topics

1.2m
Posts

NEWS

ioBroker Docker - InfluxDB Error bei hoher Disk I/O

closed failed to store statistics: timeout 1.2.0 #8036

Support us

1.7kOnline

30.4kUsers

76.7kTopics

1.2mPosts

1.7k
Online

30.4k
Users

76.7k
Topics

1.2m
Posts