I used to use an older version of Cribl that just worked using the supplied docker compose example.
Now I upgraded to 4.9.3 (also tried 4.10.0) and nothing works anymore:
- I already changed the env vars from "Master" to "Leader" (tough change!)
- I also tried to disable gitops, CRIBL_GIT_OPS=none
However:
- Despite that none setting, the server complains about not having git
- workers cannot connect (ECONNREFUSED)
- I cannot get into the GUI (ECONNREFUSED)
2025-02-25T11:52:09.860Z ERR boot failed, checking for rollback | cid=api channel=cribl reason={"message":"no versioning available","stack":"Error: no versioning available\n at new b (/opt/cribl/bin/cribl.js:15:7096923)\n at P.setupInheritance (/opt/cribl/bin/cribl.js:15:7619887)\n at /opt/cribl/bin/cribl.js:15:12733811"}2025-02-25T11:52:09.860Z ERR failed to start Cribl server, exiting... | cid=api channel=cribl reason={"message":"no versioning available","stack":"Error: no versioning available\n at new b (/opt/cribl/bin/cribl.js:15:7096923)\n at P.setupInheritance (/opt/cribl/bin/cribl.js:15:7619887)\n at /opt/cribl/bin/cribl.js:15:12733811"}2025-02-25T11:52:10.856Z INF active metrics | cid=api channel=MetricsStore numMetrics=1At the workers side:
2025-02-25T12:02:33.801Z DBG connecting | cid=api channel=output:DistWorker host=dgam-cribl-master port=4200 tls=false2025-02-25T12:02:33.804Z ERR connection error | cid=api channel=output:DistWorker error=connect ECONNREFUSED 172.26.0.2:4200 endpoint={"host":"dgam-cribl-master","port":4200,"tls":false} errno=-1112025-02-25T12:02:33.804Z DBG will retry to connect | cid=api channel=output:DistWorker nextConnectTime=17404850138042025-02-25T12:02:50.138Z WRN sending is blocked | cid=api channel=output:DistWorker since=1740484337 elapsed=632 endpoint={"host":"dgam-cribl-master","port":4200,"tls":false}And as said: can't connect to the GUI.
Any idea what is going wrong here?
In some cases (other settings) the worker tries to connect to the leader but fails with authentication: cannot parse json string.