Ethan Brown
11/29/2023, 3:09 PM{"json":{},"level":"fatal","msg":"Lost leader state. Shutting down.","ts":"2023-11-29T150420Z"}Is this common... or indicative of something that could be misbehaving within the cluster? (The cluster is mostly idling)
Thomas Newton
11/29/2023, 4:01 PMlease-duration: 15s
renew-deadline: 10s
retry-period: 2s
So every 15 seconds it makes a request to the kub-apiserver to renew the lease. If it can't get a successful response within 10 seconds then flytepropeller will restart.
I changed to using:
lease-duration: 120s
renew-deadline: 110s
retry-period: 5s
This seems to have helped quite a lot in our usecase.Thomas Newton
11/29/2023, 4:02 PMDan Rammer (hamersaw)
11/29/2023, 5:31 PMThomas Newton
11/29/2023, 5:59 PMEthan Brown
11/29/2023, 6:09 PM