acoustic-carpenter-78188
05/31/2023, 10:47 PMWithDeadline
with an optionally configurable deadline set in config
What if we do not do this?
See https://grpc.io/blog/deadlines/
In general, when you don’t set a deadline, resources will be held for all in-flight requests, and all requests can potentially reach the maximum timeout. This puts the service at risk of running out of resources, like memory, which would increase the latency of the service, or could crash the entire process in the worst case.Related component(s) flyteidl Are you sure this issue hasn't been raised already? ☑︎ Yes Have you read the Code of Conduct? ☑︎ Yes flyteorg/flyte
acoustic-carpenter-78188
06/05/2023, 9:28 PM