Xinzhou Liu
05/02/2023, 6:28 AMDan Rammer (hamersaw)
05/02/2023, 2:31 PMXinzhou Liu
05/02/2023, 4:26 PMDan Rammer (hamersaw)
05/02/2023, 7:48 PMBtw, does Flyte’s scalability also depend on the cluster configuration?can you say a little more about this? Flyte just relies on a k8s cluster, the number of nodes and corresponding resource availability will put restrictions on how fast things run. But when scaling the Flyte core isn't typically the bottleneck, rather the k8s cluster -- in which case we do support multi-cluster as well (ie. scheduling tasks on multiple k8s clusters). So there isn't necessarily specific k8s configuration for scaling, rather adding additional resources.
Xinzhou Liu
05/02/2023, 7:52 PMDebug string UNKNOWN:Error received from peer ipv4:10.79.160.119:443 {created_time:"2023-05-01T20:09:03.49763948+00:00", grpc_status:14, grpc_message:"unavailable"}
Dan Rammer (hamersaw)
05/02/2023, 8:02 PMXinzhou Liu
05/02/2023, 9:16 PM[20230501 20:09:04 ERROR] Registering against <http://flyte.company.xyz|flyte.company.xyz>
[20230501 20:09:04 ERROR] Detected Root /app/path/to/__main__, using this to create deployable package...
[20230501 20:09:04 ERROR] No output path provided, using a temporary directory at /tmp/tmpvtnuhkjl instead
[20230501 20:09:04 ERROR] Failed with Exception: Reason: SYSTEM:Unknown
[20230501 20:09:04 ERROR] RPC Failed, with Status: StatusCode.UNAVAILABLE
[20230501 20:09:04 ERROR] details: unavailable
[20230501 20:09:04 ERROR] Debug string UNKNOWN:Error received from peer ipv4:10.79.160.119:443 {created_time:"2023-05-01T20:09:03.49763948+00:00", grpc_status:14, grpc_message:"unavailable"}
Dan Rammer (hamersaw)
05/03/2023, 2:42 PMpyflyte run ...
then?Xinzhou Liu
05/03/2023, 3:47 PMpyflyte reigster