Hi. I'm evaluating flyte deployed on eks.
i'd like...
# flyte-supportc
cold-ram-85
03/19/2025, 6:36 PMHi. I'm evaluating flyte deployed on eks.
i'd like to be able to use pyflyte run to run /develop scientific workflows
i've noticed that pyflyte run is very slow for me, i tracked it down to this line https://github.com/flyteorg/flytekit/blob/master/flytekit/remote/remote.py#L1195C1-L1195C24
it seems to be able to take on average about 2 minutes to upload a small file (about 300 characters)
any ideas what might cause this?
a
average-finland-92144
03/19/2025, 10:40 PMWelcome @cold-ram-85
So the steps involved in pyflyte include packaging and zipping your code (compiled by flytekit), obtaining a signed URL (as you pointed out) and then uploading the tarball to S3.
Assuming there are no proxies in the middle, it shouldn't take that long.
Could you get logs from the flyte pod?
c
cold-ram-85
03/20/2025, 3:31 PMwhat pod?
cold-ram-85
03/20/2025, 3:33 PMwe do use zscaler @average-finland-92144 but there shouldn't be that much of a delay regardless.
cold-ram-85
03/20/2025, 3:35 PMthe error seems to be -baseed on added print statements - specifically with the small input file i have which is a FlyteFile and is passed into pyflyte run --input_file myinput.yaml
cold-ram-85
03/20/2025, 3:36 PMall of the other get signed url steps take <0.5 seconds
cold-ram-85
03/20/2025, 3:39 PMspecifically - there is no pod yet, pyflyte run is done on a local machine.
2 Views