Andrew Epstein
05/02/2023, 8:19 PMgcloud storage cp -r …
inside of a Flyte workflow, I am able to download the same exact files at approximately 1.7GB/s, and I see usage of ~20 CPU cores (the workflow requests 32 cpu cores). I observe the same behavior when uploading files to GCS as well. How can I still make use of FlyteFiles/FlyteFolders and the automatic download/upload functionality, but get faster download/upload speed?Yee
Andrew Epstein
05/02/2023, 11:09 PMYee
pip show flytekit
Andrew Epstein
05/02/2023, 11:09 PMYee
Andrew Epstein
05/02/2023, 11:10 PMKetan (kumare3)
jeev
Yee