Question, is it possible to get the remote paths o...
# flyte-support
g
Question, is it possible to get the remote paths of the files in a
FlyteDirectory
without downloading them into a task? The reason I ask is that I currently download them to my task's container and then do some string editing of the paths and send them to a service for the actual processing. The downloading right now seems to take about a minute-90 seconds. If I could have the paths directly and wouldn't require to download them that'd shave those minute-90 seconds of waiting time from my task which would be great
Ooh. A listdir function exists
Still, seems like it at most can give me the
remote_path
isntead of listing all the files
c
@gentle-tomato-480, you can use
FlyteDirectory.crawl