https://flyte.org logo
#ask-the-community
Title
# ask-the-community
j

Jay Ganbat

06/21/2023, 8:38 PM
Hi flyte folks, in Flytekit
v1.4.2
does Flytefile upload create a tmp file in the pod, i was looking at the source code and this is the data_persistence.py
put
method
Copy code
def put(self, from_path: str, to_path: str, recursive: bool = False):
        if from_path != to_path:
            if recursive:
                self.copy_tree(from_path, to_path)
            else:
                # Emulate s3's flat storage by automatically creating directory path
                self._make_local_path(os.path.dirname(self.strip_file_header(to_path)))
                # Write the object to a local file in the temp local folder
                copyfile(self.strip_file_header(from_path), self.strip_file_header(to_path))
it mentions writing an object to temp local dir.
ok maybe the above code excerpt applies only to local run 🤔
y

Yee

06/21/2023, 11:53 PM
yeah… cuz we wanted local run to mimic as much as possible.
so for local exec we pretend that remote is just another folder
73 Views