does Flytefile upload create a tmp file in the pod, i was looking at the source code and this is the data_persistence.py
put
method
Copy code
def put(self, from_path: str, to_path: str, recursive: bool = False):
if from_path != to_path:
if recursive:
self.copy_tree(from_path, to_path)
else:
# Emulate s3's flat storage by automatically creating directory path
self._make_local_path(os.path.dirname(self.strip_file_header(to_path)))
# Write the object to a local file in the temp local folder
copyfile(self.strip_file_header(from_path), self.strip_file_header(to_path))
it mentions writing an object to temp local dir.
magnificent-teacher-86590
06/21/2023, 8:49 PM
ok maybe the above code excerpt applies only to local run 🤔
t
thankful-minister-83577
06/21/2023, 11:53 PM
yeah… cuz we wanted local run to mimic as much as possible.
thankful-minister-83577
06/21/2023, 11:53 PM
so for local exec we pretend that remote is just another folder