Laura Lin
10/21/2022, 10:26 PMpyflyte register -p project_name -d domain_name --output <s3://my-s3-bucket/raw_data>
<-- subbing in my own bucket, I get FileNotFoundError: [Errno 2] No such file or directory: '<GIT REPO PATH>/s3:/my-s3-bucket/fast-serialize/fast3e198a8e9dd654e746828c0ae929fce3.tar.gz'
and when I don't feed in a --output
, it creates a new folder inside my-s3-bucket
. When I run it from the UI, I get tar: development/fast3e198a8e9dd654e746828c0ae929fce3.tar.gz: Cannot open: Not a directory
Yee
pyflyte register
you can still run pyflyte package
and then flytectl register
. Here’s a short doc that describes the difference between them.--output
switch you mention is meant for local use. that’s where the proto artifacts are saved in between those two steps.Laura Lin
10/24/2022, 3:16 PMtar: development/fast3e198a8e9dd654e746828c0ae929fce3.tar.gz: Cannot open: Not a directory
when I try running a task after doing pyflyte register
subprocess.CalledProcessError: Command '['tar', '-xvf', 'development/fast3e198a8e9dd654e746828c0ae929fce3.tar.gz', '-C', 'development']' returned non-zero exit status 2.
-d
is mapped to domain and destination-dir?pyflyte-fast-execute
@task # original docker task
def fast_serialize_test_task(test_int: int) -> str:
return str(test_int + 1)
@task # fast serialized
def fast_serialize_test_task(test_int: int) -> str:
return str(test_int + 1)
When I look at the file inside the tar.gz, I see the new version of the taskYee
Laura Lin
10/24/2022, 5:58 PMYee
Laura Lin
10/24/2022, 6:01 PM/<repo>/src
so I set the destination dir to /<repo>/src
alsoYee
Eduardo Apolinario (eapolinario)
10/26/2022, 5:11 PMWORKDIR
in your dockerfile.Laura Lin
10/26/2022, 5:13 PMEduardo Apolinario (eapolinario)
10/26/2022, 5:15 PMLaura Lin
10/26/2022, 5:16 PM