numerous-hamburger-7178
10/21/2022, 10:26 PMpyflyte register -p project_name -d domain_name --output <s3://my-s3-bucket/raw_data>
<-- subbing in my own bucket, I get FileNotFoundError: [Errno 2] No such file or directory: '<GIT REPO PATH>/s3:/my-s3-bucket/fast-serialize/fast3e198a8e9dd654e746828c0ae929fce3.tar.gz'
and when I don't feed in a --output
, it creates a new folder inside my-s3-bucket
. When I run it from the UI, I get tar: development/fast3e198a8e9dd654e746828c0ae929fce3.tar.gz: Cannot open: Not a directory
thankful-minister-83577
pyflyte register
you can still run pyflyte package
and then flytectl register
. Here’s a short doc that describes the difference between them.thankful-minister-83577
thankful-minister-83577
--output
switch you mention is meant for local use. that’s where the proto artifacts are saved in between those two steps.thankful-minister-83577
numerous-hamburger-7178
10/24/2022, 3:16 PMtar: development/fast3e198a8e9dd654e746828c0ae929fce3.tar.gz: Cannot open: Not a directory
when I try running a task after doing pyflyte register
subprocess.CalledProcessError: Command '['tar', '-xvf', 'development/fast3e198a8e9dd654e746828c0ae929fce3.tar.gz', '-C', 'development']' returned non-zero exit status 2.
numerous-hamburger-7178
10/24/2022, 3:48 PM-d
is mapped to domain and destination-dir?numerous-hamburger-7178
10/24/2022, 4:14 PMpyflyte-fast-execute
@task # original docker task
def fast_serialize_test_task(test_int: int) -> str:
return str(test_int + 1)
@task # fast serialized
def fast_serialize_test_task(test_int: int) -> str:
return str(test_int + 1)
When I look at the file inside the tar.gz, I see the new version of the taskthankful-minister-83577
numerous-hamburger-7178
10/24/2022, 5:58 PMthankful-minister-83577
numerous-hamburger-7178
10/24/2022, 6:01 PMnumerous-hamburger-7178
10/24/2022, 6:02 PM/<repo>/src
so I set the destination dir to /<repo>/src
alsothankful-minister-83577
high-accountant-32689
10/26/2022, 5:11 PMWORKDIR
in your dockerfile.numerous-hamburger-7178
10/26/2022, 5:13 PMhigh-accountant-32689
10/26/2022, 5:15 PMnumerous-hamburger-7178
10/26/2022, 5:16 PM