Evan Sadler
01/25/2023, 9:34 PMNiels Bantilan
01/25/2023, 10:04 PMremote_path
argument, but even for that I’m not sure if that only applies when the task is executed on a Flyte cluster.Evan Sadler
01/25/2023, 10:43 PMKevin Su
01/25/2023, 10:50 PMexport AWS_ACCESS_KEY_ID=
export AWS_SECRET_ACCESS_KEY=
export AWS_ENDPOINT=<https://s3.amazonaws.com>
export AWS_DEFAULT_REGION=us-east-2
and use something like
@task
def t1(a: StructuredDataset) :
…
t1(a=StructuredDataset(uri=“s3://bucket/key”))Evan Sadler
01/25/2023, 10:52 PMKevin Su
01/25/2023, 10:52 PMNiels Bantilan
01/25/2023, 11:01 PMSlackbot
01/25/2023, 11:01 PMEvan Sadler
01/27/2023, 12:23 AM