Eli Bixby
01/26/2023, 11:18 AMFlyteDirectory
inputs to a ContainerTask
? It seems like the download step doesn't correctly handle directories?
with inputs=dict(path=FlyteDirectory)
we're getting
Failed to download from ref [<gs://cradle-bio-pipelines/i9/f7aac4450113a425b905-n0-0/path>]
where that path does exist.Ketan (kumare3)
Felix Ruess
01/26/2023, 3:27 PMDan Rammer (hamersaw)
01/26/2023, 3:40 PMKetan (kumare3)
Dan Rammer (hamersaw)
01/26/2023, 3:42 PMFelix Ruess
01/26/2023, 3:43 PMDan Rammer (hamersaw)
01/26/2023, 3:44 PMFelix Ruess
01/26/2023, 6:21 PMEli Bixby
01/30/2023, 1:19 PMPryce
04/24/2023, 12:09 AMbt = ContainerTask(
name="basic-test",
input_data_dir="/var/inputs",
output_data_dir="/var/outputs",
inputs=kwtypes(indir=FlyteDirectory),
outputs=kwtypes(),
image="<http://ghcr.io/flyteorg/rawcontainers-shell:v2|ghcr.io/flyteorg/rawcontainers-shell:v2>",
command=[
"ls",
"-la",
"/var/inputs",
],
)
@task
def get_dir(dirpath: str) -> FlyteDirectory:
fd = FlyteDirectory(path=dirpath)
return fd
@workflow
def wf():
fd = get_dir(dirpath='<s3://my-s3-bucket/cv-in>')
bt(indir=fd)
Eli Bixby
04/27/2023, 8:45 AMPryce
04/29/2023, 4:03 AM