melodic-magician-71351
01/26/2023, 11:18 AMFlyteDirectory
inputs to a ContainerTask
? It seems like the download step doesn't correctly handle directories?
with inputs=dict(path=FlyteDirectory)
we're getting
Failed to download from ref [<gs://cradle-bio-pipelines/i9/f7aac4450113a425b905-n0-0/path>]
where that path does exist.melodic-magician-71351
01/26/2023, 1:28 PMfreezing-airport-6809
quaint-diamond-37493
01/26/2023, 3:27 PMquaint-diamond-37493
01/26/2023, 3:33 PMhallowed-mouse-14616
01/26/2023, 3:40 PMfreezing-airport-6809
freezing-airport-6809
freezing-airport-6809
hallowed-mouse-14616
01/26/2023, 3:42 PMquaint-diamond-37493
01/26/2023, 3:43 PMquaint-diamond-37493
01/26/2023, 3:43 PMhallowed-mouse-14616
01/26/2023, 3:44 PMhallowed-mouse-14616
01/26/2023, 5:35 PMquaint-diamond-37493
01/26/2023, 6:21 PMmelodic-magician-71351
01/30/2023, 1:19 PMloud-belgium-4006
04/24/2023, 12:09 AMbt = ContainerTask(
name="basic-test",
input_data_dir="/var/inputs",
output_data_dir="/var/outputs",
inputs=kwtypes(indir=FlyteDirectory),
outputs=kwtypes(),
image="<http://ghcr.io/flyteorg/rawcontainers-shell:v2|ghcr.io/flyteorg/rawcontainers-shell:v2>",
command=[
"ls",
"-la",
"/var/inputs",
],
)
@task
def get_dir(dirpath: str) -> FlyteDirectory:
fd = FlyteDirectory(path=dirpath)
return fd
@workflow
def wf():
fd = get_dir(dirpath='<s3://my-s3-bucket/cv-in>')
bt(indir=fd)
loud-belgium-4006
04/24/2023, 12:10 AMmelodic-magician-71351
04/27/2023, 8:45 AMloud-belgium-4006
04/29/2023, 4:03 AM