Hi Folks! Hope you are doing well. I hoped in because I have a quick Q in regards to a demo I'm putting together for my team. Whenever I use any map task, I've been getting an error: currentAttempt done. Last Error: UNKNOWN::Outputs not generated by task execution here's the code I've been working with. I've blocked out the actual functionality since the error seems to persist no matter what is done. the code was working entirely until the process task was changed to a map task. Due to enterprise constraints we're running flyte "the hard way" with onprem kube, but wondering if anyone has had a similar bug and knows what they did to resolve!

pt = PodTemplate(
        pod_spec=V1PodSpec(
            containers=[
                V1Container(
                    name="primary",
                    volume_mounts=[
                        V1VolumeMount(
                            name="wip",
                            mount_path="/mnt/WIP/",
                            read_only = True,
                        ),
                        V1VolumeMount(
                            name="models",
                            mount_path="/models/",
                            read_only = True,
                        ),
                        V1VolumeMount(
                            name="files",
                            mount_path="/mnt/files/",
                            read_only = False,
                        )
                    ],
                    security_context=V1PodSecurityContext(run_as_user= 0,),
                ),
            ],
            volumes=[
                V1Volume(
                    name="wip",
                    host_path= V1HostPathVolumeSource("/mnt/wip/"),
                ),
                V1Volume(
                    name="models",
                    host_path= V1HostPathVolumeSource("/models/"),
                
                ),
                  V1Volume(
                    name="files",
                    host_path= V1HostPathVolumeSource("/mnt/files/"),
                
                )
            ],
        ))

@task(container_image=img)
def collectData(batch : str) -> list[str]:
    #extracts a list of paths to seek

@task(pod_template=pt,
    requests=Resources(
        mem="2G",
    ),container_image=img)
def process(plate : str) -> np.ndarray:
    #applies ML ops to images and generates an array of data, writes to a disk

@task(container_image=img)
def coalesce(arrays : list[np.ndarray]) -> np.ndarray:
    return numpy.concatenate( arrays, axis=0 )


@workflow
def mlPipeline(batch: str = "98723") -> np.ndarray:
    plates = collectData(batch = batch)
    arrays = map_task(process)(plate=plates)
    return coalesce(arrays = arrays)

can you just run

pyflyte run --remote x.py process --plate ...

Hey @wide-application-96237, this is interesting.. Would you mind sharing what version of flytekit you're using and a screenshot of the console where the error is being shown?

Sure-- can do. We're using Flyte server 1.13 and pyflyte 1.12.1. The issue was originally on 1.12 server so I updated to 1.13 to see if it'd fix it but no dice.

Thanks for sending all that through! Will be taking a look today.

@eager-processor-63090 -- thanks for looking into this. Will give it a shot with the legacy map tasks in 11 and let you know if I see any change!