Are folks using Flyte to do hyperparameter optimization to the scale of 1.4k tasks in a single workflow? We are hitting error from K8S request entity too large, where Fyte propeller OSS did make a patch explicitly for this.

Hi, is there a way to get try / catch behavior in a Flyte workflow. I have a workflow where one of the tasks can fail to run. If it fails to run, I would like to perform different steps vs when it succeeds. Something like this:

@workflow
def wf():
    try:
        output0 = t0()
    except Exception:
        return handle_failure(...)
    
    return handle_success(...)

One way I can think of achieving this behavior is to move the try/catch inside

t0

, and conditioning on the output. Ideally I would like to reflect in the state of the workflow execution that t0 failed. Is there a better way to do this?

Hi community, does anyone know how to throw an exception to be user exception within the execute function when writing backend plugin?

Hi everyone, I have question related to workflows that have many tasks that are executed in a different system (for example, hive or spark), Does flyte create one pod for each task? I am trying to study the performance impact of this situation when we have high fanout workflows of this kind. any pointers will be helpful.

Hello guys i get this error

Failed to check if the image exists with error : Error while fetching server API version: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory'))

for this command

pyflyte --config ~/.flyte/config.yaml register ...

i am using GCP artifact for my registry .

what is the recommended set up for training distributed pytorch models? Found this guide but the kubeflow pytorch operator is now deprecated. is it better to use ray?

Hi flyte team, I integrated our OIDC provider for flyteadmin auth. But its failing during OIDC callback with the following error. It looks to be cookie that it generates using the auth_code becomes bigger than 4096 [gorilla securecookie implementation](https://github.com/gorilla/securecookie/blob/master/securecookie.go#L256-L259). Any ideas on how to fix this ?

{"json":{"src":"handlers.go:161"},"level":"error","msg":"Error setting encrypted JWT cookie [SECURE_COOKIE_ERROR] Error creating secure cookie, caused by: securecookie: the value is too long","ts":"2022-07-01T07:41:05Z"}

Hello, Can Polars dataframe be used as flyte task input & output params out of the box? Since which version of flyte it’s supported. I am using flyte 1.2.4.

@Hampus Rosvall @Prafulla Mahindrakar Let’s discuss auth here

Hey is there anyway to mock the NamedTuple output of a task and have that output then used in a seperate task? I have a situation where I have a task with some output

class GenerateOutputs(NamedTuple):
        uri: str
    
    @reference_task(
        ...
    )
    def generate(
        input:str 
    ) -> GenerateOutputs:
    ... 
    
    @workflow
    def my_wf(
        input="default_input"
    ) -> str:
    output = generate(
        input:str=input
    )
    return output.uri

However anytime I try to mock this out with something like

class TestNamedTuple(TestCase):
    def test_run_workflow(self):
        with task_mock(generate) as fake_generate:
            fake_generate.return_value = GenerateOutputs(uri="test_uri")
            uri = my_wf()
            self.assertIsNotNone(uri)

I get an error like :

AttributeError: 'Promise' object has no attribute 'uri'

How do I properly mock a task that has a namedTuple output with only one attribute?