Hi all I m running into a strange issue when using a custom

Question

Hi all I m running into a strange issue when using a custom type transformer in a workflow that contains nested ` dynamic` tasks Specifically something like this works fine ``` dynamic def terminus myobj MyCustomType key str gt float results dict str Promise = myobj call some flytekit tasks return results key workflow def wf myobj MyCustomType gt float return terminus myobj=myobj key= foo ``` But passing `myobj` through another ` dynamic` like this does not ``` dynamic def terminus myobj MyCustomType key str gt float results dict str Promise = myobj call some flytekit tasks return results key dynamic def passthrough myobj MyCustomType gt float return terminus myobj=myobj key= foo workflow def wf myobj MyCustomType gt float return passthrough myobj=myobj ``` Local execution works in both cases but remote execution hangs in the latter case in the following state the `passthrough` task fails but the workflow remains in a running state until it finally fails with this error message ```Workflow flytetester development failed RuntimeExecutionError max number of system retry attempts 51 50 exhausted Last known status message Workflow flytetester development failed CausedByError Failed to propagate Abort for workflow Error 0 0 User malformed dynamic workflow caused by Collected Errors 2 Error 0 Code MismatchingBindings Node Id dn0 Description Input myobj on node dn0 expects bindings of type map value type lt blob lt gt gt Received ``` Have I committed a flytepropeller faux pas flytekit 1 9 1

Samhita Alla · Answer

Hi < Bradley Worley> I just tested a simple nested dynamic workflow and it works for me

Bradley Worley · Answer

Thanks Samhita did you do anything differently that could shed some light on why my example above is failing In particular if I remove the `myobj` argument from the `terminus` dynamic task remote execution works fine Any tips for how to debug this Wrapping the methods of the type transformer in `try except logging error ` does not result in any extra information written to logs

Bradley Worley · Answer

If it helps here is my type transformer ```class MyTypeTransformer TypeTransformer MyCustomType def init self super init MyCustomType t=MyCustomType self base type = dict str FlyteFile self base impl = DictTransformer def get literal type self t Type MyCustomType gt LiteralType return self base impl get literal type t=self base type def to literal self ctx FlyteContext python val MyCustomType python type Type MyCustomType expected LiteralType gt Literal flyte files = python val pack return self base impl to literal ctx flyte files self base type expected def to python value self ctx FlyteContext lv Literal expected python type Type MyCustomType gt MyCustomType flyte files = self base impl to python value ctx lv self base type return MyCustomType unpack flyte files ``` It uses two methods on `MyCustomType` An instance method `pack MyCustomType gt dict str FlyteFile ` A class method `unpack dict str FlyteFile gt MyCustomType`

Bradley Worley · Answer

As you can see it s a very thin wrapper around `DictTransformer`

Bradley Worley · Answer

Replacing `MyCustomType` with `dict str FlyteFile ` in the `terminus` dynamic task resolves the error and results in successful remote execution

Samhita Alla · Answer

Okay `MyCustomType` has to work too Not sure why it is failing I ll try to reproduce it on my end but please feel free to create an issue

Bradley Worley · Answer

Thanks for you help Samhita I ve filed <https github com flyteorg flyte issues 4057|an issue here>