Hello, I am following this example for <defining a...
# flyte-support
c
Hello, I am following this example for defining a custom type as a template for my own custom type transformer, but am having trouble getting caching to work with it. • I think the issue might be be the random non-deterministic
uri
being returned from
to_literal
method in the example (I am using
uri
to store the path where the object is being stored using my custom serialization logic that is not json) I think the fix might be to return a deterministic
Literal
from my custom typetransformer’s
to_literal
method (by making the
uri
deterministic) Curious if there are are any examples/pointers for this? Or if someone has figured out a simpler way to do this 🙂
t
that is true in that that’s likely what’s happening yeah.
and the issue is that you want tasks downstream of this task, to not run correct? (because the output hasn’t really changed, just the uri)
c
and the issue is that you want tasks downstream of this task, to not run correct?
Yes, that is correct
I was previously using
ctx.file_access.get_random_remote_path
but that obviously causes misses
t
sorry got sidetracked with something
you should probably control this with hash method.