👋 after upgrading to Flyte backend + flytekit to 1.15, we've recently started seeing some unexpected cache misses for tasks where the signature should be the same when I dived deeper, I noticed this error from datacatalog emitted here which seems to be the cause:

err missing entity of type Tag with identifier

so I queried our DB for the tag name, dataset fields in the logs but I do see a row exists in the

tags

table, so I'm unsure why datacatalog might report this - has anyone seen this or have ideas? I also looked at our DB metrics too and doesn't seem like there were any latency spikes, and it seems consistent for particular tasks whereas other tasks are able to query cache fine. I wasn't able to identify anything unique about the problematic tasks either, and they all use

cache_serializable

@gentle-night-59824 do you have a reproducible example?

hey david, thanks for replying! this is actually the same as this thread, so we can probably merge this there