We chatted a lot about this with @thankful-minister-83577 last fall, and got to a point where I would have needed to start experimenting with implementing some rudimentary support for emitting different types of events from Flyte. Life however got in the way and I have not been able the work on this since. The idea we were discussing was indeed to emit event from Flyte that then would be translated into Datahub/Amundsen/OpenLineage/etc events by a catalog-specific translator service. The event needs have been mapped out (to some extent) in this document, but it might be quite a tall order for me to start implementing these in Flyte in my current situation. Any help on this front would be highly appreciated. I’d be happy to work on a reference event translator (for datahub), though!

@colossal-painter-70298 can you guide @dry-ability-69144

I can bring him up to speed, at least 😄

That’s great.

@dry-ability-69144 , ping me to set up a call of some sorts! 👍