Andrew Achkar02/03/2023, 7:32 PM
Andrew Achkar02/03/2023, 9:44 PM
that would get populated with the object(s) when they are stored to the backend storage layer like s3. Being able to set tags on objects would help for purposes like record keeping (eg. which project created these objects) and might assist with other things like automated deletion using lifecycle policies that filter based on tag keys/values. I think I see a way to do it in flytekit as-is, so I'm curious if the persistence layer is being overhauled whether it would still be compatible or perhaps even easier to add such a capability.
Andrew Achkar02/06/2023, 2:17 PM
as an optional to the
) constructor. This means you only get tags if you return a
and populate this optional kwarg - which preserves the simpler case in backwards compatible way, but allows for more advanced scenarios to opt-in. This makes it possible to populate tag values with runtime information as well.