Good morning!
I've been diving in the documentation, and also searching here. Still, have some questions regarding the Flyte framework/tools:
• Is it possible to set post-processing steps after error recovery?
• is it possible to search in workflow logs?
• is there the possibility of restricting workflow operations for certain users/groups?
• any planned integration with Clickhouse? or is it possible to do it currently?
• are there any options for official paid support?
also, please, if you have any experiences about any of these points, I'd be glad to hear about it. Thanks
t
tall-lock-23197
11/24/2022, 1:43 PM
cc: @freezing-airport-6809
f
freezing-airport-6809
11/24/2022, 3:42 PM
Hi @cool-needle-87868 welcome to the community. Firstly we try to keep open source and commercial stuff separate
Union.ai offers a commercial version https://www.union.ai/cloud. Cc @lemon-solstice-15641
We can dm and talk
Now to answer questions
1. There is infact error recovery cleanup support. Flytekit today does not expose this, it is planned for q1 2023. https://github.com/flyteorg/flyte/issues/1506
2. You cannot search in Flyte. But you can send logs to your preferred logging system and Flyte can link to it. https://docs.flyte.org/projects/cookbook/en/stable/auto/deployment/configure_logging_links.html
3. Not planned for Flyte yet. But sso is oob
4. You can integrate with clickhouse. Flytekit integration should be trivial. Some work that will super simplify writing backend plugins is also planned soon. Rfc will be out next week
c
cool-needle-87868
11/28/2022, 10:32 AM
Thanks a mil for the answers @freezing-airport-6809