Hi Flyte community! I’m Geoff, Data Engineer Lead at DMD. I read a blog post yesterday from Spotify about Flyte. I am actively looking in a replacement for our current orchestration tool (Talend). Looks like Flyte could be a good alternative(!!) I am still unsure how this can integrate in my current solution (I am building Spark jar files that runs in AWS/emr) so I am here to ask questions and work on a POC. Thanks in advance for the support!

Hi Geoff, firstly welcome to the community and thank you for introducing. At the moment we do not have an emergency Plugin, but you can do that in the simplest way by writing a python flytekit plugin. Over the longer term we will build a plugin like Flyte k8s spark To write a plugin is really simple - as in here https://docs.flyte.org/projects/cookbook/en/latest/auto/core/extend_flyte/custom_task_plugin.html But also remember every task is simply a python function. You can just write a reusable task

Thank you very much! I will look into it!

absolutely

@billions-gold-8765, here are links to the office hours for tomorrow: • Wednesday March 30, 7am PT: https://www.addevent.com/event/zF10349020/ • Wednesday March 30, 9pm PT: https://www.addevent.com/event/dQ10349168/