Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

Hello all, I am Martin and currently exploring capabilities of Flyte for data workflows.

Hi Martin and welcome to the Flyte community!

I guess you probably already explored, but here are some resources:

<https://flyte.org/data>

<https://docs.flyte.org/projects/cookbook/en/latest/auto/case_studies/ml_training/spark_horovod/index.html>

<https://flyte.org/blog/orchestrating-data-pipelines-at-lyft-comparing-flyte-and-airflow>

In any case, please let the community know any question you may have.

Thank you!

Welcome to the community Martin. Great to have you in the community