Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

Hey has anyone integrated Flyte with Databricks.
1- Using map tasks in flyte to use databricks compute instead of <https://flyte.org/blog/meet-the-databricks-integration|Kubernetes>
2- Rubbing Flyte with Kunernetes and o/p the data as sink to Databricks data store integration with Unity Catalog

Yes Flyte has an excellent Agent/integration with databricks. No unity catalog yet

Sadly map tasks cannot use databricks compute as databricks compute AFAICT is simply spark. If this is the case then this is an upcoming feature to run Spark jobs in map