Hello, Could you explain the benefits of using Flyte databricks plugin to execute spark jobs vs using normal k8s spark plugin? https://flyte.org/blog/meet-the-databricks-integration Thanks

It runs on databricks

databricks spark run much faster than open source one

And you pay for it

Thanks @Kevin Su, @Ketan (kumare3)