But, I want to answer about direct comparison with Flyte. They similar yet different Flyte is implemented in golang, designed for container native execution and connecting external services. For external services it offers the idea of backend plugins- which allows separating plugins from user code (python library), but these backend plugins are harder to implement if you do not know golang On the other hand, the power is reproducibility , includes container orchestration and can run spark etc in k8s. We do not use something like dask to execute

Also Flyte supports cross language workflows

Cc @Smriti Satyan