🚀 Flyte v1.3.0 is out! 🚀
Flyte's Spark plugin can now schedule, monitor and orchestrate Databricks jobs!
Flyte v1.3.0 features include:
1. Human-in-the-loop tasks: workflows and tasks can now wait for user input requests as gate nodes before proceeding.
2. Support for Dask tasks, like how Spark and Ray clusters are managed by Flyte.
3. A new helm chart for a simpler deployment.
Union Backend Engineer @Kevin Su demos the Flyte-Databricks integration, and Sr ML Engineer @Evan Sadler shows us how it worked for HBO Max.
Read the full release notes on GitHub.