@ancient-wolf-19325 connecting flyte to databricks using databricks connect API

Flyte integrates with Databricks using the Databricks Jobs API, not the Databricks Connect API. To connect Flyte to Databricks, you configure tasks with the

Databricks

or

DatabricksV2

task config from

flytekitplugins-spark

, specifying your Databricks workspace, cluster, and job parameters. The integration submits Spark jobs to Databricks via the Jobs API, not through Databricks Connect, which is not mentioned in the official Flyte documentation or examples for Databricks integration. For setup, install the Spark plugin (

pip install flytekitplugins-spark

), configure your Databricks credentials and cluster, and use the documented task configuration. See the Databricks connector guide and example usage for details. Would you like a step-by-step example or more detail on configuration? Sources: - Databricks connector guide - example usage 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.