New RunLLM response generated:
>>>*# Question*
Has anybody used the Spark plugin with volcano or another batch scheduler? I see some docs on volcano with kubeflow but nothing that also interacts with a plugin
# Answer
Yes, there has been some discussion about using Flyte with batch schedulers like Volcano. According to
this discussion, Flyte has core support to use any scheduler, including Volcano, for advanced use cases. However, there is no specific documentation or examples that detail the integration of the Spark plugin with Volcano or other batch schedulers.
Would you like more detail on how to potentially set this up or any other specific aspect?
Sources:
-
Flyte Community Discussion
Slack Link
https://flyte-org.slack.com/archives/CP2HDHKE1/p1724703515.126539 👍 0 button 👎 0 button 💡
Hint: Mention @runllm in the thread for followups.