Has anybody used the Spark plugin with volcano or ...
# flyte-support
p
Has anybody used the Spark plugin with volcano or another batch scheduler? I see some docs on volcano with kubeflow but nothing that also interacts with a plugin
c
Not sure if its helpful but I've implemented a custom plugin which schedules Python tasks to the Armada batch scheduler.
f
@clean-glass-36808 this is different because Joshua wants to use gang scheduling with spark. We have it available in union
👍 1
p
good to know