and i could see this annotation in the pod which i...
# flyte-supporte
early-addition-41415
04/02/2025, 6:57 AMand i could see this annotation in the pod which is created by flyte
Copy code
apiVersion: v1
kind: Pod
metadata:
annotations:
cluster-autoscaler.kubernetes.io/safe-to-evict: "false"
scheduling.k8s.io/group-name: agfcbnm8t8f9vzz5gxvs-n0-0
scheduling.volcano.sh/queue-name: training
volcano.sh/task-spec: workera
average-finland-92144
04/02/2025, 3:46 PMwoo
So it works?
This is a great candidate for a docs contribution 🙂
e
early-addition-41415
04/02/2025, 4:47 PMnot it doesnt work, even with the annotations being there pod group still craede with default queue
a
average-finland-92144
04/02/2025, 4:48 PMso, are you setting this in a PodTemplate as part of a Flyte workflow definition?
e
early-addition-41415
04/02/2025, 4:48 PMyes
a
average-finland-92144
04/02/2025, 4:49 PMok and the expected behavior is that it triggers the creation of a Volcano PodGroup?
e
early-addition-41415
04/02/2025, 4:49 PMit does create the podgroup but it always use default queue irrespective of whatever the annotation say
early-addition-41415
04/02/2025, 6:24 PMok after debugging for a while i found this https://github.com/flyteorg/flytekit/blob/master/plugins/flytekit-kf-pytorch/flytekitplugins/kfpytorch/task.py#L295-L302
early-addition-41415
04/02/2025, 6:25 PMso we need to pass run_policy for scheduling policy which i believe is not supported atm, any plsn to support this as its there in CRD and when i pass to the pytorch job manifest manually it just works
early-addition-41415
04/03/2025, 3:21 AM@average-finland-92144 i have made the change and test in my localnow, any idea how can i make it run in my remote. Any idea how to update my helm chart with this binary
early-addition-41415
04/03/2025, 3:22 AMi am getting this in my remote
Copy code
ImportError: cannot import name 'SchedulingPolicy' from 'flytekitplugins.kfpytorch.task' (/opt/micromamba/envs/runtime/lib/python3.10/site-packages/flytekitplugins/kfpytorch/task.py)early-addition-41415
04/03/2025, 3:22 AMwhich makes sense