SeungTaeKim
06/07/2022, 4:22 AMSamhita Alla
@task(requests=Resources(gpu=1, mem="3Gi", storage="1Gi"))
def pytorch_mnist_task(hp: Hyperparameters) -> TrainingOutputs:
...
SeungTaeKim
06/07/2022, 4:45 AMSeungTaeKim
06/07/2022, 5:17 AMvalues.yaml
file & guide docs, but these does not provide specific answers of MIG support.
I think I have waited answers from those who you taggedKetan (kumare3)
Yuvraj
06/07/2022, 6:52 AMkubectl describe node
...
Capacity:
<http://nvidia.com/mig-1g.5gb|nvidia.com/mig-1g.5gb>: 1
<http://nvidia.com/mig-2g.10gb|nvidia.com/mig-2g.10gb>: 1
<http://nvidia.com/mig-3g.20gb|nvidia.com/mig-3g.20gb>: 1
This is the global config for all task, Flyte will add taints and tolerations to all the task if they require GPU. Currently only Pod Task has option to configure taints and tolerations, Flyte core task doesnโt have option to configure the taints and tolerations, it will always use the default GPU.
cc: @Dan Rammer (hamersaw) @Haytham Abuelfutuh Please correct me if i am wrong.SeungTaeKim
06/07/2022, 8:44 AMSamhita Alla
SeungTaeKim
06/07/2022, 8:52 AMSamhita Alla
Ketan (kumare3)