Vijay Saravana
katrina
varsha Parthasarathy
"<http://spark.kubernetes.node.selector.l5.lyft.com/pool|spark.kubernetes.node.selector.l5.lyft.com/pool>": eks-pdx-pool-gpu,
Now, @Vijay Saravana is trying to convert the spark task to a map task which requires GPU, we are wondering how to do that.
Should we add it to task’s Resource?katrina
varsha Parthasarathy
you should definitely add GPU to the task resource decorator Can you show an example for this?
please go through the above documentation Where should we add that config? in propeller/admin ?Bear with me for all noob questions! 🙂
katrina
varsha Parthasarathy
k8s:
co-pilot:
name: "flyte-copilot-"
image: ${ecr_repository}:flytecopilot-${flytecopilot_version}
start-timeout: "30s"
scheduler-name: flyte-scheduler
inject-finalizer: true
default-annotations:
- <http://flyte.lyft.com/deployment|flyte.lyft.com/deployment>: flyte-l5
resource-tolerations:
<http://nvidia.com/gpu|nvidia.com/gpu>:
key: <http://lyft.com/gpu|lyft.com/gpu>
value: dedicated
operator: Equal
effect: NoSchedule
katrina
varsha Parthasarathy
Samhita Alla
flytesnacks
repo
• Update the relevant Python file
• pip install -r docs-requirements.txt
in the cookbook
folder
• Run make html
in the docs
folder
• Open HTML pages present in the docs/_build
directory in the browser to verify if everything’s rendered correctly