Vijay Saravana
06/27/2022, 6:15 PMkatrina
varsha Parthasarathy
06/27/2022, 6:26 PM"<http://spark.kubernetes.node.selector.l5.lyft.com/pool|spark.kubernetes.node.selector.l5.lyft.com/pool>": eks-pdx-pool-gpu,
Now, @Vijay Saravana is trying to convert the spark task to a map task which requires GPU, we are wondering how to do that.
Should we add it to task’s Resource?katrina
varsha Parthasarathy
06/27/2022, 6:32 PMyou should definitely add GPU to the task resource decoratorCan you show an example for this?
please go through the above documentationWhere should we add that config? in propeller/admin ? Bear with me for all noob questions! 🙂
katrina
varsha Parthasarathy
06/27/2022, 6:39 PMk8s:
co-pilot:
name: "flyte-copilot-"
image: ${ecr_repository}:flytecopilot-${flytecopilot_version}
start-timeout: "30s"
scheduler-name: flyte-scheduler
inject-finalizer: true
default-annotations:
- <http://flyte.lyft.com/deployment|flyte.lyft.com/deployment>: flyte-l5
resource-tolerations:
<http://nvidia.com/gpu|nvidia.com/gpu>:
key: <http://lyft.com/gpu|lyft.com/gpu>
value: dedicated
operator: Equal
effect: NoSchedule
katrina
varsha Parthasarathy
06/28/2022, 1:19 AMSamhita Alla
flytesnacks
repo
• Update the relevant Python file
• pip install -r docs-requirements.txt
in the cookbook
folder
• Run make html
in the docs
folder
• Open HTML pages present in the docs/_build
directory in the browser to verify if everything’s rendered correctly