orange-umbrella-99251
06/27/2022, 6:15 PMacceptable-policeman-57188
sticky-art-97180
06/27/2022, 6:26 PM"<http://spark.kubernetes.node.selector.l5.lyft.com/pool|spark.kubernetes.node.selector.l5.lyft.com/pool>": eks-pdx-pool-gpu,
Now, @orange-umbrella-99251 is trying to convert the spark task to a map task which requires GPU, we are wondering how to do that.
Should we add it to task’s Resource?acceptable-policeman-57188
sticky-art-97180
06/27/2022, 6:32 PMyou should definitely add GPU to the task resource decoratorCan you show an example for this?
sticky-art-97180
06/27/2022, 6:33 PMplease go through the above documentationWhere should we add that config? in propeller/admin ? Bear with me for all noob questions! 🙂
acceptable-policeman-57188
acceptable-policeman-57188
sticky-art-97180
06/27/2022, 6:39 PMk8s:
co-pilot:
name: "flyte-copilot-"
image: ${ecr_repository}:flytecopilot-${flytecopilot_version}
start-timeout: "30s"
scheduler-name: flyte-scheduler
inject-finalizer: true
default-annotations:
- <http://flyte.lyft.com/deployment|flyte.lyft.com/deployment>: flyte-l5
resource-tolerations:
<http://nvidia.com/gpu|nvidia.com/gpu>:
key: <http://lyft.com/gpu|lyft.com/gpu>
value: dedicated
operator: Equal
effect: NoSchedule
sticky-art-97180
06/27/2022, 6:39 PMacceptable-policeman-57188
sticky-art-97180
06/28/2022, 1:19 AMsticky-art-97180
06/28/2022, 1:19 AMsticky-art-97180
06/28/2022, 1:19 AMtall-lock-23197
flytesnacks
repo
• Update the relevant Python file
• pip install -r docs-requirements.txt
in the cookbook
folder
• Run make html
in the docs
folder
• Open HTML pages present in the docs/_build
directory in the browser to verify if everything’s rendered correctly