Hi, I am trying to mount a path from the host node...
# flyte-supportw
white-teacher-47376
06/28/2023, 8:44 AMHi, I am trying to mount a path from the host node to the task container using pod templates. For that I created a pod template on kubernetes using the following yaml:
Copy code
apiVersion: v1
kind: PodTemplate
metadata:
name: my-pod-template
namespace: flyte
template:
metadata:
labels:
pod-template-name: my-pod-template
pod-template-namespace: flyte
spec:
containers:
- name: default
image: <http://docker.io/rwgrim/docker-noop|docker.io/rwgrim/docker-noop>
volumeMounts:
- name: mnt-volume
mountPath: /mnt
volumes:
- name: mnt-volume
hostPath:
path: /mnt Copy code
@task(pod_template_name="my-pod-template")
def print_files() -> None:
print(os.listdir("/mnt"))f
fancy-plumber-70674
06/28/2023, 8:57 AMI think the pod template has to be present in the namespace related to your project and domain
fancy-plumber-70674
06/28/2023, 8:57 AMSo for example, this pod template has to exist in flytesnacks-development, if flytesnacks is the namespace and development is the domain.
We achieved this in our deployment by setting a pod template resource in the clusterResourceTemplates.inline section of the helm charts
fancy-plumber-70674
06/28/2023, 9:00 AM Copy code
clusterResourceTemplates:
inline:
001_namespace.yaml: |
apiVersion: v1
kind: Namespace
metadata:
name: '{{ namespace }}'
103_project_efs_shared.yaml: |
apiVersion: v1
kind: PodTemplate
metadata:
name: flyte-template-name
namespace: {{ namespace }}
template:
spec:
containers:
- name: default
image: imagehere
volumeMounts:
- mountPath: /shared
name: {{ namespace }}-shared-mount-name
volumes:
- name: {{ namespace }}-shared-mount-name
persistentVolumeClaim:
claimName: {{ namespace }}-shared-mount-namegratitude thank you 1
fancy-plumber-70674
06/28/2023, 9:01 AM@white-teacher-47376
w
white-teacher-47376
06/28/2023, 9:04 AMThanks a lot! I will try this immediately!
white-teacher-47376
06/28/2023, 10:59 AMNo luck so far. Is it possible that I am missing some backend plugin?
RuntimeExecutionError: failed during plugin execution, caused by: failed to execute handle for plugin [container]: [BadTaskSpecification] PodTemplate 'my-template' does not exist
f
freezing-airport-6809
06/28/2023, 1:25 PM
You can also add pod templates directly to the task
w
white-teacher-47376
06/28/2023, 1:53 PMDefining the pod template directly in the task decorator worked like a charm, however, I would like to have the mount available for all tasks in a workflow using a default pod template.
I figured out, that the default pod template set in the values.yaml as defined here: https://docs.flyte.org/en/latest/deployment/configuration/general.html does not really apply to the flyte-binary chart. Is there a way to define default pod templates in the flyte-binary chart?
f
freezing-airport-6809
06/28/2023, 1:58 PM
They should apply
w
white-teacher-47376
06/28/2023, 2:12 PMAre we talking about these
Copy code
plugins:
k8s:
default-pod-template-name: <your_template_name>white-teacher-47376
06/28/2023, 2:38 PMI was able to set a default pod template by manually adding the following to the configmap (kubectl edit)
Copy code
plugins:
k8s:
default-pod-template-name: <my-template>a
average-finland-92144
06/28/2023, 6:24 PM@white-teacher-47376 have you tried adding it under
inline Copy code
inline:
plugins:
k8s:
default-pod-template-name: <my-template>w
white-teacher-47376
06/29/2023, 5:37 AMThis was the missing piece. Thank you all so much!
189 Views