Mohd Shahid Khan Afridi
08/23/2023, 6:37 AMWorkflow[moj-ml-workflows-flyte-example:development:flyte.example.tfjob.workflow.mnist_tensorflow_workflow] failed. RuntimeExecutionError: max number of system retry attempts [51/50] exhausted. Last known status message: failed at Node[n0]. RuntimeExecutionError: failed during plugin execution, caused by: failed to execute handle for plugin [tensorflow]: [BadTaskSpecification] Unable to create pod spec: [[BadTaskSpecification] PodTemplate 'flyte-pod-template' does not exist]
apiVersion: v1
kind: PodTemplate
metadata:
name: flyte-pod-template
namespace: development
template:
metadata:
labels:
foo: testLabel
annotations:
foo: initial-value
bar: initial-value
spec:
containers:
- name: default
image: <http://docker.io/rwgrim/docker-noop|docker.io/rwgrim/docker-noop>
terminationMessagePath: "/dev/foo"
Verified it in corresponding k8s namespace:
kubectl get podTemplate -n development
NAME CONTAINERS IMAGES POD LABELS
flyte-pod-template default <http://docker.io/rwgrim/docker-noop|docker.io/rwgrim/docker-noop> foo=testLabel
kubectl get podTemplate -n flyte
NAME CONTAINERS IMAGES POD LABELS
flyte-pod-template default <http://docker.io/rwgrim/docker-noop|docker.io/rwgrim/docker-noop> foo=templateLabel
Samhita Alla
Mohd Shahid Khan Afridi
08/23/2023, 6:47 AMdevelopment
namespace and flyte cluster is setup in flyte
namespace both has the podTemplate present with this nameSamhita Alla
Mohd Shahid Khan Afridi
08/23/2023, 6:50 AMdevelopment
namespace, no project name prefixed
kubectl get <http://flyteworkflows.flyte.lyft.com|flyteworkflows.flyte.lyft.com> -n development
NAME AGE
af80ebe30d4426b22c38 10h
ar22wvbzk49qrc7b2htn 3m24s
ffdf33fba0b3b9f42000 6h49m
development
namespaceMichael Tinsley
08/23/2023, 6:57 AMMohd Shahid Khan Afridi
08/23/2023, 7:03 AMMichael Tinsley
08/23/2023, 7:05 AMMohd Shahid Khan Afridi
08/23/2023, 7:06 AMMichael Tinsley
08/23/2023, 7:06 AMFabio Grätz
08/23/2023, 7:36 AMMohd Shahid Khan Afridi
08/23/2023, 12:25 PM