hey <@U06RKAMK0UC> When a "dynamic workflow" launc...
# ask-ai
m
hey @ancient-wolf-19325 When a "dynamic workflow" launches "map tasks", Flyte UI shows status as "Running" but "k get pods" command in the k8s cluster shows no pods. How to check the exact status of the map tasks in this case?
a
To check the exact status of map tasks when the Flyte UI shows them as "Running" but no pods are visible in the Kubernetes cluster, you can follow these steps: 1. Check FlytePropeller Logs: Inspect the FlytePropeller logs for any anomalies or errors related to the task execution. This can provide insights into why the tasks are not progressing as expected.
Copy code
kubectl logs -n <flyte-namespace> <flytepropeller-pod>
2. Inspect Task Execution Details: Use Flyte's CLI tool (
flytectl
) or FlyteConsole to get detailed execution information. This includes checking the status of individual task attempts and their logs.
Copy code
flytectl get execution -p <project> -d <domain> <execution-id> --details
3. Check Dynamic Task Execution: For dynamic tasks, ensure that the parent workflow has successfully generated the sub-tasks. You can inspect the dynamic task logs and the generated sub-workflow.
Copy code
kubectl get pods -n <project>-<domain> -l flyte-execution-id=<execution-id>
4. Verify Finalizers: Ensure that Kubernetes finalizers are enabled to prevent premature pod deletion, which can cause tasks to appear stuck.
Copy code
inject-finalizer: true
Would you like more detailed steps on any of these points? Sources: - Flyte discussion on finalizers - Flyte issue on map tasks - Flyte issue on pending pods 👍 1 button 👎 0 button 💡 Hint: Mention @ancient-wolf-19325 in the thread for followups.