Hello, If a shellTask fails the stderr is not written to outputlocations and the node is destroyed before you get a chance to see it. What are some options to capture the stderr incase of failure? I have looked into Failure nodes but I am looking specifically for the content in stderr not just to capture a failure and take an action
c
careful-australia-19356
03/13/2025, 6:10 PM
the task logs should contain stderr entries. Are you not seeing those?
b
boundless-lifeguard-61788
03/13/2025, 7:26 PM
If outputlocations is set to FlyteFile in the shellTask
And the task fails, then I do not see the stderr and the pod is cleaned up before I can look at the logs. Note that our output location is s3.
If the task runs to completion the stderr and out are written to s3