Sabrina Lui03/23/2023, 6:22 PM
task with a
< 1.0 as input to another task. However, as the failed outputs are not filtered out of the results, flytekit is unable to convert them to inputs properly, resulting in errors like this and this. Since this happens in type engine code between tasks, even an intermediate task to filter out none values would fail. This blocks us from using
effectively in our workflows. Here is a min repro example: https://gist.github.com/sabrinalui/e5478b9557dcf370c84d5e57758b4c87 It seems
doesn't work locally but I attached the output when running with inputs
from our endpoint below. What would the lift be to (optionally) filter out failed tasks from the
Kevin Su03/23/2023, 11:48 PM
Dan Rammer (hamersaw)03/24/2023, 12:42 AM
? Would it be possible to declare the maptask output in a way that accepts the
. Open to discussion on if this is a good idea or not as well.
Kevin Su03/24/2023, 5:47 AM
, it works for me.
Sabrina Lui03/27/2023, 8:01 PM