cold-translator-17075
03/23/2023, 6:22 PMmap_task
task with a min_success_ratio
< 1.0 as input to another task. However, as the failed outputs are not filtered out of the results, flytekit is unable to convert them to inputs properly, resulting in errors like this and this. Since this happens in type engine code between tasks, even an intermediate task to filter out none values would fail. This blocks us from using map_task
effectively in our workflows.
Here is a min repro example: https://gist.github.com/sabrinalui/e5478b9557dcf370c84d5e57758b4c87
It seems min_success_ratio
doesn't work locally but I attached the output when running with inputs [true,true,false]
from our endpoint below.
What would the lift be to (optionally) filter out failed tasks from the map_task
output?glamorous-carpet-83516
03/23/2023, 11:48 PMhallowed-mouse-14616
03/24/2023, 12:42 AMOption
Union
? Would it be possible to declare the maptask output in a way that accepts the nilLiteral
. Open to discussion on if this is a good idea or not as well.glamorous-carpet-83516
03/24/2023, 5:47 AMOption[bool]
, it works for me.glamorous-carpet-83516
03/24/2023, 5:48 AMcold-translator-17075
03/27/2023, 8:01 PM