I might be missing something, but is there a way to pass multiple arguments to a map task (ie. if I ...
e
I might be missing something, but is there a way to pass multiple arguments to a map task (ie. if I have a list
[1,2,3]
, can I pass each item to a map task along with some other fixed inputs that are common across all tasks). All the examples in the docs only include tasks w/ a single argument Relatedly, is there a way to use a workflow as part of a map task (ie. map a sub-workflow over a sequence of inputs) Edit: guess not
Copy code
Map tasks only accept python function tasks with 0 or 1 inputs
👍 1
Would there be interest in adding support for this? Or is the recommendation to just represent multiple arguments in a single dataclass/namedtuple
👍 1
t
cc: @high-accountant-32689 @thankful-minister-83577
f
Ya this is actually a limitation of the flytekit api not the engine
There is an issue
Please upvote - we were thinking of a partial like support
e
@freezing-airport-6809 I can't find the issue, if you link it will upvote. Partial-like support would be very helpful
@tall-lock-23197 thank you for the link! I missed that earlier.
f
you are right, i did not find it too. I am not sure where it was lost. cc @thankful-minister-83577 / @acceptable-policeman-57188 do you know?
w
I would also be in favor of having the possibility to define default inputs to map tasks. Is there a plan of implementing this? A prepare_map_inputs task seems more like a workaround to me
f
It is you are right
Let’s get this as an issue, do you mind filing your thoughts
w
Late, but finally filed a feature request here: https://github.com/flyteorg/flyte/issues/3120!
👍 3
293 Views