https://flyte.org logo
#ask-the-community
Title
# ask-the-community
e

Endre Karlson

11/24/2023, 12:59 PM
If I have a
@dynamic
workflow that returns a gets tasks that returns a
Dataframe
how can I concat those frames at the end or after the dynamic into one single frame ? 🤔 my flow returns
list[pd.DataFrame]:
and then concat task takes
Copy code
@task
def concat_frames(frames: list[pd.DataFrame]) -> pd.DataFrame:
    return pd.concat(frames)
In my main workflow I then
Copy code
concat_frames(frames=action_frames)
k

Ketan (kumare3)

11/24/2023, 3:39 PM
I see one problem of memory bloat as both input and output will need memory and pandas syntax you should try
e

Endre Karlson

11/24/2023, 3:40 PM
Hmm ok
wdym ?
s

Samhita Alla

11/27/2023, 7:03 AM
may i know why you want to use dynamic workflow in this case?
e

Endre Karlson

11/27/2023, 7:04 AM
I have a output from a previous workflow that changes how many instances of a given workflow I need to run
s

Samhita Alla

11/27/2023, 7:06 AM
right, okay. so have you tried implementing the approach you described?
e

Endre Karlson

11/27/2023, 7:53 AM
Yes, but the error was bit hidden with one of the arguments to a task having a typo with
=
instead of the
: