@task
def concat_frames(frames: list[pd.DataFrame]) -> pd.DataFrame:
"""
Simple task that will concat a list of frames into 1 frame.
"""
frames = [df for df in frames if not df.empty()]
df = pd.concat(frames)
return df
FlyteScopedUserException: Failed to convert inputs of task 'xp_util.pipeline.concat_frames':
No match for FieldRef.Name(env) in __index_level_0__: null
__fragment_index: int32
__batch_index: int32
__last_in_fragment: bool
__filename: string
The above exception was the direct cause of the following exception:
t
tall-lock-23197
01/19/2024, 12:47 PM
shouldn't you be returning a dataframe, but not a list from