Note, another input param in a different task defined in the same way except it’s of type pandas.DataFrame, works. Why is that?

def estimate(test_data: Optional[pd.DataFrame] = None, ...

I'm guessing it's because

encoder

is of type that isn't understood by Flyte, whereas

pd.DataFrame

is a Flyte native type. But this should be supported. @high-accountant-32689, is this a bug?

this seems like a bug flyte should fallback on

FlytePickle

in cases where the type is not understood, unless this is a known limitation of the Union type, in which case the error message should be more informative. @salmon-refrigerator-32115 can you share a minimally reproducible example?

Two things: 1. Optional parameters are not supported in tasks yet 2. This looks like a bug in our support for unions. Samhita is right, this should be supported.

@broad-monitor-993, The task’s input dataframe is either supplied by the caller or None if user doesn’t have a df as input. I tried both, with or without Optional.

def estimate(test_data: Optional[pd.DataFrame] = None, ...
def estimate(test_data: pd.DataFrame = None, ...

[flyte-bug]

🐞 Create a new Flyte Bug issue: https://github.com/flyteorg/flyte/issues/new?assignees=&labels=bug%2Cuntriaged&template=bug_report.yaml&title=%5BBUG%5D+

@salmon-refrigerator-32115 would you mind filling out a bug report for the error? ideally it contains a copy-pastable example the repros the error

@broad-monitor-993, done. https://github.com/flyteorg/flyte/issues/3319