komal azram
03/17/2022, 6:19 AMYee
pyspark.sql.DataFrame
which should get turned into a flyte StructuredDataset
type/literal on the backendFlyteSchema
if you’re on an older version of flytekitkomal azram
03/17/2022, 8:20 AMYee
komal azram
03/17/2022, 8:31 AMYee
type(df)
komal azram
03/17/2022, 8:34 AMYee
@task
def task_name(a: pyspark.sql.DataFrame): ...
komal azram
03/18/2022, 6:14 AM