refined-dawn-96621
03/17/2022, 6:19 AMthankful-minister-83577
thankful-minister-83577
pyspark.sql.DataFrame
which should get turned into a flyte StructuredDataset
type/literal on the backendthankful-minister-83577
FlyteSchema
if you’re on an older version of flytekitrefined-dawn-96621
03/17/2022, 8:20 AMthankful-minister-83577
thankful-minister-83577
refined-dawn-96621
03/17/2022, 8:31 AMrefined-dawn-96621
03/17/2022, 8:32 AMthankful-minister-83577
thankful-minister-83577
type(df)
refined-dawn-96621
03/17/2022, 8:34 AMthankful-minister-83577
@task
def task_name(a: pyspark.sql.DataFrame): ...
thankful-minister-83577
refined-dawn-96621
03/18/2022, 6:14 AM