salmon-refrigerator-32115
04/28/2023, 10:25 PMbillowy-winter-86593
04/28/2023, 11:02 PMflytekitplugins-polars
? It has a type transformer for polars dataframes!billowy-winter-86593
04/28/2023, 11:03 PMbillowy-winter-86593
04/28/2023, 11:03 PMbillowy-winter-86593
05/01/2023, 2:50 PM# pip install flytekitplugins-polars
from flytekit import task, workflow
import polars as pl
import pandas as pd
@task
def t1() -> pl.DataFrame:
return pl.DataFrame(pd.DataFrame({"a": [1, 2, 3]}))
@task
def t2(df: pl.DataFrame) -> int:
return len(df)
@workflow
def wf() -> int:
df = t1()
return t2(df=df)
wf()
salmon-refrigerator-32115
05/01/2023, 11:49 PMbillowy-winter-86593
05/02/2023, 4:57 PM