https://flyte.org logo
#flytekit
Title
# flytekit
r

Robin Kahlow

06/11/2022, 12:35 PM
Hey, I made a PR for a polars plugin (we're using that and converting from/to pandas so far, which wasted a lot of memory hence this plugin) based on the Modin plugin. Do I need to build/upload the pypi package myself or do you have some automation?
❤️ 5
k

Ketan (kumare3)

06/11/2022, 4:15 PM
So if you make the PR in flytekit it will automatically upload
But cc @Eduardo Apolinario (eapolinario)
I don't know if the package in pupils has to be made first
Polars sounds great
Is it using structured dataset? Cc @Kevin Su / @Yee
k

Kevin Su

06/11/2022, 4:29 PM
It’s using Flyte Schema, I think we should add polars in structure dataset, right? @Ketan (kumare3)
k

Ketan (kumare3)

06/11/2022, 4:29 PM
Yes
@Kevin Su we should also migrate modin to structured dataset
I think the intel folks are currently offline
k

Kevin Su

06/11/2022, 4:32 PM
Okay, I think we can deprecate schema or add some comments in the codebase to avoid people to use it.
Will review that pr later
11 Views