• Robin Kahlow

    Robin Kahlow

    2 months ago
    Hey, I made a PR for a polars plugin (we're using that and converting from/to pandas so far, which wasted a lot of memory hence this plugin) based on the Modin plugin. Do I need to build/upload the pypi package myself or do you have some automation?
  • Ketan (kumare3)

    Ketan (kumare3)

    2 months ago
    So if you make the PR in flytekit it will automatically upload
  • But cc @Eduardo Apolinario (eapolinario)
  • I don't know if the package in pupils has to be made first
  • Polars sounds great
  • Is it using structured dataset? Cc @Kevin Su / @Yee
  • Kevin Su

    Kevin Su

    2 months ago
    It’s using Flyte Schema, I think we should add polars in structure dataset, right? @Ketan (kumare3)
  • Ketan (kumare3)

    Ketan (kumare3)

    2 months ago
    Yes
  • @Kevin Su we should also migrate modin to structured dataset
  • I think the intel folks are currently offline
  • Kevin Su

    Kevin Su

    2 months ago
    Okay, I think we can deprecate schema or add some comments in the codebase to avoid people to use it.
  • Will review that pr later