https://flyte.org logo
Title
k

Ketan (kumare3)

04/04/2023, 5:06 AM
so it should be possible to pickle and run tasks directly from notebook onto a flyte-server
g

Greg Gydush

04/04/2023, 5:07 AM
that's epic
I'm imagining map tasks from within notebook would be incredible
k

Ketan (kumare3)

04/04/2023, 5:07 AM
yup
exactly
also distributed training
and others
or use this resolver to use in fast-execute
and update pyflyte-fast-execute to use cloudpickle as an option
and then it should just work IMO?
Also @Greg Gydush have you seen the new map-tasks
support for multiple-lists etc and partials?
g

Greg Gydush

04/04/2023, 5:09 AM
I haven't yet
k

Ketan (kumare3)

04/04/2023, 5:09 AM
this is in beta, some small bugs being fixed, but keep an eye