Join Slack

Hi Flyte folks, does flyte local execution use any parallelization for dynamic tasks

# flyte-support

magnificent-teacher-86590

12/15/2022, 10:09 PM

Hi Flyte folks, does flyte local execution use any parallelization for dynamic tasks

thankful-minister-83577

12/15/2022, 10:18 PM

no not yet.

thankful-minister-83577

12/15/2022, 10:18 PM

in the future yes it will. will take some work to get there though.

magnificent-teacher-86590

12/16/2022, 12:13 AM

i see, sounds good. Yeah i was just debugging something related to joblib. we have a task that uses joblib and nested joblib call might be causing some issue

magnificent-teacher-86590

12/16/2022, 12:13 AM

well it rules that theory out haha

151 Views

Open in Slack

Previous Next

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.