Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

<@U07SB8L1F6C> / <@U05FFAF4FC2> and team i would love as an eventual goal that - nanotron - <https://github.com/huggingface/fineweb-2/blob/main/ablations/training/launch_exp.py|this> script can be fully converted to a flyte + slurm runner. This would be a fantastic achievment. we would be able to train a full LLM from scratch using one flyte workflow (small one, thats ok)