Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

has anyone used flyte with <https://github.com/huggingface/accelerate|huggingface accelerate> project? curious what that integration might look like

we have used it, but ideally i would love a deeper integration like torchrun

checkout the <https://github.com/flyteorg/flytekit/tree/master/plugins/flytekit-kf-pytorch>

<https://github.com/flyteorg/flytekit/blob/d42a0024436a3bd70b3abddc12b2cd9541dbb67f/plugins/flytekit-kf-pytorch/flytekitplugins/kfpytorch/task.py#L126>