#1627 Change flytekit Pytorch, TFJob and MPI plugins to use new kubeflow config
Pull request opened by
yubofredwang
TL;DR
We have updated the plugin config in flyteidl and flytepropeller. This PR updates flytekit to uses the new configs for kubeflow plugins including: pytorch, tfjob and mpijob.
Type
☐ Bug Fix
☑︎ Feature
☐ Plugin
Are all requirements met?
☑︎ Code completed
☐ Smoke tested
☑︎ Unit tests added
☐ Code documentation added
☐ Any pending items have an associated Issue
Complete description
This change is backward compatible. If users continue using the old config like
@task(
task_config=TFJob(num_workers=1)
)
def my_task:
...
This still works.
However, the new config should look like:
@task(
task_config=TFJob(worker=Worker(replicas=1))
)
def my_task:
...
Tracking Issue
flyteorg/flyte#3308
flyteorg/flytekit
✅ All checks have passed
30/30 successful checks