Allow 0 worker in pytorch plugins & Add object...
# contribute
b
Allow 0 worker in pytorch plugins & Add objectMeta to PyTorchJob: https://github.com/flyteorg/flyteplugins/pull/348 Enable pod template and Use copy to construct head/worker in ray plugin: https://github.com/flyteorg/flyteplugins/pull/349 PR to fix pytorch and ray plugin @Fabio Grätz @Kevin Su
d
left a few small comments, looks great @Byron Hsu!
k
updated the comment
that being said you can leave the code, but i think we should make flytekit, just send a single container task?
b
runs without needing an operator and does not need a CRD to be created.
this makes sense
ok will raise a pr to flytekit
k
nice
thank you
highly appreciated
f
torch.distributed.init_process_group()
requires some env vars to be set (world size, rank, …). If we use a single container task we need to overwrite
execute
and set these before calling
super().execute
?
149 Views