#3567 [Core feature] Support horovod in mpi task Issue created by ByronHsu Motivation: Why do you think this is important? Horovod is a special kind of tasks in mpi, it uses horovodrun to launch distributed training and ssh to communicate between launchers and workers. 1. Horovod is not implemented in flytekit mpi task. 2. Flyteplugins also need change to adjust to horovod. Goal: What should the final outcome look like, ideally? Able to run horovod on flyte Describe alternatives you've considered N/A Propose: Link/Inline OR Additional context No response Are you sure this issue hasn't been raised already? ☑︎ Yes Have you read the Code of Conduct? ☑︎ Yes flyteorg/flyte