Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

Hi, we recently opened a <https://github.com/flyteorg/flyteplugins/pull/321|pull request> to address the following <https://github.com/flyteorg/flyte/issues/2883|issue> (inter-cluster communication between Flyte and custom Ray cluster). Can someone please review it? It adds to a product Spotify is building that is integral to our machine learning platform.

Hey <@USU6W5ATA> <@UNZB4NW3S> we are trying to make Flyte work for our internal Flyte cluster setup. <@U03T940SK40> opened this PR to enable the inter-cluster communication feature for Ray plugin. Could you guys help take a look? Thank you so much!

Technically, the changes are similar to what Spotify did for the <https://github.com/spotify/flyte-flink-plugin|Flyte-Flink plugin>. Our data infra team also added context to the issue I linked. Thanks!

Looks great, merged, thanks <@U03T940SK40>! Now we would just need to update the flyteplugin dependency version in flytepropeller. Is this something you're looking for an immediate propeller release on or are you building your own image anyways?

Thanks a lot <@U029U35LRDJ>! Yess -- Since we prefer to always stay on a stable Flyte release, it is better if we make a new release to cover this plugin

<@UNZB4NW3S>, what’s the rough timeline for Flyte 1.4 release?

So 1.4 is the current stable, 1.5 will be end of month (maybe first week of April) since we switched to a monthly release cycle. I opened <https://github.com/flyteorg/flytepropeller/pull/542|this PR> to get the plugin updates merged into propeller and will make sure this is merged for the 1.5 release.