https://flyte.org logo
#ray-integration
Title
# ray-integration
a

Abdullah Mobeen

03/17/2023, 8:04 PM
Hi, we recently opened a pull request to address the following issue (inter-cluster communication between Flyte and custom Ray cluster). Can someone please review it? It adds to a product Spotify is building that is integral to our machine learning platform.
cc @Keshi Dai
k

Keshi Dai

03/17/2023, 8:08 PM
Hey @Kevin Su @Ketan (kumare3) we are trying to make Flyte work for our internal Flyte cluster setup. @Abdullah Mobeen opened this PR to enable the inter-cluster communication feature for Ray plugin. Could you guys help take a look? Thank you so much!
k

Kevin Su

03/17/2023, 8:08 PM
Thanks, reviewing
k

Ketan (kumare3)

03/17/2023, 8:11 PM
👍
cc @Dylan Wilder
a

Abdullah Mobeen

03/17/2023, 8:11 PM
Technically, the changes are similar to what Spotify did for the Flyte-Flink plugin. Our data infra team also added context to the issue I linked. Thanks!
k

Ketan (kumare3)

03/17/2023, 8:11 PM
cc @Dan Rammer (hamersaw) to review as well
d

Dylan Wilder

03/17/2023, 8:12 PM
timely 😄
d

Dan Rammer (hamersaw)

03/20/2023, 4:22 PM
Looks great, merged, thanks @Abdullah Mobeen! Now we would just need to update the flyteplugin dependency version in flytepropeller. Is this something you're looking for an immediate propeller release on or are you building your own image anyways?
a

Abdullah Mobeen

03/21/2023, 1:33 PM
Thanks a lot @Dan Rammer (hamersaw)! Yess -- Since we prefer to always stay on a stable Flyte release, it is better if we make a new release to cover this plugin
k

Ketan (kumare3)

03/21/2023, 2:37 PM
Stable Flyte release will be 1.4
k

Keshi Dai

03/21/2023, 7:48 PM
@Ketan (kumare3), what’s the rough timeline for Flyte 1.4 release?
d

Dan Rammer (hamersaw)

03/21/2023, 7:50 PM
So 1.4 is the current stable, 1.5 will be end of month (maybe first week of April) since we switched to a monthly release cycle. I opened this PR to get the plugin updates merged into propeller and will make sure this is merged for the 1.5 release.
k

Keshi Dai

03/21/2023, 8:14 PM
Thanks @Dan Rammer (hamersaw)!
5 Views