https://flyte.org logo
Title
d

Dylan Wilder

03/17/2023, 7:08 PM
hi folks! looking for some documentation on ray integration - esp as it pertains to persistent clusters. can't find my last question on this since it was more than 90d ago. even the original RFC would suffice, the public docs don't go into detail on limitations/architecture
k

Ketan (kumare3)

03/17/2023, 8:06 PM
we do not support persistent clusters today
d

Dylan Wilder

03/17/2023, 8:07 PM
any timeline on that?
nothing we can commit - please contribute 🙂
TBH no one asked for it
even folks at spotify found corruption issues
d

Dylan Wilder

03/17/2023, 8:08 PM
last i heard it was a blocker on ray's side
yea could use more info on that. is there a ticket out there?
k

Ketan (kumare3)

03/17/2023, 8:08 PM
ya ray would get corrupted
i would not know
d

Dylan Wilder

03/17/2023, 8:08 PM
someone on our side? 🙂
k

Ketan (kumare3)

03/17/2023, 8:08 PM
sorry @Dylan Wilder / but, this was tried by folks at spotify and did not really tell us - as this is a big deal
yup 🙂
d

Dylan Wilder

03/17/2023, 8:10 PM
cool. will check there. but from your perspective, persistent resources across tasks do work? or youre waiting on implementation
k

Ketan (kumare3)

03/17/2023, 9:04 PM
no there is no implementation in flyte today
we need better requirements