hi folks looking for some documentation on ray integration e

Question

hi folks looking for some documentation on ray integration esp as it pertains to persistent clusters can t find my last question on this since it was more than 90d ago even the original RFC would suffice the public docs don t go into detail on limitations architecture

Ketan (kumare3) · Answer

we do not support persistent clusters today

Dylan Wilder · Answer

any timeline on that

Ketan (kumare3) · Answer

Ketan (kumare3) · Answer

nothing we can commit please contribute slightly smiling face

Ketan (kumare3) · Answer

TBH no one asked for it

Ketan (kumare3) · Answer

even folks at spotify found corruption issues

Dylan Wilder · Answer

last i heard it was a blocker on ray s side

Dylan Wilder · Answer

yea could use more info on that is there a ticket out there

Ketan (kumare3) · Answer

ya ray would get corrupted

Ketan (kumare3) · Answer

i would not know

Dylan Wilder · Answer

someone on our side slightly smiling face

Ketan (kumare3) · Answer

sorry < Dylan Wilder> but this was tried by folks at spotify and did not really tell us as this is a big deal

Ketan (kumare3) · Answer

yup slightly smiling face

Dylan Wilder · Answer

cool will check there but from your perspective persistent resources across tasks do work or youre waiting on implementation

Ketan (kumare3) · Answer

no there is no implementation in flyte today

Ketan (kumare3) · Answer

we need better requirements