Hi there 👋 I'm looking into Flyte as the potential backbone for an ML delivery infrastructure, and one of the initial appeal was its multi-language support. We need to combine a variety of processing steps in our pipelines, with only a handful of them requiring to be in Python. As much as possible we'd like to confine Python to where it's unavoidable, and rely on other tech stacks for the rest. However it appears the Java/Scala SDK hasn't been updated since july 2024, and the README states that it is still an Alpha / MVP / unstable. Should we understand that these SDKs are a bit of a dead-end at this point and basically "not really usable" due to being neither integrated with the wider Flyte ecosystem nor documented? Or is there a plan for these SDKs going forward? Are there documentation / testimonies of companies where the multi-language nature of Flyte was leveraged in some way, and why/how? I've looked a bit into the

ContainerTask

, but it looks like that would require a lot of contorsions and stack juggling.

Hi @nice-kangaroo-62690 multi language is theoretically possible. Spotify uses the Java sdk in production- but we as a community have not fully been able to adapt and improve it. Reason is everyone uses Python - so for a small team we are focused on Python. We will go to multi language later - but we are right now doubling down on Python to actually introduce a new version. Stay tuned

JVM languages, mostly Java, as it gives access to its huge ecosystem.

there is a good starting point in the java sdk - cc @brief-window-55364 and team . Spotify uses it in production. this will need to be a community effort for now (Union cannot support it)

Hey there! @nice-kangaroo-62690 happy to chat about the Flytekit-Java SDK.

Hello @brief-window-55364! I'll send a PM shortly.