Hello Flyte Community. This is Vlado from Akvelon...
# flyte-on-gcp
b
Hello Flyte Community. This is Vlado from Akvelon. We're collaborating with the Google Kubernetes Engine (GKE) team on efforts to streamline the integration of open-source AI frameworks with GKE, ultimately enabling organizations to achieve scalable AI deployments Flyte is a workflow automation platform for complex, mission-critical data and ML processes at scale. It has reusable, type-safe, and testable building blocks to construct workflows, orchestration for both real-time and batch processes and scalability from your laptop to thousands of concurrent executions. You can read more and try it out in this Guide We would love to connect and hear your insights on the features that you feel we should prioritize to benefit both the Flyte community and GKE customers.
f
This says metaflow ?
b
Sorry for that, fixed now.
c
Hey @billions-keyboard-6253 I've been running flyte on gke for several years. In my opinion gke's image streaming is a killer feature combined with flyte because it tremendously speeds up task startup.
A while ago I integrated flyte with GCP's Identity Aware Proxy service: https://github.com/flyteorg/flytekit/tree/master/plugins/flytekit-identity-aware-proxy
This can also be interesting for GCP users in case IAP is required by IT for security reasons.
https://github.com/unionai-oss/deploy-flyte/tree/main/environments/gcp/flyte-core You could also check this repo containing terraform IaC for deploying flyte on GKE.
Let me know if you have any questions šŸ™‚
w
Couple things we've been looking at: • integrations with GCP batch or dynamic-workload-scheduler would be šŸ”„ (I think there's AWS batch support in Flyte but no equivalent for GCP) • I think the community could really benefit from an open source clean multi cluster terraform setup example to really help drive adoption at more companies.