Hi Everyone !
I was curious to find out a couple of questions regarding flyte. I’m curious to know if anyone has resources on:
1) integrating flyte with a larger kubernates cluster
2) if its possible to see the realtime console outputs for the workflow and pipe it somewhere else
01/15/2023, 6:50 PM
What do you mean by larger? Flyte has been tested on k8s cluster with more than 1000 nodes. The real test is rate at which pods are created.
Flyte provides an even stream and you can subscribe and use it. This includes inputs/outputs and other details
01/16/2023, 9:47 PM
@Ketan (kumare3) I guess by larger, I mean a superset kubernates cluster. I’m a one man dev team trying to set up our infrastructure. So I’m trying to figure out the best ways to couple the flyte cluster along with the rest of my databases, webapps, etc.
Right now we would only have 1 node but I’m just trying to figure the best ways of doing this.
01/17/2023, 3:53 PM
I guess iiuc, you want to share your k8s cluster
This should be ok in Flyte and you can limit it to one namespace