I'm struggling with installing Flyte core on our private Azure K8S (AKS) cluster using the official Helm Charts. Particularly, specifying

storage.type: custom

and

storage.custom: {}

to make Stow use Azure Blob Storage (non-S3 compatible). Does anyone have an example of using

storage.type: custom

correctly?

We're running all of our Flyte cluster in Azure using the following storage config:

storage:
  type: custom
  bucketName: "<CONTAINER_NAME>"
  custom:
    container: "<CONTAINER_NAME>"
    enable-multicontainer: true
    connection: {}
    type: stow
    stow:
      kind: azure
      config:
        account: "<STORAGE_ACCOUNT_NAME>"
        key: "<STORAGE_ACCOUNT_KEY>"

Thanks. Were missing these:

container: "<CONTAINER_NAME>"
    enable-multicontainer: true
    connection: {}

They made the deployment progress 😌

@incalculable-zebra-90365 would it possible to upstream it

@freezing-airport-6809 sure, although I'm not 100% sure what to upstream? do you mean creating another helm chart override for azure like there currently already is for gcp/aws? or just documentation in general somewhere?

Would be great if you could share your

values.yaml

for AKS. I tried (to the best of my ability) to adopt

values-eks.yaml

to Azure, but now I am stuck again, facing an issue where gRPC connections are forcely closed, like described here. I use an nginx ingress controller, but issuing

flytectl get projects --admin.insecureSkipVerify --logger.level=10

yields me with a

{"json":{"src":"client.go:183"},"level":"error","msg":"failed to initialize token source provider. Err: failed to fetch auth metadata. Error: rpc error: code = Unavailable desc = connection closed","ts":"2022-12-19T13:08:42+01:00"}

😞 Any ideas what could be the cause, @incalculable-zebra-90365?

you should be able to do without that as well 🤔 we've had to add a few different ingress routes though, although we're using traefik, not nginx as a ingress controller. I'll try to get you a

values.yaml

of our complete setup a bit later this afternoon, will take a bit to put together since we use some extra templating on top of the public helm chart. will let you know @worried-sandwich-38800

@incalculable-zebra-90365 Thank you so much for your help 🙏

@incalculable-zebra-90365 - atleast 3-5 companies decided not to use Flyte as they thought azure is not supported. If you upstream and contribute azure docs, lots of companies could join in So, Deployment docs, Example flytekit Values

@freezing-airport-6809 sure, I can try to put something together. can't guarantee when I'll get to it (especially over the christmas/new year period), but I've put it down as a task in my backlog 🙂

@incalculable-zebra-90365: Absolutely no worries 🙂

@worried-sandwich-38800 sent you a link to a gist with our current setup. since I couldn't add

/

in the filenames, they have two spaces now to show a folder/file structure

@incalculable-zebra-90365 @freezing-airport-6809 Is there a link to the updated deployment docs, helm charts, and examples, for Azure AKS? Thanks for discussing this on this forum. As @freezing-airport-6809 mentioned in this thread, there is very less mention of Azure in current stable docs . I also checked Github for open PRs and recent commits related to docs, its been mostly EKS and GKE. Would be great to see more AKS specific docs too.

Nothing so far yet, unfortunately, sorry 😕 I was planning on getting some documentation done over the christmas period but got quite busy with other tasks. the best I can offer at the moment is what's in this thread ^

got it! Thanks Nick. 🙂

I have a gist of the full helm chart I sent to Thomas in case you're interested in that, that's what we're using for the deployment

yes sure. Will be glad to take a look at that and see if its helpful for me.

Thank you Nick. I hop @victorious-kilobyte-69570 can help put it in Flyte docs

Yes once I do it, coz im not working with a team as of now, I will inform and add it to docs.

@colossal-musician-95989 we’re currently revamping the deployment documentation, please hold tight as a lot of the current docs will change significantly! I’ll ping you when those changes have been merged

Okay great. @broad-monitor-993

Hi there, I'm trying out a deployment on Azure for my company, and wondering if you had any docs besides what I've seen here or in Slack? Even in-progress would be greatly appreciated! Cheers