I’m João Lobo, devops engineer. I’m looking into u...
# introductions
s
I’m João Lobo, devops engineer. I’m looking into using Flyte to manage process ML and data processing. I’m try install on aks but I can’t to find configuration values. Anybody could me help
👋 3
👋🏽 1
t
Welcome @swift-byte-26134! We don't have AKS specific docs yet. Here's a thread on how the deployment's done: https://flyte-org.slack.com/archives/CP2HDHKE1/p1671186930946039. @broad-monitor-993, are we going to have docs on deployment to AKS?
🙏 1
f
I think the blackshark team promised to contribute- cc @incalculable-zebra-90365
b
I don’t believe we’re working on this currently… @thankful-minister-83577 @freezing-boots-56761?
f
We are not, but the community is?
i
Last I've heard, deployment docs were being rewritten/revamped and also partially adapted to some new helm chart, so we've been waiting for that to finish mostly. @freezing-airport-6809 While we do have a slightly adapted helm chart based roughly on the 1.2.0 release, there's still some issues with fsspec/adlfs that have not fully been resolved yet
we're using our own fork of adlfs with a workaround implemented, however the upstream PR has been unanswered for a while in the fsspec repo 😕 we've recently tested using the latest released version of adlfs since that contains a partial fix, but there's some minor things that still appear to be broken, so I'm not fully confident saying all 100% of flyte's blob storage functionality will work without these changes being merged officially yet
f
cc @thankful-minister-83577 welcome back, do you know if we can contribute to the docs now?
t
hey @incalculable-zebra-90365 yeah that would be awesome. the large docs change is in, as is the helm chart.
we still have some follow-up work to do to streamline the old and new helm charts
the new docs are here https://github.com/flyteorg/flyte/tree/master/rsts/deployment/deployment - we’ve split them up into simple and production, and both rely on the single flyte deployment model helm chart encapsulated here - https://github.com/flyteorg/flyte/tree/master/charts/flyte-binary
you’ll notice the two values files we have already there for eks.
the prerequisites (like how to create an eks cluster) should be listed, but not documented there, as they are typically outside the scope of Flyte itself
i
alright, good to hear! unfortunately I'm afraid I won't find much time on updating docs until I get back from my holiday in the second week of March as I'm quite busy before that.
I'll try to get some basic information about an Azure setup into the docs then, will have to see about the new helm chart as we're currently running an internal fork roughly based on Flyte 1.2.0, so it'll take a bit to change to that
t
thanks
let us know if you have any issues moving to the new helm chart.
i
I'm not sure if the default setup will work out of the box on Azure though due to the adlfs issue mentioned above. unfortunately the maintainers don't seem to be very responsive, not sure how to best proceed on that
I believe the one thing that's currently still broken in the upstream version is recursively creating directories in Azure blob storage
rest seems to work, but needs more testing with the upstream version
b
@thankful-minister-83577 @incalculable-zebra-90365 I created a stub issue for adding Azure deployment docs: https://github.com/flyteorg/flyte/issues/3335
👍 2
please feel free to edit it/add more details
i
will do!
s
Hi everyone. I can deploy in AKS. Thank you so much But I received some errors, as example Status Code 501 in url https://flyte.example.com/me I don’t know about this /me Anybody could you more details about this Thank you
t
the /me endpoint is part of the authentication suite in flyte. It’s provided as part of the Identity grpc service defined here
if oauth is enabled, and the user is logged in, this endpoint will return information about the logged in user.
👀 1
f
cc @powerful-gold-59386 / @average-finland-92144 docs maybe
s
@thankful-minister-83577 this endpoint only work with google.api.http because I’m trying to test with azure
t
can you elaborate? this endpoint should work across cloud providers
what is google.api.http?
s
like this example here.
sorry I’m noob with app yet. I’m studying about the documentation
In my test environment it has the same error as in the eks cluster I would like to understand more about how it works
t
hey @swift-byte-26134 can we move this to flyte-deployment? i’m getting a bit confused.
this looks like the sandbox, but i thought you were trying to get this to work on aks
or did you move to eks?
s
No, I work on aks
yes, go ahed to move flyte-deployment