Hello Flyte-Gang, does anyone have experience with...
# flyte-deployment
j
Hello Flyte-Gang, does anyone have experience with deploying flyte on an ARM kubernetes cluster? I am currently trying to deploy flytepropeller via helm on this aws instancetype:
c6g.xlarge
but i keep running into
format exec
errors. Anything particular to watch out for? Thanks!
b
You need to build the docker image using the right platform
linux/arm64
j
b
yes it should
j
Unfortunately it’s not making any difference
Ah i made it work! Actually the Makefile of the flytepropeller does not use the TARGETARCH env variable from the Dockerfile. Its is hardcoded to amd64 right now! https://github.com/flyteorg/flytepropeller/blob/master/Makefile#L14 Using the env variable made it work for me
j
good catch. not sure how i missed this 😞
in this case, looks like it was publishing a multi-arch image with an amd64 binary
🤦
j
Yes Exactly! I also saw it happening in flyteadmin. Is there a chance this gets fixed anytime soon? I am also happy to create a PR tomorrow 🙂
j
@Jan Fiedler yea we have draft PRs here: https://github.com/flyteorg/datacatalog/pull/103 https://github.com/flyteorg/flyteadmin/pull/550 https://github.com/flyteorg/flytepropeller/pull/552 definitely want to do some additional testing before we merge. perhaps you can help with that as well?
j
Amazing! Yeah why not, let me know how i can help exactly?
j
just with some testing to make sure the images work as intended. i realized that the last time i tested this, i was running on an m1 mac with rosetta enabled, so i didn’t catch the error.
i’ll likely spin up an arm VM to more accurately test this this time around 😅
j
hehe yes that sounds more save! I can also have a look tomorrow and test on eks.
Just tried the flytepropeller in a multi cluster setup with the latest
v1.1.79
image on
t4g.medium
and it worked like a charm! Thank you so much!
j
the last few should be merged in a few hours
but sounds like you’re only running a dataplane on the arm cluster
j
Yes - great stuff!
j
@Jan Fiedler: you'll likely need the flytecopilot image bumped to multi-arch too. whenever this is merged: https://github.com/flyteorg/flytecopilot/pull/57
you will need this to run raw container tasks in the arm dataplane
j
Im pretty sure i had a successful run for a container task already yesterday with just the updated flytepropeller. 🤔 I guess i update copilot anyway if this merged. Thanks!
112 Views