https://flyte.org
Join Slack
Hello Flyte-Gang, does anyone have experience with deploying flyte on an ARM kubernetes cluster? I a...
# flyte-deployment
f
Hello Flyte-Gang, does anyone have experience with deploying flyte on an ARM kubernetes cluster? I am currently trying to deploy flytepropeller via helm on this aws instancetype: 
c6g.xlarge
but i keep running into 
format exec
errors. Anything particular to watch out for? Thanks!
q
You need to build the docker image using the right platform 
linux/arm64
f
q
yes it should
f
Unfortunately it’s not making any difference
Ah i made it work! Actually the Makefile of the flytepropeller does not use the TARGETARCH env variable from the Dockerfile. Its is hardcoded to amd64 right now! https://github.com/flyteorg/flytepropeller/blob/master/Makefile#L14 Using the env variable made it work for me
🙌🏽 1
f
good catch. not sure how i missed this 😞
in this case, looks like it was publishing a multi-arch image with an amd64 binary
💯 1
🤦
f
Yes Exactly! I also saw it happening in flyteadmin. Is there a chance this gets fixed anytime soon? I am also happy to create a PR tomorrow 🙂
f
@faint-activity-87590 yea we have draft PRs here: https://github.com/flyteorg/datacatalog/pull/103 https://github.com/flyteorg/flyteadmin/pull/550 https://github.com/flyteorg/flytepropeller/pull/552 definitely want to do some additional testing before we merge. perhaps you can help with that as well?
f
Amazing! Yeah why not, let me know how i can help exactly?
f
just with some testing to make sure the images work as intended. i realized that the last time i tested this, i was running on an m1 mac with rosetta enabled, so i didn’t catch the error.
i’ll likely spin up an arm VM to more accurately test this this time around 😅
f
hehe yes that sounds more save! I can also have a look tomorrow and test on eks.
Just tried the flytepropeller in a multi cluster setup with the latest 
v1.1.79
image on 
t4g.medium
and it worked like a charm! Thank you so much!
👍 1
f
the last few should be merged in a few hours
💪 1
but sounds like you’re only running a dataplane on the arm cluster
f
Yes - great stuff!
f
@faint-activity-87590: you'll likely need the flytecopilot image bumped to multi-arch too. whenever this is merged: https://github.com/flyteorg/flytecopilot/pull/57
you will need this to run raw container tasks in the arm dataplane
f
Im pretty sure i had a successful run for a container task already yesterday with just the updated flytepropeller. 🤔 I guess i update copilot anyway if this merged. Thanks!
🤔 1
164 Views
Open in Slack
PreviousNext
Powered by

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Powered by