https://flyte.org logo
#flyte-deployment
Title
# flyte-deployment
j

Jan Fiedler

04/11/2023, 9:11 AM
Hello Flyte-Gang, does anyone have experience with deploying flyte on an ARM kubernetes cluster? I am currently trying to deploy flytepropeller via helm on this aws instancetype:
c6g.xlarge
but i keep running into
format exec
errors. Anything particular to watch out for? Thanks!
b

Bosco Raju

04/11/2023, 9:55 AM
You need to build the docker image using the right platform
linux/arm64
j

Jan Fiedler

04/11/2023, 10:13 AM
b

Bosco Raju

04/11/2023, 10:28 AM
yes it should
j

Jan Fiedler

04/11/2023, 10:43 AM
Unfortunately it’s not making any difference
Ah i made it work! Actually the Makefile of the flytepropeller does not use the TARGETARCH env variable from the Dockerfile. Its is hardcoded to amd64 right now! https://github.com/flyteorg/flytepropeller/blob/master/Makefile#L14 Using the env variable made it work for me
j

jeev

04/11/2023, 3:54 PM
good catch. not sure how i missed this 😞
in this case, looks like it was publishing a multi-arch image with an amd64 binary
🤦
j

Jan Fiedler

04/11/2023, 4:00 PM
Yes Exactly! I also saw it happening in flyteadmin. Is there a chance this gets fixed anytime soon? I am also happy to create a PR tomorrow 🙂
j

jeev

04/11/2023, 7:43 PM
@Jan Fiedler yea we have draft PRs here: https://github.com/flyteorg/datacatalog/pull/103 https://github.com/flyteorg/flyteadmin/pull/550 https://github.com/flyteorg/flytepropeller/pull/552 definitely want to do some additional testing before we merge. perhaps you can help with that as well?
j

Jan Fiedler

04/11/2023, 8:51 PM
Amazing! Yeah why not, let me know how i can help exactly?
j

jeev

04/11/2023, 8:55 PM
just with some testing to make sure the images work as intended. i realized that the last time i tested this, i was running on an m1 mac with rosetta enabled, so i didn’t catch the error.
i’ll likely spin up an arm VM to more accurately test this this time around 😅
j

Jan Fiedler

04/11/2023, 9:01 PM
hehe yes that sounds more save! I can also have a look tomorrow and test on eks.
Just tried the flytepropeller in a multi cluster setup with the latest
v1.1.79
image on
t4g.medium
and it worked like a charm! Thank you so much!
j

jeev

04/12/2023, 1:31 PM
the last few should be merged in a few hours
but sounds like you’re only running a dataplane on the arm cluster
j

Jan Fiedler

04/12/2023, 1:33 PM
Yes - great stuff!
j

jeev

04/12/2023, 3:46 PM
@Jan Fiedler: you'll likely need the flytecopilot image bumped to multi-arch too. whenever this is merged: https://github.com/flyteorg/flytecopilot/pull/57
you will need this to run raw container tasks in the arm dataplane
j

Jan Fiedler

04/12/2023, 3:59 PM
Im pretty sure i had a successful run for a container task already yesterday with just the updated flytepropeller. 🤔 I guess i update copilot anyway if this merged. Thanks!
13 Views