Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

Hello Flyte-Gang,
does anyone have experience with deploying flyte on an ARM kubernetes cluster? I am currently trying to deploy flytepropeller via helm on this aws instancetype: `c6g.xlarge`  but i keep running into `format exec` errors. Anything particular to watch out for? Thanks!

You need to build the docker image using the right platform `linux/arm64`

Okay but using the following arch specific image also use should work right? <https://github.com/flyteorg/flytepropeller/pkgs/container/flytepropeller/63028613?tag=ce57dbf15274a77c7037f367bda738e6ce33b453>

Unfortunately it’s not making any difference

Ah i made it work! Actually the Makefile of the flytepropeller does not use the TARGETARCH env variable from the Dockerfile. Its is hardcoded to amd64 right now! <https://github.com/flyteorg/flytepropeller/blob/master/Makefile#L14>
Using the env variable made it work for me

good catch. not sure how i missed this :disappointed:

in this case, looks like it was publishing a multi-arch image with an amd64 binary

Yes Exactly! I also saw it happening in flyteadmin. Is there a chance this gets fixed anytime soon? I am also happy to create a PR tomorrow :slightly_smiling_face:

<@U04PPM6DPA6> yea we have draft PRs here:
<https://github.com/flyteorg/datacatalog/pull/103>
<https://github.com/flyteorg/flyteadmin/pull/550>
<https://github.com/flyteorg/flytepropeller/pull/552>

definitely want to do some additional testing before we merge. perhaps you can help with that as well?

Amazing! Yeah why not, let me know how i can help exactly?

just with some testing to make sure the images work as intended. i realized that the last time i tested this, i was running on an m1 mac with rosetta enabled, so i didn’t catch the error.

i’ll likely spin up an arm VM to more accurately test this this time around :sweat_smile: 

hehe yes that sounds more save! I can also have a look tomorrow and test on eks.

Just tried the flytepropeller in a multi cluster setup with the latest `v1.1.79`  image on `t4g.medium` and it worked like a charm! Thank you so much!

the last few should be merged in a few hours

but sounds like you’re only running a dataplane on the arm cluster

<@U04PPM6DPA6>: you'll likely need the flytecopilot image bumped to multi-arch too. whenever this is merged: <https://github.com/flyteorg/flytecopilot/pull/57>

you will need this to run raw container tasks in the arm dataplane

Im pretty sure i had a successful run for a container task already yesterday with just the updated flytepropeller. :thinking_face: I guess i update copilot anyway if this merged. Thanks!