Hi everyone, I'm working on deploying Flyte on Az...
# flyte-deployment
m
Hi everyone, I'm working on deploying Flyte on Azure and I'm looking for some guidance on using Flyte-binary with Terraform. I've previously deployed Flyte using Helm without Terraform, but I'd like to use Terraform to manage my infrastructure more effectively. I've been exploring the
unionai-oss/deploy-flyte
project as a starting point, but it focuses on Flyte-core with a multi-cluster AKS setup. My use case requires a single-cluster deployment, which is why I want to use Flyte-binary. While testing the Flyte-core example, I encountered the following error when running a workflow:
Copy code
"Failed to get data from <abfs://flytetf/flytesnacks/development/5VQ5YWMCBE7D3QTKVTF4Z4YS4E======/script_mode.tar.gz>"
I've already checked the Azure storage variables, and they appear to be correctly configured. I also came across this thread (https://discuss.flyte.org/t/13904302/hello-back-with-more-azure-adventures-slightly-smiling-face-#171ed070-94f0-4bf9-b670-1f4416bd6d10) which discusses a similar issue, but it didn't solve my problem. Could anyone provide assistance with either of the following: • Terraform/OpenTofu scripts for deploying Flyte-binary on AKS. • Troubleshooting the Azure Blob Storage error mentioned above. Any help would be greatly appreciated!
a
@millions-bird-5377 sorry if the Terraform code or docs led you to think that the module is for multicluster only, but that's not the case. It deploys flyte-core yes, which is a Flyte form factor that supports multi cluster, but this setup only uses a single AKS instance. The main reason we chose flyte-core for the Terraform implementation is because the chart helpers allows us to mess with the values to enable the automated deployment of the chart. We can tweak flyte-binary to do the same but that was left out of scope of the reference implementation (but contributions are welcome)
the error you're getting is concerning, last time we tested it worked OOB. Could you try getting logs from the propeller pod?
p
> • Troubleshooting the Azure Blob Storage error mentioned above. @millions-bird-5377 - we get this error when the serviceaccount used by our task pods don't have the correct permissions setup. are you using SAS tokens? workload identity?