Hi there, We're trying to put together a clustered environment on a baremetal microk8s cluster. We've provisioned our postgresql server and our minio server and we're trying to work with the flyte-binary helm chart. We've configured the necessary

configuration.database

and

configuration.storage.providerConfig

configs with the following:

configuration.database.host = "postgres-svc"
configuration.database.username = "postgres"
configuration.database.password = "<passwd>"
configuration.storage.metadataContainer = "bucket1"
configuration.storage.userDataContainer = "bucket1"
configuration.storage.providerConfig.s3.endpoint = "minio-svc"
configuration.storage.providerConfig.s3.authType = "acceskey"
configuration.storage.providerConfig.s3.accessKey = "flyteuser"
configuration.storage.providerConfig.s3.secretKey = "<flyteuserpasswd>"
configuration.storage.providerConfig.s3.disableSSL = true

We're able to register workflows and tasks and we're able to execute them, although the pods running our hello world tasks are not able to connect to our minio instance (at least that's what we get from the following error)

│ │ _execute_task                                                                │                                                                                                                              ││ │                                                                              │                                                                                                                              │
│ │ ❱ 362 │   │   _handle_annotated_task(ctx, _task_def, inputs, output_prefix)  │                                                                                                                              │
│ │                                                                              │                                                                                                                              │
│ │ /opt/venv/lib/python3.8/site-packages/flytekit/bin/entrypoint.py:304 in      │                                                                                                                              │
│ │ _handle_annotated_task                                                       │                                                                                                                              ││ │                                                                              │                                                                                                                              │
│ │ ❱ 304 │   _dispatch_execute(ctx, task_def, inputs, output_prefix)            │                                                                                                                              │
│ │                                                                              │                                                                                                                              │
│ │ /opt/venv/lib/python3.8/site-packages/flytekit/bin/entrypoint.py:160 in      │                                                                                                                              │
│ │ _dispatch_execute                                                            │                                                                                                                              │
│ │                                                                              │                                                                                                                              │
│ │ ❱ 160 │   ctx.file_access.put_data(ctx.execution_state.engine_dir, output_pr │                                                                                                                              │
│ │                                                                              │                                                                                                                              │
│ │ /opt/venv/lib/python3.8/site-packages/flytekit/core/data_persistence.py:320  │                                                                                                                              │
│ │ in put_data                                                                  │                                                                                                                              │
│ │                                                                              │                                                                                                                              │
│ │ ❱ 320 │   │   │   raise FlyteAssertion(                                      │                                                                                                                              │
│ ╰──────────────────────────────────────────────────────────────────────────────╯                                                                                                                              │
│ FlyteAssertion: Failed to put data from                                                                                                                                                                       │
│ /tmp/flyte-erp4nnjc/sandbox/local_flytekit/engine_dir to                                                                                                                                                      │
│ <s3://flyte/metadata/propeller/flytesnacks-development-fa6db7ab7ed90473588b/n0/da>                                                                                                                              │
│ ta/0 (recursive=True).                                                                                                                                                                                        │
│                                                                                                                                                                                                               │
│ Original exception: Unable to locate credentials

Any idea what's going wrong?

did you add default-env-vars in propeller configmap? https://github.com/flyteorg/flyte/blob/585143028fe4cef0af568938503e1a52669f6c34/charts/flyte-core/values-sandbox.yaml#L72-L76

Yes, I've tried that but these environment variables then were all lowercase in the task's pod which resulted in a failed authentication since the values were not picked up correctly.