https://flyte.org logo
s

Sujith Samuel

09/07/2022, 6:39 PM
#general One of my tasks is using mlflow logging facilities and when that tasks runs in the flyte pod, I am getting the below error mlflow.utils.autologging_utils: Encountered unexpected error during autologging: Unable to locate credentials This is because the flyte pod will not have the mlflow env variables pertaining to the mlflow environment like artefact store, s3 endpoint. My query is how to provide env variables to the flyte task pod which is triggered by flyte for each task
s

Shivay Lamba

09/07/2022, 8:09 PM
Hi Sujith, thanks for your question. Normally Flyte allows for secret injections directly inside of tasks incase the credentials/secrets are static. (https://docs.flyte.org/projects/cookbook/en/latest/auto/core/containerization/use_secrets.html#secrets) Would love to know more about your specific use-case with mlflow and how that handles authentication. cc @Yee
e

Eduardo Apolinario (eapolinario)

09/07/2022, 8:53 PM
@Sujith Samuel, https://docs.flyte.org/projects/cookbook/en/latest/auto/core/containerization/use_secrets.html#secrets describes how secrets work. You should be able to define env vars that mlflow can then read. Let us know if that helps.