Sujith Samuel

    Sujith Samuel

    2 weeks ago
    #general One of my tasks is using mlflow logging facilities and when that tasks runs in the flyte pod, I am getting the below error mlflow.utils.autologging_utils: Encountered unexpected error during autologging: Unable to locate credentials This is because the flyte pod will not have the mlflow env variables pertaining to the mlflow environment like artefact store, s3 endpoint. My query is how to provide env variables to the flyte task pod which is triggered by flyte for each task
    Shivay Lamba

    Shivay Lamba

    2 weeks ago
    Hi Sujith, thanks for your question. Normally Flyte allows for secret injections directly inside of tasks incase the credentials/secrets are static. (https://docs.flyte.org/projects/cookbook/en/latest/auto/core/containerization/use_secrets.html#secrets) Would love to know more about your specific use-case with mlflow and how that handles authentication. cc @Yee
    Eduardo Apolinario (eapolinario)

    Eduardo Apolinario (eapolinario)

    2 weeks ago
    @Sujith Samuel, https://docs.flyte.org/projects/cookbook/en/latest/auto/core/containerization/use_secrets.html#secrets describes how secrets work. You should be able to define env vars that mlflow can then read. Let us know if that helps.