https://flyte.org logo
#ask-the-community
Title
# ask-the-community
n

Nandakumar Raghu

10/24/2023, 4:41 PM
Hi, I am getting the following error when running a workflow:
Copy code
failed at Node[n2]. BindingResolutionError: Error binding Var [wf].[cv_res], caused by: failed at Node[n1]. CausedByError: Failed to GetPrevious data from outputDir [<s3://flyte-metadata/metadata/propeller/model-fdd918cd6b2c34e3ea92/n3/data/0/n1/0/outputs.pb>], caused by: path:<s3://flyte-metadata/metadata/propeller/model-fdd918cd6b2c34e3ea92/n3/data/0/n1/0/outputs.pb>: [LIMIT_EXCEEDED] limit exceeded. 3mb > 2mb.
I found this github discussion about changing the storage limit. We are using the
flyte-binary
chart. Should I add the
maxDownloadMBs
under
configuration.storage
?
Copy code
configuration:
  storage:
    metadataContainer: "${metadata_bucket}"
    userDataContainer: "${userdata_bucket}"
    provider: s3
    providerConfig:
      s3:
        region: "${region}"
        authType: "iam"
Thanks!
k

Ketan (kumare3)

10/24/2023, 6:51 PM
yes
do not go too high we recommend 10MB
n

Nandakumar Raghu

10/25/2023, 12:19 PM
@Ketan (kumare3) I tried it like this and it didn't work, still getting the same error.
Copy code
storage:
    metadataContainer: "${metadata_bucket}"
    userDataContainer: "${userdata_bucket}"
    provider: s3
    providerConfig:
      s3:
        region: "${region}"
        authType: "iam"
    limits:
      maxDownloadMBs: 6
That is how it is shown in the github discussion. Does that need to go somewhere else for
flyte-binary
values.yaml?
@Ketan (kumare3) - thoughts on why this might not be working?
s

Samhita Alla

11/16/2023, 4:37 AM
k

Ketan (kumare3)

11/16/2023, 4:52 AM
@Nandakumar Raghu I think your indentation looks wrong
n

Nandakumar Raghu

11/16/2023, 8:45 AM
@Ketan (kumare3) looks alright to me..
k

Ketan (kumare3)

11/16/2023, 6:07 PM
interesting
why do you have 2 storage
we use it everywhere and we know it works, it has to be some indentation issue - god you have to love yaml
n

Nandakumar Raghu

11/16/2023, 9:01 PM
We don’t have have two storage sections, I just put together the storage section from the example @Samhita Alla shared and what we are using to check the indentation.
s

Samhita Alla

11/17/2023, 4:32 AM
@Dan Rammer (hamersaw) could you help us figure out why this isn't working?
k

Ketan (kumare3)

11/17/2023, 4:36 AM
Hey @Samhita Alla Dan is out for a few days
I don’t understand the problem
4 Views