https://flyte.org logo
Powered by
#ask-the-community
Title
# ask-the-community
a

Alexey Kharlamov

03/10/2023, 3:26 PM
Hi there! Do we have any options to increase limits?
Copy code
failed at Node[n1]. BindingResolutionError: Error binding Var [wf].[chunk_list], caused by: failed at Node[n0]. CausedByError: Failed to GetPrevious data from outputDir [<s3://flyte-data/metadata/propeller/flytesnacks-development-a52pb87sdr8blxsbzgpp/n3/data/0/n0/0/outputs.pb>], caused by: path:<s3://flyte-data/metadata/propeller/flytesnacks-development-a52pb87sdr8blxsbzgpp/n3/data/0/n0/0/outputs.pb>: [LIMIT_EXCEEDED] limit exceeded. 5mb > 2mb.
k

Ketan (kumare3)

03/10/2023, 4:10 PM
Yes check out propeller config. But preferably offload large lists etc
a

Alexey Kharlamov

03/10/2023, 4:13 PM
Is it working in binary setup with:
Copy code
inline:   
   storage:      
    cache:
        max_size_mbs: 512
        target_gc_percent: 70
      limits:
        maxDownloadMBs: 10
k

Ketan (kumare3)

03/10/2023, 4:13 PM
MaxDownload
That’s the one
a

Alexey Kharlamov

03/10/2023, 4:15 PM
Currently I’m using this setup:
Copy code
storage:
      cache:
        max_size_mbs: 5120
        target_gc_percent: 70
        limits:
          maxDownloadMBs: 1000
And still receive the same error about 2mb. 
[LIMIT_EXCEEDED] limit exceeded. 5mb > 2mb.
I found the reason for the incorrect limits. The config was incorrectly aligned.
4 Views
Powered by