https://flyte.org
Join Slack
Hi there! Do we have any options to increase limits? ```failed at Node[n1]. BindingResolutionError...
# flyte-support
w
Hi there! Do we have any options to increase limits?
Copy code
failed at Node[n1]. BindingResolutionError: Error binding Var [wf].[chunk_list], caused by: failed at Node[n0]. CausedByError: Failed to GetPrevious data from outputDir [<s3://flyte-data/metadata/propeller/flytesnacks-development-a52pb87sdr8blxsbzgpp/n3/data/0/n0/0/outputs.pb>], caused by: path:<s3://flyte-data/metadata/propeller/flytesnacks-development-a52pb87sdr8blxsbzgpp/n3/data/0/n0/0/outputs.pb>: [LIMIT_EXCEEDED] limit exceeded. 5mb > 2mb.
f
Yes check out propeller config. But preferably offload large lists etc
w
Is it working in binary setup with:
Copy code
inline:   
   storage:      
    cache:
        max_size_mbs: 512
        target_gc_percent: 70
      limits:
        maxDownloadMBs: 10
f
MaxDownload
That’s the one
w
Currently I’m using this setup:
Copy code
storage:
      cache:
        max_size_mbs: 5120
        target_gc_percent: 70
        limits:
          maxDownloadMBs: 1000
And still receive the same error about 2mb. 
[LIMIT_EXCEEDED] limit exceeded. 5mb > 2mb.
I found the reason for the incorrect limits. The config was incorrectly aligned.
157 Views
Open in Slack
PreviousNext
Powered by

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Powered by