Nizar Hattab
08/14/2023, 9:52 AM@task(requests=Resources(cpu="1", mem="1Gi"))
def read_json_files(json_dir: FlyteDirectory) -> List[Dict]:
loaded_objs = []
for json_file in os.listdir(json_dir):
file_path = os.path.join(json_dir, json_file)
with open(file_path, 'r') as jf:
try:
obj = json.load(jf)
except:
print(f'Invalid json file: {json_file}')
continue
loaded_objs.append(obj)
<http://logger.info|logger.info>(f'done')
return loaded_objs
I am working on 238 json file.
Logs show that operation is done in few seconds.
resources used are negligible. but the task never finishes. stuck on running.
Update:
in propeller logs, I see this error:
Failed to check if the output file exists. Error: output file @[<gs://flyte-storage/metadata/propeller/proj-development-fcd5d390ce6a443bea7d/n0/data/0/outputs.pb>] is too large [41447872] bytes, max allowed [10485760] bytes
and
failed Execute for node. Error: failed at Node[n0]. RuntimeExecutionError: failed during plugin execution, caused by: output file @[<gs://flyte-storage/metadata/propeller/proj-development-fcd5d390ce6a443bea7d/n0/data/0/outputs.pb>] is too large [41447872] bytes, max allowed [10485760] bytes
how to change this max value?
I think it should fail the task instead of keeping it stuck on Running.Pryce
08/14/2023, 5:01 PMNizar Hattab
08/14/2023, 5:10 PMYee