Hi all I have a few process now converted into tasks just ad

Question

Hi all I have a few process now converted into tasks just added the decorator but when I run the task takes a lot of time to complete compared when I run the process in a non flyte environment I set the same resources Any ideas

Ketan (kumare3) · Answer

Hmm quantify lot of time

Eduardo Matus · Answer

nonflyte takes 50 mins aprox on Flyte environment takes 2 hours aprox

Kevin Su · Answer

what kind of task you are running model training are you reading large files from s3

Eduardo Matus · Answer

< Kevin Su> Read large data sets from elastic search to then transform the data and store in another index The existing process has many multiprocessing steps

Kevin Su · Answer

which version of flytekit you are running

Eduardo Matus · Answer

version = 1 2 0 b1

Kevin Su · Answer

we have a pr to add runtime metric in flytekit so it will be easy to debug by using that <https github com flyteorg flytekit pull 1581>

Kevin Su · Answer

just to confirm you are using elastic search sdk to download data not using awscli right

Eduardo Matus · Answer

correct

Ketan (kumare3) · Answer

< Eduardo Matus> also I think you should add enough cpus

Ketan (kumare3) · Answer

And memory

Ketan (kumare3) · Answer

Hmm can you add a couple log lines I would be curious and want to help

Ketan (kumare3) · Answer

If at all it should go faster with more power

Felix Ruess · Answer

< Eduardo Matus> what do you mean by a non flyte environment Still in containers on kubernetes though And there on the same class of node machine