Taeef Najib
07/27/2022, 3:13 AMflytekit
using:
pip install flytekit
tried to reinstall it, used conda to install it, removed it and then installed it again using pip. But when I use flytekit status
on my vscode terminal I get this error:
'flytekit' is not recognized as an internal or external command,
operable program or batch file.
I've added these PATHS to my environment variables [the image is attached]
Can anyone please give me a clue? Why is flytekit
or any of its features like pyflyte
is not recognized on my terminal (either vscode or cmd)? Any help would be really appreciated. Thanks.Ketan (kumare3)
Kevin Su
07/27/2022, 5:30 AMconda activate ENVIRONMENT
, and run pyflyte --help
againflyte-cli
and pyflyte
Taeef Najib
07/27/2022, 9:09 PM[1/1] currentAttempt done. Last Error: USER::Pod failed. No message received from kubernetes.
[fa1fe016a52f4407f854-n0-0] terminated with exit code (1). Reason [OOMKilled]. Message:
tar: Removing leading `/' from member names
Traceback (most recent call last):
File "/opt/venv/bin/pyflyte-fast-execute", line 8, in <module>
sys.exit(fast_execute_task_cmd())
File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1130, in __call__
return self.main(*args, **kwargs)
File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1055, in main
rv = self.invoke(ctx)
File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1404, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 760, in invoke
return __callback(*args, **kwargs)
File "/opt/venv/lib/python3.8/site-packages/flytekit/bin/entrypoint.py", line 502, in fast_execute_task_cmd
subprocess.run(cmd, check=True)
File "/usr/lib/python3.8/subprocess.py", line 516, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pyflyte-execute', '--inputs', '<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-fa1fe016a52f4407f854/n0/data/inputs.pb>', '--output-prefix', '<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-fa1fe016a52f4407f854/n0/data/0>', '--raw-output-data-prefix', '<s3://my-s3-bucket/99/fa1fe016a52f4407f854-n0-0>', '--checkpoint-path', '<s3://my-s3-bucket/99/fa1fe016a52f4407f854-n0-0/_flytecheckpoints>', '--prev-checkpoint', '""', '--dynamic-addl-distro', '<s3://my-s3-bucket/ak/flytesnacks/development/OYOIT33YIIPNI6APLKLW6GQCME======/scriptmode.tar.gz>', '--dynamic-dest-dir', '.', '--resolver', 'flytekit.core.python_auto_container.default_task_resolver', '--', 'task-module', 'diabetes', 'task-name', 'split_traintest_dataset']' died with <Signals.SIGKILL: 9>.
.
Somehow I'm always stuck with kubernetes pods failures.Yee
kubectl get pod -o yaml
?Kevin Su
07/28/2022, 5:41 AMOOMKilled
.It seems like you don’t have enough resource for your task.
you can overwrite default task resource.
@task(limits=Resources(cpu='2', mem="2000Mi"))
def t1():
...
Taeef Najib
07/28/2022, 6:23 PM