millions-librarian-94423
07/27/2022, 3:13 AMflytekit
using:
pip install flytekit
tried to reinstall it, used conda to install it, removed it and then installed it again using pip. But when I use flytekit status
on my vscode terminal I get this error:
'flytekit' is not recognized as an internal or external command,
operable program or batch file.
I've added these PATHS to my environment variables [the image is attached]
Can anyone please give me a clue? Why is flytekit
or any of its features like pyflyte
is not recognized on my terminal (either vscode or cmd)? Any help would be really appreciated. Thanks.freezing-airport-6809
freezing-airport-6809
glamorous-carpet-83516
07/27/2022, 5:30 AMconda activate ENVIRONMENT
, and run pyflyte --help
againglamorous-carpet-83516
07/27/2022, 5:31 AMflyte-cli
and pyflyte
millions-librarian-94423
07/27/2022, 9:09 PM[1/1] currentAttempt done. Last Error: USER::Pod failed. No message received from kubernetes.
[fa1fe016a52f4407f854-n0-0] terminated with exit code (1). Reason [OOMKilled]. Message:
tar: Removing leading `/' from member names
Traceback (most recent call last):
File "/opt/venv/bin/pyflyte-fast-execute", line 8, in <module>
sys.exit(fast_execute_task_cmd())
File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1130, in __call__
return self.main(*args, **kwargs)
File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1055, in main
rv = self.invoke(ctx)
File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1404, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 760, in invoke
return __callback(*args, **kwargs)
File "/opt/venv/lib/python3.8/site-packages/flytekit/bin/entrypoint.py", line 502, in fast_execute_task_cmd
subprocess.run(cmd, check=True)
File "/usr/lib/python3.8/subprocess.py", line 516, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pyflyte-execute', '--inputs', '<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-fa1fe016a52f4407f854/n0/data/inputs.pb>', '--output-prefix', '<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-fa1fe016a52f4407f854/n0/data/0>', '--raw-output-data-prefix', '<s3://my-s3-bucket/99/fa1fe016a52f4407f854-n0-0>', '--checkpoint-path', '<s3://my-s3-bucket/99/fa1fe016a52f4407f854-n0-0/_flytecheckpoints>', '--prev-checkpoint', '""', '--dynamic-addl-distro', '<s3://my-s3-bucket/ak/flytesnacks/development/OYOIT33YIIPNI6APLKLW6GQCME======/scriptmode.tar.gz>', '--dynamic-dest-dir', '.', '--resolver', 'flytekit.core.python_auto_container.default_task_resolver', '--', 'task-module', 'diabetes', 'task-name', 'split_traintest_dataset']' died with <Signals.SIGKILL: 9>.
.
Somehow I'm always stuck with kubernetes pods failures.thankful-minister-83577
thankful-minister-83577
kubectl get pod -o yaml
?glamorous-carpet-83516
07/28/2022, 5:41 AMOOMKilled
.It seems like you don’t have enough resource for your task.
you can overwrite default task resource.
@task(limits=Resources(cpu='2', mem="2000Mi"))
def t1():
...
millions-librarian-94423
07/28/2022, 6:23 PM