I'm on Windows 10. I've installed `flytekit` using...
# ask-the-community
t
I'm on Windows 10. I've installed
flytekit
using:
Copy code
pip install flytekit
tried to reinstall it, used conda to install it, removed it and then installed it again using pip. But when I use
flytekit status
on my vscode terminal I get this error:
Copy code
'flytekit' is not recognized as an internal or external command,
operable program or batch file.
I've added these PATHS to my environment variables [the image is attached] Can anyone please give me a clue? Why is
flytekit
or any of its features like
pyflyte
is not recognized on my terminal (either vscode or cmd)? Any help would be really appreciated. Thanks.
k
Where did you get flytekit status from
Did you mean flytectl
k
Did you activate your conda environment?
conda activate ENVIRONMENT
, and run
pyflyte --help
again
btw, we don’t have “flytekit” command, we only have
flyte-cli
and
pyflyte
t
Thank you @Ketan (kumare3) and @Kevin Su for all your help. I could run pyflyte on a local cluster. But my first node gets stuck and shows this error:
Copy code
[1/1] currentAttempt done. Last Error: USER::Pod failed. No message received from kubernetes.
[fa1fe016a52f4407f854-n0-0] terminated with exit code (1). Reason [OOMKilled]. Message: 
tar: Removing leading `/' from member names

Traceback (most recent call last):
  File "/opt/venv/bin/pyflyte-fast-execute", line 8, in <module>
    sys.exit(fast_execute_task_cmd())
  File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/opt/venv/lib/python3.8/site-packages/flytekit/bin/entrypoint.py", line 502, in fast_execute_task_cmd
    subprocess.run(cmd, check=True)
  File "/usr/lib/python3.8/subprocess.py", line 516, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pyflyte-execute', '--inputs', '<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-fa1fe016a52f4407f854/n0/data/inputs.pb>', '--output-prefix', '<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-fa1fe016a52f4407f854/n0/data/0>', '--raw-output-data-prefix', '<s3://my-s3-bucket/99/fa1fe016a52f4407f854-n0-0>', '--checkpoint-path', '<s3://my-s3-bucket/99/fa1fe016a52f4407f854-n0-0/_flytecheckpoints>', '--prev-checkpoint', '""', '--dynamic-addl-distro', '<s3://my-s3-bucket/ak/flytesnacks/development/OYOIT33YIIPNI6APLKLW6GQCME======/scriptmode.tar.gz>', '--dynamic-dest-dir', '.', '--resolver', 'flytekit.core.python_auto_container.default_task_resolver', '--', 'task-module', 'diabetes', 'task-name', 'split_traintest_dataset']' died with <Signals.SIGKILL: 9>.
.
Somehow I'm always stuck with kubernetes pods failures.
y
hey do you have access to the pod?
can you paste the pod spec from
kubectl get pod -o yaml
?
k
OOMKilled
.It seems like you don’t have enough resource for your task. you can overwrite default task resource.
Copy code
@task(limits=Resources(cpu='2', mem="2000Mi"))
def t1():
    ...
❤️ 1
t
@Yee It worked when I changed the memory to 2000 like @Kevin Su and @Samhita Alla said. @Kevin Su thank you sooo much! It worked! Thanks to @Ketan (kumare3), @austin and others who helped me in every step. You guys are amazing!
👍 2
280 Views