I'm on Windows 10. I've installed `flytekit` using...
# flyte-support
m
I'm on Windows 10. I've installed
flytekit
using:
Copy code
pip install flytekit
tried to reinstall it, used conda to install it, removed it and then installed it again using pip. But when I use
flytekit status
on my vscode terminal I get this error:
Copy code
'flytekit' is not recognized as an internal or external command,
operable program or batch file.
I've added these PATHS to my environment variables [the image is attached] Can anyone please give me a clue? Why is
flytekit
or any of its features like
pyflyte
is not recognized on my terminal (either vscode or cmd)? Any help would be really appreciated. Thanks.
f
Where did you get flytekit status from
Did you mean flytectl
g
Did you activate your conda environment?
conda activate ENVIRONMENT
, and run
pyflyte --help
again
btw, we don’t have “flytekit” command, we only have
flyte-cli
and
pyflyte
m
Thank you @freezing-airport-6809 and @glamorous-carpet-83516 for all your help. I could run pyflyte on a local cluster. But my first node gets stuck and shows this error:
Copy code
[1/1] currentAttempt done. Last Error: USER::Pod failed. No message received from kubernetes.
[fa1fe016a52f4407f854-n0-0] terminated with exit code (1). Reason [OOMKilled]. Message: 
tar: Removing leading `/' from member names

Traceback (most recent call last):
  File "/opt/venv/bin/pyflyte-fast-execute", line 8, in <module>
    sys.exit(fast_execute_task_cmd())
  File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/opt/venv/lib/python3.8/site-packages/flytekit/bin/entrypoint.py", line 502, in fast_execute_task_cmd
    subprocess.run(cmd, check=True)
  File "/usr/lib/python3.8/subprocess.py", line 516, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pyflyte-execute', '--inputs', '<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-fa1fe016a52f4407f854/n0/data/inputs.pb>', '--output-prefix', '<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-fa1fe016a52f4407f854/n0/data/0>', '--raw-output-data-prefix', '<s3://my-s3-bucket/99/fa1fe016a52f4407f854-n0-0>', '--checkpoint-path', '<s3://my-s3-bucket/99/fa1fe016a52f4407f854-n0-0/_flytecheckpoints>', '--prev-checkpoint', '""', '--dynamic-addl-distro', '<s3://my-s3-bucket/ak/flytesnacks/development/OYOIT33YIIPNI6APLKLW6GQCME======/scriptmode.tar.gz>', '--dynamic-dest-dir', '.', '--resolver', 'flytekit.core.python_auto_container.default_task_resolver', '--', 'task-module', 'diabetes', 'task-name', 'split_traintest_dataset']' died with <Signals.SIGKILL: 9>.
.
Somehow I'm always stuck with kubernetes pods failures.
t
hey do you have access to the pod?
can you paste the pod spec from
kubectl get pod -o yaml
?
g
OOMKilled
.It seems like you don’t have enough resource for your task. you can overwrite default task resource.
Copy code
@task(limits=Resources(cpu='2', mem="2000Mi"))
def t1():
    ...
❤️ 1
m
@thankful-minister-83577 It worked when I changed the memory to 2000 like @glamorous-carpet-83516 and @tall-lock-23197 said. @glamorous-carpet-83516 thank you sooo much! It worked! Thanks to @freezing-airport-6809, @echoing-translator-95395 and others who helped me in every step. You guys are amazing!
👍 2
302 Views