few-animal-62717
08/24/2022, 9:25 PM[1/1] currentAttempt done. Last Error: USER::Pod failed. No message received from kubernetes.
[f167c07ba12604be28d7-n0-0] terminated with exit code (1). Reason [Error]. Message:
tar: Removing leading `/' from member names
Traceback (most recent call last):
File "/opt/venv/bin/pyflyte-fast-execute", line 8, in <module>
sys.exit(fast_execute_task_cmd())
File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1130, in __call__
return self.main(*args, **kwargs)
File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1055, in main
rv = self.invoke(ctx)
File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1404, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 760, in invoke
return __callback(*args, **kwargs)
File "/opt/venv/lib/python3.8/site-packages/flytekit/bin/entrypoint.py", line 502, in fast_execute_task_cmd
subprocess.run(cmd, check=True)
File "/usr/local/lib/python3.8/subprocess.py", line 516, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pyflyte-execute', '--inputs', '<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-f167c07ba12604be28d7/n0/data/inputs.pb>', '--output-prefix', '<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-f167c07ba12604be28d7/n0/data/0>', '--raw-output-data-prefix', '<s3://my-s3-bucket/test/n1/f167c07ba12604be28d7-n0-0>', '--checkpoint-path', '<s3://my-s3-bucket/test/n1/f167c07ba12604be28d7-n0-0/_flytecheckpoints>', '--prev-checkpoint', '""', '--dynamic-addl-distro', '<s3://my-s3-bucket/ht/flytesnacks/development/XB5EEQT46XRRFMME7UC7ROF2JA======/scriptmode.tar.gz>', '--dynamic-dest-dir', '/root', '--resolver', 'flytekit.core.python_auto_container.default_task_resolver', '--', 'task-module', 'feast_integration.feast_workflow', 'task-name', 'dummy_thing']' died with <Signals.SIGKILL: 9>.
.
freezing-airport-6809
freezing-airport-6809
tall-lock-23197
@task(requests=Resources(mem="500Mi", cpu="2"))
. Would you mind letting me know what this task encompasses?freezing-airport-6809
broad-monitor-993
08/25/2022, 2:27 PMHmm we should improve the error visibilityI feel like a quick win here would be to use
rich
to pretty print tracebacks: https://rich.readthedocs.io/en/stable/traceback.htmlfew-animal-62717
08/25/2022, 2:28 PM@task
def dummy(bucket_name: str) -> str:
<http://logger.info|logger.info>("test!")
return bucket_name
few-animal-62717
08/25/2022, 2:28 PMflytekit==0.32.3
@freezing-airport-6809broad-monitor-993
08/25/2022, 2:29 PM1.1.*
?few-animal-62717
08/25/2022, 2:30 PMfew-animal-62717
08/25/2022, 2:30 PMbroad-monitor-993
08/25/2022, 2:35 PMfor the cookbook tutorial i was running need an updateyes we use
pip-compile
to pin all package versions, we currently don’t have an automatic way of doing this, we can look into thatfew-animal-62717
08/25/2022, 2:35 PM