Tom Szumowski07/29/2022, 6:11 PM
, but with the
task decorator changed to:
When I run it, I get this error:
Is it possible to use any arbitrary image as a task there? Or does the image need to follow a specific build process that includes
[f902b0296c1a94ed4ade-n1-0] terminated with exit code (128). Reason [StartError]. Message: failed to create containerd task: failed to create shim: OCI runtime create failed: container_linux.go:380: starting container process caused: exec: "pyflyte-fast-execute": executable file not found in $PATH: unknown.
? Thank you!
pyflyte run --image <http://gcr.io/urbn-data-science/flytekit-test-wrapper:latest|gcr.io/urbn-data-science/flytekit-test-wrapper:latest> --remote workflows/basic_workflow_custom.py my_wf --a 10 --b foobar
image is a default image I built due to GCP workflow identity errors discussed here. Not sure if that is conflicting with my desired goal above or not.
Kevin Su07/29/2022, 6:43 PM
Tom Szumowski07/29/2022, 6:49 PM
If I wish to use a custom image, do I need to create a new image that runs all of the above as well? Otherwise I was getting GCP permission errors. And if so, does that mean this should be applied to every custom Dockerfile I wish to have?
WORKDIR /root ENV PYTHONPATH /root RUN pip install awscli RUN pip install gsutil ARG VERSION ARG DOCKER_IMAGE # Pod tasks should be exposed in the default image RUN pip install -U flytekit==$VERSION flytekitplugins-pod==$VERSION ENV FLYTE_INTERNAL_IMAGE "$DOCKER_IMAGE"
Tom Szumowski07/29/2022, 10:34 PM
Tom Szumowski07/29/2022, 10:35 PM
Tom Szumowski07/29/2022, 10:39 PM
what we call
pyflyte run / register
Eli Bixby01/25/2023, 4:56 PM
on e.g. a
that doesn't have anything to do with python, has anyone tried making a sidecar pattern work? We have a lot of weird tools we package up (bringing in legacy tools from another industry) in containers, and I'm a little worried about this pulling us into dependency hell.
Felix Ruess01/25/2023, 5:32 PM
Eli Bixby01/25/2023, 5:36 PM
Dan Rammer (hamersaw)01/25/2023, 5:37 PM
Eli Bixby01/25/2023, 5:37 PM
Slackbot01/25/2023, 7:18 PM
Niels Bantilan01/25/2023, 9:54 PM