https://flyte.org logo
Title
f

Fhuad Balogun

02/16/2023, 8:04 AM
Hi comm, I'm new to Flyte. I have been trying to get around this, but don't know what the issue is. I installed the flyte sandbox to test things out. When I run a workflow locally, it works fine and completed (typically completed in 3 mins). However, when I run it remotely in the sandbox, it takes very long time (about an hour) and eventually fails with this error:
Pod failed. No message received from kubernetes.
s

Samhita Alla

02/16/2023, 9:54 AM
Welcome @Fhuad Balogun to the community. Have you run
flytectl demo start
to spin up the cluster? And what workflow are you trying to run?
f

Fhuad Balogun

02/16/2023, 3:34 PM
Yes I have
I created a small custom workflow. Although the quick one from the getting started page on the doc also had the same issue.
d

David Espejo (he/him)

02/16/2023, 6:25 PM
HI @Fhuad Balogun could you share the output of
kubectl get pods -n flyte
s

Samhita Alla

02/17/2023, 5:04 AM
Could you also share the output of
kubcetl logs <pod-name> -n flytesnacks-development
? You can get the pod that's erroring out by running
kubectl get pods -n flytesnacks-development
considering
flytesnacks-development
is the namespace you triggered the workflow in.
f

Fhuad Balogun

02/17/2023, 9:28 AM
Thanks guys @David Espejo @Samhita Alla This is the error I get on describing the pod in
flytesnacks-development
namespace (screenshot) And when I check the logs, it says trying and failing to pull image.
s

Samhita Alla

02/17/2023, 10:02 AM
I believe your system isn't allowing you to pull the image.
f

Fhuad Balogun

02/19/2023, 5:34 PM
Thanks @Samhita Alla still didn't work. However, I'm already going deeper into registering workflows. I want to ask, how do I ship in all necessary packages that are needed to make a workflow run successfully? for example, I've modularized my code and the tasks arranged into a workflow are in different modules of the project, will Flyte be able to package all these when I run "pyflyte register", "pyflyte packages" or "flytctl register"? Also, how do I register workflows with different tasks from a Jupyter Notebook?
s

Samhita Alla

02/20/2023, 3:59 AM
@Fhuad Balogun, you can use
pyflyte register
to package up all your tasks and workflows present in different modules. You can register workflows from a Jupyter notebook using
register_workflow
method: https://github.com/flyteorg/flytekit/blob/707fc03b88ec08fb10d60ac642f3c80e275bd90c/tests/flytekit/unit/remote/test_sandbox.py#L70-L77.
f

Fhuad Balogun

02/20/2023, 8:41 AM
Ok. Thank you very much.
Hello @Samhita Alla Can you help with this issue? https://flyte-org.slack.com/archives/CP2HDHKE1/p1676980150513129