https://flyte.org
Join Slack
Help please, In my journey of exploring flyte. I am blocked in setting up Flyte by sandbox path. I a...
# flyte-support
m
Help please, In my journey of exploring flyte. I am blocked in setting up Flyte by sandbox path. I am getting the below error by triggering the task -
Copy code
[1/1] currentAttempt done. Last Error: USER::containers with unready status: [f1292d6636de043288f1-n0-0]|Back-off pulling image "<http://cr.flyte.org/flyteorg/flytekit:py3.9-1.5.0|cr.flyte.org/flyteorg/flytekit:py3.9-1.5.0>"
On further debugging, I came to know this due to Container is failed to pull the image -
Copy code
<http://ghcr.io/flyteorg/flytekit:py3.9-latest|ghcr.io/flyteorg/flytekit:py3.9-latest>
Here are the Kubernetes event logs -
Copy code
Events:
  Type     Reason     Age                From               Message
  ----     ------     ----               ----               -------
  Normal   Scheduled  54s                default-scheduler  Successfully assigned default/py39-cacher to ac11a6c8fb0e
  Normal   Pulling    15s (x3 over 54s)  kubelet            Pulling image "<http://ghcr.io/flyteorg/flytekit:py3.9-latest|ghcr.io/flyteorg/flytekit:py3.9-latest>"
  Warning  Failed     15s (x3 over 54s)  kubelet            Failed to pull image "<http://ghcr.io/flyteorg/flytekit:py3.9-latest|ghcr.io/flyteorg/flytekit:py3.9-latest>": rpc error: code = Unknown desc = failed to pull and unpack image "<http://ghcr.io/flyteorg/flytekit:py3.9-latest|ghcr.io/flyteorg/flytekit:py3.9-latest>": failed to resolve reference "<http://ghcr.io/flyteorg/flytekit:py3.9-latest|ghcr.io/flyteorg/flytekit:py3.9-latest>": failed to do request: Head "<https://ghcr.io/v2/flyteorg/flytekit/manifests/py3.9-latest>": x509: certificate signed by unknown authority
  Warning  Failed     15s (x3 over 54s)  kubelet            Error: ErrImagePull
  Normal   BackOff    2s (x3 over 54s)   kubelet            Back-off pulling image "<http://ghcr.io/flyteorg/flytekit:py3.9-latest|ghcr.io/flyteorg/flytekit:py3.9-latest>"
  Warning  Failed     2s (x3 over 54s)   kubelet            Error: ImagePullBackOff
f
Hi @mammoth-librarian-92821 firstly welcome to Flyte. Then thank you for reporting Can you try to docker pull the image
m
@freezing-airport-6809 Thanks for the warm welcome. I ran following commands -
Copy code
$(get-infra-prompt)(base) chirayu.gupta@BLRETV-K32FK2W6 ~ % docker ps
CONTAINER ID   IMAGE                                                                                      COMMAND                  CREATED          STATUS          PORTS                                                                                    NAMES
ac11a6c8fb0e   <http://cr.flyte.org/flyteorg/flyte-sandbox-bundled:sha-bc521dac6f0dc6e1942efa6447611cd3354540c4|cr.flyte.org/flyteorg/flyte-sandbox-bundled:sha-bc521dac6f0dc6e1942efa6447611cd3354540c4>   "/bin/k3d-entrypoint…"   59 seconds ago   Up 55 seconds   0.0.0.0:6443->6443/tcp, 0.0.0.0:30000-30002->30000-30002/tcp, 0.0.0.0:30080->30080/tcp   flyte-sandbox
``````
when I tried doing exec in container
Copy code
docker exec -it ac11a6c8fb0e sh  
/ # kubectl get pods
NAME          READY   STATUS         RESTARTS   AGE
py39-cacher   0/1     ErrImagePull   0          33s

/ # docker
sh: docker: not found
docker is not installed inside the container however docker is running locally and I am able pull image through it.
f
You don’t have to exec
It uses your machines docker
Might be some proxy issue
m
got it
How I can resolve proxy issue?
@freezing-airport-6809 Any lead here?
f
Does local Pull work?
m
yes
f
ok, then i am not sure, has to be some odd networking setup
m
@freezing-airport-6809 Do you know someone who can help out ?
f
I could have if I understood the problem- let’s start from the beginning 1. Where are you running demo cluster 2. How did you start 3. Can you docker pull the image 4. Can you try running kubectl create pod for some random image
166 Views
Open in Slack
PreviousNext
Powered by

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Powered by