I m trying to do some tests in flyte sandbox but `pyflyte co

Question

I m trying to do some tests in flyte sandbox but `pyflyte config ~ flyte config sandbox yaml register ` gives me exceptions failed to put data Is this supposed to work out of the box I can t seem to find where I configure credentials as that seems to be the problem

Felix Ruess · Answer

```flytekit exceptions user FlyteAssertion Failed to put data from tmp tmpj j4utc7 fast451f92eba04c8d8928e00c0180d0e672 tar gz to recursive=False Original exception 400 message= Bad Request url=URL ``` somehow signed urls are not working

Felix Ruess · Answer

< Dan Rammer hamersaw > < Yee> any pointers here so I can test

Dan Rammer (hamersaw) · Answer

what does your `~ flyte config sandbox yaml` look like it should just work out of the box

Felix Ruess · Answer

looks good ```admin For GRPC endpoints you might want to use dns flyte myexample com endpoint localhost 30080 authType Pkce insecure true console endpoint <http localhost 30080> logger show source true level 0```

Felix Ruess · Answer

minio is running and I can view the bucket

Dan Rammer (hamersaw) · Answer

oh sure sorry been a long morning sweat smile < Yee> ideas on registering into sandbox issue

Yee · Answer

um

Yee · Answer

no i ve not seen this before

Yee · Answer

which version of flytekit are you on

Felix Ruess · Answer

v1 3 2 15 g569b5633 so my containertask podtemplate branch

Yee · Answer

yeah there should be no reason you re seeing that

Yee · Answer

let me try to repro

Felix Ruess · Answer

I already tore down the demo sandbox again and deleted the flyte sandbox docker volume for good measure still the same

Felix Ruess · Answer

this was with `flytectl demo start image <http ghcr io flyteorg flyte sandbox bundled sha e3703333bbef6153f5ec15d3c0c6500009c41bdf|ghcr io flyteorg flyte sandbox bundled sha e3703333bbef6153f5ec15d3c0c6500009c41bdf>` that you posted

Yee · Answer

can you check out master and try again

Yee · Answer

just try ```$ pyflyte config ~ flyte config sandbox yaml register version fr8 core flyte basics hello world py```

Yee · Answer

um i m in `~ go src github com flyteorg flytesnacks cookbook` but you can just copy that file anywhere

Felix Ruess · Answer

ah and I did a `pip install git+` to thet the flyteidl pr from < Dan Rammer hamersaw > in

Felix Ruess · Answer

gotta run now will try it tomorrow or sunday thanks < Yee>

Yee · Answer

okay sure

Yee · Answer

i m not able to repro though btw

Yee · Answer

```$ pyflyte config ~ flyte config sandbox yaml register version fr8 core ress py asctime 2023 03 03 09 33 22 695 name flytekit levelname WARNING message FlyteSchema is deprecated use Structured Dataset instead Running pyflyte register from Users ytong go src github com flyteorg flytesnacks cookbook with images ImageConfig default image=Image name= default fqn= tag= py3 10 latest images= Image name= default fqn= tag= py3 10 latest and image destination folder root on 1 package s Users ytong go src github com flyteorg flytesnacks cookbook core ress py Registering against localhost 30080 Detected Root Users ytong go src github com flyteorg flytesnacks cookbook using this to create deployable package No output path provided using a temporary directory at var folders jx 54tww2ls58n8qtlp9k31nbd80000gp T tmp6d5w6095 instead Loading packages core ress under source root Users ytong go src github com flyteorg flytesnacks cookbook Successfully serialized 1 flyte objects Registration ellipse area metadata shell type TASK successful with version fr8 Successfully registered 1 entities```

Felix Ruess · Answer

k will try with a fresh flytekit then

Yee · Answer

let us knwo

Felix Ruess · Answer

ok so with a fresh flytekit venv that part works now no idea what went wrong the first time but it fails in flyte copilot downloader with ```time= 2023 03 05T20 26 06Z level=info msg= 0 Couldn t find a config file Relying on env vars and pflags json level info msg Downloading inputs from ts 2023 03 05T20 26 06Z json level error msg Failed to read from the raw store Error getItem getting the object RequestError send request failed ncaused by Head dial tcp 1 30002 connect connection refused ts 2023 03 05T20 26 06Z json level error msg Failed to download inputs from err path getItem getting the object RequestError send request failed ncaused by Head dial tcp 1 30002 connect connection refused ts 2023 03 05T20 26 06Z json level info msg Exited downloading inputs from ts 2023 03 05T20 26 06Z json level error msg Downloading failed err failed to download input metadata message from remote store path getItem getting the object RequestError send request failed ncaused by Head dial tcp 1 30002 connect connection refused ts 2023 03 05T20 26 06Z json level info msg Uploading Error file to path errFile errors pb ts 2023 03 05T20 26 06Z json level error msg Failed to write to the raw store Error Failed to write data 493b to path metadata propeller flytesnacks development ahwn6q5rj8phfxhqfgf6 ellipse area metadata shell data 3 errors pb PutObject putting object RequestError send request failed ncaused by Put dial tcp 1 30002 connect connection refused ts 2023 03 05T20 26 06Z json level error msg Failed to write error document err Failed to write data 493b to path metadata propeller flytesnacks development ahwn6q5rj8phfxhqfgf6 ellipse area metadata shell data 3 errors pb PutObject putting object RequestError send request failed ncaused by Put dial tcp 1 30002 connect connection refused ts 2023 03 05T20 26 06Z Error Failed to write data 493b to path metadata propeller flytesnacks development ahwn6q5rj8phfxhqfgf6 ellipse area metadata shell data 3 errors pb PutObject putting object RequestError send request failed caused by Put dial tcp 1 30002 connect connection refused``` seems it tries to connect via IPv6 instead of IPv4 will further try to debug tomorrow

Felix Ruess · Answer

Shouldn t the flyte copilot downloader init container and the sidecar be using `` instead of ``

Yee · Answer

yeah it should be `<http flyte sandbox minio flyte 9000>`

Yee · Answer

that s what pods use trying to track that down

jeev · Answer

this has to do with how the sandbox is configured to generate signed URLs that can be used from outside the sandbox container within the user s machine investigating

Felix Ruess · Answer

thx thought so could not directly find where so thanks for looking into it

Yee · Answer

we ll get back to you later today < Felix Ruess>

jeev · Answer

this PR fixes <https github com flyteorg flyte pull 3410>

jeev · Answer

< Ketan kumare3 > cc

Ketan (kumare3) · Answer

uhh interesting how did sandbox work with this config

Felix Ruess · Answer

ok thanks < Yee> can you build another sandbox image with this fix and the podtemplate backend stuff so I can test it

jeev · Answer

we ll clean up and merge soon that will push a new image

Felix Ruess · Answer

nice could you also build a new image with the pod template backend PRs included

jeev · Answer

ah not familiar with that i ll defer to < Yee>

Yee · Answer

yeah this is the thing i was talking about jeev

Yee · Answer

building a sandbox bundled image with all the backend changes in instances where flytekit changes also need backend changes

Yee · Answer

i ll build an image this afternoon dealing with some bugs rn

Felix Ruess · Answer

awesome < Yee> then I can pick up the PR testing tomorrow

Yee · Answer

updated <https github com flyteorg flyte pull 3382> jobs are queued though

Yee · Answer

will check back later

Yee · Answer

seems to have built but in the middle of something so haven t tested it

Yee · Answer

`<http ghcr io flyteorg flyte sandbox bundled sha ae54328f88f8036cf1531bdea828ee43588aee6e|ghcr io flyteorg flyte sandbox bundled sha ae54328f88f8036cf1531bdea828ee43588aee6e>`

Felix Ruess · Answer

thanks works