Couple of problems I ran into while I try to go through

Question

Couple of problems I ran into while I try to go through 1 I am seeing `` and `` for flytectl local sandbox dashboard links Are they necessary 2 What s the purpose of `pyflyte` 3 cont d

Han · Answer

3 Running the pyflyte remote example locally on Windows WSL2 ``` ~ flytesnacks cookbook$ pyflyte run remote core flyte basics hello world py my wf Go to <http localhost 30080 console projects flytesnacks domains development executions f2066c1781e1b4b31bd9> to see execution in the console ``` But on the console I see pod failed ``` 1 1 currentAttempt done Last Error USER Pod failed No message received from kubernetes f2066c1781e1b4b31bd9 n0 0 terminated with exit code 137 Reason OOMKilled Message tar Removing leading ` from member names``` This is using `flytectl sandbox start` `flytectl demo start` doesn t work for me Version 0 5 21

Han · Answer

Running the same `pyflyte remote` command on our shared linux server I am getting ```pyflyte run remote core flyte basics hello world py my wf E0426 20 09 01 812198758 57838 Handshake failed with fatal error SSL ERROR SSL error 100000f7 SSL routines OPENSSL internal WRONG VERSION NUMBER E0426 20 09 01 814035626 57838 Handshake failed with fatal error SSL ERROR SSL error 100000f7 SSL routines OPENSSL internal WRONG VERSION NUMBER asctime 2022 04 26 20 09 01 820 name flytekit cli levelname ERROR message Non auth RPC error lt InactiveRpcError of RPC that terminated with n tstatus = StatusCode UNAVAILABLE n tdetails = failed to connect to all addresses n tdebug error string = created 1651003741 820656500 description Failed to pick subchannel file src core ext filters client channel client channel cc file line 3128 referenced errors created 1651003741 820655223 description failed to connect to all addresses file src core lib transport error utils cc file line 163 grpc status 14 n gt sleeping 200ms and retrying asctime 2022 04 26 20 09 02 021 name flytekit cli levelname ERROR message Non auth RPC error lt InactiveRpcError of RPC that terminated with n tstatus = StatusCode UNAVAILABLE n tdetails = failed to connect to all addresses n tdebug error string = created 1651003742 021633228 description Failed to pick subchannel file src core ext filters client channel client channel cc file line 3128 referenced errors created 1651003742 021631791 description failed to connect to all addresses file src core lib transport error utils cc file line 163 grpc status 14 n gt sleeping 400ms and retrying Traceback most recent call last File venv bin pyflyte line 8 in lt module gt sys exit main File venv lib python3 8 site packages click core py line 1130 in call return self main args kwargs File venv lib python3 8 site packages click core py line 1055 in main rv = self invoke ctx File venv lib python3 8 site packages click core py line 1657 in invoke return process result sub ctx command invoke sub ctx File venv lib python3 8 site packages click core py line 1404 in invoke return ctx invoke self callback ctx params File venv lib python3 8 site packages click core py line 760 in invoke return callback args kwargs File venv lib python3 8 site packages click decorators py line 26 in new func return f get current context args kwargs File venv lib python3 8 site packages flytekit clis sdk in container run py line 152 in run wf = remote register script File venv lib python3 8 site packages flytekit remote remote py line 517 in register script upload location md5 version = fast register single script File venv lib python3 8 site packages flytekit tools script mode py line 118 in fast register single script upload location = create upload location fn content md5=md5 File venv lib python3 8 site packages flytekit clients friendly py line 998 in get upload signed url return super SynchronousFlyteClient self create upload location File venv lib python3 8 site packages flytekit clients raw py line 40 in handler return fn args kwargs File venv lib python3 8 site packages flytekit clients raw py line 834 in create upload location return self dataproxy stub CreateUploadLocation create upload location request metadata=self metadata File venv lib python3 8 site packages grpc channel py line 946 in call return end unary response blocking state call False None File venv lib python3 8 site packages grpc channel py line 849 in end unary response blocking raise InactiveRpcError state grpc channel InactiveRpcError lt InactiveRpcError of RPC that terminated with status = StatusCode UNAVAILABLE details = failed to connect to all addresses debug error string = created 1651003742 422810939 description Failed to pick subchannel file src core ext filters client channel client channel cc file line 3128 referenced errors created 1651003742 422810939 description failed to connect to all addresses file src core lib transport error utils cc file line 163 grpc status 14 ```

Yee · Answer

hey when you run `flytectl demo start` what error do you get

Yee · Answer

re `pyflyte` it s a python click command that has a variety of commands beneath it these are most importantly 1 `package` which goes through the local python code files and compiles the objects into Flyte protobufs 2 `run` which does the same thing but only for one file currently and additionally also sends those protofbufs over to the Flyte backend service Admin It does so by uploading that file to S3 GCS Azure blob storage and creating a task definition that relies on a prebuilt default image modifying the command to pull back down that file before running

Yee · Answer

re the error message which Flyte version are you running on the backend

Yee · Answer

it looks like it is failing on the `CreateUploadLocation` request which is a new endpoint we added to handle step 2 `run` above when the uploading to the blob store happens

Yee · Answer

for 1 could you give us a bit more information where are you seeing this

Yee · Answer

can you send a screenshot

Yee · Answer

oh and re the oom the default example doesn t set any memory requests which means they re being set by admin on the backend using defaults would it be possible to bump up the defaults a bit

katrina · Answer

< Yee> didn t we bump the admin defaults b c of ooms on M1s but regardless shouldn t they just work out of the box for all use cases now

Yee · Answer

yeah i m not sure what the configuration is just wanted to check

Han · Answer

Okay Restarted everything using ```flytectl demo start``` and run ```pyflyte run remote core flyte basics hello world py my wf``` Was abvle to get outputs on dashboard

Han · Answer

What s the diference between `flytectl demo start` vs `flytectl sandbox start`

Han · Answer

RE 1 it shows up on my js blocker

Han · Answer

I am using `flytectl` version 0 5 21 And flytekit 0 32 3 as specified in `flytesnacks core requirements txt`

Han · Answer

And one other question if I have an workflow that I can execute locally i e ```python workflow py``` The ` workflow` decorated workflow function takes a few arguments How do I pass in arguments using `pyflyte` And how do I run the same workflow in the sandbox demo environment

Ketan (kumare3) · Answer

Using pyflyte you can type help and that will Show all arguments

Samhita Alla · Answer

gt What s the diference between `flytectl demo start` vs `flytectl sandbox start` `flytectl demo` uses single binary to spin up the Flyte sandbox To get started quickly in a limited testing environment `flytectl demo start` is preferred to `flytectl sandbox start` gt And how do I run the same workflow in the sandbox demo environment Please use the ` remote` flag Make sure `~ flyte config yaml` is set up This has to happen automatically on installing flytectl

Samhita Alla · Answer

re <https flyte org slack com archives CP2HDHKE1 p1651024686417919 thread ts=1651004643 081319 amp cid=CP2HDHKE1> googletagmanager is used for analytics and gstatic for static content

Han · Answer

Okay And ` dynamic` decoractor will allow for dynamic workflows using native python instead of say `conditional ` type of logic branching DSL correct Will there be an workflow DAG w ` dynamic` decorators

Han · Answer

Also when I do `pyflyte remote` how do I ensure that the packages exist in the demo env aka im getting ModuleNotFoundError for some of my imports

Han · Answer

gt `flytectl demo` uses single binary to spin up the Flyte sandbox To get started quickly in a limited testing environment `flytectl demo start` is preferred to `flytectl sandbox start` Okay so for proof of concept `fyltectl demo start` Under what condition is `flytectl sandbox start` preferred

Ketan (kumare3) · Answer

Demo start is a full drop in replacement

Ketan (kumare3) · Answer

One place where sandbox is better if you want to modify the helm chart etc today

Ketan (kumare3) · Answer

That will change soon

Samhita Alla · Answer

gt And ` dynamic` decoractor will allow for dynamic workflows using native python instead of say `conditional ` type of logic branching DSL correct ` dynamic` is useful when you cannot determine the DAG structure beforehand `conditional ` is similar to the `if else` construct meaning it switches b w the conditions but doesn t dynamically determine the DAG structure

Samhita Alla · Answer

gt Will there be an workflow DAG w ` dynamic` decorators Do you mean if a workflow DAG is possible

Samhita Alla · Answer

gt Also when I do `pyflyte remote` how do I ensure that the packages exist in the demo env aka im getting ModuleNotFoundError for some of my imports `pyflyte run remote` uses a default image bundled with flytekit which contains numpy pandas and flytekit If you want to install additional dependencies you ll have to build your Docker image and send that as an argument to pyflyte using the ` image` flag

Ketan (kumare3) · Answer

This image has to be pushed else you can follow the image build instructions cc < Yee>