Rupsha Chaudhuri
06/14/2022, 5:27 PMdynamic
be cached?Evan Sadler
06/14/2022, 8:52 PM--remote
command. I am running into an issue. I am not sure where to start looking, so any advice is much appreciated.
Inside of a new venv
$git clone <https://github.com/flyteorg/flytesnacks>
$cd flytesnacks/cookbook
$pip install -r core/requirements.txt
$flytectl demo start
$pyflyte run --remote core/flyte_basics/hello_world.py:my_wf
And then I get this
Handshake failed with fatal error SSL_ERROR_SSL: error:100000f7:SSL routines:OPENSSL_internal:WRONG_VERSION_NUMBER.
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "failed to connect to all addresses"
debug_error_string = "{"created":"@1655239314.572674000","description":"Failed to pick subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3129,"referenced_errors":[{"created":"@1655239314.572673000","description":"failed to connect to all addresses","file":"src/core/lib/transport/error_utils.cc","file_line":163,"grpc_status":14}]}"
Rupsha Chaudhuri
06/15/2022, 8:38 PMBrian Dobray
06/17/2022, 2:35 AMlist-active-launch-plans
for flytectl
? I really really miss this right now:
flyte-cli \
-h HOST \
-d ENV \
-p PROJECT \
list-active-launch-plans
Ruksana Kabealo
06/17/2022, 3:58 PMOliver Nguyen
06/21/2022, 3:46 AMkrishna Yerramsetty
06/21/2022, 5:31 PM{1 item
o0:{2 items
type:"multi-part blob"
uri:"<s3://my-s3-bucket/hi/ag5dp94bs4c846cn847s-n0-0/628c0053bbedf3f1db4d44362f48857e>"
}
}
Not sure where this multi-part blob residesOliver Nguyen
06/22/2022, 4:13 AMhelm upgrade flyte flyteorg/flyte-core -f <https://raw.githubusercontent.com/flyteorg/flyte/master/charts/flyte-core/values-sandbox.yaml> -f values-override.yaml -n flyte
In step 3. I get the following error
Error: failed to download "flyteorg/flyte-core"
After checking, the flyte-core not installed after running the āflytectl demo startā command, and I not found the flyte-core repository in flyteorg. The flyte-core have still in use or has it been dropped?seunggs
06/23/2022, 10:23 PMflytectl create project
instead of running it as a CLI command?)Ketan (kumare3)
06/23/2022, 10:29 PMKetan (kumare3)
06/23/2022, 10:29 PMNada Saiyed
06/23/2022, 11:43 PM@task(
container_image="{{.image.img1.fqn }}:{{.image.img1.version}}"
)
and the value of image.img1.version
can be specified in a config file.. but how is that config linked to tasks while packaging the workflow?Oliver Nguyen
06/27/2022, 3:57 AMflytectl create project --name myflyteproject --id myflyteproject --description "myflyteproject description" --labels app=myflyte
Step 2: build docker image
Example:
docker build -t my-flyte-img:v1 .
docker tag my-flyte-img:v1 <http://ghcr.io/nguyenhuuvan51703223/my-flyte-img:v1|ghcr.io/nguyenhuuvan51703223/my-flyte-img:v1>
docker push <http://ghcr.io/nguyenhuuvan51703223/my-flyte-img:v1|ghcr.io/nguyenhuuvan51703223/my-flyte-img:v1>
Step 3:
Example:
pyflyte -c sandbox.config --pkgs core serialize --in-container-config-path /root/sandbox.config --local-source-root /Users/admin/hvan/myproject/flytesnacks/cookbook --image <http://ghcr.io/nguyenhuuvan51703223/my-flyte-img:v1|ghcr.io/nguyenhuuvan51703223/my-flyte-img:v1> workflows -f _pb_output/
Step 4:
Example
flytectl register files _pb_output/* -p myflyteproject -d development --version v1 k8sServiceAccount demo --outputLocationPrefix <s3://my-s3-bucket/raw_data>
Step 5: open UI and launch workflow
I get the error:
[1/1] currentAttempt done. Last Error: USER::containers with unready status: [a5k8lnk9s5qh98szvgc8-n0-0]|Back-off pulling image "<http://ghcr.io/nguyenhuuvan51703223/my-flyte-img:v1|ghcr.io/nguyenhuuvan51703223/my-flyte-img:v1>
Did I miss or take wrong on any step?? Do I need push my image to my docker registry? Do I need define my repository name somewhere?caioau
06/27/2022, 1:19 PMRupsha Chaudhuri
06/27/2022, 4:41 PMSlackbot
06/27/2022, 8:28 PMRupsha Chaudhuri
06/27/2022, 8:58 PMflytectl get workflows --admin.endpoint <remote_host>:30080 -p <project_name> -d development
is successful
docker run --rm --entrypoint flytectl <http://cr.flyte.org/flyteorg/flyte-sandbox|cr.flyte.org/flyteorg/flyte-sandbox> get workflows --admin.endpoint <remote_host>:30080 -p <project_name> -d development
throws an error
time="2022-06-27T20:18:25Z" level=info msg="[0] Couldn't find a config file []. Relying on env vars and pflags."
{"json":{},"level":"error","msg":"failed to initialize token source provider. Err: failed to fetch auth metadata. Error: rpc error: code = Unavailable desc = connection error: desc = \"transport: authentication handshake failed: tls: first record does not look like a TLS handshake\"","ts":"2022-06-27T20:18:26Z"}
{"json":{},"level":"warning","msg":"Starting an unauthenticated client because: can't create authenticated channel without a TokenSourceProvider","ts":"2022-06-27T20:18:26Z"}
{"json":{},"level":"info","msg":"Initialized Admin client","ts":"2022-06-27T20:18:26Z"}
Error: rpc error: code = Unavailable desc = connection error: desc = "transport: authentication handshake failed: tls: first record does not look like a TLS handshake"
{"json":{},"level":"error","msg":"rpc error: code = Unavailable desc = connection error: desc = \"transport: authentication handshake failed: tls: first record does not look like a TLS handshake\"","ts":"2022-06-27T20:18:27Z"}
Nada Saiyed
06/27/2022, 9:11 PMPod failed. No message received from kubernetes.
[atg6lnllwptbr4j6thwc-n0-0] terminated with exit code (137). Reason [Error]. Message:
.
the flyte cluster is local sandbox clusterseunggs
06/27/2022, 9:18 PMRupsha Chaudhuri
06/28/2022, 6:46 PMRupsha Chaudhuri
06/28/2022, 11:53 PMflytectl register files
.. However pyflyte is not serializing anything. This is what I see when I run pyflyte serialize...
in the container. Any ideas what's going on?
pyflyte serialize workflows -f /tmp/_pb_output
{"asctime": "2022-06-28 23:51:47,894", "name": "flytekit", "levelname": "INFO", "message": "Setting protocol to file"}
{"asctime": "2022-06-28 23:51:48,124", "name": "flytekit", "levelname": "INFO", "message": "Setting protocol to file"}
{"asctime": "2022-06-28 23:51:48,125", "name": "flytekit", "levelname": "INFO", "message": "Setting protocol to file"}
{"asctime": "2022-06-28 23:51:48,125", "name": "flytekit", "levelname": "INFO", "message": "Setting protocol to file"}
{"asctime": "2022-06-28 23:51:48,125", "name": "flytekit", "levelname": "INFO", "message": "We won't register bigquery handler for structured dataset because we can't find the packages google-cloud-bigquery-storage and google-cloud-bigquery"}
Serializing Flyte elements with image
Writing output to /tmp/_pb_output
Loading packages [] under source root /root
Successfully serialized 0 flyte objects
Rupsha Chaudhuri
06/29/2022, 5:53 PMTan Li
06/30/2022, 7:17 AMsvclb-flyte-deps-contour-envoy-c519e84f-lnpvm
keeps pending in the namespace kube-system. I worked around this by upgradeing the flyte-deps config.
However, I am still confronting the envoy pod pending issue. Terminal output are in the reply thread. Anyone know how should I fix this? In general, it seems to be some port allocation issue, but I really donāt have any idea how to debug this futher, lol. Really appreciate it! šAleksei Potov
06/30/2022, 9:42 PMFredrick
07/01/2022, 6:25 PM{
"json": {
"src": "handlers.go:161"
},
"level": "error",
"msg": "Error setting encrypted JWT cookie [SECURE_COOKIE_ERROR] Error creating secure cookie, caused by: securecookie: the value is too long",
"ts": "2022-07-01T07:41:05Z"
}
Andrew Achkar
07/06/2022, 5:18 PMseunggs
07/08/2022, 2:11 AMseunggs
07/08/2022, 2:11 AMStefan Avesand
07/13/2022, 1:57 PMSlackbot
07/15/2022, 5:23 PMSlackbot
07/15/2022, 5:23 PMKetan (kumare3)
07/15/2022, 5:38 PMaustin
07/15/2022, 7:15 PM<_InactiveRpcError of RPC that terminated with:\n\tstatus = StatusCode.UNAVAILABLE\n\tdetails = \"failed to connect to all addresses\"\n\tdebug_error_string = \"
etcā¦. even when the script has [at least initially] connected to the right endpoint. Not sure exactly the source of flakiness. For @Taeef Najib, I agree ensuring config is correct is the good place to start.Niels Bantilan
07/15/2022, 8:08 PMcat ~/.flyte/config.yaml
and copy-paste it here?austin
07/15/2022, 8:14 PMconfig.yaml
Yee
07/15/2022, 9:21 PMdns:///
in front of the domain, or using/not using insecureaustin
07/15/2022, 9:31 PMendpoint
field is ādns://<DNS_OF_SERVICE> ⦠ādns://ā is missingāā¦. [ but Iām not sure if you could address with just IP, and in that case, dns:// might not be required ]. Or other things like thatā¦.Taeef Najib
07/17/2022, 1:36 AMbash
and then curl -sL <https://ctl.flyte.org/install>
but no luck. I see a file called flytectl
in the bin folder. But that is not editable or readable on vs code. I am very inexperienced into this, but how do I find config.yaml
for flyte on my windows machine? or how do I correctly install it using cmd (on vs code)?austin
07/17/2022, 4:21 AMKetan (kumare3)
07/17/2022, 5:59 AMTaeef Najib
07/17/2022, 12:09 PMKetan (kumare3)
07/17/2022, 2:57 PMTaeef Najib
07/17/2022, 6:47 PMaustin
07/17/2022, 7:25 PMTaeef Najib
07/17/2022, 9:00 PM'flytectl' is not recognized as an internal or external command
Thatās where Iām stuck. Do you have any suggestions? š
When I use
curl -sL <https://ctl.flyte.org/install> | bash
I get this:
flyteorg/flytectl info checking GitHub for latest tag
flyteorg/flytectl info found version: 0.6.4 for v0.6.4/Linux/x86_64
flyteorg/flytectl info installed ./bin/flytectl