Alex Bain
04/17/2022, 11:39 PMv0.19.4
(i.e. Flyte Console v0.52.1
, Flyte Admin v0.6.147
, etc). When I browse to Flyte Console, instead of getting a list of my projects I get:
Failed to fetch data
invalid wire type 4 at offset 1
Retry (button)
This looks like a gRPC binary incompatibility between the latest Flyte Console and Flyte Admin. Flyte team, could you take a look?Louis DiNatale
04/18/2022, 2:35 PMSandra Youssef
Alex Pozimenko
04/18/2022, 6:30 PMterminated in the background, manually
intermittently. No errors are reported in the POD log. Any suggestions on how to troubleshoot?Rahul Mehta
04/18/2022, 7:08 PMRahul Mehta
04/19/2022, 2:52 PMflytekit
that'd enable specifying images like `docker.io/my-image@sha256:...`/is helpful to ensure that a specific workflow is locked to an exact image. Happy to make the PR later this week.Sandra Youssef
Sandra Youssef
Calvin Leather
04/20/2022, 1:54 PMfunctools.partial
and its (possible) flyte equivalent. More details in threadRaviraja Ganta
04/21/2022, 8:00 PM(flyte) raviraja@ip-192-168-124-8 ~/Desktop/flows/flyte_flows pyflyte run example.py:wf --n 500 --mean 42 --sigma 2
Usage: pyflyte [OPTIONS] COMMAND [ARGS]...
Try 'pyflyte --help' for help.
Error: No such command 'run'.
(flyte) raviraja@ip-192-168-124-8 ~/Desktop/flows/flyte_flows pyflyte --help
Usage: pyflyte [OPTIONS] COMMAND [ARGS]...
Entrypoint for all the user commands.
Options:
-c, --config TEXT Path to config file for use within container
-k, --pkgs TEXT Dot separated python packages to operate on.
Multiple may be specified Please note that this
option will override the option specified in the
configuration file, or environment variable
-i, --insecure BOOLEAN Disable SSL when connecting to Flyte backend.
--help Show this message and exit.
Commands:
init Create flyte-ready projects.
local-cache Interact with the local cache.
package This command produces a Flyte backend registrable package...
serialize This command produces protobufs for tasks and templates.
run
is not available. Am I missing something? When running normally with python example.py
it is working fine.
I have installed flytekit==0.32.6
this version.Alex Bain
04/21/2022, 9:30 PMv0.19.5
release (before the 1.0.0 release)? Either way, what do you think is a timeline for the next release version? Rough estimates ok.Raviraja Ganta
04/22/2022, 10:41 AM(flyte) raviraja@ip-192-168-124-8 ~/Desktop/python-monorepo/taxonomy/taxonomy/flows/flyte_flows flyte_demo pyflyte run --remote --image flyte_image:latest cluster_creation_flow.py:reason_clusters_pipeline
In the UI it is coming asDavid Przybilla
04/24/2022, 3:58 AMSamhita Alla
Mike Ossareh
04/25/2022, 3:20 PMMike Zhong
04/25/2022, 4:15 PMcreate_node()
. We have a bunch of @tasks
which have dependencies on one another, but they are not explicit (nothing is returned or passed in). We can easily use the imperative style to define the order of the tasks in a regular @workflow
. Does the imperative style also work for @dynamic
workflows?Alex Bain
04/26/2022, 1:59 AMv0.55.0
and I'm back to Failed to fetch data: invalid wire type 4 at offset 1
for /console
Anil Kumar Nandibhatla
04/26/2022, 3:58 AMHafsa Junaid
04/26/2022, 6:09 AMDylan Wilder
04/26/2022, 4:19 PMSandra Youssef
Sandra Youssef
v1.0.0
should be expected to run against all v1.x.x
versions.
Features include, among others:
• Single Binary (Fast Flyte deployment) and improved Garbage Collector [Core]
• File Ignore and Script Mode (Single command to register and run workflows) [FlyteKit]
• Project dashboard, Map task reporting, and Dynamic workflow rendering [FlyteConsole]
Check out the full list here:
https://github.com/flyteorg/flyte/releases/tag/v1.0.0
🎉🎉🎉Bernhard Stadlbauer
04/27/2022, 11:43 AMflytectl==0.5.21
. The workflows were serialized using pyflyte
(from `flytekit=1.0.0`; using fast
). The storage configuration looks like this:
...
storage:
type: stow
stow:
kind: google
config:
project_id: "<project>"
scopes: <https://www.googleapis.com/auth/devstorage.read_write>
container: "<bucket>"
Now, when running flytectl register files tmp/workflows/* -p acorn -d development
, we see:
Error: failed to upload source code from [tmp/workflows/fasta438eafa1aa98e76043e131e481a7a23.tar.gz]. Error: failed to create an upload location. Error: rpc error: code = Unknown desc = failed to create a signed url. Error: storage: missing required GoogleAccessID
{"json":{},"level":"error","msg":"failed to upload source code from [tmp/workflows/fasta438eafa1aa98e76043e131e481a7a23.tar.gz]. Error: failed to create an upload location. Error: rpc error: code = Unknown desc = failed to create a signed url. Error: storage: missing required GoogleAccessID","ts":"2022-04-27T13:37:26+02:00"}
GOOGLE_APPLICATION_CREDENTIALS
env is set to a service account which has access to the bucket. Registering against flyteadmin in version 1.0.0austin
04/27/2022, 3:05 PMaustin
04/27/2022, 3:26 PMAlex Bain
04/27/2022, 5:28 PMv0.19.3
to new v1.0.0
and Flyte Admin no longer wants to register workflows like:
@flytekit.workflow
def DDPTrainingWorkflow(
train_datasets: typing.List[str] = [],
...
):
patch_experiment(train_datasets)
@flytekit.task()
def patch_experiment(
train_datasets: typing.List[str],
)
^^^^
while registering the workflow, this throws:
[2022-04-27T15:09:25Z] details = "Type mismatch for Parameter train_datasets in default_inputs has type collection_type:<simple:STRING > , expected simple:NONE "
clearly something doesn't like the default []
value of train_datasets
against its declared type typing.List[str]
. Ideas?katrina
Matheus Moreno
04/27/2022, 6:50 PM