Hi! If I define a workflow with a dataclass/struct as input, along the lines of:

@dataclass_json
@dataclass
class Foo:
    bar: int
    baz: float
    

@workflow
def my_wf(foo: Foo):
    ...

Is it possible to introspect the fields of the

STRUCT

or is this checked at runtime?

Is there an easy way to specify a that a task should recieve the serialized version of an output from a previous task? Like say I have a train task that outputs a

nn.Module

with the pytorch plugin, but I want a downstream task to receive the filepath that the

nn.Module

is saved to. Is there a way to do that?

Hi, How do I delete a registered task or workflow in a specific project-domain? First, I checked the CLI help. If you look at the

flytectl --help

, it says that you can delete tasks,worfklows.

delete      Terminates/deletes various Flyte resources such as tasks, workflows, launch plans, executions, and projects.

But in the available command of

delete

, I don't see an option to actually delete tasks or workflows.

Usage:
  flytectl delete [command]

Available Commands:
  cluster-resource-attribute Deletes matchable resources of cluster attributes.
  execution                  Terminates/deletes execution resources.
  execution-cluster-label    Deletes matchable resources of execution cluster label.
  execution-queue-attribute  Deletes matchable resources of execution queue attributes.
  plugin-override            Deletes matchable resources of plugin overrides.
  task-resource-attribute    Deletes matchable resources of task attributes.
  workflow-execution-config  Deletes matchable resources of workflow execution config.

is there a flyte literal parser utility to produce the json that gets surfaced in the flyte UI?

Hey, I am setting up OIDC Authentication using Azure AD IdP. I followed the steps here. Right now when I hit the console I am prompted to authenticate against our IdP, then I get sent back to the callback URI,

https://<host>/callback

and get stuck in some redirect loop where the

FlyteAdmin

Pod keeps logging like below. Does anyone know what could cause this? Thanks 🙂

flyteadmin-6d648c5c7b-x9w54 flyteadmin {"json":{"src":"cookie.go:80"},"level":"debug","msg":"Existing [flyte_idt] cookie found","ts":"2022-04-05T17:46:04Z"}
flyteadmin-6d648c5c7b-2m4zv flyteadmin {"json":{"src":"cookie.go:80"},"level":"debug","msg":"Existing [flyte_idt] cookie found","ts":"2022-04-05T17:46:04Z"}
flyteadmin-6d648c5c7b-2m4zv flyteadmin {"json":{"src":"cookie.go:80"},"level":"debug","msg":"Existing [flyte_at] cookie found","ts":"2022-04-05T17:46:04Z"}
flyteadmin-6d648c5c7b-2m4zv flyteadmin {"json":{"src":"cookie.go:71"},"level":"info","msg":"Could not detect existing cookie [flyte_rt]. Error: http: named cookie not present","ts":"2022-04-05T17:46:04Z"}
flyteadmin-6d648c5c7b-2m4zv flyteadmin {"json":{"src":"cookie_manager.go:71"},"level":"info","msg":"Refresh token doesn't exist or failed to read it. Ignoring this error. Error: [EMPTY_OAUTH_TOKEN] Failure to retrieve cookie [flyte_rt], caused by: http: named cookie not present","ts":"2022-04-05T17:46:04Z"}
flyteadmin-6d648c5c7b-2m4zv flyteadmin {"json":{"src":"cookie.go:80"},"level":"debug","msg":"Existing [flyte_user_info] cookie found","ts":"2022-04-05T17:46:04Z"}
flyteadmin-6d648c5c7b-2m4zv flyteadmin {"json":{"src":"handlers.go:227"},"level":"debug","msg":"Running authentication gRPC interceptor","ts":"2022-04-05T17:46:04Z"}
flyteadmin-6d648c5c7b-2m4zv flyteadmin {"json":{"src":"token.go:84"},"level":"debug","msg":"Could not retrieve bearer token from metadata rpc error: code = Unauthenticated desc = Request unauthenticated with Bearer","ts":"2022-04-05T17:46:04Z"}
flyteadmin-6d648c5c7b-2m4zv flyteadmin {"json":{"src":"handlers.go:237"},"level":"info","msg":"Failed to parse Access Token from context. Will attempt to find IDToken. Error: [JWT_VERIFICATION_FAILED] Could not retrieve bearer token from metadata, caused by: rpc error: code = Unauthenticated desc = Request unauthenticated with Bearer","ts":"2022-04-05T17:46:04Z"}
flyteadmin-6d648c5c7b-2m4zv flyteadmin {"json":{"src":"token.go:64"},"level":"debug","msg":"JWT parsing with claims failed failed to verify signature: failed to verify id token signature","ts":"2022-04-05T17:46:04Z"}
flyteadmin-6d648c5c7b-x9w54 flyteadmin {"json":{"src":"cookie.go:80"},"level":"debug","msg":"Existing [flyte_at] cookie found","ts":"2022-04-05T17:46:04Z"}
flyteadmin-6d648c5c7b-x9w54 flyteadmin {"json":{"src":"cookie.go:71"},"level":"info","msg":"Could not detect existing cookie [flyte_rt]. Error: http: named cookie not present","ts":"2022-04-05T17:46:04Z"}

Hi, I have deployed Flyte on EKS and I am experimenting with the fast register approach as I am only iterating my source code. I saw that I should configure flytectl with S3 configuration. It works with “non-fast” registration but I am getting this error with fast registration. I have serialized using the fast approach initially. Any ideas what might cause this error?

(.venv) ☁  ~ ⚡ make register PROJECT=determined DOMAIN=development
flytectl register files \
		 --project determined \
		 --domain development \
		 --archive flyte-package.tgz \
		 --version v1-fast1
Error: please check your Storage Config. It failed while uploading the source code. Failed to write data [69b] to path [fast/v1-fast1-fast9bb248f6c3ae89386ec7105633eaaee8.tar.gz].: PutObject, putting object: NoCredentialProviders: no valid providers in chain. Deprecated.
	For verbose messaging see aws.Config.CredentialsChainVerboseErrors
gmake: *** [Makefile:22: register] Error 1

(.venv) ☁  ~  cat ~/.flyte/config.yaml
admin:
  endpoint: dns:///localhost:8089
  authType: Pkce
  insecure: true
logger:
  show-source: true
  level: 0
storage:
  type: stow	
  stow:
    kind: s3
    config:
      auth_type: iam
      region: eu-west-1
  container: <name-of-my-bucket>

Hi everyone! Does anyone know if there is a way to get the

node id

of a Flyte task execution from within that task? I have been looking into

current_context

from

flytekit

but it is of type

ExecutionParameters

which only has

execution_id

(workflow id) and

task_id

. The

task_id

is of type

Identifier

not

TaskExecutionIdentifier

, so it does not have

node_execution_id

Thank you !!

Hi Flyte team, I am trying to add node selector and tolerations to my Flyte task pods. What is the difference between

default-node-selector

and

interruptible-node-selector?

configuration:
  inline:
    plugins:
      k8s:
        default-node-selector:
           node ="spot"
        default-tolerations:
           - xxxxx

Got it, first single node multi GPU 👍 I can implement this on Friday or Saturday and then ping you for review. Or do you need it before that?

Hi All, I tried to upgrade my Google GKE flyte deployment from v0.19.2 to v0.19.3 using Helm and encountered two issues… Issue One: Flytepropeller’s deployment now has

PriorityClass: system-cluster-critical

attribute which requires an associated k8s

quota

that was not generated by my helm config. Manually creating one allowed Flytepropeller pods to start. Was this documented anywhere? What do I need to add to my helm values file to generate this quota automatically?