Hi, I an trying to do scheduling workflows by following this https://docs.flyte.org/projects/cookbook/en/latest/auto/core/scheduled_workflows/lp_schedules.html From ,

kubectl get po -n flyte

shall show scheduler pod, but for me I cannot find such pods. So I get stacked now. Could you give me some advice?

$ kubectl get po -n flyte 
NAME                                                  READY   STATUS    RESTARTS      AGE
flyte-sandbox-proxy-d95874857-m8hlt                   1/1     Running   0             46m
flyte-sandbox-kubernetes-dashboard-6757db879c-867nz   1/1     Running   0             46m
flyte-sandbox-docker-registry-78686dccc-vd666         1/1     Running   0             46m
flyte-sandbox-postgresql-0                            1/1     Running   0             46m
flyte-sandbox-c744b94c5-5mp68                         1/1     Running   1 (45m ago)   46m
flyte-sandbox-minio-645c8ddf7c-4vwxr                  1/1     Running   0             46m

A quick question. What’s the difference between

flytectl sandbox

and

flytectl demo

? The documentation looks very similar.

#CP2HDHKE1 I am still stuck on the flytectl vs flytekit.remote not showing consisten behaviour. flytectl get projects works fine with clientsecret method but flytekit.remote throws the below error {"asctime": "2023-01-31 124443,934", "name": "flytekit.remote", "levelname": "WARNING", "message": "This feature is still in beta. Its interface and UX is subject to change."} {"asctime": "2023-01-31 124443,997", "name": "flytekit.cli", "levelname": "ERROR", "message": "Unauthenticated RPC error <_InactiveRpcError of RPC that terminated with:\n\tstatus = StatusCode.UNAUTHENTICATED\n\tdetails = \"token parse error [JWT_VERIFICATION_FAILED] Could not retrieve id token from metadata, caused by: rpc error: code = Unauthenticated desc = Request unauthenticated with IDToken\"\n\tdebug_error_string = \"UNKNOWN:Error received from peer ipv410.183.180.0443 {created_time:\"2023-01-31T124443.996825038+02:00\", grpc_status:16, grpc_message:\"token parse error [JWT_VERIFICATION_FAILED] Could not retrieve id token from metadata, caused by: rpc error: code = Unauthenticated desc = Request unauthenticated with IDToken\"}\"\n>, refreshing credentials and retrying\n"} ^CProcess ForkProcess-1: Traceback (most recent call last): File "/home/samuel/.local/lib/python3.8/site-packages/flytekit/clients/raw.py", line 150, in handler return fn(*args, **kwargs) File "/home/samuel/.local/lib/python3.8/site-packages/flytekit/clients/raw.py", line 448, in list_workflows_paginated return self._stub.ListWorkflows(resource_list_request, metadata=self._metadata) File "/home/samuel/.local/lib/python3.8/site-packages/grpc/_channel.py", line 946, in call return _end_unary_response_blocking(state, call, False, None) File "/home/samuel/.local/lib/python3.8/site-packages/grpc/_channel.py", line 849, in _end_unary_response_blocking raise _InactiveRpcError(state) grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with: status = StatusCode.UNAUTHENTICATED details = "token parse error [JWT_VERIFICATION_FAILED] Could not retrieve id token from metadata, caused by: rpc error: code = Unauthenticated desc = Request unauthenticated with IDToken" debug_error_string = "UNKNOWN:Error received from peer ipv410.183.180.0443 {created_time:"2023-01-31T124443.996825038+02:00", grpc_status:16, grpc_message:"token parse error [JWT_VERIFICATION_FAILED] Could not retrieve id token from metadata, caused by: rpc error: code = Unauthenticated desc = Request unauthenticated with IDToken"}"

Hi all - having an issue injecting secrets from k8s into my task. Here's how I've set it up. I created a test secret like this to try and see if a task can read it

kubectl-n flytesnacks-development create secret generic common-secrets --from-literal=TEST_SECRET=blah
kubectl -n flytesnacks-development get secret/common-secrets -o json | jq '.data | to_entries | map(.value= (.value | @base64d))'
>> [
  {
    "key": "TEST_SECRET",
    "value": "blah"
  }
]

Within the flytesnacks-development namespace, I'm running a task like this

@task(secret_requests=[Secret(group="common-secrets", key="TEST_SECRET")])
def print_secret() -> str:
    secrets = current_context().secrets
    return secrets.get("common-secrets", "TEST_SECRET")

However, this fails with the following

Unable to find secret for key TEST_SECRET in group common-secrets in Env Var:_FSEC_COMMON-SECRETS_TEST_SECRET and FilePath: /root/secrets/common-secrets/test_secret

From looking at the code in the the SecretManager, it looks like it only checks the ENV variable or a file path (which does not exist because I'm using k8s secrets as an additional provider). Am I missing something? I've checked that the k8s secret is in the same namespace as the task being run

Hey, everyone! I'm trying to integrate our MLflow server to our Flyte projects. My current approach consists of passing the MLflow username and password as Secrets to the required tasks, but I was wondering: does anyone else here uses this stack, and if so, are you willing to share a little bit about how it's configured? 🙂

@Nicholas LoFaso / @jeev / @Sören Brunk / @Pradithya Aria Pura / @Guillaume Perchais - and other GCP users. Nick has been trying to get IAP working with Flyte and here is an excerpt - Google documentation recommended we use an Identity Aware Proxy (IAP) with the Google HTTPS load balancer instead of contour. That approach almost worked, but there is an issue with the flyteadmin grpc healthcheck and HTTPS load balancer. — Would any of you folks be interested in joining a working group / meeting to help with this problem. Nick has graciously accepted to help document the findings and this will make Flyte even more reliable and accessible on GCP. cc @Prafulla Mahindrakar cc @Aijamal (do you think someone from GCP can help with this too?)

Howdy, is there currently a way to restart a flyte execution from python code somehow? Lets say

workflow_a

hits a transient error, in code can we get that

WorkflowExecution

object or use the

FlyteRemote

class to restart it from where it left off, either in-place or as a new execution? This is aside from adding retries or anything to the task definition.

Question about the Ray plugin. In the docs, it mentions that the Ray plugin use Ray's Job Submission to run the ray task. However, looking at the code, I don't see the

JobSubmissionClient

being used anywhere. Am I missing something?

Hi Everyone. i am trying to deploy flye in azure AKS cluster. Pods are up and running after running helm command for single cluster deployment.i am able to access flyte service without authentication through port-forward. As per documentation I am trying to test workflow by cloning flytesnacks repo. This will require pyflyte cli but I am unable to find any link or reference where to download pyflyte binary from. Can somebody please suggest on it?

I've deployed "Flyte the hard way" in my dev AWS account, which is all working now. I've deployed to prod and I'm trying to push a wf. When I do port forwarding and open the console I get the attached grpc error When I run a wf, the command seems happy

FLYTE_CONFIG=~/.flyte/config.yaml pyflyte run --remote workflows/greeting.py wf --name Sam

Go to <http://localhost:8089/console/projects/flytesnacks/domains/development/executions/fd724a646bd6342cab6c> to see execution in the console.

And when I go to the console, it again shows a grpc error. Any idea what I'm doing wrong. Looks like some connection issue