Hi team, for every flyte execution in the UI, can I attach custom links such as Wavefront/cloudwatch events etc? Is there like a template I can create/attach for this?

This message was deleted.

Hello All, Recently I added 7 flyteplugins to conda-forge. As the number of plugins increases, it would be more manageable to have multiple contributors onboarded to maintain conda-forge recipes of the Flyte plugins. I am planning on hosting a conda-forge recipe creators workshop in near future. Would you like to attend a hands on workshop? Please feel free to respond to this poll and share it with anyone else you might think could benefit from the workshop. https://www.linkedin.com/posts/sugatoray_conda-condaforge-workshop-activity-6962057281697984512-u7yM

hi, anyone knows why after running sandbox login page does not work

Wrong channel. Sorry. Asked in #flytekit

Hey all, we're moving forward with our migration to flyte and are making sure that various end-user workflows are at parity w/ our current Kubeflow deployment. A couple of topics that have come up include the best ways to support multi-tenancy/projects for experimentation. 1. We currently group runs submitted by various users as "experiments" in Kubeflow. I notice in Flyte there is an option in the UI to filter down to only workflows submitted by the currently-authenticated user, but more broadly what's the best way to group different sets of experiments that multiple users are running 2. Does having a project per user make sense (ie. for a user's dev workspace)? I noticed in the docs that a common pattern is having one project per repo, but in our current setup we run everything out of one monorepo.

Hello, flyte team! My team has a busy day with flyte deployment in my company. we will gonna deploy flyte next week, so we are solving some specific issues like notification. I am doing setup of aws sns & sqs, do I setup this below in the image in helm chart, values.yaml? here is the link

Folks will appreciate if people chime in - https://www.reddit.com/r/mlops/comments/wfxa4o/metaflow_vs_airflow_vs_others/?utm_source=share&utm_medium=ios_app&utm_name=iossmf - cc @Calvin Leather / @Babis Kiosidis / @Rahul Mehta / @SeungTaeKim / @jeev and others

Hi all. Has there been any work on, or interest in, scheduling workflows based on the presence of input data and the absence of output data? I'm thinking of something similar to dagster's "asset reconciliation" where a scheduler is aware of the (possibly time-partitioned) inputs and outputs of each workflow and then it continually schedules a set of workflows as each workflow's input becomes available.

Hi all! My team is preparing to provide Pulumi to our researchers. We want to set a timezone that is familiar to researchers Can I set the default timezone? It's installed using helm chart on bare metal k8s

@Smriti Satyan can we doc This as a note in the Spark on Flyte deployment guide - Curently Spark on Flyte talks about AWS - https://docs.flyte.org/projects/cookbook/en/stable/auto/integrations/kubernetes/k8s_spark/index.html#how-to-build-your-dockerfile-for-spark-on-k8s We should add a note that for GCP you have to use - https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/docs/gcp.md

Hi, I'm trying to pass a FlyteDirectory between tasks... When I pass it from python task to ShellTask it works as expected, but when I pass from python task to python task the directory came empty. Can someone help me?

Hello.. what the best way to represent a complex schema in a dataframe passed between tasks? I think its not supported natively in

StructuredDataset

, but can that be somehow represented as

FlyteSchema

?

Hey, a few questions, 1. are there any examples of setting up CI/CD to register workflows using GitHub Actions when Flyte is deployed with OIDC authentication? I assume you need to generate a

~/.flyte/config.yaml

and configure backend to authenticate using OIDC flow with

clientId

&

clientSecret

but not sure if I am missing anything else? Basically what I want to achieve is something in line with what you described at Set up DevOps in this blogpost: https://mlops.community/mlops-with-flyte-the-convergence-of-workflows-between-machine-learning-and-engineering/ 2. How would you add tolerations to the Pod Specifications for a task/workflow to run on dedicated node pool such as e.g., nodes with GPU/dedicated CPU nodes?

Hi, flyte team! I'd like to ask the notification setting of flyte. I have refered to this link, https://flyte-org.slack.com/archives/CPQ3ZFQ84/p1660104814016329 and it was so helpful to setup the notification. however, there are several problem I did not solve. First, when I have setup notification with the sample code above the link or flyte notifictaion tutorial, it was not working. For example, when I have written subject in emailer like

"Notice: Execution \"{{ workflow.name }}\" has {{ phase }} in \"{{ domain }}\"."

, then flyte return

workflow does not exist

message. Second, do I need to set addtiional things, such as policy or service of SQS & SNS in AWS? I have made launchplan with Email configuration, when the workflow become success, but flyteadmin did not send any email to me. Do I add

credential

&

config

key with the same account of SQS & SNS in

.aws

folder? Thanks you for your advice

Hi!! Quick question! Im using flyte cluster on localhost, is thefe any api to trigger a workflow from a remote service?

Hey guys, trying to run the example workflow on my Flyte AWS cluster and seeing

Exceeded resourcequota: [BackOffError] The operation attempt was blocked by back-off [attempted at: 2022-08-15 22:25:40.938456125 +0000 UTC m=+13688.975277765][the block expires at: 2022-08-15 22:25:58.135850691 +0000 UTC m=+13706.172672341] and the requested resource(s) exceeds resource ceiling(s)

. However, following the config instructions, I manually edited the

ResourceQuota

to some absurdly high cpu and memory limit. I’m seeing this in Flyteconsole UI as well as propeller logs. I’m trying to spin up some more nodes for testing to see if that helps

hey guys, another q, maybe I missed this somewhere in the docs, but how do I configure flyte propeller settings? Specifically, I want to change the K8s pod spec. I couldn’t find this anywhere in the

values.yaml

file in the Helm chart

Hi Flyers, Watch ML Engineers, Data Scientists and Software Engineers - @Matheus Moreno, @Robin Kahlow, @Mike Zhong and @krishna Yerramsetty - discuss how to unify teams, how to choose ML orchestration tools, and some differences between MLOps and ML Orchestration, in this Fireside Chat featured in one of our Flyte Community Sync events.

we're getting collisions with the execution IDs of subworkflow launch plans that propeller is kicking off:

Setting the MetadataDir for StartNode [<gs://flyte-freenome-computational/metadata/propeller/balrog-production-fldyczra/start-node/data>]

fldyczra

was already used. given that these are much shorter than what can be used, is there an easy way to make these longer to avoid possible collisions?

hello, flyte team. I have a question about workflow register process. I am currently automating ML process through flyte with github CI, and I have problem, launchplan deactivation. The workflow successfully registered in flyte, but it does not show DAG and users cannot start "launch" in console. where do I check log? I hope to get some advice. thanks

Hey flyte team, I was wondering if there is a way to better name pods in kubernetes to help identify what they are?

Hi Flyers, Join us tomorrow 8/18 at 10am PT to ask @Ketan (kumare3) anything, hosted by the MLOps Community. Topics include: - Convergence of data & ML - Taking ideas from concept to production - Workflow automation & best practices https://mlops-community.slack.com (#ask-me-anything)

Hey, I am trying to use the

clientSecret

authflow to be able to build and register workflows in our GitHub Actions CI builds. I looked at the CI docs here, and getting the following error both locally and in our CI when I run the same command. Has anyone experienced anything similar? Flytectl config available in comments

☁  ~  flytectl get projects
Error: rpc error: code = Unauthenticated desc = transport: oauth2: cannot fetch token: 401 Unauthorized
Response: {"error":"invalid_client","error_description":"Client authentication failed (e.g., unknown client, no client authentication included, or unsupported authentication method)."}

On to the next question. I am setting up Flyte to be used by many different teams. My idea was use the same service account for each of the projects i.e., use the https://docs.flyte.org/en/latest/deployment/aws/manual.html#flyte-user-role the pods are assuming and pass IAM roles in the launch plan that the service account assumes during execution, I remembered that there were some problems with this a while back. Is this working or is there a better way to achieve project specific permissions?

Hi, flyte team. I would like to ask a question about notification email. I have setup notification in values.yaml and build SQS & SNS in aws. I have checked logs that it is publishing message but it did not arriave in my mail box. would anyone can give some advice?

2022/08/18 08:08:18 /go/src/github.com/flyteorg/flyteadmin/pkg/repositories/gormimpl/execution_repo.go:61
[21.243ms] [rows:1] UPDATE "executions" SET "id"=358,"created_at"='2022-08-18 08:05:44.14',"updated_at"='2022-08-18 08:08:18.501',"execution_project"='flytesnacks',"execution_domain"='development',"execution_name"='f985b6eddf4c43d5f000',"launch_plan_id"=114,"workflow_id"=106,"phase"='SUCCEEDED',"closure"='<binary>',"spec"='<binary>',"started_at"='2022-08-18 08:05:49.251',"execution_created_at"='2022-08-18 08:05:44.139',"execution_updated_at"='2022-08-18 08:08:18.497',"duration"='2m29.245844975s',"mode"=1,"inputs_uri"='<s3://my-s3-bucket/metadata/flytesnacks/development/f985b6eddf4c43d5f000/inputs>',"user_inputs_uri"='<s3://my-s3-bucket/metadata/flytesnacks/development/f985b6eddf4c43d5f000/user_inputs>',"user"='a57ebf23-a6e8-45e7-bcb1-52b69f508f67',"state"=0 WHERE "execution_project" = 'flytesnacks' AND "execution_domain" = 'development' AND "execution_name" = 'f985b6eddf4c43d5f000'
{"json":{"exec_id":"f985b6eddf4c43d5f000","src":"execution_manager.go:1588"},"level":"debug","msg":"publishing notifications for execution [project:\"flytesnacks\" domain:\"development\" name:\"f985b6eddf4c43d5f000\" ] in state [SUCCEEDED] for notifications [[phases:SUCCEEDED email:\u003crecipients_email:\"<my email>\" \u003e ]]","ts":"2022-08-18T08:08:18Z"}
{"json":{"exec_id":"f985b6eddf4c43d5f000","src":"publisher.go:30"},"level":"debug","msg":"Publishing the following message [recipients_email:\"<my mail>\" sender_email:\"<sender mail setup in SES>\" subject_line:\"Notice: Execution \\\"flyte_fixedrate.positive_wf\\\" has succeeded in \\\"development\\\".\" body:\"Execution \\\\\\\"flyte_fixedrate.positive_wf [f985b6eddf4c43d5f000]\\\\\\\" has succeeded in \\\\\\\"development\\\\\\\". View details at \u003ca href=\\\\<http://flow.qraftpilot.com/console/projects/flytesnacks/domains/development/executions/f985b6eddf4c43d5f000>\u003e http://<flyte url>/console/projects/flytesnacks/domains/development/executions/f985b6eddf4c43d5f000\u003c/a\u003e. \\n\" ]","ts":"2022-08-18T08:08:18Z"}



{"json":{"exec_id":"faf3d92fb8453e24d000","node":"n0","src":"noop_notifications.go:32"},"level":"debug","msg":"call to noop publish with notification type [flyteidl.admin.NodeExecutionEventRequest] and proto message [event:\u003cid:\u003cnode_id:\"n0\" execution_id:\u003cproject:\"flytesnacks\" domain:\"development\" name:\"faf3d92fb8453e24d000\" \u003e \u003e producer_id:\"propeller\" phase:SUCCEEDED occurred_at:\u003cseconds:1660810338 nanos:222102672 \u003e input_uri:\"<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-faf3d92fb8453e24d000/n0/data/inputs.pb>\" output_uri:\"<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-faf3d92fb8453e24d000/n0/data/0/outputs.pb>\" task_node_metadata:\u003c\u003e spec_node_id:\"n0\" node_name:\"be_positive\" event_version:1 deck_uri:\"<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-faf3d92fb8453e24d000/n0/data/0/deck.html>\" \u003e ]","ts":"2022-08-18T08:12:18Z"}

thank you!

Hi, anyone have a guess as to why

TypeTransformerFailedError

occurs when using imported variables in workflows, but if the variables are declared in the same python module as the workflow there is no error? Thank you!