varsha Parthasarathy
08/08/2022, 11:50 PMSlackbot
08/09/2022, 4:56 AMSugato Ray
08/09/2022, 12:25 PMPiotr Zawadzki
08/09/2022, 1:05 PMPiotr Zawadzki
08/09/2022, 1:06 PMAbdullah Mobeen
08/09/2022, 1:27 PMRahul Mehta
08/09/2022, 9:16 PMSeungTaeKim
08/10/2022, 7:37 AMKetan (kumare3)
08/10/2022, 1:44 PMGeoff Salmon
08/10/2022, 10:32 PMKim Junil
08/11/2022, 5:32 AMKetan (kumare3)
08/11/2022, 10:33 PMKetan (kumare3)
08/11/2022, 11:35 PMRenata Rodrigues Gotler
08/15/2022, 6:35 PMNada Saiyed
08/15/2022, 7:47 PMStructuredDataset
, but can that be somehow represented as FlyteSchema
?Hampus Rosvall
08/16/2022, 6:00 AM~/.flyte/config.yaml
and configure backend to authenticate using OIDC flow with clientId
& clientSecret
but not sure if I am missing anything else? Basically what I want to achieve is something in line with what you described at Set up DevOps in this blogpost: https://mlops.community/mlops-with-flyte-the-convergence-of-workflows-between-machine-learning-and-engineering/
2. How would you add tolerations to the Pod Specifications for a task/workflow to run on dedicated node pool such as e.g., nodes with GPU/dedicated CPU nodes?SeungTaeKim
08/16/2022, 6:00 AM"Notice: Execution \"{{ workflow.name }}\" has {{ phase }} in \"{{ domain }}\"."
, then flyte return workflow does not exist
message.
Second, do I need to set addtiional things, such as policy or service of SQS & SNS in AWS?
I have made launchplan with Email configuration, when the workflow become success, but flyteadmin did not send any email to me.
Do I add credential
& config
key with the same account of SQS & SNS in .aws
folder?
Thanks you for your adviceOr Itzary
08/16/2022, 6:02 AMallen
08/16/2022, 2:48 PMExceeded resourcequota: [BackOffError] The operation attempt was blocked by back-off [attempted at: 2022-08-15 22:25:40.938456125 +0000 UTC m=+13688.975277765][the block expires at: 2022-08-15 22:25:58.135850691 +0000 UTC m=+13706.172672341] and the requested resource(s) exceeds resource ceiling(s)
. However, following the config instructions, I manually edited the ResourceQuota
to some absurdly high cpu and memory limit. I’m seeing this in Flyteconsole UI as well as propeller logs. I’m trying to spin up some more nodes for testing to see if that helpsallen
08/16/2022, 3:11 PMvalues.yaml
file in the Helm chartSandra Youssef
08/16/2022, 10:10 PMhttps://www.youtube.com/watch?v=HE7lJFW6ki8▾
jeev
08/16/2022, 11:41 PMSetting the MetadataDir for StartNode [<gs://flyte-freenome-computational/metadata/propeller/balrog-production-fldyczra/start-node/data>]
fldyczra
was already used.
given that these are much shorter than what can be used, is there an easy way to make these longer to avoid possible collisions?SeungTaeKim
08/17/2022, 6:03 AMLouis DiNatale
08/17/2022, 6:00 PMSandra Youssef
08/17/2022, 6:25 PMHampus Rosvall
08/18/2022, 5:47 AMclientSecret
authflow to be able to build and register workflows in our GitHub Actions CI builds. I looked at the CI docs here, and getting the following error both locally and in our CI when I run the same command. Has anyone experienced anything similar? Flytectl config available in comments
☁ ~ flytectl get projects
Error: rpc error: code = Unauthenticated desc = transport: oauth2: cannot fetch token: 401 Unauthorized
Response: {"error":"invalid_client","error_description":"Client authentication failed (e.g., unknown client, no client authentication included, or unsupported authentication method)."}
Hampus Rosvall
08/18/2022, 9:15 AMSeungTaeKim
08/18/2022, 9:41 AM2022/08/18 08:08:18 /go/src/github.com/flyteorg/flyteadmin/pkg/repositories/gormimpl/execution_repo.go:61
[21.243ms] [rows:1] UPDATE "executions" SET "id"=358,"created_at"='2022-08-18 08:05:44.14',"updated_at"='2022-08-18 08:08:18.501',"execution_project"='flytesnacks',"execution_domain"='development',"execution_name"='f985b6eddf4c43d5f000',"launch_plan_id"=114,"workflow_id"=106,"phase"='SUCCEEDED',"closure"='<binary>',"spec"='<binary>',"started_at"='2022-08-18 08:05:49.251',"execution_created_at"='2022-08-18 08:05:44.139',"execution_updated_at"='2022-08-18 08:08:18.497',"duration"='2m29.245844975s',"mode"=1,"inputs_uri"='<s3://my-s3-bucket/metadata/flytesnacks/development/f985b6eddf4c43d5f000/inputs>',"user_inputs_uri"='<s3://my-s3-bucket/metadata/flytesnacks/development/f985b6eddf4c43d5f000/user_inputs>',"user"='a57ebf23-a6e8-45e7-bcb1-52b69f508f67',"state"=0 WHERE "execution_project" = 'flytesnacks' AND "execution_domain" = 'development' AND "execution_name" = 'f985b6eddf4c43d5f000'
{"json":{"exec_id":"f985b6eddf4c43d5f000","src":"execution_manager.go:1588"},"level":"debug","msg":"publishing notifications for execution [project:\"flytesnacks\" domain:\"development\" name:\"f985b6eddf4c43d5f000\" ] in state [SUCCEEDED] for notifications [[phases:SUCCEEDED email:\u003crecipients_email:\"<my email>\" \u003e ]]","ts":"2022-08-18T08:08:18Z"}
{"json":{"exec_id":"f985b6eddf4c43d5f000","src":"publisher.go:30"},"level":"debug","msg":"Publishing the following message [recipients_email:\"<my mail>\" sender_email:\"<sender mail setup in SES>\" subject_line:\"Notice: Execution \\\"flyte_fixedrate.positive_wf\\\" has succeeded in \\\"development\\\".\" body:\"Execution \\\\\\\"flyte_fixedrate.positive_wf [f985b6eddf4c43d5f000]\\\\\\\" has succeeded in \\\\\\\"development\\\\\\\". View details at \u003ca href=\\\\<http://flow.qraftpilot.com/console/projects/flytesnacks/domains/development/executions/f985b6eddf4c43d5f000>\u003e http://<flyte url>/console/projects/flytesnacks/domains/development/executions/f985b6eddf4c43d5f000\u003c/a\u003e. \\n\" ]","ts":"2022-08-18T08:08:18Z"}
{"json":{"exec_id":"faf3d92fb8453e24d000","node":"n0","src":"noop_notifications.go:32"},"level":"debug","msg":"call to noop publish with notification type [flyteidl.admin.NodeExecutionEventRequest] and proto message [event:\u003cid:\u003cnode_id:\"n0\" execution_id:\u003cproject:\"flytesnacks\" domain:\"development\" name:\"faf3d92fb8453e24d000\" \u003e \u003e producer_id:\"propeller\" phase:SUCCEEDED occurred_at:\u003cseconds:1660810338 nanos:222102672 \u003e input_uri:\"<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-faf3d92fb8453e24d000/n0/data/inputs.pb>\" output_uri:\"<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-faf3d92fb8453e24d000/n0/data/0/outputs.pb>\" task_node_metadata:\u003c\u003e spec_node_id:\"n0\" node_name:\"be_positive\" event_version:1 deck_uri:\"<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-faf3d92fb8453e24d000/n0/data/0/deck.html>\" \u003e ]","ts":"2022-08-18T08:12:18Z"}
thank you!Zachary Carrico
08/18/2022, 3:33 PMTypeTransformerFailedError
occurs when using imported variables in workflows, but if the variables are declared in the same python module as the workflow there is no error? Thank you!Sandra Youssef
08/18/2022, 10:26 PMhttps://www.youtube.com/watch?v=AJnNXrdaQHE▾
Sandra Youssef
08/18/2022, 10:26 PMhttps://www.youtube.com/watch?v=AJnNXrdaQHE▾