https://flyte.org logo
Join the conversationJoin Slack
Channels
announcements
ask-the-community
auth
conference-talks
contribute
databricks-integration
datahub-flyte
deployment
ecosystem-unionml
engineeringlabs
events
feature-discussions
flyte-bazel
flyte-build
flyte-console
flyte-deployment
flyte-documentation
flyte-github
flyte-ui-ux
flytekit
flytekit-java
flytelab
great-content
hacktoberfest-2022
helsing-flyte
in-flyte-conversations
introductions
jobs
konan-integration
linkedin-flyte
random
ray-integration
ray-on-flyte
release
scipy-2022-sprint
sig-large-models
workflow-building-ui-proj
writing-w-sfloris
Powered by Linen
announcements
  • v

    varsha Parthasarathy

    08/08/2022, 11:50 PM
    Hi team, for every flyte execution in the UI, can I attach custom links such as Wavefront/cloudwatch events etc? Is there like a template I can create/attach for this?
    d
    k
    • 3
    • 11
  • s

    Slackbot

    08/09/2022, 4:56 AM
    This message was deleted.
    k
    • 2
    • 3
  • s

    Sugato Ray

    08/09/2022, 12:25 PM
    Hello All, Recently I added 7 flyteplugins to conda-forge. As the number of plugins increases, it would be more manageable to have multiple contributors onboarded to maintain conda-forge recipes of the Flyte plugins. I am planning on hosting a conda-forge recipe creators workshop in near future. Would you like to attend a hands on workshop? Please feel free to respond to this poll and share it with anyone else you might think could benefit from the workshop. https://www.linkedin.com/posts/sugatoray_conda-condaforge-workshop-activity-6962057281697984512-u7yM
    🙋‍♂️ 1
    😛artyparrot: 3
    • 1
    • 1
  • p

    Piotr Zawadzki

    08/09/2022, 1:05 PM
    hi, anyone knows why after running sandbox login page does not work
    k
    • 2
    • 2
  • p

    Piotr Zawadzki

    08/09/2022, 1:06 PM
  • a

    Abdullah Mobeen

    08/09/2022, 1:27 PM
    Wrong channel. Sorry. Asked in #flytekit
  • r

    Rahul Mehta

    08/09/2022, 9:16 PM
    Hey all, we're moving forward with our migration to flyte and are making sure that various end-user workflows are at parity w/ our current Kubeflow deployment. A couple of topics that have come up include the best ways to support multi-tenancy/projects for experimentation. 1. We currently group runs submitted by various users as "experiments" in Kubeflow. I notice in Flyte there is an option in the UI to filter down to only workflows submitted by the currently-authenticated user, but more broadly what's the best way to group different sets of experiments that multiple users are running 2. Does having a project per user make sense (ie. for a user's dev workspace)? I noticed in the docs that a common pattern is having one project per repo, but in our current setup we run everything out of one monorepo.
    ❤️ 3
    k
    v
    • 3
    • 12
  • s

    SeungTaeKim

    08/10/2022, 7:37 AM
    Hello, flyte team! My team has a busy day with flyte deployment in my company. we will gonna deploy flyte next week, so we are solving some specific issues like notification. I am doing setup of aws sns & sqs, do I setup this below in the image in helm chart, values.yaml? here is the link
    y
    k
    • 3
    • 4
  • k

    Ketan (kumare3)

    08/10/2022, 1:44 PM
    Folks will appreciate if people chime in - https://www.reddit.com/r/mlops/comments/wfxa4o/metaflow_vs_airflow_vs_others/?utm_source=share&utm_medium=ios_app&utm_name=iossmf - cc @Calvin Leather / @Babis Kiosidis / @Rahul Mehta / @SeungTaeKim / @jeev and others
    👍 3
    s
    • 2
    • 2
  • g

    Geoff Salmon

    08/10/2022, 10:32 PM
    Hi all. Has there been any work on, or interest in, scheduling workflows based on the presence of input data and the absence of output data? I'm thinking of something similar to dagster's "asset reconciliation" where a scheduler is aware of the (possibly time-partitioned) inputs and outputs of each workflow and then it continually schedules a set of workflows as each workflow's input becomes available.
    k
    • 2
    • 17
  • k

    Kim Junil

    08/11/2022, 5:32 AM
    Hi all! My team is preparing to provide Pulumi to our researchers. We want to set a timezone that is familiar to researchers Can I set the default timezone? It's installed using helm chart on bare metal k8s
    k
    • 2
    • 12
  • k

    Ketan (kumare3)

    08/11/2022, 10:33 PM
    @Smriti Satyan can we doc This as a note in the Spark on Flyte deployment guide - Curently Spark on Flyte talks about AWS - https://docs.flyte.org/projects/cookbook/en/stable/auto/integrations/kubernetes/k8s_spark/index.html#how-to-build-your-dockerfile-for-spark-on-k8s We should add a note that for GCP you have to use - https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/docs/gcp.md
    👀 1
    ✅ 1
  • k

    Ketan (kumare3)

    08/11/2022, 11:35 PM
    https://mlops-community.slack.com/archives/C7DR1E5NC/p1660237844643319
  • r

    Renata Rodrigues Gotler

    08/15/2022, 6:35 PM
    Hi, I'm trying to pass a FlyteDirectory between tasks... When I pass it from python task to ShellTask it works as expected, but when I pass from python task to python task the directory came empty. Can someone help me?
    n
    • 2
    • 2
  • n

    Nada Saiyed

    08/15/2022, 7:47 PM
    Hello.. what the best way to represent a complex schema in a dataframe passed between tasks? I think its not supported natively in
    StructuredDataset
    , but can that be somehow represented as
    FlyteSchema
    ?
    👀 1
    n
    s
    • 3
    • 9
  • h

    Hampus Rosvall

    08/16/2022, 6:00 AM
    Hey, a few questions, 1. are there any examples of setting up CI/CD to register workflows using GitHub Actions when Flyte is deployed with OIDC authentication? I assume you need to generate a
    ~/.flyte/config.yaml
    and configure backend to authenticate using OIDC flow with
    clientId
    &
    clientSecret
    but not sure if I am missing anything else? Basically what I want to achieve is something in line with what you described at Set up DevOps in this blogpost: https://mlops.community/mlops-with-flyte-the-convergence-of-workflows-between-machine-learning-and-engineering/ 2. How would you add tolerations to the Pod Specifications for a task/workflow to run on dedicated node pool such as e.g., nodes with GPU/dedicated CPU nodes?
    s
    p
    +2
    • 5
    • 17
  • s

    SeungTaeKim

    08/16/2022, 6:00 AM
    Hi, flyte team! I'd like to ask the notification setting of flyte. I have refered to this link, https://flyte-org.slack.com/archives/CPQ3ZFQ84/p1660104814016329 and it was so helpful to setup the notification. however, there are several problem I did not solve. First, when I have setup notification with the sample code above the link or flyte notifictaion tutorial, it was not working. For example, when I have written subject in emailer like
    "Notice: Execution \"{{ workflow.name }}\" has {{ phase }} in \"{{ domain }}\"."
    , then flyte return
    workflow does not exist
    message. Second, do I need to set addtiional things, such as policy or service of SQS & SNS in AWS? I have made launchplan with Email configuration, when the workflow become success, but flyteadmin did not send any email to me. Do I add
    credential
    &
    config
    key with the same account of SQS & SNS in
    .aws
    folder? Thanks you for your advice
    s
    p
    +3
    • 6
    • 14
  • o

    Or Itzary

    08/16/2022, 6:02 AM
    Hi!! Quick question! Im using flyte cluster on localhost, is thefe any api to trigger a workflow from a remote service?
    👍 1
    s
    s
    • 3
    • 4
  • a

    allen

    08/16/2022, 2:48 PM
    Hey guys, trying to run the example workflow on my Flyte AWS cluster and seeing
    Exceeded resourcequota: [BackOffError] The operation attempt was blocked by back-off [attempted at: 2022-08-15 22:25:40.938456125 +0000 UTC m=+13688.975277765][the block expires at: 2022-08-15 22:25:58.135850691 +0000 UTC m=+13706.172672341] and the requested resource(s) exceeds resource ceiling(s)
    . However, following the config instructions, I manually edited the
    ResourceQuota
    to some absurdly high cpu and memory limit. I’m seeing this in Flyteconsole UI as well as propeller logs. I’m trying to spin up some more nodes for testing to see if that helps
    k
    s
    k
    • 4
    • 5
  • a

    allen

    08/16/2022, 3:11 PM
    hey guys, another q, maybe I missed this somewhere in the docs, but how do I configure flyte propeller settings? Specifically, I want to change the K8s pod spec. I couldn’t find this anywhere in the
    values.yaml
    file in the Helm chart
    k
    d
    a
    • 4
    • 8
  • s

    Sandra Youssef

    08/16/2022, 10:10 PM
    Hi Flyers, Watch ML Engineers, Data Scientists and Software Engineers - @Matheus Moreno, @Robin Kahlow, @Mike Zhong and @krishna Yerramsetty - discuss how to unify teams, how to choose ML orchestration tools, and some differences between MLOps and ML Orchestration, in this Fireside Chat featured in one of our Flyte Community Sync events.

    https://www.youtube.com/watch?v=HE7lJFW6ki8▾

    👍 5
    ❤️ 5
    ☕ 4
    🔥 4
  • j

    jeev

    08/16/2022, 11:41 PM
    we're getting collisions with the execution IDs of subworkflow launch plans that propeller is kicking off:
    Setting the MetadataDir for StartNode [<gs://flyte-freenome-computational/metadata/propeller/balrog-production-fldyczra/start-node/data>]
    fldyczra
    was already used. given that these are much shorter than what can be used, is there an easy way to make these longer to avoid possible collisions?
    k
    d
    +4
    • 7
    • 54
  • s

    SeungTaeKim

    08/17/2022, 6:03 AM
    hello, flyte team. I have a question about workflow register process. I am currently automating ML process through flyte with github CI, and I have problem, launchplan deactivation. The workflow successfully registered in flyte, but it does not show DAG and users cannot start "launch" in console. where do I check log? I hope to get some advice. thanks
    s
    p
    • 3
    • 33
  • l

    Louis DiNatale

    08/17/2022, 6:00 PM
    Hey flyte team, I was wondering if there is a way to better name pods in kubernetes to help identify what they are?
    k
    s
    • 3
    • 6
  • s

    Sandra Youssef

    08/17/2022, 6:25 PM
    Hi Flyers, Join us tomorrow 8/18 at 10am PT to ask @Ketan (kumare3) anything, hosted by the MLOps Community. Topics include: - Convergence of data & ML - Taking ideas from concept to production - Workflow automation & best practices https://mlops-community.slack.com (#ask-me-anything)
    👍 5
    ❤️ 5
    🔥 4
  • h

    Hampus Rosvall

    08/18/2022, 5:47 AM
    Hey, I am trying to use the
    clientSecret
    authflow to be able to build and register workflows in our GitHub Actions CI builds. I looked at the CI docs here, and getting the following error both locally and in our CI when I run the same command. Has anyone experienced anything similar? Flytectl config available in comments
    ☁  ~  flytectl get projects
    Error: rpc error: code = Unauthenticated desc = transport: oauth2: cannot fetch token: 401 Unauthorized
    Response: {"error":"invalid_client","error_description":"Client authentication failed (e.g., unknown client, no client authentication included, or unsupported authentication method)."}
    s
    p
    • 3
    • 48
  • h

    Hampus Rosvall

    08/18/2022, 9:15 AM
    On to the next question. I am setting up Flyte to be used by many different teams. My idea was use the same service account for each of the projects i.e., use the https://docs.flyte.org/en/latest/deployment/aws/manual.html#flyte-user-role the pods are assuming and pass IAM roles in the launch plan that the service account assumes during execution, I remembered that there were some problems with this a while back. Is this working or is there a better way to achieve project specific permissions?
    s
    p
    k
    • 4
    • 14
  • s

    SeungTaeKim

    08/18/2022, 9:41 AM
    Hi, flyte team. I would like to ask a question about notification email. I have setup notification in values.yaml and build SQS & SNS in aws. I have checked logs that it is publishing message but it did not arriave in my mail box. would anyone can give some advice?
    2022/08/18 08:08:18 /go/src/github.com/flyteorg/flyteadmin/pkg/repositories/gormimpl/execution_repo.go:61
    [21.243ms] [rows:1] UPDATE "executions" SET "id"=358,"created_at"='2022-08-18 08:05:44.14',"updated_at"='2022-08-18 08:08:18.501',"execution_project"='flytesnacks',"execution_domain"='development',"execution_name"='f985b6eddf4c43d5f000',"launch_plan_id"=114,"workflow_id"=106,"phase"='SUCCEEDED',"closure"='<binary>',"spec"='<binary>',"started_at"='2022-08-18 08:05:49.251',"execution_created_at"='2022-08-18 08:05:44.139',"execution_updated_at"='2022-08-18 08:08:18.497',"duration"='2m29.245844975s',"mode"=1,"inputs_uri"='<s3://my-s3-bucket/metadata/flytesnacks/development/f985b6eddf4c43d5f000/inputs>',"user_inputs_uri"='<s3://my-s3-bucket/metadata/flytesnacks/development/f985b6eddf4c43d5f000/user_inputs>',"user"='a57ebf23-a6e8-45e7-bcb1-52b69f508f67',"state"=0 WHERE "execution_project" = 'flytesnacks' AND "execution_domain" = 'development' AND "execution_name" = 'f985b6eddf4c43d5f000'
    {"json":{"exec_id":"f985b6eddf4c43d5f000","src":"execution_manager.go:1588"},"level":"debug","msg":"publishing notifications for execution [project:\"flytesnacks\" domain:\"development\" name:\"f985b6eddf4c43d5f000\" ] in state [SUCCEEDED] for notifications [[phases:SUCCEEDED email:\u003crecipients_email:\"<my email>\" \u003e ]]","ts":"2022-08-18T08:08:18Z"}
    {"json":{"exec_id":"f985b6eddf4c43d5f000","src":"publisher.go:30"},"level":"debug","msg":"Publishing the following message [recipients_email:\"<my mail>\" sender_email:\"<sender mail setup in SES>\" subject_line:\"Notice: Execution \\\"flyte_fixedrate.positive_wf\\\" has succeeded in \\\"development\\\".\" body:\"Execution \\\\\\\"flyte_fixedrate.positive_wf [f985b6eddf4c43d5f000]\\\\\\\" has succeeded in \\\\\\\"development\\\\\\\". View details at \u003ca href=\\\\<http://flow.qraftpilot.com/console/projects/flytesnacks/domains/development/executions/f985b6eddf4c43d5f000>\u003e http://<flyte url>/console/projects/flytesnacks/domains/development/executions/f985b6eddf4c43d5f000\u003c/a\u003e. \\n\" ]","ts":"2022-08-18T08:08:18Z"}
    
    
    
    {"json":{"exec_id":"faf3d92fb8453e24d000","node":"n0","src":"noop_notifications.go:32"},"level":"debug","msg":"call to noop publish with notification type [flyteidl.admin.NodeExecutionEventRequest] and proto message [event:\u003cid:\u003cnode_id:\"n0\" execution_id:\u003cproject:\"flytesnacks\" domain:\"development\" name:\"faf3d92fb8453e24d000\" \u003e \u003e producer_id:\"propeller\" phase:SUCCEEDED occurred_at:\u003cseconds:1660810338 nanos:222102672 \u003e input_uri:\"<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-faf3d92fb8453e24d000/n0/data/inputs.pb>\" output_uri:\"<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-faf3d92fb8453e24d000/n0/data/0/outputs.pb>\" task_node_metadata:\u003c\u003e spec_node_id:\"n0\" node_name:\"be_positive\" event_version:1 deck_uri:\"<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-faf3d92fb8453e24d000/n0/data/0/deck.html>\" \u003e ]","ts":"2022-08-18T08:12:18Z"}
    thank you!
    p
    j
    k
    • 4
    • 39
  • z

    Zachary Carrico

    08/18/2022, 3:33 PM
    Hi, anyone have a guess as to why
    TypeTransformerFailedError
    occurs when using imported variables in workflows, but if the variables are declared in the same python module as the workflow there is no error? Thank you!
    s
    a
    y
    • 4
    • 36
  • s

    Sandra Youssef

    08/18/2022, 10:26 PM
    Hi Flyers, If you work at a biotech company and need to orchestrate your bio workflows, tune into the Flyte For Biotech discussion, sharing some incredibly interesting insights from our panelists: • @jeev, Software Engineer at Freenome • @Kenny Workman, Co-Founder and CEO at LatchBio • @Calvin Leather, Tech Lead at Embark Veterinary • @krishna Yerramsetty, Data Scientist at Infinome • @Jason Daniel, Solutions Engineer at Zymergen • @Ketan (kumare3), Co-Founder and CEO at Union.ai • @Niels Bantilan, ML Engineer at Union.ai Learn about the challenges that biotech companies typically encounter, and how Flyte promotes a seamless migration from research to production.

    https://www.youtube.com/watch?v=AJnNXrdaQHE▾

    ❤️ 3
    🔥 4
    :flyte: 2
    👍 4
Powered by Linen
Title
s

Sandra Youssef

08/18/2022, 10:26 PM
Hi Flyers, If you work at a biotech company and need to orchestrate your bio workflows, tune into the Flyte For Biotech discussion, sharing some incredibly interesting insights from our panelists: • @jeev, Software Engineer at Freenome • @Kenny Workman, Co-Founder and CEO at LatchBio • @Calvin Leather, Tech Lead at Embark Veterinary • @krishna Yerramsetty, Data Scientist at Infinome • @Jason Daniel, Solutions Engineer at Zymergen • @Ketan (kumare3), Co-Founder and CEO at Union.ai • @Niels Bantilan, ML Engineer at Union.ai Learn about the challenges that biotech companies typically encounter, and how Flyte promotes a seamless migration from research to production.

https://www.youtube.com/watch?v=AJnNXrdaQHE▾

❤️ 3
🔥 4
:flyte: 2
👍 4
View count: 5