• Kim Junil

    Kim Junil

    1 month ago
    Hi all! My team is preparing to provide Pulumi to our researchers. We want to set a timezone that is familiar to researchers Can I set the default timezone? It's installed using helm chart on bare metal k8s
    Kim Junil
    Ketan (kumare3)
    12 replies
    Copy to Clipboard
  • Ketan (kumare3)

    Ketan (kumare3)

    1 month ago
    @Smriti Satyan can we doc This as a note in the Spark on Flyte deployment guide - Curently Spark on Flyte talks about AWS - https://docs.flyte.org/projects/cookbook/en/stable/auto/integrations/kubernetes/k8s_spark/index.html#how-to-build-your-dockerfile-for-spark-on-k8s We should add a note that for GCP you have to use - https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/docs/gcp.md
  • Renata Rodrigues Gotler

    Renata Rodrigues Gotler

    1 month ago
    Hi, I'm trying to pass a FlyteDirectory between tasks... When I pass it from python task to ShellTask it works as expected, but when I pass from python task to python task the directory came empty. Can someone help me?
    Renata Rodrigues Gotler
    Niels Bantilan
    2 replies
    Copy to Clipboard
  • n

    Nada Saiyed

    1 month ago
    Hello.. what the best way to represent a complex schema in a dataframe passed between tasks? I think its not supported natively in
    StructuredDataset
    , but can that be somehow represented as
    FlyteSchema
    ?
    n
    Niels Bantilan
    +1
    9 replies
    Copy to Clipboard
  • Hampus Rosvall

    Hampus Rosvall

    1 month ago
    Hey, a few questions, 1. are there any examples of setting up CI/CD to register workflows using GitHub Actions when Flyte is deployed with OIDC authentication? I assume you need to generate a
    ~/.flyte/config.yaml
    and configure backend to authenticate using OIDC flow with
    clientId
    &
    clientSecret
    but not sure if I am missing anything else? Basically what I want to achieve is something in line with what you described at Set up DevOps in this blogpost: https://mlops.community/mlops-with-flyte-the-convergence-of-workflows-between-machine-learning-and-engineering/ 2. How would you add tolerations to the Pod Specifications for a task/workflow to run on dedicated node pool such as e.g., nodes with GPU/dedicated CPU nodes?
    Hampus Rosvall
    Samhita Alla
    +3
    17 replies
    Copy to Clipboard
  • s

    SeungTaeKim

    1 month ago
    Hi, flyte team! I'd like to ask the notification setting of flyte. I have refered to this link, https://flyte-org.slack.com/archives/CPQ3ZFQ84/p1660104814016329 and it was so helpful to setup the notification. however, there are several problem I did not solve. First, when I have setup notification with the sample code above the link or flyte notifictaion tutorial, it was not working. For example, when I have written subject in emailer like
    "Notice: Execution \"{{ workflow.name }}\" has {{ phase }} in \"{{ domain }}\"."
    , then flyte return
    workflow does not exist
    message. Second, do I need to set addtiional things, such as policy or service of SQS & SNS in AWS? I have made launchplan with Email configuration, when the workflow become success, but flyteadmin did not send any email to me. Do I add
    credential
    &
    config
    key with the same account of SQS & SNS in
    .aws
    folder? Thanks you for your advice
    s
    Samhita Alla
    +3
    14 replies
    Copy to Clipboard
  • Or Itzary

    Or Itzary

    1 month ago
    Hi!! Quick question! Im using flyte cluster on localhost, is thefe any api to trigger a workflow from a remote service?
    Or Itzary
    s
    +1
    4 replies
    Copy to Clipboard
  • a

    allen

    1 month ago
    Hey guys, trying to run the example workflow on my Flyte AWS cluster and seeing
    Exceeded resourcequota: [BackOffError] The operation attempt was blocked by back-off [attempted at: 2022-08-15 22:25:40.938456125 +0000 UTC m=+13688.975277765][the block expires at: 2022-08-15 22:25:58.135850691 +0000 UTC m=+13706.172672341] and the requested resource(s) exceeds resource ceiling(s)
    . However, following the config instructions, I manually edited the
    ResourceQuota
    to some absurdly high cpu and memory limit. I’m seeing this in Flyteconsole UI as well as propeller logs. I’m trying to spin up some more nodes for testing to see if that helps
    a
    Ketan (kumare3)
    +2
    5 replies
    Copy to Clipboard