• o

    Oliver Nguyen

    1 month ago
    Hi everyone. I was wondering if there is a way to submit the spark job to the amazon EMR cluster from a Flyte workflow. (My Flyte deployed on AWS cloud environment). Thanks all
    o
    Ketan (kumare3)
    2 replies
    Copy to Clipboard
  • a

    Andrew Achkar

    3 weeks ago
    Hello, curious if anyone else has had a need for a FlyteFile that has an associated lifetime - whereby it would be automatically cleaned up after a user-specified timeframe. This could be along the lines of compliance with data retention policies.
    a
    Ketan (kumare3)
    18 replies
    Copy to Clipboard
  • varsha Parthasarathy

    varsha Parthasarathy

    2 weeks ago
    Question about flyte workflows roadmap/features: If i have a pipeline of 10 steps, could I simply click on the 5th step and just re-run that from the UI/cmd line ?
    varsha Parthasarathy
    Eduardo Apolinario (eapolinario)
    +1
    16 replies
    Copy to Clipboard
  • Guillaume Perchais

    Guillaume Perchais

    1 week ago
    Within Spotify, we were discussing human in the loop feature and could see that some work has been done on this:https://github.com/lyft/flyte/issues/208 What is the best way to check it and share feedback?
    Guillaume Perchais
    Eduardo Apolinario (eapolinario)
    +1
    6 replies
    Copy to Clipboard
  • Hampus Rosvall

    Hampus Rosvall

    1 week ago
    Hey, I was thinking about adding
    nodeSelector
    to the Pod template propeller uses to create pods. Currently I am only using tolerations to allow my pods to schedule on certain nodes. However, let’s say I have multiple node pools for e.g., CPU/GPU tasks and I want to be verbose about which node I want to run my workloads on. Is tolerations sufficient or would I benefit from using
    nodeSelectors
    ? It would be a fun contribution to work on, if you also think it would add value. This could e.g., be added in the
    @task
    decorator by the same means you are adjusting
    requests/limits
    . Let me know what you think! 🙂
    Hampus Rosvall
    Ketan (kumare3)
    7 replies
    Copy to Clipboard
  • honnix

    honnix

    1 week ago
    Hi. What do you think of this feature request? https://github.com/flyteorg/flyte/issues/2883
    honnix
    Dan Rammer (hamersaw)
    5 replies
    Copy to Clipboard