• Robert Everson

    Robert Everson

    3 months ago
    Does anyone else use the
    namespaceTemplate
    option for the k8s-array plugin in flytepropeller? We’re on a rather old version, but I’m seeing that flyteadmin is only using the parent namespace for the resources it creates, so when we override the
    namespaceTemplate
    in our clusterresource templates in flyteadmin, we are now seeing an error that the namespace is incorrect (our templates have the namespaceTemplate manually applied to them, so the verification of creating the resource fails as the namespace on the Template and the namespace on the object differ). This might just be an issue with using 2 different versions of flyteadmin and flytepropeller, but wanted to check if this is expected.
    Robert Everson
    k
    3 replies
    Copy to Clipboard
  • Robin Kahlow

    Robin Kahlow

    2 months ago
    Anyone know a good way to do non-grid (eg. some kind of bayesian) hyperparameter optimization with Flyte, with multiple trials in parallel? (ie. is there some library that makes this easy or do I have to implement most of the optimization stuff myself? eg. a library which spits out parameters to try and I give it back the results would be pretty easy to use with Flyte, rather than the library calling an objective function like hyperopt does)
    Robin Kahlow
    Niels Bantilan
    +2
    32 replies
    Copy to Clipboard
  • Sonja Ericsson

    Sonja Ericsson

    2 months ago
    Hey! Is there an easy way to see all workflow using a particular task?
    Sonja Ericsson
    Ketan (kumare3)
    +1
    3 replies
    Copy to Clipboard
  • Ketan (kumare3)

    Ketan (kumare3)

    2 months ago
    Invitations sent to 12 outstanding contributors to get officially added to the Flyte contributors family. Thank you for your contributions and making Flyte what it is
  • Sandra Youssef

    Sandra Youssef

    2 months ago
    Hi Flyers, Thank you for attending the Flyte Community Sync yesterday. Special thanks to our guest appearances and presenters! On the agenda were: Community Updates, featuring Contributors of the Month (June), guest appearance by @Bernhard Stadlbauer, Flyte Ecosystem Project UnionML update by @Niels Bantilan, and roadmap details by @Ketan (kumare3).

    Recording

    PyFlyte Register, a combination of PyFlyte Package and PyFlyte Run, by @Yee.

    Recording

    Flyte Airflow Provider, which can construct Flyte ETL pipelines in Airflow and then ML pipelines in Flyte, triggering Flyte ML pipelines from within Airflow, by @Samhita Alla.

    Recording

    Slides are in the Meeting notes. Mark your calendars for the next community sync on July 12th! Flyte Team
  • a

    Andrew Achkar

    2 months ago
    Hello, I’m wondering how involved it would be to extend the sagemaker plugin to support additional task types like batch transforms and creating/updating endpoint configurations. Is this something that can be done purely in python (flytekit)?
    a
    Ketan (kumare3)
    +1
    18 replies
    Copy to Clipboard
  • f

    Felix Ruess

    2 months ago
    Hi all, just evaluating flyte right now and looks promising for automating and scaling our container based workflows! I'm wondering if there are plans to add support for local execution of raw containers?
    f
    Ketan (kumare3)
    +1
    16 replies
    Copy to Clipboard
  • varsha Parthasarathy

    varsha Parthasarathy

    2 months ago
    Hey team, What is the recommended way to get the execution Id of a workflow? We used the following, are there better ways to do it?
    flytekit.current_context().execution_id.name or os.environ['FLYTE_INTERNAL_EXECUTION_ID']
    varsha Parthasarathy
    Ketan (kumare3)
    +1
    11 replies
    Copy to Clipboard
  • Robin Kahlow

    Robin Kahlow

    2 months ago
    Hey, a colleague is having an issue: he's running a workflow locally, and Flyte stores all the inputs/outputs in /tmp, but he's using tmpfs mounted on /tmp. Is there a way to change the folder? // solved by setting TMPDIR for the command 🙂
  • Vijay Saravana

    Vijay Saravana

    2 months ago
    Hi team, While specifying resources for a task, what does CPU = '2' actually mean? whether cpu means different instances or threads in the same instance?
    Vijay Saravana
    Samhita Alla
    2 replies
    Copy to Clipboard