• Matheus Moreno

    Matheus Moreno

    4 months ago
    Hey, everyone! I'm looking at the new parts of the documentation and wondering if the serialization/registration process changed on 1.x.x. The Getting Started example executes a workflow locally using the default Docker image in the sandbox server, right? But I thought that the code was required to be inside the container so that Flyte could run it. Does pyflyte run an implicit fast serialization? If not, what is it doing? I'm curious because our team wants to use Flyte on production, but I fear that we'll have a lot of very similar Docker images (since we mostly use the same libraries). Having "base" images that we could use on simple tasks/projects would be a life-saver.
    Matheus Moreno
    Kevin Su
    +1
    3 replies
    Copy to Clipboard
  • Viktor Gerdin

    Viktor Gerdin

    4 months ago
    Hello! We have a webapi plugin and would like to control the rate of how often propeller calls the
    Status()
    hook [interface explained]. We have noticed that this is very much depending on load. During low (normal) load
    Status()
    is called multiple times per second. The
    Get()
    hook is only executed once every 30s, so we consider any rate of
    Status()
    higher than 15s to be a waste. The webapi
    PluginConfig
    contains configurations for a
    ReadRateLimiter
    and
    WriteRateLimiter
    [github] which I am unable to find being used in either propeller nor plugin machinery. We are not experiencing any throttling from the external API, only that the
    Status()
    rate is very high. Anyone have any pointers where to go from here?
    Viktor Gerdin
    Ketan (kumare3)
    6 replies
    Copy to Clipboard
  • Badar Ahmed

    Badar Ahmed

    4 months ago
    I am looking for a way to pass Numpy Arrays (ndarray) and PyTorch/Tensorflow Tensors as Flyte Task input/output. I haven’t come across any example yet. I’m aware of the native support for Dataframes. It seems inefficient to convert ndarray/Tensors back and forth using Dataframes. How are folks handling this?
    Badar Ahmed
    k
    +2
    5 replies
    Copy to Clipboard
  • Andrew Rubiano

    Andrew Rubiano

    4 months ago
    When using the API, what is the format for specifying filters. ex: I want to fetch a project with a certain name. The API docs all say:
    Indicates a list of filters passed as string. More info on constructing filters : +optional.
    but I don't see anywhere where it explains the structure of the filters
    Andrew Rubiano
    k
    2 replies
    Copy to Clipboard
  • Mike Ossareh

    Mike Ossareh

    4 months ago
    I'm getting a typing complaint while writing an integration test for a workflow: 🧵
    Mike Ossareh
    Eduardo Apolinario (eapolinario)
    20 replies
    Copy to Clipboard
  • Robin Kahlow

    Robin Kahlow

    4 months ago
    Hey! I'm trying to set up schedules for my workflows (LaunchPlan.get_or_create -> remote.register_launch_plan -> flyte update launchplan --activate in cli). The schedule does show up in Flyte console (eg. as "Every hour"), but the workflow is never executed. In the scheduler pod there's an error message
    rpc error: code = InvalidArgument desc = missing key in inputs
    . Any ideas what could be wrong? More code in the thread.
    Robin Kahlow
    p
    9 replies
    Copy to Clipboard
  • Sandra Youssef

    Sandra Youssef

    4 months ago
    Hi Flyers, Flyte 1.0 was featured in GitHub's Release Radar blog this month - thanks to our awesome community!https://github.blog/2022-05-20-release-radar-apr-2022/
  • Robert Everson

    Robert Everson

    4 months ago
    Is there a way to override/add a particular option when calling the
    pyflyte register
    command? I.E. I’m adding a new field in flytekit and in the Container IDL proto to add an architecture override, is there a way to force that during the register for all workflows in a github repo, rather than needing to modify all of the workflows one by one? @Anmol had mentioned this to me before, but we couldn’t find any docs about it.
    Robert Everson
    k
    +3
    7 replies
    Copy to Clipboard
  • Lucas Rolim

    Lucas Rolim

    4 months ago
    Hi everyone! Is there any plan to add a way to define task dependencies just using a requiriment.txt file or dependency name, as it is in Airflow's PythonVirtualenvOperator?
    Lucas Rolim
    Robin Kahlow
    +2
    13 replies
    Copy to Clipboard
  • Robin Kahlow

    Robin Kahlow

    4 months ago
    I archived my launch plans with
    flytectl update launchplan -p flytesnacks -d development <launch plan name> --version <launch plan version> --archive
    There's a success message "updated launchplan successfully on <launch plan name>" and the Flyte console doesn't show anything under Schedules anymore but my workflow is still being executed every hour. Am I missing something or is this a bug?
    Robin Kahlow
    p
    7 replies
    Copy to Clipboard