https://flyte.org logo
Join the conversationJoin Slack
Channels
announcements
ask-the-community
auth
conference-talks
contribute
databricks-integration
datahub-flyte
deployment
ecosystem-unionml
engineeringlabs
events
feature-discussions
flyte-bazel
flyte-build
flyte-console
flyte-deployment
flyte-documentation
flyte-github
flyte-ui-ux
flytekit
flytekit-java
flytelab
great-content
hacktoberfest-2022
helsing-flyte
in-flyte-conversations
introductions
jobs
konan-integration
linkedin-flyte
random
ray-integration
ray-on-flyte
release
scipy-2022-sprint
sig-large-models
workflow-building-ui-proj
writing-w-sfloris
Powered by Linen
announcements
  • a

    Alex Pozimenko

    05/09/2022, 9:02 PM
    hi team, we're having issues with metric collection on the recent flyteadmin. Telegraf starts throwing lots of these after just a day or two of uptime and some metrics disappear from the dashboard:
    Error in plugin [inputs.prometheus]: error reading body: net/http: request canceled (Client.Timeout exceeded while reading body)
    original settings were:
    interval = "10s"
    response_timeout = "3s"
    I changed these to 30s and 15s and it seems to be ok for now. Do you have a recommendation on that these should be set to?
    k
    • 2
    • 4
  • m

    Matheus Moreno

    05/10/2022, 3:06 PM
    Hi, everyone! Any tips to help debugging Helm errors when trying to start the new sandbox lite? I can only see
    Starting Docker daemon...
    Done.
    Starting k3s cluster...
    Done.
    Deploying Flyte...
    "flyteorg" has been added to your repositories
    Release "flyte" does not exist. Installing it now.
    Error: timed out waiting for the condition
    y
    • 2
    • 18
  • a

    Alex Bain

    05/10/2022, 6:47 PM
    @katrina @Prafulla Mahindrakar @Haytham Abuelfutuh I updated to Flyte
    1.0.1
    and now workflows executed with
    flyte-cli execute-launch-plan
    (with flytekit 0.26.0) lose their k8s service account that was declared with
    flyte-cli register-files --kubernetes-service-account
    . When I execute the same workflow from Flyte Console the k8s service account is fine.
    k
    h
    • 3
    • 36
  • a

    Alex Bain

    05/11/2022, 1:13 AM
    I am running a bunch of subworkflows from my parent workflow. I want to run them in serial (instead of in parallel). Can I chain them together like I can chain together normal Flyte tasks (i.e. https://docs.flyte.org/projects/cookbook/en/latest/auto/core/control_flow/chain_tasks.html)?
    k
    • 2
    • 2
  • a

    Alessandro Liparoti

    05/11/2022, 11:54 AM
    hi, we used to rely on this file in the sandbox image https://github.com/flyteorg/flyte/blob/master/deployment/sandbox/flyte_generated.yaml with
    dind
    tag but it seems I can’t find it anymore, any idea?
    y
    y
    • 3
    • 13
  • m

    Matheus Moreno

    05/11/2022, 4:10 PM
    Hey, everyone. Did the in-container path for secrets change for 1.x.x? I can't access my secrets anymore, and I can't find the directory
    /etc/flyte/secrets
    either
    k
    y
    k
    • 4
    • 54
  • a

    Alex Pozimenko

    05/12/2022, 7:03 PM
    hi, has this metric been renamed recently? (@katrina)
    flyte-admin-task.execution.manager-task.executions.terminated.counter
    k
    • 2
    • 11
  • s

    Sonja Ericsson

    05/13/2022, 10:29 AM
    Hi! I was looking at this metric from propeller called
    grpc_client_handled_total
    but I only see requests to the AdminService, is there a way to see requests to datacatalog as well?
    p
    • 2
    • 5
  • g

    George Odette

    05/16/2022, 9:34 AM
    Hi everyone. I'm new to using flyte. I'm using wsl and have installed flytectl using curl. How do I address "flytectl command not found?
    s
    • 2
    • 2
  • s

    Sandra Youssef

    05/16/2022, 3:04 PM
    Hi Flyers, Join us in welcoming our Flyte OS Community Sync guest speaker, Freenome's @jeev, who will tell us more about how Flyte can benefit the biotech industry, in Taking Flyte at Freenome. Tomorrow 5/17, 9am PT Zoom Link: https://www.addevent.com/event/EA7823958 See you there! Flyte Team
    🚀 7
  • g

    George Odette

    05/16/2022, 6:25 PM
    Plus how does someone deal missing modules such while writing python scripts using flyte functionalities?
    k
    • 2
    • 1
  • r

    Ruksana Kabealo

    05/16/2022, 6:39 PM
    Hello all. I'm attempting to use flytectl 0.5.25 on Centos7. I am trying to create a project. I keep getting the attached SIGSEGV, similar to (but not exactly) the issue here: https://github.com/flyteorg/flyte/issues/1320. What am I doing wrong here?
    cmdline_txt.cpp
    👀 1
    e
    p
    • 3
    • 10
  • s

    Sandra Youssef

    05/16/2022, 8:17 PM
    Also join the Flyte Community Sync tomorrow for a demo of pyflyte run (script mode) by Union.ai's @Eduardo Apolinario (eapolinario) 5/17, 9am PT Zoom Link: https://addevent.com/event/EA7823958
    🔥 7
    🏃 2
  • s

    Sandra Youssef

    05/18/2022, 12:44 AM
    Have a Flyte question? Want to chat? Drop in to our Weekly on Wednesdays Flyte office hours: - Red Eye Flyte with @Haytham Abuelfutuh, 7:00am PT (Zoom link) -✨*New*✨Office Hours with @katrina, 1:30pm PT (Zoom link) - Late Night MLOps with @Ketan (kumare3), 9:00pm PT (Zoom link) Check out the #announcements channel for reminders!
    🙏 2
  • a

    Alex Bain

    05/18/2022, 8:10 AM
    Hey #flyte team, I want to use
    FlyteRemote
    to execute a workflow launch plan where one of the parameters is my custom class (assume that I have a good reason why I want to do this). For example, I have:
    @dataclass_json
    @dataclass
    class WrappedList:
        files: str
    and the workflow
    @flytekit.workflow
    def LocalSlam(input_list: WrappedList)
    and that I want to use
    FlyteRemote
    to execute this worklow like
    lp = remote.fetch_launch_plan(name=workflow_name, version=workflow_version)
    e = remote.execute(lp, inputs=inputs)
    y
    • 2
    • 10
  • b

    Bernhard Stadlbauer

    05/18/2022, 8:54 AM
    Hi! Is there a way to get current image FQN (in case of a remote execution) from within a task? Specifically I would be interested in having that information in
    PythonTask.pre_execute()
    , so
    user_params: ExecutionParameters
    would also be available if that helps.
    y
    k
    m
    • 4
    • 16
  • l

    Luísa Braga Simões

    05/18/2022, 5:31 PM
    Hi all! 👋 I've started exploring flyte recently but I don't seem to be able to run workflows on my sandbox environment. I've created a sandbox environment using the command
    flytectl sandbox start
    and exported the env vars for kube and flyte configuration. I'm trying to run the hello world example from flytesnacks and I've created a virtual env using poetry, in which I installed pyflyte (1.0.2). I can run it locally no problem, but when I add the
    remote
    flag, I get a connection reset by peer error. Any ideas what is wrong on my setup? I'm on WSL2
    y
    k
    +4
    • 7
    • 38
  • s

    Sandra Youssef

    05/18/2022, 6:11 PM
    Hi Flyers, Many thanks to folks who attended yesterday's Flyte Community Sync, and special thanks to our speakers! Recordings have been published on Flyte's YouTube channel: • Community Update - @katrina (

    recording▾

    ) • Script Mode - pyflyte run - @Eduardo Apolinario (eapolinario) (

    recording▾

    ) • Taking Flyte at Freenome - @jeev (

    recording▾

    ) Feel free to check out the Meeting Notes, and mark your calendars for our next sync on Tuesday May 31st, featuring MethaneSAT! Flyte Team
    ❤️ 12
    🎉 9
    💯 2
    😛artyparrot: 4
    👍 1
    ⚡ 3
  • n

    Nastya Rusina

    05/19/2022, 1:54 AM
    Hi all 👋 The new release of FlyteConsole v.1.1.0 is now available. 🎉 It includes: • Refactor to monorepo structure to simplify future support for plugin system • StructuredDataSet Input/Output type support • Updated TaskDetails, with link to TaskDetails page and ability to collapse parts of the schema • Better representation for map-task in Graph view (more to come…) • Fix to ensure that API requests for users with different admin/console domain will work as expected • Add interruptible override to launch forms • Number of cosmetic fixes Full list of changes could be found in #flyte-console channel
    🎉 12
  • s

    Stephen

    05/19/2022, 10:55 AM
    I don't know exactly where to put it but would it be possible to push a fix for this issue? https://github.com/flyteorg/flyte/issues/2444 We had to downgrade as half of our data scientists couldn't log-in because of that bug 😅
    👀 1
    👍 1
    k
    s
    • 3
    • 9
  • m

    Matheus Moreno

    05/19/2022, 1:56 PM
    Hey, everyone! I'm looking at the new parts of the documentation and wondering if the serialization/registration process changed on 1.x.x. The Getting Started example executes a workflow locally using the default Docker image in the sandbox server, right? But I thought that the code was required to be inside the container so that Flyte could run it. Does pyflyte run an implicit fast serialization? If not, what is it doing? I'm curious because our team wants to use Flyte on production, but I fear that we'll have a lot of very similar Docker images (since we mostly use the same libraries). Having "base" images that we could use on simple tasks/projects would be a life-saver.
    k
    k
    • 3
    • 3
  • v

    Viktor Gerdin

    05/20/2022, 9:33 AM
    Hello! We have a webapi plugin and would like to control the rate of how often propeller calls the
    Status()
    hook [interface explained]. We have noticed that this is very much depending on load. During low (normal) load
    Status()
    is called multiple times per second. The
    Get()
    hook is only executed once every 30s, so we consider any rate of
    Status()
    higher than 15s to be a waste. The webapi
    PluginConfig
    contains configurations for a
    ReadRateLimiter
    and
    WriteRateLimiter
    [github] which I am unable to find being used in either propeller nor plugin machinery. We are not experiencing any throttling from the external API, only that the
    Status()
    rate is very high. Anyone have any pointers where to go from here?
    k
    • 2
    • 6
  • b

    Badar Ahmed

    05/20/2022, 6:26 PM
    I am looking for a way to pass Numpy Arrays (ndarray) and PyTorch/Tensorflow Tensors as Flyte Task input/output. I haven’t come across any example yet. I’m aware of the native support for Dataframes. It seems inefficient to convert ndarray/Tensors back and forth using Dataframes. How are folks handling this?
    k
    n
    +2
    • 5
    • 5
  • a

    Andrew Rubiano

    05/23/2022, 3:55 PM
    When using the API, what is the format for specifying filters. ex: I want to fetch a project with a certain name. The API docs all say:
    Indicates a list of filters passed as string. More info on constructing filters : +optional.
    but I don't see anywhere where it explains the structure of the filters
    k
    • 2
    • 2
  • m

    Mike Ossareh

    05/23/2022, 4:46 PM
    I'm getting a typing complaint while writing an integration test for a workflow: 🧵
    e
    • 2
    • 20
  • r

    Robin Kahlow

    05/24/2022, 9:15 AM
    Hey! I'm trying to set up schedules for my workflows (LaunchPlan.get_or_create -> remote.register_launch_plan -> flyte update launchplan --activate in cli). The schedule does show up in Flyte console (eg. as "Every hour"), but the workflow is never executed. In the scheduler pod there's an error message
    rpc error: code = InvalidArgument desc = missing key in inputs
    . Any ideas what could be wrong? More code in the thread.
    p
    • 2
    • 9
  • s

    Sandra Youssef

    05/24/2022, 2:50 PM
    Hi Flyers, Flyte 1.0 was featured in GitHub's Release Radar blog this month - thanks to our awesome community! https://github.blog/2022-05-20-release-radar-apr-2022/
    ❤️ 12
    🚀 14
  • r

    Robert Everson

    05/24/2022, 8:41 PM
    Is there a way to override/add a particular option when calling the
    pyflyte register
    command? I.E. I’m adding a new field in flytekit and in the Container IDL proto to add an architecture override, is there a way to force that during the register for all workflows in a github repo, rather than needing to modify all of the workflows one by one? @Anmol had mentioned this to me before, but we couldn’t find any docs about it.
    k
    a
    +2
    • 5
    • 7
  • l

    Lucas Rolim

    05/24/2022, 9:41 PM
    Hi everyone! Is there any plan to add a way to define task dependencies just using a requiriment.txt file or dependency name, as it is in Airflow's PythonVirtualenvOperator?
    r
    y
    k
    • 4
    • 13
  • r

    Robin Kahlow

    05/25/2022, 12:56 PM
    I archived my launch plans with
    flytectl update launchplan -p flytesnacks -d development <launch plan name> --version <launch plan version> --archive
    There's a success message "updated launchplan successfully on <launch plan name>" and the Flyte console doesn't show anything under Schedules anymore but my workflow is still being executed every hour. Am I missing something or is this a bug?
    p
    • 2
    • 7
Powered by Linen
Title
r

Robin Kahlow

05/25/2022, 12:56 PM
I archived my launch plans with
flytectl update launchplan -p flytesnacks -d development <launch plan name> --version <launch plan version> --archive
There's a success message "updated launchplan successfully on <launch plan name>" and the Flyte console doesn't show anything under Schedules anymore but my workflow is still being executed every hour. Am I missing something or is this a bug?
p

Prafulla Mahindrakar

05/25/2022, 1:53 PM
is this cron or fixed rate schedule
r

Robin Kahlow

05/25/2022, 1:54 PM
fixed rate
it stopped doing that 12 hours ago, strange
p

Prafulla Mahindrakar

05/26/2022, 11:13 AM
strange. I will look more into this issue and try to repro
❤️ 1
r

Robin Kahlow

05/26/2022, 11:17 AM
some more info: i had a fixed-rate daily schedule first, archived that one, then activated the hourly schedule, then archived the hourly schedule (and then it still kept executing it hourly for a while)
p

Prafulla Mahindrakar

05/26/2022, 1:35 PM
Found the issue with fixed rate . I have sent it for review .I could repro it https://github.com/flyteorg/flyteadmin/pull/431
r

Robin Kahlow

05/26/2022, 1:51 PM
awesome, thank you!
View count: 7