• James Evers

    James Evers

    5 days ago
    hi everyone, i'm having some trouble pulling images on a sandbox deployment. everything works fine with the base image (the one used when i started the deployment with
    flytectl sandbox start --source .
    ), but when i try to build another image in the sandbox (
    flytectl sandbox exec -- <docker build statement
    ), the pod fails to pull the image even though i can see that its been successfully build via
    flytectl sandbox exec -- docker image ls
    . anyone have any idea where i might be going wrong?
    James Evers
    Yee
    51 replies
    Copy to Clipboard
  • Robert Everson

    Robert Everson

    1 week ago
    Hello, is there any method of Rate Limiting the number of resources that can get created on a k8s cluster (or just the number of tasks/nodes that start up in general)? We’re hitting an issue with crio on our clusters that is causing some of the nodes to fall over, but the nodes stay up in k8s so the resources don’t get returned to the cluster
    Robert Everson
    Ketan (kumare3)
    +1
    18 replies
    Copy to Clipboard
  • Calvin Leather

    Calvin Leather

    6 days ago
    Hey @krishna Yerramsetty nice presentation... bioinformatics-oriented question... how have you been using FlyteFiles for indexed files? Do you have tabix indexes etc. on your bed of vcf files? This has been something my company has been thinking about/prototyping (using 2 flyte files is a bit annoying because the index doesn’t end up “next to” the file its indexing so in our shell tasks we have to cp the files + its index into a new temp folder, but what if we had something like FlyteDirectory that wrapped a file family with an expected number of files)
    Calvin Leather
    Yee
    +2
    20 replies
    Copy to Clipboard
  • s

    Sanjay Chouhan

    5 days ago
    Hi, I had setup Flyte Sandbox on EKS by following these steps https://docs.flyte.org/en/latest/deployment/sandbox.html#deploy-flyte-sandbox-to-a-cloud-kubernetes-cluster I can access the console UI. But when I run "pyflyte --config .flyte/config.yaml run --remote example.py wf --n 500 --mean 42 --sigma 2" I get error like " flytekit.exceptions.user.FlyteAssertion: Failed to put data from /tmp/tmp9l0dj7e1/script_mode.tar.gz to http://localhost:30084/my-s3-bucket --- Original exception: HTTPConnectionPool(host='localhost', port=30084): Max retries exceeded with url: /my-s3-bucket/bh/flytesnacks/development/OWEO " I have mentioned the details in config.yaml like,
    admin:
    # For GRPC endpoints you might want to use dns:///flyte.myexample.com
    endpoint: dns:///a4ad903c61##################.<http://us-west-1.elb.amazonaws.com:80|us-west-1.elb.amazonaws.com:80>
    authType: Pkce
    insecure: true
    logger:
    show-source: true
    level: 0
    storage:
    connection:
    access-key: minio
    auth-type: accesskey
    disable-ssl: true
    endpoint: <http://a093eb##############.us-west-1.elb.amazonaws.com:9001/>
    region: us-east-1
    secret-key: miniostorage
    type: minio
    container: "my-s3-bucket"
    enable-multicontainer: true
    Why it's checking in localhost when I have mentioned the AWS ingress URL?
    s
    Samhita Alla
    +1
    15 replies
    Copy to Clipboard
  • seunggs

    seunggs

    4 days ago
    This is blocking me from running even a simple test workflow on Flyte in a production cluster
  • seunggs

    seunggs

    4 days ago
    Would really appreciate some guidance
  • Rahul Mehta

    Rahul Mehta

    5 days ago
    I might be missing something, but is there a way to pass multiple arguments to a map task (ie. if I have a list
    [1,2,3]
    , can I pass each item to a map task along with some other fixed inputs that are common across all tasks). All the examples in the docs only include tasks w/ a single argument Relatedly, is there a way to use a workflow as part of a map task (ie. map a sub-workflow over a sequence of inputs) Edit: guess not
    Map tasks only accept python function tasks with 0 or 1 inputs
    Rahul Mehta
    Samhita Alla
    +1
    9 replies
    Copy to Clipboard
  • seunggs

    seunggs

    4 days ago
    Been struggling with s3 PutObject access denied issue for days now (@Yee I’m posting a new one here because the existing Slack thread won’t load for me for some reason). Any idea why having a service account with the
    flyte-user-role
    (which has full s3 access) attached as an annotation still gives me PutObject access denied error?
    seunggs
    Ketan (kumare3)
    22 replies
    Copy to Clipboard