https://flyte.org
Join Slack
Team, i am trying to modify existing registered workflow and register again with some changes but e...
s

Sathish kumar Venkatesan

almost 3 years ago
Team, i am trying to modify existing registered workflow and register again with some changes but ending up with below exception. it is showing exception with launch plan already exists. kindly let me know best practices to redeploy the workflow with same launch plan.
details = "launch plan with different structure already exists with id resource_type:LAUNCH_PLAN project:"cloudops-max-flyte-demo" domain:"development" name:"snowflake_cron_scheduled_lp" version:"v1"
s
s
k
  • 3
  • 6
  • 380
Hi everyone :raised_hands: In my company we are evaluating Flyte :partyparrot:and we want to deploy...
m

Marti Jorda Roca

over 2 years ago
Hi everyone 🙌 In my company we are evaluating Flyte 🦜and we want to deploy an MVP to AWS EKS, with s3 and RDS postgres. We are following the guide flyte-the-hard-way but we are stuck in the 05-deploy-with-helm.md. When we try to install flyte the pod throws the following error:
/go/pkg/mod/gorm.io/gorm@v1.24.1-0.20221019064659-5dd2bb482755/gorm.go:206
[error] failed to initialize database, got error failed to connect to `host=***** user=flyteadmin database=flyteadmin`: server error (FATAL: no pg_hba.conf entry for host "172.32.101.12", user "flyteadmin", database "flyteadmin", no encryption (SQLSTATE 28000))
We have run this command to test the database connection:
kubectl run pgsql-postgresql-client --rm --tty -i --restart='Never' --namespace testdb --image <http://docker.io/bitnami/postgresql:11.7.0-debian-10-r9|docker.io/bitnami/postgresql:11.7.0-debian-10-r9> --env='PGPASSWORD=<Password>' --command -- psql testdb --host <RDS-ENDPOINT-NAME> -U flyteadmin -d flyteadmin -p 5432
And works. The only difference is that when we run it asks for the password. Anyone knows what’s happening here?
❤️ 3
m
r
+2
  • 4
  • 13
  • 375
Hi, I have a question: Is there a way from within a task code execution to retrieve information on u...
a

Arshak Ulubabyan

about 3 years ago
Hi, I have a question: Is there a way from within a task code execution to retrieve information on under what domain & project is it running. on? E.g. I have Development/Staging/Production domains, and when I run the workflow, I want task to load configs for the right environment.
a
n
+4
  • 6
  • 12
  • 369
Hi! I hope everyone is well and safe I have a flyte cluster running on kubernetes. I am trying to ...
v

Vinicius Esperança

over 3 years ago
Hi! I hope everyone is well and safe I have a flyte cluster running on kubernetes. I am trying to run a simple workflow, from my machine, on that cluster. I am struggling a bit how to do that. Is there any documentation explaining how to do that?
v
k
+4
  • 6
  • 43
  • 368
Got a question with regards to RBAC because I couldn’t find anything in the doc. Is it possible at ...
s

Stephen

over 2 years ago
Got a question with regards to RBAC because I couldn’t find anything in the doc. Is it possible at the moment to limit access to some specific projects to a group of people only? I haven’t found anything where I could limit viewing/ editing a project to a specific group of developers.
s
k
  • 2
  • 4
  • 365
Hi folks... I have a `@dynamic` task that calls a `@task` task that's expected to return a dict. Ins...
r

Rupsha Chaudhuri

over 3 years ago
Hi folks... I have a
@dynamic
task that calls a
@task
task that's expected to return a dict. Instead I'm getting a
flytekit.core.promise.Promise
object back. I also don't see any of the logs from that task.. nor do I see the called task executing on the console. What's weird is that the same called task works as expected when invoked from other tasks in the same workflow. Can someone help me understand why a task would not execute and return a Promise instead?
r
k
  • 2
  • 35
  • 361
hey everyone, i'm trying to run ray on the flyte sandbox deployment, and am running into the followi...
j

James Evers

about 3 years ago
hey everyone, i'm trying to run ray on the flyte sandbox deployment, and am running into the following error. it looks like its basically an OOM error, but i'm not sure how to increase the default size of
/dev/shm
. what's the best approach to bumping this default in the sandbox deployment?
/usr/local/lib/python3.8/dist-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated
  "class": algorithms.Blowfish,
2022-09-14 18:10:43,190	WARNING services.py:1882 -- WARNING: The object store is using /tmp instead of /dev/shm because /dev/shm has only 67108864 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=0.10gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2022-09-14 18:10:46,611	INFO worker.py:1509 -- Started a local Ray instance. View the dashboard at [1m[32m<http://127.0.0.1:8265> [39m[22m
[2022-09-14 18:10:57,864 E 1 1] <http://core_worker.cc:149|core_worker.cc:149>: Failed to register worker 01000000ffffffffffffffffffffffffffffffffffffffffffffffff to Raylet. IOError: [RayletClient] Unable to register worker with raylet. No such file or directory
j
k
e
  • 3
  • 19
  • 358
Hi, I'm trying to run Sandbox deployment with k3d cluster, following the instruction: <https://docs....
t

Tatyana Vlasova

over 3 years ago
Hi, I'm trying to run Sandbox deployment with k3d cluster, following the instruction: https://docs.flyte.org/en/latest/deployment/sandbox.html#deploying-your-own-flyte-sandbox-environment-to-a-k8s-cluster At the resource page I see:
TODO: These instructions currently still rely on the old kustomize setup, and will be moved over to the Helm chart soon.
Is there any relevant instruction for deploying Flyte with k3d, because the current version runs into error (or maybe is not full) with the 2d step:
k3d cluster create -p "30081:30081" –no-lb –k3s-server-arg '–no-deploy=traefik' –k3s-server-arg '–no-deploy=servicelb' flyte
Error:
Error: accepts between 0 and 1 arg(s), received 6
Tried to fix it with (following the k3d hints for tags):
k3d cluster create flyte -p 30081:30081 --no-lb  --k3s-arg "–no-deploy=traefik" --k3s-arg "–no-deploy=servicelb"
but get an error again:
FATA[0000] failed to transform ports: No nodefilters specified
What is the right setup procedure and what are the right parameters for this?
t
s
+2
  • 4
  • 8
  • 358
Hello, what's the difference between `flytectl demo start` and `flytectl sandbox start`? For context...
a

Albert Wibowo

over 2 years ago
Hello, what's the difference between
flytectl demo start
and
flytectl sandbox start
? For context, I am NOT using Docker Desktop. I am using Docker Engine + Colima. As such, my docker host is in another path. To change it, I ran the following command as per @Marti Jorda Roca' suggestion:
export DOCKER_HOST= .......
flytectl config init
When I ran
flytectl sandbox start
, it worked perfectly fine. But if I ran
flytectl demo start
instead, my workflow failed. Any idea what's happening under the hood? I also tried to use my own docker image when running
flytectl sandbox start
but turns out it did not spin up local registry. Any work around?
✅ 1
a
y
+2
  • 4
  • 46
  • 355
I'm trying to do some tests in flyte sandbox, but `pyflyte --config ~/.flyte/config-sandbox.yaml reg...
f

Felix Ruess

over 2 years ago
I'm trying to do some tests in flyte sandbox, but
pyflyte --config ~/.flyte/config-sandbox.yaml register ...
gives me exceptions: failed to put data... Is this supposed to work out of the box? I can't seem to find where I configure credentials as that seems to be the problem.
f
d
+3
  • 5
  • 47
  • 355
Previous8910Next

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Powered by