https://flyte.org
Join Slack
Hi, is it possible to get at some underlying task execution data from the flytekit python sdk? Speci...
a

Andrew Achkar

about 3 years ago
Hi, is it possible to get at some underlying task execution data from the flytekit python sdk? Specifically, say I create a
SagemakerBuiltinAlgorithmsTask
and I would like to retrieve the
TrainingJobName
, which the backend plugin has access to.
a
s
k
  • 3
  • 7
  • 168
Hi! We are currently trying to add automatic tracing through datadog to the pods started through Fl...
b

Bernhard Stadlbauer

over 3 years ago
Hi! We are currently trying to add automatic tracing through datadog to the pods started through Flyte. To do so, we would need to set a few environment variables and mount a volume. While we can set the environment variables in the config, there is no way to add volumes here. Is there any other way that we're missing? The only other thing I could think of is switching all of our tasks to pod tasks, where we would have control over the whole spec, but that is something we would like to avoid if possible. Also happy to contribute here if this is something you'd see a need for.
b
d
a
  • 3
  • 17
  • 168
Has anyone deployed flyte to a bare metal k8s cluster, likely with MetallB? I’d like to run this on...
b

Bryan Yeung

about 3 years ago
Has anyone deployed flyte to a bare metal k8s cluster, likely with MetallB? I’d like to run this on prem if I can.
b
  • 1
  • 1
  • 168
Has anyone tried running Dask together with Flyte?
s

Stefan Avesand

over 3 years ago
Has anyone tried running Dask together with Flyte?
s
k
+2
  • 4
  • 10
  • 168
I have some colleagues that are running the flyte demo step by step in <https://docs.flyte.org/en/la...
k

Katrina P

over 3 years ago
I have some colleagues that are running the flyte demo step by step in https://docs.flyte.org/en/latest/getting_started/index.html, but they're running into an issue
Back-off pulling image "<http://ghcr.io/flyteorg/flytekit:py3.9-1.0.3|ghcr.io/flyteorg/flytekit:py3.9-1.0.3>
as it seems that image tag doesn't exist. Is anyone else having this issue with running that getting started page?
k
k
+3
  • 5
  • 18
  • 168
Hello all. I am trying to set resources for a task using ```@task(requests=Resources(cpu="8"))``` Bu...
k

krishna Yerramsetty

over 3 years ago
Hello all. I am trying to set resources for a task using
@task(requests=Resources(cpu="8"))
But when I try registering the files I get the following error:
Requested CPU default [8] is greater than current limit set in the platform configuration [2]
How and where do I change the default platform configuration? I am running on an AWS EKS cluster with a minimum compute group node size of 2, desired size of 2, and maximum of 24. Each node is a 16 cpu EC2 instance
k
y
+2
  • 4
  • 12
  • 168
Anyone have any experience adding caching to `map_task`? I've tried by adding the caching stuff to t...
t

Thomas Addison

over 3 years ago
Anyone have any experience adding caching to
map_task
? I've tried by adding the caching stuff to the
@task
decorator and in the "mapification" like this:
map_task(my_task)(input=input).with_overrides(cache=True, cache_version="1.0")
but I'm not seeing in the flyte console the little swirly that indicates the task either wrote to or read from the cache. Is caching a map task supported?
t
d
n
  • 3
  • 10
  • 168
Hi guys, was trying to follow instructions from <https://docs.flyte.org/en/latest/getting_started/in...
y

Yaroslav

over 3 years ago
Hi guys, was trying to follow instructions from https://docs.flyte.org/en/latest/getting_started/index.html to run
pyflyte run --remote example.py wf --n 500 --mean 42 --sigma 2
but it was failing on my local environment https://flyte-org.slack.com/files/U037VET9014/F03KJK10Y10/untitled.txt Flytectl was up & running itself. @Yuvraj suggested running
flytectl config init
and it helped. I wonder, is this smth. that needs to be added on a getting_started page?
Untitled.txt
y
y
+2
  • 4
  • 7
  • 168
I think i asked about it a while ago so i am trying to collect all the tasks, subworkflows for a giv...
j

Jay Ganbat

over 3 years ago
I think i asked about it a while ago so i am trying to collect all the tasks, subworkflows for a given workflow execution. For successful workflow it works fine and even the subworkflow launched from dynamic tasks can be retrieved(previously it wasn’t i think) 🎉 however i want to get the same thing for failed tasks, up until the failed node execution. but when i do
remote.sync
it is failing with
FlyteAssertion: Outputs could not be found because the execution ended in failure.
is there a way to circumvent this issue use case for this is to track down the exact tasks that failed, because there can be multiple type of failures in a nested workflow its a bit tedious to scroll through in the web UI
j
c
e
  • 3
  • 4
  • 168
Hey! I'm trying to set up schedules for my workflows (LaunchPlan.get_or_create -&gt; remote.register...
r

Robin Kahlow

over 3 years ago
Hey! I'm trying to set up schedules for my workflows (LaunchPlan.get_or_create -> remote.register_launch_plan -> flyte update launchplan --activate in cli). The schedule does show up in Flyte console (eg. as "Every hour"), but the workflow is never executed. In the scheduler pod there's an error message
rpc error: code = InvalidArgument desc = missing key in inputs
. Any ideas what could be wrong? More code in the thread.
r
p
  • 2
  • 9
  • 168
Previous787980Next

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Powered by