https://flyte.org
Join Slack
hi flyte team, we recently upgraded the console to the latest and now it doesn't show dynamic subtas...
a

Alex Pozimenko

over 3 years ago
hi flyte team, we recently upgraded the console to the latest and now it doesn't show dynamic subtasks. Is there a switch/config setting for that?
a
h
+5
  • 7
  • 127
  • 171
Hello Team, I want to specify a GPU pool for my map task. I went through this <documentation> and i...
v

Vijay Saravana

over 3 years ago
Hello Team, I want to specify a GPU pool for my map task. I went through this documentation and it is not very clear. Could you please help with this ?
🖖 1
v
k
+2
  • 4
  • 14
  • 171
Is there a way to configure the storage location/prefix for code when using the new fast registratio...
s

Sören Brunk

over 3 years ago
Is there a way to configure the storage location/prefix for code when using the new fast registration without bucket credentials? It used to be stored under
bucket-name/fast/
before (not sure if I had configured it before, I can't find any config related to that). Now it's just stored in random paths under the bucket root.
s
k
  • 2
  • 9
  • 171
Hello! We have a webapi plugin and would like to control the rate of how often propeller calls the ...
v

Viktor Gerdin

over 3 years ago
Hello! We have a webapi plugin and would like to control the rate of how often propeller calls the
Status()
hook [interface explained]. We have noticed that this is very much depending on load. During low (normal) load
Status()
is called multiple times per second. The
Get()
hook is only executed once every 30s, so we consider any rate of
Status()
higher than 15s to be a waste. The webapi
PluginConfig
contains configurations for a
ReadRateLimiter
and
WriteRateLimiter
[github] which I am unable to find being used in either propeller nor plugin machinery. We are not experiencing any throttling from the external API, only that the
Status()
rate is very high. Anyone have any pointers where to go from here?
v
k
  • 2
  • 6
  • 171
Flyte team - do you think there will be a Flyte `v0.19.5` release (before the 1.0.0 release)? Either...
a

Alex Bain

over 3 years ago
Flyte team - do you think there will be a Flyte
v0.19.5
release (before the 1.0.0 release)? Either way, what do you think is a timeline for the next release version? Rough estimates ok.
a
k
  • 2
  • 2
  • 171
Hey all, my team is shifting some existing data processing code over to flyte and we are using map t...
c

Calvin Leather

over 3 years ago
Hey all, my team is shifting some existing data processing code over to flyte and we are using map tasks to replace some existing parallel code, had a question about
functools.partial
and its (possible) flyte equivalent
. More details in thread
c
k
+3
  • 5
  • 14
  • 171
Hey flyte friends, sorry for the spam but I'm running into yet another weird error. Might be some mi...
s

Sören Brunk

over 3 years ago
Hey flyte friends, sorry for the spam but I'm running into yet another weird error. Might be some misconfiguration on my side as it used to work but I wasn't able to figure out yet what change causes the issue. So what's happening is that suddenly mosts tasks fail almost immediately after they started running. The high-level error shown in flyteconsole is this:
Some node execution failed, auto-abort.
The task pods start, go into running state. I can see a few lines of task logs sometimes but then it looks like the pod is just deleted long before it's finished. It terminates and is cleaned up. Log says:
Stopping container m4dydd0r8y-n0-0
So i checked flytepropeller logs and there's one error log a few seconds before the pod is deleted. Not sure if it's related:
Failed to update workflow. Error [Operation cannot be fulfilled on <http://flyteworkflows.flyte.lyft.com|flyteworkflows.flyte.lyft.com> "m4dydd0r8y": the object has been modified; please apply your changes to the latest version and try again]
I'm a bit at a loss here how to debug this further. Any hints much appreciated. I can also provide the full propeller log if that could help tracing this down.
s
h
  • 2
  • 8
  • 171
When using `FlyteFile` , we end up returning something like this when we want to upload a file to sp...
g

Greg Gydush

over 3 years ago
When using
FlyteFile
, we end up returning something like this when we want to upload a file to specific GCS path. This is fine if you have one file you are returning, but can be verbose when working with a handful of output files.
FlyteFile(random_local_path, remote_path=os.path.join(gcs_outdir, os.path.basename(random_local_path))
Does anyone have recommendations to simplify this? I was thinking a small PR adding an additional parameter to FlyteFile could be nice, but thought I’d ask here in case anyone has other ideas to simplify!
FlyteFile(random_local_path, remote_dir=gcs_outdir)
g
y
  • 2
  • 18
  • 171
I don't where where to find the starting announcement :disappointed:
a

Ali Ahmed

over 3 years ago
I don't where where to find the starting announcement 😞
a
s
n
  • 3
  • 6
  • 171
<@U01KKNMC47J> not sure if you remember this PR <https://github.com/flyteorg/flytekit/pull/497/files...
y

Yee

over 3 years ago
@Sonja Ericsson not sure if you remember this PR https://github.com/flyteorg/flytekit/pull/497/files but was wondering if you could check something for me please?
y
d
s
  • 3
  • 14
  • 171
Previous686970Next

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Powered by