New RunLLM response generated: >>>*# Question* Is...
# runllm-flyte-trial
a
New RunLLM response generated: >>>*# Question* Is there a way to dynamically override arbitrary parts of a PythonFunctionTask pod template at the call site, similar to overriding resources with
with_overrides
? It looks like
with_overrides
is implemented on
Promise
and
Node
, but there aren't any overrides for
pod_template
. Is there something precluding this or is it just not implemented yet? # Answer Currently, Flyte does not support dynamically overriding arbitrary parts of a
PythonFunctionTask
pod template at the call site using
with_overrides
. The
with_overrides
method primarily supports overriding resources like CPU and memory. According to this discussion, overriding the
pod_template
using
with_overrides
is not supported at the moment. Would you like more details on potential workarounds or further explanation on this limitation? Sources: - Flyte Community Discussion - Flyte GitHub Issue #1323 Slack Link https://flyte-org.slack.com/archives/CP2HDHKE1/p1719496327.340279 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.