Hi. We tried the agent feature in the latest release and got a couple of questions. This might be a long thread so please let me know what could be the best way to communicate, and I will happy to share more.
⢠There is no way to set log URL for an agent so on flyteconsole it is not possible to see log link. I think this is mainly because
core.TaskInfo
is not exposed to agent and
Status
call is transparent to agent.
⢠It is not supported for an agent to already send back a result (resource) as part of
CreateTask
call. While this makes sense for many async tasks, it does not play well with synchronous tasks that can already return a result fairly quickly. The workaround we have now is sending back the result in
CreateTaskResponse.ResourceMeta
and then in
GetTask
call we just send the
ResourceMeta
back directly as
Resource
. Basically some byte array back and forth.
⢠When
CreateTask
gRPC calls fails, the workflow (a single-tasked one in our test) does not fail and the task appears as queued forever (maybe there is a timeout eventually). And there is generally no way to signal a failure type (e.g. using gRPC error code) in any of the calls (Create/Get/Delete), if I understood it correctly.
cc
@glamorous-carpet-83516 whom I know has been working on this feature a lot.