https://flyte.org
Join Slack
hey there :wave:! Trying to deploy my custom agent, I’m not sure what the following instruction mean...
# flyte-support
a
hey there 👋! Trying to deploy my custom agent, I’m not sure what the following instruction means: 
Update the FlyteAgent deployment's image
. From that manifest I understand the command is 
pyflyte serve <my-docker-image>
but none of the k8s Deployments I have running do run that cmd 🤔 https://docs.flyte.org/projects/cookbook/en/latest/auto_examples/extend_flyte/agent_service.html#update-flyteagent
are Agent svc and deployment supposed to spawn on-demand?
t
cc @glamorous-carpet-83516
g
it’s a new feature, so it disable by default. agent is running in the deployment, so you should build a new image when adding a custom agent. https://github.com/flyteorg/flyte/blob/dfb56f4639a57d519d8fc48cae7d192a385fc160/charts/flyte-core/values.yaml#L211
image is not part of args in pyflyte serve. you will build a new image, and the entrypoint of the image is pyflyte serve, which will start a gRPC server.
a
hi @glamorous-carpet-83516 thanks for that! How’s the above different from adding the following to configmap?
Copy code
agent-service:
      supportedTaskTypes:
        - default_task
        - bacalhau_task
      # By default, all the request will be sent to the default agent.
      defaultAgent:
        endpoint: "dns:///flyteagent.flyte.svc.cluster.local:8000"
        insecure: true
        timeouts:
          GetTask: 200ms
        defaultTimeout: 50ms
      agents:
        bacalhau_agent:
          endpoint: "dns:///myagent-flyteagent.flyte.svc.cluster.local:8000"
          insecure: true
          defaultServiceConfig: '{"loadBalancingConfig": [{"round_robin":{}}]}'
          timeouts:
            GetTask: 100ms
          defaultTimeout: 20ms
      agentForTaskTypes:
        # It will override the default agent for custom_task, which means propeller will send the request to this agent.
        - mytask_task: mytask_agent
reference: https://docs.flyte.org/projects/cookbook/en/stable/auto_examples/extend_flyte/agent_service.html#update-flyteagent
g
The above config is to enable agent chart, so 
helm install flytekit-core
will create agent deployment. the configmap stuff is to enable agent service, and add your custom agent config in the flytepropeller
Also, how to add my custom agent in https://github.com/flyteorg/flyte/blob/dfb56f4639a57d519d8fc48cae7d192a385fc160/charts/flyte-core/values.yaml#L211 ?
you need to create a dockerfile, and install your custom flytekit plugin containing your agent. Then, replace the default image 
flyteorg/flyteagent
with your new image. The gRPC server will automatically load your agent when it’s running
21 Views
Open in Slack
PreviousNext
Powered by

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Powered by