https://flyte.org logo
#ask-the-community
Title
# ask-the-community
a

Alex Lyashok

01/18/2024, 7:41 PM
task log ocnfiguration folks - i have been struggling to understand how to configure the logs for regular and map_tasks some of the documentaiton refers to needing to do configuration.logging some of it refers to task_logs? Whoch is the rigth way?
c

Chris Grass

01/18/2024, 7:44 PM
howdy - i think that config is for the primary flyte container. i use a flytectl config in
~/.flyte/config.yaml
to configure task pods. e.g.:
Copy code
admin:
  # For GRPC endpoints you might want to use dns:///flyte.myexample.com
  endpoint: dns:///localhost:8089
  insecure: true
console:
  endpoint: http:///localhost:8088
logger:
  show-source: true
  level: 20
a

Alex Lyashok

01/18/2024, 7:47 PM
i have that
i still get
image.png
no logs found
c

Chris Grass

01/18/2024, 7:48 PM
i'm not sure how that UI serves logs - do you see the logs in the pod itself?
i.e., running
kubectl logs {taskPodId} -n task-namespace
a

Alex Lyashok

01/18/2024, 7:49 PM
yes i do
c

Chris Grass

01/18/2024, 7:50 PM
ok - sorry, we'll need to wait for a maintainer to answer the question about getting those logs into that UI.
b

Bernhard Stadlbauer

01/18/2024, 7:55 PM
We do have them setup with something like the following:
Copy code
configmap:
      plugins:
        logs:
          templates:
            - displayName: Datadog
              templateUris:
                - "my_template"
        k8s-array:
          logs:
            config:
              kubernetes-enabled: false
              templates:
                - displayName: Datadog
                  templateUris:
                    - "my_template"
Not deployed with the single-binary
This should be the link to the relevant docs section
For map task you’d wanna use the
k8s-array
config, docs here
a

Alex Lyashok

01/18/2024, 7:58 PM
thx
sorry for being a noob - my yaml file i pass to --values to update flyte-backend flyteorg/flyte-binary it has configuration: as root do i create another file that has configmap:?
@Bernhard Stadlbauer does it need config: under logs: for k8-array? i got regular task log working but k8-array is still empty
b

Bernhard Stadlbauer

01/19/2024, 7:24 AM
It should need that yes
s

Samhita Alla

01/19/2024, 1:32 PM
@Alex Lyashok if you use array node, you don't need separate configuration for logging. here's how you can use array node: https://docs.flyte.org/en/latest/flytesnacks/examples/advanced_composition/map_task.html#arraynode
a

Alex Lyashok

01/19/2024, 3:01 PM
for posterity - this works
image.png
s

Samhita Alla

01/19/2024, 3:52 PM
would you mind creating an issue so that we can document this properly? please mention how you deployed flyte as well. [flyte-docs]
2 Views