https://flyte.org logo
#ask-the-community
Title
# ask-the-community
a

Alex Lyashok

01/17/2024, 1:59 AM
what is the way to find out why certain map task fails? also is the only way to check what input it ran against is to switch between map_exec and input tabs in deck?
j

Jay Ganbat

01/17/2024, 3:34 AM
do you have a logging setup for your cluster? we have a stackdriver logging and each map task elemnets will generate separate log links for you so you can probe why individual task has failed
a

Alex Lyashok

01/17/2024, 4:01 AM
i do and i see logiles in cloudwatch but there is nothing in console
also when tasks error out - there is nothing in logiles
i see my own application logging in logs but when error happens
image.png
this text in the middle - it is nowhere in the logs
j

Jay Ganbat

01/17/2024, 4:46 AM
i see, i think map task might need different wiring
d

Dan Rammer (hamersaw)

01/17/2024, 3:22 PM
Might want to look into logging for maptasks, they require separate configuration. However, ArrayNode uses the same logging as regular Flyte tasks.
a

Alex Lyashok

01/17/2024, 4:02 PM
is there a sample config I can find somewhere?
this thread is old so dont open for me
d

Dan Rammer (hamersaw)

01/18/2024, 3:29 PM
Yeah, so the logs should be something like:
Copy code
plugins:
  k8s-array:
    logs:
      kubernetes-enabled: true
      kubernetes-url: "<http://localhost:30082>"      
  logs:
    kubernetes-enabled: true
    kubernetes-url: "<http://localhost:30082>"
where the log configuration for the
k8s-array
element should be identical to the regular
logs
configuration.
a

Alex Lyashok

01/18/2024, 5:56 PM
thx - should this sit on the same level as k8s config? i.e. configuration > inline> plugins?
and i dont have regular logs: i have it under logging:.....
4 Views