https://flyte.org logo
#ask-the-community
Title
# ask-the-community
r

Rupsha Chaudhuri

01/23/2023, 11:09 PM
Hello all.. so I have a flyte setup where logs go to splunk and it works properly. However for map tasks it looks like the logging is not setup correctly and shows a non working k8s link in the flyte UI. Is there some additional config required?
d

Dan Rammer (hamersaw)

01/24/2023, 12:18 AM
Hey @Rupsha Chaudhuri, it looks like maptask has a separate config for logs. This can be set under the
k8s-array
specific plugin configuration. I believe the nested keys are
log
and
config
. So something like this:
Copy code
plugins:
  # All k8s plugins default configuration
  k8s:
    # k8s plugin configuration
  k8s-array:
    logs:
      config:
        kubernetes-enabled: true
        kubernetes-url: "<http://localhost:30082>"
  # Logging configuration
  logs:
    kubernetes-enabled: true
    kubernetes-url: "<http://localhost:30082>"
sorry - let me edit about before reading it ... that
Enter
vs
Shift + Enter
in slack kills me 😂
r

Rupsha Chaudhuri

01/24/2023, 12:23 AM
thanks.. so basically k8s-array
d

Dan Rammer (hamersaw)

01/24/2023, 12:25 AM
yeah, regular tasks use the logs at the plugin config level, k8s-array defines it's own separate, similar to spark. I'm wondering if it would make sense to have a flag allowing these to use the global config rather than their own default - it may be more useful.
r

Rupsha Chaudhuri

01/24/2023, 12:25 AM
+1 for common config
In our file I see
Copy code
task_logs:
    plugins:
        logs:
             templates:...
I basically add the following under task_logs, right?
Copy code
k8s-array:
        logs:
             templates:...
d

Dan Rammer (hamersaw)

01/24/2023, 12:37 AM
It would be under
plugins
and it looks like it requires another layer
config
so:
Copy code
task_logs:
    plugins:
        logs: # existing configuration
            templates:
        k8s-array: # adding configuration
            logs:
                config:
                    templates:
I can test this locally to be sure, but I don't have time right now. Probably in an hour or so.
... I really don't like this 😅, do you mind filing an issue for common configuration? I'll mark it as a "good first issue" and hopefully we can have a community member contribute!
[flyte-core]
r

Rupsha Chaudhuri

01/24/2023, 1:17 AM
Sure.. I'll add it!
91 Views