brash-london-45337
06/10/2022, 11:21 PMflytepropeller
deployment and itβs hard to tell if the system is picking up the changes:
$ kubectl logs -f deployment/flytepropeller -nflyte | grep -i logs
Found 6 pods, using pod/flytepropeller-785bcc6f6d-sr8bl
{"json":{"src":"viper.go:398"},"level":"debug","msg":"Config section [plugins.logs] updated. No update handler registered.","ts":"2022-06-08T16:32:15Z"}
{"json":{"src":"viper.go:396"},"level":"debug","msg":"Config section [plugins.logs] hasn't changed.","ts":"2022-06-10T22:36:33Z"}
From looking at the plugins β it seems like adding that config should just automatically workelegant-petabyte-32634
06/10/2022, 11:54 PMtask_logs.yaml: |
plugins:
logs:
cloudwatch-enabled: false
kubernetes-enabled: true
kubernetes-template-uri: <https://my.papertrailapp.com/systems/{{> .podName }}/events
brash-london-45337
06/11/2022, 12:47 AMbrash-london-45337
06/11/2022, 2:22 AM$ kubectl get configmaps -n flyte flyte-propeller-config -oyaml
apiVersion: v1
data:
...
task_logs.yaml: |
plugins:
logs:
cloudwatch-enabled: false
kubernetes-enabled: true
kubernetes-template-uri: "<https://splunk.corp.stripe.com/en-US/app/search/search?q=search%20source=>"/pay/log/pods/{{.namespace }}_{{.podName }}*"%20%7C%20reverse&display.events.type=raw&display.prefs.events.count=50&earliest=-7d&latest=now"
...
elegant-petabyte-32634
06/11/2022, 1:31 PMbrash-london-45337
06/14/2022, 4:11 PMmessageFormat: "json"
line was causing the pods to crash loop. Removing that and fixing the quotes seems to fix it. Thanks for the look over!