https://flyte.org logo
Powered by
v

varsha Parthasarathy

08/08/2022, 11:50 PM
Hi team, for every flyte execution in the UI, can I attach custom links such as Wavefront/cloudwatch events etc? Is there like a template I can create/attach for this?
Currently we have this config in 
avflytepropeller
for our UI logs - 
stackdriver-enabled
is set to true. Is there a 
wavefront-enabled
etc?
Copy code
logs:
        kubernetes-enabled: false
        stackdriver-enabled: true
        stackdriver-template-uri: "<https://console.cloud.google.com/logs/query;query=resource.labels.pod_name%3D{{> .podName }}?"
Its equivalent in UI for a non-spark task
d

Dan Rammer (hamersaw)

08/09/2022, 1:01 AM
Hey @varsha Parthasarathy great question. This is absolutely supported. There are defaulted stackdriver configuration options (ie. enabled option, template uri ). If the stackdrvier template uri is not set it looks like it defaults to 
<https://console.cloud.google.com/logs/viewer?project=%s&angularJsUrl=%%2Flogs%%2Fviewer%%3Fproject%%3D%s&resource=%s&advancedFilter=resource.labels.pod_name%%3D{{> .podName }}
. To support anything else (ex. wavefront) you can define a custom log template documented here.
k

Ketan (kumare3)

08/09/2022, 1:25 AM
Let me know if it works
Would love a contrib on this
v

varsha Parthasarathy

08/09/2022, 5:00 AM
This is awesome, I will try this and get back to you @Dan Rammer (hamersaw) and @Ketan (kumare3) 🎉
k

Ketan (kumare3)

08/09/2022, 5:08 AM
awesome
v

varsha Parthasarathy

08/09/2022, 11:15 PM
Sorry, one more question - From within a flyte workflow code - during execution - is it possible to get details like which “git sha”/git branch etc is this wf running ?
Are those stored within flyte vars somewhere ?
k

Ketan (kumare3)

08/09/2022, 11:34 PM
no, there is no git, but what we did at Lyft was added the git SHA to the image as an env var
v

varsha Parthasarathy

08/10/2022, 3:51 AM
interesting, let me try this
7 Views
Powered by