varsha Parthasarathy

    varsha Parthasarathy

    1 month ago
    Hi team, for every flyte execution in the UI, can I attach custom links such as Wavefront/cloudwatch events etc? Is there like a template I can create/attach for this?
    Currently we have this config in
    avflytepropeller
    for our UI logs -
    stackdriver-enabled
    is set to true. Is there a
    wavefront-enabled
    etc?
    logs:
            kubernetes-enabled: false
            stackdriver-enabled: true
            stackdriver-template-uri: "<https://console.cloud.google.com/logs/query;query=resource.labels.pod_name%3D{{> .podName }}?"
    Its equivalent in UI for a non-spark task
    Dan Rammer (hamersaw)

    Dan Rammer (hamersaw)

    1 month ago
    Hey @varsha Parthasarathy great question. This is absolutely supported. There are defaulted stackdriver configuration options (ie. enabled option, template uri ). If the stackdrvier template uri is not set it looks like it defaults to
    <https://console.cloud.google.com/logs/viewer?project=%s&angularJsUrl=%%2Flogs%%2Fviewer%%3Fproject%%3D%s&resource=%s&advancedFilter=resource.labels.pod_name%%3D{{> .podName }}
    . To support anything else (ex. wavefront) you can define a custom log template documented here.
    Ketan (kumare3)

    Ketan (kumare3)

    1 month ago
    Let me know if it works
    Would love a contrib on this
    varsha Parthasarathy

    varsha Parthasarathy

    1 month ago
    This is awesome, I will try this and get back to you @Dan Rammer (hamersaw) and @Ketan (kumare3) 🎉
    Ketan (kumare3)

    Ketan (kumare3)

    1 month ago
    awesome
    varsha Parthasarathy

    varsha Parthasarathy

    1 month ago
    Sorry, one more question - From within a flyte workflow code - during execution - is it possible to get details like which “git sha”/git branch etc is this wf running ?
    Are those stored within flyte vars somewhere ?
    Ketan (kumare3)

    Ketan (kumare3)

    1 month ago
    no, there is no git, but what we did at Lyft was added the git SHA to the image as an env var
    varsha Parthasarathy

    varsha Parthasarathy

    1 month ago
    interesting, let me try this