Team, we configured own domain name and able to access the flyte console after running workflow. jobs are getting succeed but unable to view the pod logs from the console. link is pointing to http://localhost:30082 like below but our flyte url is https://dev-flyte.example.com. please let me know anything need to be updated. also we dont see any logs are pushed to cloudwatch after completion of job. http://localhost:30082/#!/log/cloudops-max-flyte-demo-development/f82ed701fa1f04c489[…]0-0-driver/pod?namespace=cloudops-max-flyte-demo-development

@Sathish kumar Venkatesan, you may have to refer to https://github.com/flyteorg/flyte/blob/cc127265aec490ad9537d29bd7baff828043c6f5/charts/flyte-core/values-eks.yaml#L304-L317 section to configure your logging links. @Yuvraj / @Prafulla Mahindrakar, how should we configure domain name for logging?

cloudwatch is set to true and configured buckets. still don't see spark logs are pushing to cloudwatch. can you suggest the location where i can go and debug the logging issue.

@Samhita Alla have you seen this https://docs.flyte.org/projects/cookbook/en/stable/auto/deployment/configure_logging_links.html

Oh yes. I forgot to share it but yea, it has the code template I shared earlier.

Is the log group name and region configured for cloud watch logs eg : https://github.com/flyteorg/flyte/blob/master/deployment/eks/flyte_aws_scheduler_helm_generated.yaml#L514-L517 You can also check this for using cloudwatchtemplateUri’s https://github.com/flyteorg/flyteplugins/blob/master/go/tasks/plugins/k8s/spark/spark_test.go#L78 And for configuring domain check this values file https://github.com/flyteorg/flyte/blob/0b3273fa931f379ee3ab3fca9c0ab19ee4590036/charts/flyte/values.yaml#L577

I am from @Sathish kumar Venkatesan team. I am gettiing below error when trying to add those templated.

time="2022-09-02T19:21:45Z" level=error msg="\n\n\n1 error(s) decoding:\n\n* cannot parse 'templates[0].messageFormat' as int: strconv.ParseInt: parsing \"json\": invalid syntax"

Here is my task_logs in config.

task_logs:
    plugins:
      logs:
        kubernetes-enabled: false
        cloudwatch-enabled: true
        cloudwatch-region: "{{ .Values.userSettings.accountRegion }}"
        cloudwatch-log-group: "{{ .Values.userSettings.logGroup }}"
        templates:
          - displayName: logs_test
            templateUris:
              - "<https://console.aws.amazon.com/cloudwatch/home?region=us-east-1#logEventViewer:group=/flyte-production/kubernetes;stream=var.log.containers.{{.podName}}_{{.namespace}}_{{.containerName}}-{{.containerId}}.log>"
            messageFormat: "json" # "unknown" | "csv" | "json"

@Smriti Satyan, can you create an issue to document this?

@karthikraj can you use upper case JSON https://github.com/flyteorg/flyteidl/blob/master/gen/pb-go/flyteidl/core/execution.pb.go#L216 https://github.com/flyteorg/flyteplugins/blob/e863c76a7cbecc0f22091992845cb22b8ac1caf6/go/tasks/logs/config.go#L40