Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

image.png

when running a `pytorch` job, the cloudwatch log link is broken because it is missing some variables as you can see in the screenshot

currently I'm defining the template like this:
````<https://console.aws.amazon.com/cloudwatch/home?region=${props.cluster.env.region}#logEventViewer:group=/aws/containerinsights/${props.cluster.clusterName}/application;stream={{> .nodeName }}-application.var.log.containers.{{ .podName }}_{{ .namespace }}_{{ .containerName }}-{{ .containerId }}.log````
this works fine for other regular python tasks

is there a way i can get the logs to work properly for pytorch?

I see the logs definitely exist for the pytorch jobs too with the same format as defined above - it just seems like the variables of `nodeName`, `containerName`, and `containerId` are missing for this job type

how is the template defined in the k8s propeller config?

If you are willing to contribute, you could refer to <https://github.com/flyteorg/flyte/commit/6922a962e171a02cb5e7c0147cc847406709eaa9|this> PR I made a while ago to add support for some other templating vars in the kubeflow plugin.

If you are up to contributing but don’t know how to get started, I’m happy to jump on a call :slightly_smiling_face:

<https://github.com/flyteorg/flyte/blob/cb56df3ad96d019710d8c188729106f2f82ca814/flyteplugins/go/tasks/plugins/k8s/kfoperators/common/common_operator.go#L119|These> are the vars I would expect are available:


```if taskType == PytorchTaskType &amp;&amp; hasMaster {
		masterTaskLog, masterErr := logPlugin.GetTaskLogs(
			tasklog.Input{
				PodName:              name + "-master-0",
				Namespace:            namespace,
				LogName:              "master",
				PodRFC3339StartTime:  RFC3999StartTime,
				PodRFC3339FinishTime: RFC3999FinishTime,
				PodUnixStartTime:     startTime,
				PodUnixFinishTime:    finishTime,
				TaskExecutionID:      taskExecID,
				TaskTemplate:         taskTemplate,
			},
		)```

It is true that those are fewer than e.g. <https://github.com/flyteorg/flyte/blob/cb56df3ad96d019710d8c188729106f2f82ca814/flyteplugins/go/tasks/logs/logging_utils.go#L51|here>.

awesome, I can give it a try and reach out to setup a quick call if I get blocked. for reference, what time zone are you on?

Sounds good, ping me in case you are blocked