https://flyte.org logo
r

Rupsha Chaudhuri

06/09/2022, 5:38 PM
Hi team.. while running the workflow in the local sandbox, is there a way to view the k8s logs? The k8s dashboard asks for a token or a config
k

Ketan (kumare3)

06/09/2022, 5:42 PM
just say skip
🙂
the token can be empty
there is some work in progress to fetch the logs in a separate service
r

Rupsha Chaudhuri

06/09/2022, 5:44 PM
ah!
I still don't see anything logged using python's logging library
Looks like I may need to use _`flytekit.current_context().logging` ?_
Still no logs 😞
k

katrina

06/09/2022, 6:17 PM
do you see any logs in the console for the workflow execution?
r

Rupsha Chaudhuri

06/09/2022, 6:18 PM
which console? I went to node->executions->K8s logs
I see nothing other than the stack backtrace
k

katrina

06/09/2022, 6:21 PM
if you're running demo it should be available here: http://localhost:30080/console
when you use pyflyte run, it will output a link to the execution as well!
r

Rupsha Chaudhuri

06/09/2022, 6:22 PM
oh that console.. yes I'm looking at the console
when I click on view logs for failed task it opens the pane on the right. I click k8s logs but I don't see any of the actual logs
other than the stack trace from the failure
k

katrina

06/09/2022, 6:33 PM
@Rupsha Chaudhuri when you click k8s logs and it takes you to the kubernetes console can you change the namespace to
flytesnacks-development
(or whatever corresponds to the <project>-<domain> you ran your workflow under) and see if there are pods there that correspond to your execution id?
k

Ketan (kumare3)

06/09/2022, 6:34 PM
ohh Rupsha you are running Flyte demo on a remote machine right
r

Rupsha Chaudhuri

06/09/2022, 6:34 PM
I am in the correct namespace
k

Ketan (kumare3)

06/09/2022, 6:34 PM
then you will have to port forward or change the endpoint
r

Rupsha Chaudhuri

06/09/2022, 6:34 PM
@Ketan (kumare3) I'm running locally
This is what the url looks like
And the only thing I see is the stack trace
none of the info logs
@katrina I do see all the pods
looks like ONLY error logs show up.. not info
k

katrina

06/09/2022, 8:14 PM
r

Rupsha Chaudhuri

06/09/2022, 8:15 PM
where should I set this?
k

katrina

06/09/2022, 8:22 PM
I believe in the container definition cc @Eduardo Apolinario (eapolinario)
e

Eduardo Apolinario (eapolinario)

06/09/2022, 8:23 PM
correct. @Rupsha Chaudhuri, can you set that env var to
20
?
r

Rupsha Chaudhuri

06/09/2022, 8:24 PM
so in the dockerfile I set
ENV LOGGING_ENV_VAR 20
?
or is it
FLYTE_SDK_LOGGING_LEVEL
?
e

Eduardo Apolinario (eapolinario)

06/09/2022, 8:25 PM
FLYTE_SDK_LOGGING_LEVEL
r

Rupsha Chaudhuri

06/09/2022, 8:27 PM
thanks
👍 1
2 Views