https://flyte.org logo
r

Robert Everson

05/10/2022, 11:35 PM
I see above that
flyte-cli parse-proto
would work to print out the raw values of a proto, is there a way to get the proto from the flyte metastore directly? I’m trying to add an architecture feature to flytekit, and flyteidl and flyteadmin have both been updated, but the value isn’t making it from my register step all the way to the pod runtime, so I’m trying to debug where the breakdown is happening. I’ve copied the closure field from the tasks table, but the proto parsing isn’t outputting any information for me.
flyte-cli parse-proto -f closure.pb -p flyteidl.core.tasks_pb2.TaskTemplate
is what I’m trying, and I just get
{}
as the output
y

Yee

05/10/2022, 11:48 PM
you’re sure the closure was downloaded correctly?
just cat it…
there should at least be some ascii characters in there, might mess up your terminal though
and which table is this from?
r

Robert Everson

05/10/2022, 11:49 PM
I get a
\x200….
value, I manually copy pasted from the closure field, so that may not be the right way
y

Yee

05/10/2022, 11:49 PM
what’s the size of the file?
probably not, this is postgres right?
r

Robert Everson

05/10/2022, 11:50 PM
yep
y

Yee

05/10/2022, 11:50 PM
i think you can query a binary column to a file..
will probably need to set up a tunnel though since you need the file locally.
what table is this?
oh tasks table
you’re referring to the
closure
field? this one?
if you are, then after you pull the data, you should use
Copy code
flyteidl.admin.task_pb2.TaskClosure
instead (in your command)
r

Robert Everson

05/10/2022, 11:52 PM
y

Yee

05/10/2022, 11:53 PM
wouldn’t the UI show that?
r

Robert Everson

05/10/2022, 11:53 PM
size is super small.
Copy code
4.0K    task_closure.pb
y

Yee

05/10/2022, 11:53 PM
and if not the ui, just hitting the admin api.
r

Robert Everson

05/10/2022, 11:53 PM
I was hoping it would, but I’m not seeing it, though the version of flyteconsole we have deployed is using flyteidl
0.18.9
ah, perfect!
y

Yee

05/10/2022, 11:54 PM
try the admin api
r

Robert Everson

05/10/2022, 11:56 PM
awesome, I see it there, thanks so much!
3 Views