is there a flyte literal parser utility to produce...
# flytekitd
Dylan Wilder
05/05/2022, 8:33 PMis there a flyte literal parser utility to produce the json that gets surfaced in the flyte UI?
y
Yee
05/05/2022, 9:33 PM
there’s an informal one that I use. but it’s more of an internal utilty for us.
Yee
05/05/2022, 9:33 PM
wait, what do you mean by literal parser?
Yee
05/05/2022, 9:33 PM
sorry - i was referring to parsing protobufs
d
Dylan Wilder
05/05/2022, 9:43 PMyea i just want something that produces a user friendly json, minus the literal wrappers
Dylan Wilder
05/05/2022, 9:43 PMif you can just point us to code that's cool too
Dylan Wilder
05/05/2022, 9:43 PMand we can reproduce
Dylan Wilder
05/05/2022, 9:43 PMas long as it's not go 😄
y
Yee
05/05/2022, 9:45 PM
for which object?
Yee
05/05/2022, 9:45 PM
a task?
Yee
05/05/2022, 9:45 PM
or like a flyte literal integer 3
d
Dylan Wilder
05/05/2022, 9:57 PMthe latter
Dylan Wilder
05/05/2022, 9:58 PMLiteralMap -> json, or dict etc
y
Yee
05/05/2022, 10:00 PM
i mean… the command I use is this
Yee
05/05/2022, 10:00 PM
Copy code
flyte-cli parse-proto -f map_input.pb -p flyteidl.core.literals_pb2.LiteralMapYee
05/05/2022, 10:00 PM
and you can take a peek at the code, it’s not much
Yee
05/05/2022, 10:00 PM
this is all it does
Yee
05/05/2022, 10:01 PM
it’s dumb because you have to know what type of protobuf you have.
d
Dylan Wilder
05/05/2022, 10:19 PMAh but this containers the literal types like primitive stringvalue etc
y
Yee
05/05/2022, 10:20 PM
oh you want a normal representation?
Yee
05/05/2022, 10:20 PM
there’s nothing for that, short of converting them into pure python native values, but that’s complicated.
d
Dylan Wilder
05/05/2022, 10:20 PMYea literally what appears in flyte console
y
Yee
05/05/2022, 10:21 PM
unf that’s probably done in js/ts only
Yee
05/05/2022, 10:21 PM
can ask nastya if you’d like?
d
Dylan Wilder
05/05/2022, 10:22 PMThat's fine. Just need the example
y
Yee
05/05/2022, 10:23 PM
the code that does this?
d
Dylan Wilder
05/05/2022, 10:23 PMYes
y
Yee
05/05/2022, 10:24 PM
@Nastya Rusina or @Carina Ursu - can you point us to the JS/TS code that prettifies the flyte literal values? so that you don’t get “Literal(Scalar(Primitive(….”
n
Nastya Rusina
05/05/2022, 10:26 PMCarina could be a better person to check with as she is literally makes it better right now :)
c
Carina Ursu
05/05/2022, 10:41 PM@Dylan Wilder our existing code is processing the json directly into ui, you can look here as an entry point https://github.com/flyteorg/flyteconsole/blob/master/src/components/Literals/LiteralMapViewer.tsx
The current change in progress would simplify the structure and then display it in the UI as raw json https://github.com/flyteorg/flyteconsole/pull/445 (entrypoint through src/components/Literals/helpers.ts : transformLiteralMap)
k
Ketan (kumare3)
05/05/2022, 11:12 PM
@Dylan Wilder there is some stuff in golang
Ketan (kumare3)
05/05/2022, 11:12 PM
Ketan (kumare3)
05/05/2022, 11:12 PM
this is what powers Flytectl
d
Dylan Wilder
05/06/2022, 12:50 PMthanks ketan, this is what i was looking for! i had written this a while back but lost the code 🙂
👍 2
198 Views