https://flyte.org logo
Title
d

Dylan Wilder

08/29/2022, 6:10 PM
how is the description field in the protobuf populated for StructuredDatasets?
y

Yee

08/29/2022, 6:15 PM
where?
can you link me the field you’re referring to?
or screenshot
d

Dylan Wilder

08/29/2022, 6:36 PM
sorry i suppose it's not just structured dataset
y

Yee

08/29/2022, 6:56 PM
cc @Kevin Su
this is something we’ve been trying to schedule for a while.
d

Dylan Wilder

08/29/2022, 6:57 PM
What is it?
y

Yee

08/29/2022, 6:57 PM
it’s a wip. we’ve finally slated as part of the upcoming releases, but can’t commit to a specific date yet.
piping through user comments
parse out comments from tasks/workflows/parameters, and getting it all populated and show on console
d

Dylan Wilder

08/29/2022, 6:58 PM
Is it about embedded metadata in types eg the logical type?
y

Yee

08/29/2022, 6:58 PM
no, just user comments for now.
@Eduardo Apolinario (eapolinario) remind again how logical types related to user docs?
d

Dylan Wilder

08/29/2022, 8:53 PM
is it something we can possibly set? we need a way to inject metadata into types
so that we can understand them in post processing
we have a pretty well worn convention at spotify of using description fields to sneak in additional metadata about type semantics etc
y

Yee

08/29/2022, 9:56 PM
@ketn
@Ketan (kumare3) is this what we wanted to use logical types for?
k

Ketan (kumare3)

08/29/2022, 11:26 PM
yes
d

Dylan Wilder

08/30/2022, 4:22 PM
wait, so is it usable, or will be?