Nada Saiyed
08/15/2022, 7:47 PMStructuredDataset
, but can that be somehow represented as FlyteSchema
?List
or Dict
type be specified as part of the schema?schema = StructType([
StructField('name', StructType([
StructField('firstname', StringType(), True),
StructField('middlename', StringType(), True),
StructField('lastname', StringType(), True)
])),
StructField('state', StringType(), True),
StructField('gender', StringType(), True)
])
Niels Bantilan
08/15/2022, 7:53 PMNada Saiyed
08/15/2022, 7:54 PMlist
or a set
Niels Bantilan
08/15/2022, 7:57 PMNada Saiyed
08/15/2022, 8:00 PMStructType
sSamhita Alla
StructType
(ref: https://arrow.apache.org/docs/python/generated/pyarrow.StructType.html)