<#4241 [Core feature] Allow nested fields in struc...
# flytekit
a
#4241 [Core feature] Allow nested fields in structured datasets Issue created by dylanwilder Motivation: Why do you think this is important? Most storage formats have support for nested field structures today (Avro, parquet, bq) but currently StructuredDatasets only support flat schemas. This prevents the usage of common data modeling and organizational practices, or requires bypassing structured datasets to simple pass a URI which prevents type checking. Goal: What should the final outcome look like, ideally? one or both of the following should be possible
Copy code
@dataclass_json
@dataclass
class RecordField
    name: str
    age: int

Schema1 = Annotated[StructuredDataset, kwtypes(data=RecordField, ...)
Schema2 = Annotated[StructuredDataset, kwtypes(data={"name": str, "age": int}, ...)
Describe alternatives you've considered As above, can return a URI, but this is essentially bypassing the type system entirely. Propose: Link/Inline OR Additional context No response Are you sure this issue hasn't been raised already? ☑︎ Yes Have you read the Code of Conduct? ☑︎ Yes flyteorg/flyte