#1456 [Core Feature]Generic Schemas should detect the schema at runtime
Issue created by
kumare3
Motivation: Why do you think this is important?
It is possible to use Schema's in Flyte, without individual columns. this may be desirable for cases in which the schema is not completely known ahead of time. But, it might be useful to automatically detect the schema and populate it in the runtime transport Schema layer. the Transport allows us to carry the schema type
Goal: What should the final outcome look like, ideally?
In case a pandas.DataFrame is used, Flytekit should be able to supply the schema at runtime. This can be visualized in Flyteconsole
Describe alternatives you've considered
None
[Optional] Propose: Link/Inline OR Additional context
Parquet files carry the schema inherently. Also it is possible to extract the schema from a pandas dataframe
flyteorg/flyte