<#2807 Plugin: petastorm datatype for structured d...
# flytekit
c
#2807 Plugin: petastorm datatype for structured dataset Issue created by kumare3 ### Motivation: Why do you think this is important? Working with large parquet files can be cumbersome and hard, especially in tight training loops. Petastorm can simplify this. This can be a simple type plugin for structureddataset in Flyte https://github.com/uber/petastorm ### Goal: What should the final outcome look like, ideally? Work with large datasets ### Describe alternatives you've considered Self converting it ### Propose: Link/Inline OR Additional context No response ### Are you sure this issue hasn't been raised already? • Yes ### Have you read the Code of Conduct? • Yes flyteorg/flyte