#5050 [Core feature] ability to sample df's on serialisation
Issue created by
andrewm4894
### Motivation: Why do you think this is important?
when we pass df to and from flyte tasks - is there any native way to ask Flyte to do sampling as its reading and writing the data?
eg i sometimes want to just randomly sample or write N rows to/from a task and wondering if Flyte could in some way do this natively?
use case here is say task A makes a big df
task B1 and B2 need that as input - B1 needs it all but B2 actually only needs a random sample of N from df
### Goal: What should the final outcome look like, ideally?
maybe I could pass the sampling param to the task decorator.
### Describe alternatives you've considered
Maybe it's a horrible idea idk. Just that I find myself having some tasks where first thing I do is quickly downsample the data right away.
### Propose: Link/Inline OR Additional context
No response
### Are you sure this issue hasn't been raised already?
• Yes
### Have you read the Code of Conduct?
• Yes
flyteorg/flyte