#5993 [Core feature] Add optional minimal flag to FrameProfilingDeck for large datasets
Issue created by
EternalDeiwos
### Motivation: Why do you think this is important?
Attempting to create a summary for a moderately sized dataset using this plugin takes too long due to being single threaded and consuming a lot of memory (relative to the size of the dataset).
### Goal: What should the final outcome look like, ideally?
ydata have a flag to enable
minimal mode on their tool which removes some of the more expensive operations making it appropriate to use for large datasets.
We should be able to set this flag on the plugin and have it make its way into call
here
### Describe alternatives you've considered
Disabling the profile
### Propose: Link/Inline OR Additional context
•
Discussion thread
### Are you sure this issue hasn't been raised already?
• Yes
### Have you read the Code of Conduct?
• Yes
flyteorg/flyte