#1509 [Core Feature][flytekit] Ability to track resource utilization and gpu utilization of a python task as a plugin
Issue created by
kumare3
Motivation: Why do you think this is important?
When users are running tasks that use GPU's, CPUs and Memory, it might be useful to allow some meta-outputs that render this information
Goal: What should the final outcome look like, ideally?
There are many libraries like
https://github.com/gpuopenanalytics/pynvml etc that can be used to collect stats for various resources and we could either stream or outputs these stats as a rendered PNG at the end of the run. The rendering can be done either in python or on the server and the outputs should be meta outputs.
Describe alternatives you've considered
Use other external libraries like Wandb etc
[Optional] Propose: Link/Inline OR Additional context
Write a new plugin
flytekit-resource-monitoring
that can load components that can output certain meta outputs.
For this, we will need support for meta-outputs.
flyteorg/flyte