#1556 [Plugin]BlazingSQL and Rapids dataframe support
Issue created by
kumare3
Why would this plugin be helpful to the Flyte community
It would be great to have a simple plugin that would allow users to simply write BlazingSQL queries in their workflows to manipulate data-frames on a GPU as part of their Flyte workflows.
An example of writing a query from the User point of view could be
task = BlazingSQL(
input_schema=FlyteSchema,
outputs=...,
query=""" SELECT count(*) FROM taxi GROUP BY year(key)""",
use_gpus=False, # True by default
)
Type of Plugin
• Python/Java interface only plugin
• Web Service (e.g. AWS Sagemaker, GCP DataFlow, Qubole etc...)
• Kubernetes Operator (e.g. TfOperator, SparkOperator, FlinkK8sOperator, etc...)
• Customized Plugin using native kubernetes constructs
• Other
flyteorg/flyte