<#1556 [Plugin]BlazingSQL and Rapids dataframe sup...
# flytekit
c
#1556 [Plugin]BlazingSQL and Rapids dataframe support Issue created by kumare3 Why would this plugin be helpful to the Flyte community It would be great to have a simple plugin that would allow users to simply write BlazingSQL queries in their workflows to manipulate data-frames on a GPU as part of their Flyte workflows. An example of writing a query from the User point of view could be task = BlazingSQL( input_schema=FlyteSchema, outputs=..., query=""" SELECT count(*) FROM taxi GROUP BY year(key)""", use_gpus=False, # True by default ) Type of Plugin • Python/Java interface only plugin • Web Service (e.g. AWS Sagemaker, GCP DataFlow, Qubole etc...) • Kubernetes Operator (e.g. TfOperator, SparkOperator, FlinkK8sOperator, etc...) • Customized Plugin using native kubernetes constructs • Other flyteorg/flyte