#1417 Creating new spark_sql_task
Issue created by
yunhao-qing
Why would this plugin be helpful to the Flyte community
sparksqltask will allow users to submit a query that will run a Spark. It will not necessarily run on native Spark kubernetes operator. It will be similar structure to current
hivetask or
prestotask.
Type of Plugin
• Python/Java interface only plugin
• Web Service (e.g. AWS Sagemaker, GCP DataFlow, Qubole etc...)
• Kubernetes Operator (e.g. TfOperator, SparkOperator, FlinkK8sOperator, etc...)
• Customized Plugin using native kubernetes constructs
• Other
Can you help us with the implementation?
• Yes
• No
flyteorg/flyte