#2418 Add support for Spark tasks in Scala Issue created by MariaSL Motivation: Why do you think this is important? It's quite common to run Spark jobs in Scala. Adding support for Spark tasks in Scala will allow users to write and execute Flyte workflows in Scala with an ability to run Spark jobs. Goal: What should the final outcome look like, ideally? The outcome is similar to what can currently be done with pyspark: • The user is able to create a workflow with a spark task written in Scala; • The user is able to run the workflow with spark task in scala locally; • The user is able to run the workflow with spark task in scala remotely - once the spark task runs, a Spark cluster is spinned up. • The user is able to configure spark properties (SparkContext); Additionally • Flyte documentation (or flyte scala examples) is extended with an example of running Spark task in Scala and deploying a workflow. Describe alternatives you've considered None Propose: Link/Inline OR Additional context No response Are you sure this issue hasn't been raised already? ☑︎ Yes Have you read the Code of Conduct? ☑︎ Yes flyteorg/flyte