HIMANSHU JOSHI
03/28/2023, 5:03 PMDan Rammer (hamersaw)
03/28/2023, 5:41 PMtask_config
argument indirectly defines what task_type
the task is. Passing Pod
as well as Spark
would be conflicting here. Can you elaborate on your use-case here? The Spark k8s operator supports Pod
level configuration through a number of k8s configuration values in the spark config - you can very likely configure whatever you're looking for using these.HIMANSHU JOSHI
03/28/2023, 7:03 PMDan Rammer (hamersaw)
03/28/2023, 8:40 PM