salmon-refrigerator-32115
01/17/2023, 7:51 PMpyflyte run --remote --service-account spark --image spark_image ...
But this will cause other flyte tasks to have permission issues.
How can we provide the --service-account spark param in the code for the spark task to avoid this?
Will the following work?
@task(
container_image=".../flyte-pyspark:latest",
task_config=Spark(
spark_conf={...
},
service_account: "spark",
),
)
glamorous-carpet-83516
01/17/2023, 9:07 PMsalmon-refrigerator-32115
01/17/2023, 9:38 PMglamorous-carpet-83516
01/17/2023, 9:43 PMglamorous-carpet-83516
01/17/2023, 9:44 PMuser
01/17/2023, 9:44 PMsalmon-refrigerator-32115
01/17/2023, 10:13 PMsalmon-refrigerator-32115
01/18/2023, 7:48 PMtall-lock-23197
thankful-minister-83577
thankful-minister-83577
salmon-refrigerator-32115
01/19/2023, 6:09 PMthankful-minister-83577
thankful-minister-83577
salmon-refrigerator-32115
01/19/2023, 6:17 PMthankful-minister-83577