Frank Shen
01/17/2023, 7:51 PMpyflyte run --remote --service-account spark --image spark_image ...
But this will cause other flyte tasks to have permission issues.
How can we provide the --service-account spark param in the code for the spark task to avoid this?
Will the following work?
@task(
container_image=".../flyte-pyspark:latest",
task_config=Spark(
spark_conf={...
},
service_account: "spark",
),
)
Kevin Su
01/17/2023, 9:07 PMFrank Shen
01/17/2023, 9:38 PMKevin Su
01/17/2023, 9:43 PMSlackbot
01/17/2023, 9:44 PMFrank Shen
01/17/2023, 10:13 PMSamhita Alla
Yee
Frank Shen
01/19/2023, 6:09 PMYee
Frank Shen
01/19/2023, 6:17 PMYee